00000001:02000400:3.0F:1783134814.514933:0:2964:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg141-server.virtnet: executing set_hostid 00000001:02000400:3.0:1783134824.832128:0:3163:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg141-server.virtnet: executing load_modules_local 00000001:01000000:2.0F:1783134825.919356:0:3224:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm adler32 speed = 1311 MB/s 00000001:01000000:0.0F:1783134826.169489:0:3224:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm crc32 speed = 1539 MB/s 00000001:01000000:0.0:1783134826.419354:0:3224:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm crc32c speed = 10343 MB/s 00000020:02000000:2.0:1783134826.774654:0:3255:0:(class_obd.c:804:obdclass_init()) Lustre: Build Version: 2.17.54_83_gdf67fd6 00000400:02000000:0.0:1783134827.207677:0:3270:0:(api-ni.c:2752:lnet_startup_lndni()) Added LNI 192.168.201.141@tcp [8/256/0/180] 00008000:02000000:3.0:1783134829.599930:0:3420:0:(echo_client.c:2573:obdecho_init()) Echo OBD driver; http://www.lustre.org/ 00000001:02000400:3.0:1783134857.464413:0:5217:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg141-server.virtnet: executing load_modules_local 00000020:01000004:1.0F:1783134862.570018:0:5750:0:(obd_mount.c:914:lmd_print()) mount data: 00000020:01000004:1.0:1783134862.570027:0:5750:0:(obd_mount.c:917:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:1.0:1783134862.570223:0:5750:0:(super25.c:130:lustre_fill_super()) VFS Op: sb 000000003c103942 00000080:02000400:1.0:1783134862.570233:0:5750:0:(super25.c:154:lustre_fill_super()) lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' 00000020:01000004:1.0:1783134862.574211:0:5750:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200065, mountfl=0 00000020:01000004:1.0:1783134862.574223:0:5750:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:1.0:1783134862.574257:0:5750:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (00000000eac6f5fd) 00000020:00000080:1.0:1783134862.574276:0:5750:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1783134862.592391:0:5750:0:(scrub.c:229:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:2.0:1783134862.592943:0:5750:0:(scrub.c:229:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:2.0:1783134862.611069:0:5750:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:2.0:1783134862.611149:0:5750:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:2.0:1783134862.611161:0:5750:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:2.0:1783134862.611199:0:5750:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:2.0:1783134862.611216:0:5750:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:2.0:1783134862.611503:0:5750:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:2.0:1783134862.611509:0:5750:0:(osd_handler.c:1569:osd_obd_connect()) connect #0 00000020:00000080:2.0:1783134862.611523:0:5750:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xd6c4b8f05867e28d 00000020:01000004:2.0:1783134862.611529:0:5750:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:2.0:1783134862.611533:0:5750:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:2.0:1783134862.611536:0:5750:0:(tgt_mount.c:101:server_register_mount()) register mount 000000003c103942 from MGS 00000020:01000004:2.0:1783134862.611540:0:5750:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:2.0:1783134862.611552:0:5750:0:(genops.c:413:class_newdev()) Allocate new device MGS (0000000074ea662a) 00000020:00000080:2.0:1783134862.611560:0:5750:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:2.0:1783134862.611824:0:5750:0:(tgt_mount.c:153:server_get_mount()) get mount 000000003c103942 from MGS, refs=2 00080000:01000000:2.0:1783134862.611830:0:5750:0:(osd_handler.c:1569:osd_obd_connect()) connect #1 00000020:00000080:2.0:1783134862.611836:0:5750:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xd6c4b8f05867e29b 00000100:00100000:2.0:1783134862.611919:0:5750:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:2.0:1783134862.612033:0:5750:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:2.0:1783134862.612040:0:5750:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:2.0:1783134862.612578:0:5750:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:2.0:1783134862.612593:0:5750:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:2.0:1783134862.613462:0:5750:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1783134862.613596:0:5750:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:2.0:1783134862.613660:0:5750:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:2.0:1783134862.614250:0:5750:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:2.0:1783134862.614264:0:5750:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:2.0:1783134862.614822:0:5750:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:2.0:1783134862.614829:0:5750:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:1.0:1783134862.615458:0:5757:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783134862.615462:0:5757:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783134862.615463:0:5757:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783134862.615819:0:5758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783134862.615822:0:5758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783134862.615823:0:5758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783134862.616396:0:5750:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:3.0:1783134862.619674:0:5757:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:01000000:2.0:1783134862.865326:0:5750:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip512 speed = 4763 MB/s 00000001:01000000:2.0:1783134863.115325:0:5750:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip4K speed = 4839 MB/s 00000001:01000000:2.0:1783134863.365649:0:5750:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc512 speed = 1207 MB/s 00000001:01000000:3.0:1783134863.615497:0:5750:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc4K speed = 1355 MB/s 00010000:00010000:1.0:1783134863.619703:0:5758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00080000:10000000:3.0:1783134863.620138:0:5750:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000040:01000000:3.0:1783134863.628389:0:5750:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:3.0:1783134863.628405:0:5750:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:3.0:1783134863.628407:0:5750:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:0.0:1783134863.628871:0:5761:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:3.0:1783134863.628905:0:5750:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:3.0:1783134863.628938:0:5750:0:(mgs_llog.c:683:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000040:00080000:3.0:1783134863.629069:0:5750:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:3.0:1783134863.629096:0:5750:0:(mgs_llog.c:683:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:3.0:1783134863.629487:0:5750:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1783134863.629667:0:5750:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:3.0:1783134863.629672:0:5750:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:3.0:1783134863.630139:0:5750:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:3.0:1783134863.630146:0:5750:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:3.0:1783134863.630530:0:5750:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:3.0:1783134863.630537:0:5750:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000100:00080000:2.0:1783134863.631131:0:5766:0:(pinger.c:468:ping_evictor_main()) Starting Ping Evictor 00000020:00000080:1.0:1783134863.631170:0:5750:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:1.0:1783134863.631189:0:5750:0:(obd_mount.c:402:lustre_start_mgc()) Start MGC 'MGC192.168.201.141@tcp' 00000020:01000004:1.0:1783134863.631191:0:5750:0:(obd_mount.c:411:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:1.0:1783134863.631238:0:5750:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD MGC192.168.201.141@tcp (typ=mgc) 00000020:00000080:1.0:1783134863.631249:0:5750:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.201.141@tcp (00000000de916d08) 00000020:00000080:1.0:1783134863.631266:0:5750:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:1.0:1783134863.631381:0:5750:0:(ldlm_lib.c:102:import_set_conn()) imp 000000006be18bfd@MGC192.168.201.141@tcp: add connection 192.168.201.141@tcp at head 00010000:00010000:1.0:1783134863.631595:0:5750:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.201.141@tcp-0 is initialized 00000040:01000000:1.0:1783134863.631600:0:5750:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.141@tcp ctxt 1 is initialized 10000000:01000000:3.0:1783134863.632381:0:5767:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:3.0:1783134863.632408:0:5750:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.201.141@tcp (uuid 88a2002e-2ea7-4f07-912a-8d001832cfc0) 00000020:00000080:3.0:1783134863.632424:0:5750:0:(genops.c:1406:class_connect()) connect: client 88a2002e-2ea7-4f07-912a-8d001832cfc0, cookie 0xd6c4b8f05867e2a9 00000100:00080000:3.0:1783134863.632432:0:5750:0:(import.c:512:import_select_connection()) MGC192.168.201.141@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1783134863.632436:0:5750:0:(import.c:626:import_select_connection()) MGC192.168.201.141@tcp: import 000000006be18bfd using connection 192.168.201.141@tcp/0@lo 00000100:00100000:3.0:1783134863.632469:0:5750:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000fb6104b7 x1869752384356480/t0(0) o250->MGC192.168.201.141@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1783134863.632484:0:5750:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import 88a2002e-2ea7-4f07-912a-8d001832cfc0->MGS 00000020:01000004:3.0:1783134863.632496:0:5750:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:3.0:1783134863.632499:0:5750:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:3.0:1783134863.632513:0:5750:0:(genops.c:413:class_newdev()) Allocate new device MDS (00000000656b4c2e) 00000020:00000080:3.0:1783134863.632525:0:5750:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:1.0:1783134863.634036:0:3285:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000fb6104b7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:88a2002e-2ea7-4f07-912a-8d001832cfc0:3285:1869752384356480:0@lo:250: 00000100:00100000:1.0:1783134863.634126:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783134863.634207:0:5762:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384356480 00000100:00100000:1.0:1783134863.634215:0:5762:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384356480 00000100:00100000:1.0:1783134863.634267:0:5762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1783134863.634272:0:5762:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000bcea8400 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3285:x1869752384356480:12345-0@lo:250: 00010000:00080000:1.0:1783134863.634311:0:5762:0:(ldlm_lib.c:1432:target_handle_connect()) MGS: connection from 88a2002e-2ea7-4f07-912a-8d001832cfc0@0@lo t0 exp 0000000000000000 cur 146 last 0 00000020:00000080:1.0:1783134863.634331:0:5762:0:(genops.c:1406:class_connect()) connect: client 88a2002e-2ea7-4f07-912a-8d001832cfc0, cookie 0xd6c4b8f05867e2b7 00000100:00080000:1.0:1783134863.634453:0:5762:0:(import.c:65:import_set_state_nolock()) 0000000085ac1614 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1783134863.634501:0:5762:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000bcea8400 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88a2002e-2ea7-4f07-912a-8d001832cfc0+5:3285:x1869752384356480:12345-0@lo:250: Request processed in 228us (376us total) trans 0 rc 0/0 00000100:00100000:1.0:1783134863.634509:0:5762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1783134863.634554:0:3285:0:(client.c:3111:ptlrpc_free_committed()) MGC192.168.201.141@tcp: committing for last_committed 0 gen 1 00000100:00080000:1.0:1783134863.634561:0:3285:0:(import.c:1134:ptlrpc_connect_interpret()) MGC192.168.201.141@tcp: connect to target with instance 0 00000100:00080000:1.0:1783134863.635621:0:3285:0:(import.c:961:ptlrpc_connect_set_flags()) MGC192.168.201.141@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:1.0:1783134863.635628:0:3285:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:1.0:1783134863.635632:0:3285:0:(import.c:65:import_set_state_nolock()) 000000006be18bfd MGS: changing import state from CONNECTING to FULL 10000000:01000000:1.0:1783134863.635635:0:3285:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:1.0:1783134863.635649:0:3285:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:1.0:1783134863.635656:0:3285:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000fb6104b7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:88a2002e-2ea7-4f07-912a-8d001832cfc0:3285:1869752384356480:0@lo:250: 00000100:00100000:3.0:1783134863.638994:0:5750:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1783134863.639160:0:5750:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:3.0:1783134863.639166:0:5750:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:3.0:1783134863.639758:0:5750:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:3.0:1783134863.639765:0:5750:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:3.0:1783134863.640321:0:5750:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:3.0:1783134863.640327:0:5750:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:3.0:1783134863.640939:0:5750:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1783134863.641054:0:5750:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:3.0:1783134863.641059:0:5750:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:3.0:1783134863.641726:0:5750:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:3.0:1783134863.641732:0:5750:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:3.0:1783134863.661733:0:5750:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1783134863.661910:0:5750:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:3.0:1783134863.661916:0:5750:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:0.0:1783134863.663095:0:5750:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:0.0:1783134863.663102:0:5750:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:0.0:1783134863.663734:0:5750:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1783134863.663869:0:5750:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:0.0:1783134863.663875:0:5750:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:0.0:1783134863.664923:0:5750:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:0.0:1783134863.664929:0:5750:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:0.0:1783134863.665504:0:5750:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1783134863.665605:0:5750:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:0.0:1783134863.665609:0:5750:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:0.0:1783134863.666117:0:5750:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:0.0:1783134863.666123:0:5750:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:0.0:1783134863.666646:0:5750:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1783134863.666750:0:5750:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:0.0:1783134863.666754:0:5750:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:0.0:1783134863.667185:0:5750:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:0.0:1783134863.667192:0:5750:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:0.0:1783134863.681592:0:5750:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1783134863.681791:0:5750:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:0.0:1783134863.681797:0:5750:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:0.0:1783134863.682694:0:5750:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:0.0:1783134863.682702:0:5750:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:0.0:1783134863.684191:0:5750:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:0.0:1783134863.684198:0:5750:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:0.0:1783134863.686393:0:5750:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:0.0:1783134863.686420:0:5750:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:0.0:1783134863.686426:0:5750:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.141@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:0.0:1783134863.686598:0:5750:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.141@tcp ctxt 0 is initialized 00000020:01000004:0.0:1783134863.686630:0:5750:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.201.141@tcp, index=0000, flags=0x20065 00000020:01000004:0.0:1783134863.686635:0:5750:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1783134863.686641:0:5750:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1783134863.686643:0:5750:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1783134863.686644:0:5750:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1783134863.686645:0:5750:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1783134863.686646:0:5750:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1783134863.686647:0:5750:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1783134863.686648:0:5750:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1783134863.686649:0:5750:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1783134863.686651:0:5750:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1783134863.686652:0:5750:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1783134863.686653:0:5750:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1783134863.686656:0:5750:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020065 00000020:01000004:0.0:1783134863.686659:0:5750:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1783134863.686660:0:5750:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1783134863.686661:0:5750:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1783134863.686662:0:5750:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1783134863.686663:0:5750:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1783134863.686664:0:5750:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1783134863.686665:0:5750:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1783134863.686666:0:5750:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1783134863.686667:0:5750:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1783134863.686668:0:5750:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1783134863.686669:0:5750:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1783134863.686670:0:5750:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1783134863.686713:0:5750:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:0.0:1783134863.686732:0:5750:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000003d589276 pname:cluuid:pid:xid:nid:opc:job mount.lustre:88a2002e-2ea7-4f07-912a-8d001832cfc0:5750:1869752384356608:0@lo:253: 00000100:00100000:0.0:1783134863.686830:0:5750:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783134863.686887:0:5765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384356608 00000100:00100000:0.0:1783134863.686895:0:5750:0:(client.c:2701:ptlrpc_set_wait()) set 0000000076739979 going to sleep for 11 seconds 00000100:00100000:3.0:1783134863.686896:0:5765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384356608 00000100:00100000:3.0:1783134863.686936:0:5765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1783134863.686944:0:5765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f77b8ef3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88a2002e-2ea7-4f07-912a-8d001832cfc0+5:5750:x1869752384356608:12345-0@lo:253: 20000000:01000000:3.0:1783134863.687003:0:5765:0:(mgs_llog.c:683:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1783134863.687006:0:5765:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 10000000:01000000:3.0:1783134863.687461:0:5785:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:1.0:1783134863.687500:0:5765:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 00000040:00080000:1.0:1783134863.687883:0:5765:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1783134863.689196:0:5786:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 20000000:01000000:1.0:1783134863.689531:0:5765:0:(mgs_llog.c:683:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1783134863.689535:0:5765:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0000, index=0 20000000:01000000:1.0:1783134863.689541:0:5765:0:(mgs_llog.c:867:mgs_set_index()) Set index for lustre-MDT0000 to 0 20000000:01000000:1.0:1783134863.689544:0:5765:0:(mgs_llog.c:3603:mgs_write_log_mdt()) writing new mdt lustre-MDT0000 20000000:01000000:1.0:1783134863.689560:0:5765:0:(mgs_llog.c:3163:mgs_write_log_lov()) Writing lov(lustre-MDT0000-mdtlov) log for lustre-MDT0000 00000040:00080000:1.0:1783134863.689919:0:5765:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1783134863.690146:0:5765:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 20000000:01000000:1.0:1783134863.690159:0:5765:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf001 lov lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:1.0:1783134863.690208:0:5765:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 136 off8552 00000040:00080000:1.0:1783134863.690273:0:5765:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 176 off8728 00000040:00080000:1.0:1783134863.690367:0:5765:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8952 00000040:00080000:1.0:1783134863.690462:0:5765:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9176 20000000:01000000:1.0:1783134863.690471:0:5765:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-MDT0000 0xcf001 mdt lustre-MDT0000_UUID (null) (null) 00000040:00080000:1.0:1783134863.690532:0:5765:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9296 20000000:01000000:1.0:1783134863.690541:0:5765:0:(mgs_llog.c:1536:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0000 lustre-MDT0000-mdtlov (null) (null) 00000040:00080000:1.0:1783134863.690590:0:5765:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 112 off9408 20000000:01000000:1.0:1783134863.690598:0:5765:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-MDT0000 0xcf003 lustre-MDT0000_UUID 0 lustre-MDT0000-mdtlov f 00000040:00080000:1.0:1783134863.690638:0:5765:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 160 off9568 00000040:00080000:1.0:1783134863.690706:0:5765:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9792 00000040:00080000:1.0:1783134863.690862:0:5765:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:1.0:1783134863.690867:0:5765:0:(mgs_llog.c:3163:mgs_write_log_lov()) Writing lov(lustre-clilov) log for lustre-client 00000040:00080000:1.0:1783134863.690882:0:5765:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1783134863.691024:0:5765:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 20000000:01000000:1.0:1783134863.691034:0:5765:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-clilov 0xcf001 lov lustre-clilov_UUID (null) (null) 00000040:00080000:1.0:1783134863.691062:0:5765:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 120 off8536 00000040:00080000:1.0:1783134863.691081:0:5765:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 168 off8704 00000040:00080000:1.0:1783134863.691105:0:5765:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].4, 224 off8928 20000000:01000000:1.0:1783134863.691112:0:5765:0:(mgs_llog.c:3120:mgs_write_log_lmv()) Writing lmv(lustre-clilmv) log for lustre-client 00000040:00080000:1.0:1783134863.691166:0:5765:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].5, 224 off9152 20000000:01000000:1.0:1783134863.691172:0:5765:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-clilmv 0xcf001 lmv lustre-clilmv_UUID (null) (null) 00000040:00080000:1.0:1783134863.691197:0:5765:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].6, 120 off9272 00000040:00080000:1.0:1783134863.691215:0:5765:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].7, 168 off9440 00000040:00080000:1.0:1783134863.691239:0:5765:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].8, 224 off9664 20000000:01000000:1.0:1783134863.691249:0:5765:0:(mgs_llog.c:3085:mgs_write_log_mount_opt()) Writing mount options log for lustre-client 00000040:00080000:1.0:1783134863.691385:0:5765:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].9, 224 off9888 20000000:01000000:1.0:1783134863.691393:0:5765:0:(mgs_llog.c:1536:record_base_raw()) lcfg (null) 0xcf007 lustre-client lustre-clilov lustre-clilmv (null) 00000040:00080000:1.0:1783134863.691414:0:5765:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].10, 120 off10008 00000040:00080000:1.0:1783134863.691430:0:5765:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].11, 224 off10232 00000040:00080000:1.0:1783134863.691519:0:5765:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 20000000:01000000:1.0:1783134863.691574:0:5765:0:(mgs_llog.c:3300:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0000 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:1.0:1783134863.691581:0:5765:0:(mgs_llog.c:1106:mgs_modify()) modify lustre-client/lustre-MDT0000/add mdc fl=4 00000040:00080000:2.0:1783134863.691896:0:5787:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 00000040:00080000:1.0:1783134863.692658:0:5765:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].12, 224 off10456 20000000:01000000:1.0:1783134863.692681:0:5765:0:(mgs_llog.c:3346:mgs_write_log_mdc_to_lmv()) add nid 192.168.201.141@tcp for mdt 20000000:01000000:1.0:1783134863.692682:0:5765:0:(mgs_llog.c:1536:record_base_raw()) lcfg (null) 0xcf005 192.168.201.141@tcp (null) (null) (null) 00000040:00080000:1.0:1783134863.692718:0:5765:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].13, 88 off10544 20000000:01000000:1.0:1783134863.692726:0:5765:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:1.0:1783134863.692753:0:5765:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].14, 128 off10672 20000000:01000000:1.0:1783134863.692759:0:5765:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf003 lustre-MDT0000_UUID 192.168.201.141@tcp (null) (null) 00000040:00080000:1.0:1783134863.692821:0:5765:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].15, 144 off10816 20000000:01000000:1.0:1783134863.692834:0:5765:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:1.0:1783134863.692885:0:5765:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].16, 160 off10976 00000040:00080000:1.0:1783134863.692921:0:5765:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].17, 224 off11200 20000000:01000000:1.0:1783134863.692996:0:5765:0:(mgs_llog.c:5244:mgs_write_log_target()) remaining string: ' mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity ', param: 'sys.timeout=20' 20000000:01000000:1.0:1783134863.693000:0:5765:0:(mgs_llog.c:4738:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:1.0:1783134863.693003:0:5765:0:(mgs_llog.c:4172:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:1.0:1783134863.693014:0:5765:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:1.0:1783134863.693017:0:5765:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:1.0:1783134863.693044:0:5765:0:(mgs_llog.c:2541:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:1.0:1783134863.693045:0:5765:0:(mgs_llog.c:1106:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 00000040:00080000:2.0:1783134863.693721:0:5788:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 10 count 10 00000040:00080000:1.0:1783134863.694052:0:5765:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 224 off10016 00000040:00080000:1.0:1783134863.694166:0:5765:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 80 off10096 00000040:00080000:1.0:1783134863.694315:0:5765:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10320 20000000:01000000:1.0:1783134863.694331:0:5765:0:(mgs_llog.c:2541:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:1.0:1783134863.694333:0:5765:0:(mgs_llog.c:1106:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 00000040:00080000:2.0:1783134863.694718:0:5789:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 18 count 18 00000040:00080000:1.0:1783134863.694936:0:5765:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].18, 224 off11424 00000040:00080000:1.0:1783134863.694977:0:5765:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].19, 80 off11504 00000040:00080000:1.0:1783134863.695025:0:5765:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].20, 224 off11728 00000020:00000080:1.0:1783134863.695039:0:5765:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1783134863.695041:0:5765:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 100 to 20 20000000:01000000:1.0:1783134863.695046:0:5765:0:(mgs_llog.c:5244:mgs_write_log_target()) remaining string: ' ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:1.0:1783134863.695048:0:5765:0:(mgs_llog.c:4738:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:1.0:1783134863.695053:0:5765:0:(mgs_llog.c:5063:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:1.0:1783134863.695058:0:5765:0:(mgs_llog.c:1376:mgs_modify_param()) modify lustre-MDT0000/lustre-MDT0000/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:2.0:1783134863.696404:0:5790:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 13 count 13 20000000:02000000:1.0:1783134863.696471:0:5765:0:(mgs_llog.c:4111:mgs_wlp_lcfg()) Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 00000040:00080000:1.0:1783134863.706564:0:5765:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 224 off10544 00000040:00080000:1.0:1783134863.706630:0:5765:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 160 off10704 00000040:00080000:1.0:1783134863.706703:0:5765:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 224 off10928 10000000:01000000:1.0:1783134863.706722:0:5765:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:1.0:1783134863.706748:0:5765:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000a1082784/0xd6c4b8f05867e2be lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134863.706784:0:5765:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000a1082784/0xd6c4b8f05867e2be lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134863.706794:0:5765:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000a1082784/0xd6c4b8f05867e2be lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134863.706800:0:5765:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000a1082784/0xd6c4b8f05867e2be lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134863.706806:0:5765:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000a1082784/0xd6c4b8f05867e2be lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134863.706812:0:5765:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000a1082784/0xd6c4b8f05867e2be lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134863.706820:0:5765:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000a1082784 already unused, calling callback (000000000c24fdc4) 00010000:00010000:1.0:1783134863.706823:0:5765:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000a1082784/0xd6c4b8f05867e2be lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134863.706830:0:5765:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000a1082784/0xd6c4b8f05867e2be lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134863.706842:0:5765:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000a1082784/0xd6c4b8f05867e2be lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134863.706848:0:5765:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000a1082784/0xd6c4b8f05867e2be lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134863.706854:0:5765:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000a1082784/0xd6c4b8f05867e2be lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1783134863.706898:0:5765:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:1.0:1783134863.826023:0:5765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f77b8ef3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88a2002e-2ea7-4f07-912a-8d001832cfc0+5:5750:x1869752384356608:12345-0@lo:253: Request processed in 139072us (139186us total) trans 0 rc 0/0 00000100:00100000:1.0:1783134863.826038:0:5765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1783134863.826050:0:5750:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000003d589276 pname:cluuid:pid:xid:nid:opc:job mount.lustre:88a2002e-2ea7-4f07-912a-8d001832cfc0:5750:1869752384356608:0@lo:253: 10000000:01000000:0.0:1783134863.826064:0:5750:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:0.0:1783134863.826067:0:5750:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1783134863.826068:0:5750:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1783134863.826069:0:5750:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1783134863.826070:0:5750:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0000_UUID 00000020:01000004:0.0:1783134863.826072:0:5750:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1783134863.826073:0:5750:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1783134863.826074:0:5750:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1783134863.826075:0:5750:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1783134863.826088:0:5750:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:0.0:1783134863.826090:0:5750:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1783134863.826091:0:5750:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1783134863.826109:0:5750:0:(tgt_mount.c:101:server_register_mount()) register mount 000000003c103942 from lustre-MDT0000 10000000:01000000:0.0:1783134863.826136:0:5750:0:(mgc_request.c:1945:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:0.0:1783134863.826138:0:5750:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:0.0:1783134863.826143:0:5750:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff9fe9d13819c0 10000000:01000000:0.0:1783134863.826147:0:5750:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1783134863.826155:0:5750:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-sptlrpc-ffff9fe9d13819c0 from 1 10000000:01000000:0.0:1783134863.826157:0:5750:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1783134863.826191:0:5750:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.141@tcp lock: 0000000027056a73/0xd6c4b8f05867e2c5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134863.826202:0:5750:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.141@tcp lock: 0000000027056a73/0xd6c4b8f05867e2c5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134863.826211:0:5750:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.141@tcp lock: 0000000027056a73/0xd6c4b8f05867e2c5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783134863.826224:0:5750:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000003d589276 pname:cluuid:pid:xid:nid:opc:job mount.lustre:88a2002e-2ea7-4f07-912a-8d001832cfc0:5750:1869752384356736:0@lo:101: 00000100:00100000:0.0:1783134863.826262:0:5750:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783134863.826308:0:5763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384356736 00000100:00100000:1.0:1783134863.826314:0:5763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384356736 00000100:00100000:1.0:1783134863.826347:0:5763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1783134863.826355:0:5763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000132bf693 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88a2002e-2ea7-4f07-912a-8d001832cfc0+5:5750:x1869752384356736:12345-0@lo:101: 00000100:00100000:0.0:1783134863.826373:0:5750:0:(client.c:2701:ptlrpc_set_wait()) set 00000000c678cfb5 going to sleep for 11 seconds 00010000:00010000:1.0:1783134863.826413:0:5763:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783134863.826425:0:5763:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000a1082784/0xd6c4b8f05867e2cc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd6c4b8f05867e2c5 expref: -99 pid: 5763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134863.826447:0:5763:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000a1082784/0xd6c4b8f05867e2cc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd6c4b8f05867e2c5 expref: 6 pid: 5763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134863.826454:0:5763:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000a1082784/0xd6c4b8f05867e2cc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd6c4b8f05867e2c5 expref: 6 pid: 5763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134863.826461:0:5763:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000a1082784, rc 0) 00000100:00100000:1.0:1783134863.826487:0:5763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000132bf693 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88a2002e-2ea7-4f07-912a-8d001832cfc0+6:5750:x1869752384356736:12345-0@lo:101: Request processed in 134us (225us total) trans 0 rc 0/0 00000100:00100000:1.0:1783134863.826493:0:5763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1783134863.826516:0:5750:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000003d589276 pname:cluuid:pid:xid:nid:opc:job mount.lustre:88a2002e-2ea7-4f07-912a-8d001832cfc0:5750:1869752384356736:0@lo:101: 00010000:00010000:0.0:1783134863.826527:0:5750:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.141@tcp lock: 0000000027056a73/0xd6c4b8f05867e2c5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd6c4b8f05867e2cc expref: -99 pid: 5750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134863.826535:0:5750:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.141@tcp lock: 0000000027056a73/0xd6c4b8f05867e2c5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd6c4b8f05867e2cc expref: -99 pid: 5750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783134863.826585:0:5750:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000003d589276 pname:cluuid:pid:xid:nid:opc:job mount.lustre:88a2002e-2ea7-4f07-912a-8d001832cfc0:5750:1869752384356864:0@lo:501: 00000100:00100000:0.0:1783134863.826609:0:5750:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783134863.826637:0:5750:0:(client.c:2701:ptlrpc_set_wait()) set 00000000c678cfb5 going to sleep for 11 seconds 00000100:00100000:1.0:1783134863.826663:0:5765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384356864 00000100:00100000:1.0:1783134863.826667:0:5765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384356864 00000100:00100000:1.0:1783134863.826692:0:5765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1783134863.826697:0:5765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008eb83612 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88a2002e-2ea7-4f07-912a-8d001832cfc0+6:5750:x1869752384356864:12345-0@lo:501: 00000100:00100000:1.0:1783134863.826873:0:5765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008eb83612 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88a2002e-2ea7-4f07-912a-8d001832cfc0+6:5750:x1869752384356864:12345-0@lo:501: Request processed in 176us (263us total) trans 0 rc -2/-2 00000100:00100000:1.0:1783134863.826886:0:5765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1783134863.826902:0:5750:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000003d589276 pname:cluuid:pid:xid:nid:opc:job mount.lustre:88a2002e-2ea7-4f07-912a-8d001832cfc0:5750:1869752384356864:0@lo:501: 10000000:01000000:0.0:1783134863.826929:0:5750:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.201.141@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1783134863.826943:0:5750:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.141@tcp lock: 0000000027056a73/0xd6c4b8f05867e2c5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd6c4b8f05867e2cc expref: -99 pid: 5750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134863.826951:0:5750:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.141@tcp lock: 0000000027056a73/0xd6c4b8f05867e2c5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd6c4b8f05867e2cc expref: -99 pid: 5750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783134863.826957:0:5750:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9fe9e0d14800 10000000:01000000:0.0:1783134863.826961:0:5750:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1783134863.826964:0:5750:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff9fe9e0d14800 10000000:01000000:0.0:1783134863.826966:0:5750:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:0.0:1783134863.826969:0:5750:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-barrier-ffff9fe9e0d14800 from 1 10000000:01000000:0.0:1783134863.826971:0:5750:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:0.0:1783134863.826984:0:5750:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.141@tcp lock: 00000000e4a9a24a/0xd6c4b8f05867e2d3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134863.826991:0:5750:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.141@tcp lock: 00000000e4a9a24a/0xd6c4b8f05867e2d3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134863.826997:0:5750:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.141@tcp lock: 00000000e4a9a24a/0xd6c4b8f05867e2d3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783134863.827007:0:5750:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000003d589276 pname:cluuid:pid:xid:nid:opc:job mount.lustre:88a2002e-2ea7-4f07-912a-8d001832cfc0:5750:1869752384356992:0@lo:101: 00000100:00100000:0.0:1783134863.827030:0:5750:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783134863.828100:0:5763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384356992 00000100:00100000:2.0:1783134863.828108:0:5763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384356992 00000100:00100000:0.0:1783134863.828119:0:5750:0:(client.c:2701:ptlrpc_set_wait()) set 00000000c678cfb5 going to sleep for 11 seconds 00000100:00100000:2.0:1783134863.828136:0:5763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1783134863.828141:0:5763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000212af69b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88a2002e-2ea7-4f07-912a-8d001832cfc0+6:5750:x1869752384356992:12345-0@lo:101: 00010000:00010000:2.0:1783134863.828151:0:5763:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783134863.828164:0:5763:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000555fd7b0/0xd6c4b8f05867e2da lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd6c4b8f05867e2d3 expref: -99 pid: 5763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134863.828181:0:5763:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000555fd7b0/0xd6c4b8f05867e2da lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd6c4b8f05867e2d3 expref: 7 pid: 5763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134863.828190:0:5763:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000555fd7b0/0xd6c4b8f05867e2da lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd6c4b8f05867e2d3 expref: 7 pid: 5763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134863.828198:0:5763:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000555fd7b0, rc 0) 00000100:00100000:2.0:1783134863.828300:0:5763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000212af69b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88a2002e-2ea7-4f07-912a-8d001832cfc0+7:5750:x1869752384356992:12345-0@lo:101: Request processed in 158us (1269us total) trans 0 rc 0/0 00000100:00100000:2.0:1783134863.828307:0:5763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1783134863.828319:0:5750:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000003d589276 pname:cluuid:pid:xid:nid:opc:job mount.lustre:88a2002e-2ea7-4f07-912a-8d001832cfc0:5750:1869752384356992:0@lo:101: 00010000:00010000:0.0:1783134863.828330:0:5750:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.141@tcp lock: 00000000e4a9a24a/0xd6c4b8f05867e2d3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd6c4b8f05867e2da expref: -99 pid: 5750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134863.828348:0:5750:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.141@tcp lock: 00000000e4a9a24a/0xd6c4b8f05867e2d3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd6c4b8f05867e2da expref: -99 pid: 5750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783134863.828365:0:5750:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.201.141@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:0.0:1783134863.828378:0:5750:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.141@tcp lock: 00000000e4a9a24a/0xd6c4b8f05867e2d3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd6c4b8f05867e2da expref: -99 pid: 5750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134863.828385:0:5750:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.141@tcp lock: 00000000e4a9a24a/0xd6c4b8f05867e2d3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd6c4b8f05867e2da expref: -99 pid: 5750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783134863.828391:0:5750:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:0.0:1783134863.828395:0:5750:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1783134863.828400:0:5750:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff9fe9e0d14800 10000000:01000000:0.0:1783134863.828403:0:5750:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:0.0:1783134863.828406:0:5750:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:0.0:1783134863.828408:0:5750:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1783134863.828423:0:5750:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.141@tcp lock: 0000000039f945ae/0xd6c4b8f05867e2e1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134863.828430:0:5750:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.141@tcp lock: 0000000039f945ae/0xd6c4b8f05867e2e1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134863.828435:0:5750:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.141@tcp lock: 0000000039f945ae/0xd6c4b8f05867e2e1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783134863.828446:0:5750:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000003d589276 pname:cluuid:pid:xid:nid:opc:job mount.lustre:88a2002e-2ea7-4f07-912a-8d001832cfc0:5750:1869752384357120:0@lo:101: 00000100:00100000:0.0:1783134863.828467:0:5750:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783134863.828485:0:5750:0:(client.c:2701:ptlrpc_set_wait()) set 00000000c678cfb5 going to sleep for 11 seconds 00000100:00100000:2.0:1783134863.828503:0:5762:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384357120 00000100:00100000:2.0:1783134863.828511:0:5762:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384357120 00000100:00100000:2.0:1783134863.828578:0:5762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1783134863.828592:0:5762:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000dbaea166 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88a2002e-2ea7-4f07-912a-8d001832cfc0+7:5750:x1869752384357120:12345-0@lo:101: 00010000:00010000:2.0:1783134863.828600:0:5762:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783134863.828607:0:5762:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000005738572/0xd6c4b8f05867e2e8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xd6c4b8f05867e2e1 expref: -99 pid: 5762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134863.828620:0:5762:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000005738572/0xd6c4b8f05867e2e8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd6c4b8f05867e2e1 expref: 8 pid: 5762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134863.828627:0:5762:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000005738572/0xd6c4b8f05867e2e8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd6c4b8f05867e2e1 expref: 8 pid: 5762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134863.828633:0:5762:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000005738572, rc 0) 00000100:00100000:2.0:1783134863.828666:0:5762:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000dbaea166 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88a2002e-2ea7-4f07-912a-8d001832cfc0+8:5750:x1869752384357120:12345-0@lo:101: Request processed in 83us (198us total) trans 0 rc 0/0 00000100:00100000:2.0:1783134863.828672:0:5762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1783134863.828713:0:5750:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000003d589276 pname:cluuid:pid:xid:nid:opc:job mount.lustre:88a2002e-2ea7-4f07-912a-8d001832cfc0:5750:1869752384357120:0@lo:101: 00010000:00010000:0.0:1783134863.828722:0:5750:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.141@tcp lock: 0000000039f945ae/0xd6c4b8f05867e2e1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd6c4b8f05867e2e8 expref: -99 pid: 5750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134863.828729:0:5750:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.141@tcp lock: 0000000039f945ae/0xd6c4b8f05867e2e1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xd6c4b8f05867e2e8 expref: -99 pid: 5750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783134863.828767:0:5750:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000003d589276 pname:cluuid:pid:xid:nid:opc:job mount.lustre:88a2002e-2ea7-4f07-912a-8d001832cfc0:5750:1869752384357248:0@lo:501: 00000100:00100000:0.0:1783134863.828791:0:5750:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783134863.828811:0:5762:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384357248 00000100:00100000:0.0:1783134863.828813:0:5750:0:(client.c:2701:ptlrpc_set_wait()) set 00000000c678cfb5 going to sleep for 11 seconds 00000100:00100000:2.0:1783134863.828815:0:5762:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384357248 00000100:00100000:2.0:1783134863.828878:0:5762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1783134863.828884:0:5762:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e15cb947 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88a2002e-2ea7-4f07-912a-8d001832cfc0+8:5750:x1869752384357248:12345-0@lo:501: 00000100:00100000:2.0:1783134863.829174:0:5762:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e15cb947 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88a2002e-2ea7-4f07-912a-8d001832cfc0+9:5750:x1869752384357248:12345-0@lo:501: Request processed in 290us (382us total) trans 0 rc 0/0 00000100:00100000:2.0:1783134863.829182:0:5762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1783134863.829314:0:5750:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000003d589276 pname:cluuid:pid:xid:nid:opc:job mount.lustre:88a2002e-2ea7-4f07-912a-8d001832cfc0:5750:1869752384357248:0@lo:501: 00000100:00100000:0.0:1783134863.829351:0:5750:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000003d589276 pname:cluuid:pid:xid:nid:opc:job mount.lustre:88a2002e-2ea7-4f07-912a-8d001832cfc0:5750:1869752384357376:0@lo:503: 00000100:00100000:0.0:1783134863.829383:0:5750:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783134863.829409:0:5750:0:(client.c:2701:ptlrpc_set_wait()) set 00000000c678cfb5 going to sleep for 11 seconds 00000100:00100000:1.0:1783134863.829418:0:5763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384357376 00000100:00100000:1.0:1783134863.829422:0:5763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384357376 00000100:00100000:1.0:1783134863.829441:0:5763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1783134863.829446:0:5763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d0519a17 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88a2002e-2ea7-4f07-912a-8d001832cfc0+9:5750:x1869752384357376:12345-0@lo:503: 00000100:00100000:1.0:1783134863.829615:0:5763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d0519a17 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88a2002e-2ea7-4f07-912a-8d001832cfc0+9:5750:x1869752384357376:12345-0@lo:503: Request processed in 168us (231us total) trans 0 rc 0/0 00000100:00100000:1.0:1783134863.829623:0:5763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1783134863.829696:0:5750:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000003d589276 pname:cluuid:pid:xid:nid:opc:job mount.lustre:88a2002e-2ea7-4f07-912a-8d001832cfc0:5750:1869752384357376:0@lo:503: 00000100:00100000:0.0:1783134863.830130:0:5792:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000003d589276 pname:cluuid:pid:xid:nid:opc:job llog_process_th:88a2002e-2ea7-4f07-912a-8d001832cfc0:5792:1869752384357504:0@lo:502: 00000100:00100000:0.0:1783134863.830155:0:5792:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783134863.830171:0:5792:0:(client.c:2701:ptlrpc_set_wait()) set 000000002dc5c41b going to sleep for 11 seconds 00000100:00100000:3.0:1783134863.830208:0:5765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384357504 00000100:00100000:3.0:1783134863.830212:0:5765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384357504 00000100:00100000:3.0:1783134863.830236:0:5765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1783134863.830242:0:5765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003aa91ac8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88a2002e-2ea7-4f07-912a-8d001832cfc0+9:5792:x1869752384357504:12345-0@lo:502: 00000100:00100000:3.0:1783134863.830404:0:5765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003aa91ac8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88a2002e-2ea7-4f07-912a-8d001832cfc0+9:5792:x1869752384357504:12345-0@lo:502: Request processed in 163us (248us total) trans 0 rc 0/0 00000100:00100000:3.0:1783134863.830409:0:5765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1783134863.830469:0:5792:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000003d589276 pname:cluuid:pid:xid:nid:opc:job llog_process_th:88a2002e-2ea7-4f07-912a-8d001832cfc0:5792:1869752384357504:0@lo:502: 00000020:01000000:0.0:1783134863.830485:0:5792:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1783134863.830493:0:5792:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783134863.830495:0:5792:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:0.0:1783134863.830499:0:5792:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:0.0:1783134863.830501:0:5792:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1783134863.830516:0:5792:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (00000000bd33e925) 00000020:00000080:0.0:1783134863.830529:0:5792:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:0.0:1783134863.830536:0:5792:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00080000:01000000:0.0:1783134863.830647:0:5792:0:(osd_handler.c:1569:osd_obd_connect()) connect #2 00000020:00000080:0.0:1783134863.830659:0:5792:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xd6c4b8f05867e2f6 00000020:00000080:0.0:1783134863.830835:0:5792:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:0.0:1783134863.830838:0:5792:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1783134863.830840:0:5792:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783134863.830841:0:5792:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:0.0:1783134863.830843:0:5792:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1783134863.830845:0:5792:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783134863.830846:0:5792:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:0.0:1783134863.830848:0:5792:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1783134863.830852:0:5792:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (0000000025df5740) 00000020:00000080:0.0:1783134863.830859:0:5792:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:0.0:1783134863.830861:0:5792:0:(obd_config.c:1470:class_process_config()) processing cmd: cf007 00000020:00000080:0.0:1783134863.830862:0:5792:0:(obd_config.c:1514:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:0.0:1783134863.830864:0:5792:0:(obd_config.c:1148:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:0.0:1783134863.830868:0:5792:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1783134863.830912:0:5792:0:(tgt_mount.c:153:server_get_mount()) get mount 000000003c103942 from lustre-MDT0000, refs=3 00000020:00000080:0.0:1783134863.830925:0:5792:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (00000000b8d67ba4) 00000020:00000080:0.0:1783134863.830933:0:5792:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:0.0:1783134863.830981:0:5792:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:0.0:1783134863.830985:0:5792:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xd6c4b8f05867e30b 00000020:00000080:0.0:1783134863.831075:0:5792:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:0.0:1783134863.831079:0:5792:0:(mdd_device.c:1596:mdd_obd_connect()) connect #0 00000020:00000080:0.0:1783134863.831083:0:5792:0:(genops.c:1406:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0xd6c4b8f05867e312 00080000:01000000:0.0:1783134863.831085:0:5792:0:(osd_handler.c:1569:osd_obd_connect()) connect #3 00000020:00000080:0.0:1783134863.831087:0:5792:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xd6c4b8f05867e319 00080000:10000000:0.0:1783134863.831443:0:5792:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 40000000:02000000:0.0:1783134863.831641:0:5792:0:(fid_handler.c:560:seq_server_init()) ctl-lustre-MDT0000: No data found on store. Initialize space. 40000000:02000000:0.0:1783134863.833864:0:5792:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0000: No data found on store. Initialize space. 00010000:00010000:2.0:1783134863.876551:0:5792:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:02000400:2.0:1783134863.876823:0:5792:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-MDT0000: new disk, initializing 00000001:00000004:2.0:1783134863.878145:0:5792:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 0 00000001:00080000:2.0:1783134863.878389:0:5792:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0000: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:1.0:1783134863.891109:0:5792:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (000000006eff903b) 00000020:00000080:1.0:1783134863.891125:0:5792:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:1.0:1783134863.891175:0:5792:0:(osd_handler.c:1569:osd_obd_connect()) connect #4 00000020:00000080:1.0:1783134863.891180:0:5792:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xd6c4b8f05867e327 00000020:00000080:0.0:1783134863.891877:0:5792:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00080000:10000000:0.0:1783134863.894000:0:5792:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/8/4) registered 00080000:10000000:1.0:1783134863.913179:0:5792:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/8/4) registered 00080000:10000000:1.0:1783134863.940064:0:5792:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/8/4) registered 00080000:10000000:1.0:1783134863.965958:0:5792:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/8/4) registered 00080000:10000000:1.0:1783134863.998807:0:5792:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/8/4) registered 00080000:10000000:1.0:1783134864.017971:0:5792:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/8/4) registered 00000020:00000080:2.0:1783134864.037472:0:5792:0:(genops.c:1406:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0xd6c4b8f05867e32e 00000020:00000080:1.0:1783134864.037807:0:5792:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:1.0:1783134864.037817:0:5792:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1783134864.037824:0:5792:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783134864.037826:0:5792:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:1.0:1783134864.037830:0:5792:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1783134864.037834:0:5792:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783134864.037835:0:5792:0:(obd_config.c:1561:class_process_config()) marker 8 (0x1) lustre sys.timeout 00000020:00000080:1.0:1783134864.037838:0:5792:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1783134864.037840:0:5792:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1783134864.037842:0:5792:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1783134864.037844:0:5792:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783134864.037846:0:5792:0:(obd_config.c:1561:class_process_config()) marker 8 (0x2) lustre sys.timeout 00000020:01000000:1.0:1783134864.037855:0:5792:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1783134864.037859:0:5792:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783134864.037860:0:5792:0:(obd_config.c:1561:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:1.0:1783134864.037865:0:5792:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000004:01000000:1.0:1783134864.037902:0:5792:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000100:00100000:1.0:1783134864.037966:0:5792:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000156a3468 pname:cluuid:pid:xid:nid:opc:job llog_process_th:88a2002e-2ea7-4f07-912a-8d001832cfc0:5792:1869752384357632:0@lo:502: 00000100:00100000:1.0:1783134864.038040:0:5792:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783134864.038108:0:5792:0:(client.c:2701:ptlrpc_set_wait()) set 00000000f2f02c31 going to sleep for 11 seconds 00000100:00100000:2.0:1783134864.038120:0:5762:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384357632 00000100:00100000:2.0:1783134864.038128:0:5762:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384357632 00000100:00100000:2.0:1783134864.038173:0:5762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1783134864.038179:0:5762:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000071448621 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88a2002e-2ea7-4f07-912a-8d001832cfc0+9:5792:x1869752384357632:12345-0@lo:502: 00000100:00100000:2.0:1783134864.038546:0:5762:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000071448621 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88a2002e-2ea7-4f07-912a-8d001832cfc0+9:5792:x1869752384357632:12345-0@lo:502: Request processed in 366us (507us total) trans 0 rc 0/0 00000100:00100000:2.0:1783134864.038553:0:5762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1783134864.038598:0:5792:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000156a3468 pname:cluuid:pid:xid:nid:opc:job llog_process_th:88a2002e-2ea7-4f07-912a-8d001832cfc0:5792:1869752384357632:0@lo:502: 00000020:01000000:1.0:1783134864.038623:0:5792:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1783134864.038628:0:5792:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783134864.038630:0:5792:0:(obd_config.c:1561:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000040:00080000:1.0:1783134864.038633:0:5792:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000020:01000000:3.0:1783134864.038761:0:5750:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-15 (rc=0) 10000000:01000000:3.0:1783134864.038783:0:5750:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.201.141@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1783134864.038801:0:5750:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.141@tcp lock: 0000000039f945ae/0xd6c4b8f05867e2e1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd6c4b8f05867e2e8 expref: -99 pid: 5750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134864.038808:0:5750:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.141@tcp lock: 0000000039f945ae/0xd6c4b8f05867e2e1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd6c4b8f05867e2e8 expref: -99 pid: 5750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783134864.038813:0:5750:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-mdtir-ffff9fe9e0d14800 from 1 10000000:01000000:3.0:1783134864.038816:0:5750:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1783134864.038836:0:5750:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.141@tcp lock: 0000000023118ea0/0xd6c4b8f05867e335 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134864.038840:0:5750:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.141@tcp lock: 0000000023118ea0/0xd6c4b8f05867e335 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134864.038846:0:5750:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.141@tcp lock: 0000000023118ea0/0xd6c4b8f05867e335 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783134864.038854:0:5750:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000188783af pname:cluuid:pid:xid:nid:opc:job mount.lustre:88a2002e-2ea7-4f07-912a-8d001832cfc0:5750:1869752384357760:0@lo:101: 00000100:00100000:3.0:1783134864.038876:0:5750:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783134864.039006:0:5765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384357760 00000100:00100000:1.0:1783134864.039011:0:5765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384357760 00000100:00100000:3.0:1783134864.039014:0:5750:0:(client.c:2701:ptlrpc_set_wait()) set 0000000016b53ed3 going to sleep for 11 seconds 00000100:00100000:1.0:1783134864.039048:0:5765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1783134864.039055:0:5765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b06289f4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88a2002e-2ea7-4f07-912a-8d001832cfc0+9:5750:x1869752384357760:12345-0@lo:101: 00010000:00010000:1.0:1783134864.039065:0:5765:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783134864.039076:0:5765:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000049b9c118/0xd6c4b8f05867e33c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd6c4b8f05867e335 expref: -99 pid: 5765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134864.039097:0:5765:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000049b9c118/0xd6c4b8f05867e33c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd6c4b8f05867e335 expref: 10 pid: 5765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134864.039107:0:5765:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000049b9c118/0xd6c4b8f05867e33c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd6c4b8f05867e335 expref: 10 pid: 5765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134864.039116:0:5765:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000049b9c118, rc 0) 00000100:00100000:1.0:1783134864.039149:0:5765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b06289f4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88a2002e-2ea7-4f07-912a-8d001832cfc0+10:5750:x1869752384357760:12345-0@lo:101: Request processed in 96us (272us total) trans 0 rc 0/0 00000100:00100000:1.0:1783134864.039161:0:5765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1783134864.039467:0:5750:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000188783af pname:cluuid:pid:xid:nid:opc:job mount.lustre:88a2002e-2ea7-4f07-912a-8d001832cfc0:5750:1869752384357760:0@lo:101: 00010000:00010000:3.0:1783134864.039478:0:5750:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.141@tcp lock: 0000000023118ea0/0xd6c4b8f05867e335 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd6c4b8f05867e33c expref: -99 pid: 5750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134864.039487:0:5750:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.141@tcp lock: 0000000023118ea0/0xd6c4b8f05867e335 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd6c4b8f05867e33c expref: -99 pid: 5750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783134864.040022:0:5750:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000188783af pname:cluuid:pid:xid:nid:opc:job mount.lustre:88a2002e-2ea7-4f07-912a-8d001832cfc0:5750:1869752384357888:0@lo:256: 00000100:00100000:3.0:1783134864.040052:0:5750:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783134864.040086:0:5750:0:(client.c:2701:ptlrpc_set_wait()) set 0000000016b53ed3 going to sleep for 11 seconds 00000100:00100000:2.0:1783134864.040147:0:5762:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384357888 00000100:00100000:2.0:1783134864.040152:0:5762:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384357888 00000100:00100000:2.0:1783134864.040182:0:5762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1783134864.040189:0:5762:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000071f19eb5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88a2002e-2ea7-4f07-912a-8d001832cfc0+10:5750:x1869752384357888:12345-0@lo:256: 20000000:01000000:2.0:1783134864.040202:0:5762:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:2.0:1783134864.040218:0:5762:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:3.0:1783134864.040333:0:5750:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000188783af pname:cluuid:pid:xid:nid:opc:job mount.lustre:88a2002e-2ea7-4f07-912a-8d001832cfc0:5750:1869752384357888:0@lo:256: 00000100:00100000:2.0:1783134864.040774:0:5762:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000071f19eb5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88a2002e-2ea7-4f07-912a-8d001832cfc0+10:5750:x1869752384357888:12345-0@lo:256: Request processed in 128us (264us total) trans 0 rc 0/0 00000100:00100000:2.0:1783134864.040783:0:5762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 10000000:01000000:3.0:1783134864.041000:0:5750:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.201.141@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1783134864.041012:0:5750:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.141@tcp lock: 0000000023118ea0/0xd6c4b8f05867e335 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd6c4b8f05867e33c expref: -99 pid: 5750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134864.041018:0:5750:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.141@tcp lock: 0000000023118ea0/0xd6c4b8f05867e335 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd6c4b8f05867e33c expref: -99 pid: 5750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783134864.041024:0:5750:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff9fe9e0d14800 from 1 10000000:01000000:3.0:1783134864.041026:0:5750:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1783134864.041044:0:5750:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.141@tcp lock: 000000000591dbd7/0xd6c4b8f05867e343 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134864.041048:0:5750:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.141@tcp lock: 000000000591dbd7/0xd6c4b8f05867e343 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134864.041054:0:5750:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.141@tcp lock: 000000000591dbd7/0xd6c4b8f05867e343 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783134864.041067:0:5750:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000188783af pname:cluuid:pid:xid:nid:opc:job mount.lustre:88a2002e-2ea7-4f07-912a-8d001832cfc0:5750:1869752384358016:0@lo:101: 00000100:00100000:3.0:1783134864.041095:0:5750:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783134864.041123:0:5765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384358016 00000100:00100000:3.0:1783134864.041126:0:5750:0:(client.c:2701:ptlrpc_set_wait()) set 0000000016b53ed3 going to sleep for 11 seconds 00000100:00100000:1.0:1783134864.041129:0:5765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384358016 00000100:00100000:1.0:1783134864.041164:0:5765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1783134864.041169:0:5765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000bd6f137d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88a2002e-2ea7-4f07-912a-8d001832cfc0+10:5750:x1869752384358016:12345-0@lo:101: 00010000:00010000:1.0:1783134864.041178:0:5765:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783134864.041189:0:5765:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000e279b816/0xd6c4b8f05867e34a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd6c4b8f05867e343 expref: -99 pid: 5765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134864.041215:0:5765:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000e279b816/0xd6c4b8f05867e34a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd6c4b8f05867e343 expref: 11 pid: 5765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134864.041224:0:5765:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000e279b816/0xd6c4b8f05867e34a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd6c4b8f05867e343 expref: 11 pid: 5765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134864.041232:0:5765:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000e279b816, rc 0) 00000100:00100000:1.0:1783134864.041261:0:5765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000bd6f137d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88a2002e-2ea7-4f07-912a-8d001832cfc0+11:5750:x1869752384358016:12345-0@lo:101: Request processed in 92us (166us total) trans 0 rc 0/0 00000100:00100000:1.0:1783134864.041267:0:5765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1783134864.041318:0:5750:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000188783af pname:cluuid:pid:xid:nid:opc:job mount.lustre:88a2002e-2ea7-4f07-912a-8d001832cfc0:5750:1869752384358016:0@lo:101: 00010000:00010000:3.0:1783134864.041327:0:5750:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.141@tcp lock: 000000000591dbd7/0xd6c4b8f05867e343 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd6c4b8f05867e34a expref: -99 pid: 5750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134864.041332:0:5750:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.141@tcp lock: 000000000591dbd7/0xd6c4b8f05867e343 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd6c4b8f05867e34a expref: -99 pid: 5750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783134864.041374:0:5750:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000188783af pname:cluuid:pid:xid:nid:opc:job mount.lustre:88a2002e-2ea7-4f07-912a-8d001832cfc0:5750:1869752384358144:0@lo:501: 00000100:00100000:3.0:1783134864.041391:0:5750:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783134864.041409:0:5750:0:(client.c:2701:ptlrpc_set_wait()) set 0000000016b53ed3 going to sleep for 11 seconds 00000100:00100000:2.0:1783134864.041429:0:5762:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384358144 00000100:00100000:2.0:1783134864.041533:0:5762:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384358144 00000100:00100000:3.0:1783134864.041676:0:5762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1783134864.041682:0:5762:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001778dc70 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88a2002e-2ea7-4f07-912a-8d001832cfc0+11:5750:x1869752384358144:12345-0@lo:501: 00000100:00100000:3.0:1783134864.042202:0:5762:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001778dc70 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88a2002e-2ea7-4f07-912a-8d001832cfc0+11:5750:x1869752384358144:12345-0@lo:501: Request processed in 521us (809us total) trans 0 rc 0/0 00000100:00100000:3.0:1783134864.042213:0:5762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1783134864.042253:0:5750:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000188783af pname:cluuid:pid:xid:nid:opc:job mount.lustre:88a2002e-2ea7-4f07-912a-8d001832cfc0:5750:1869752384358144:0@lo:501: 00000100:00100000:0.0:1783134864.042317:0:5750:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000003d589276 pname:cluuid:pid:xid:nid:opc:job mount.lustre:88a2002e-2ea7-4f07-912a-8d001832cfc0:5750:1869752384358272:0@lo:503: 00000100:00100000:0.0:1783134864.042351:0:5750:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783134864.042366:0:5750:0:(client.c:2701:ptlrpc_set_wait()) set 000000003669436d going to sleep for 11 seconds 00000100:00100000:1.0:1783134864.042420:0:5765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384358272 00000100:00100000:1.0:1783134864.042424:0:5765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384358272 00000100:00100000:1.0:1783134864.042451:0:5765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1783134864.042456:0:5765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001de7f315 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88a2002e-2ea7-4f07-912a-8d001832cfc0+11:5750:x1869752384358272:12345-0@lo:503: 00000040:00080000:1.0:1783134864.042492:0:5765:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1783134864.042535:0:5765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001de7f315 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88a2002e-2ea7-4f07-912a-8d001832cfc0+11:5750:x1869752384358272:12345-0@lo:503: Request processed in 80us (184us total) trans 0 rc 0/0 00000100:00100000:1.0:1783134864.042542:0:5765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1783134864.042674:0:5750:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000003d589276 pname:cluuid:pid:xid:nid:opc:job mount.lustre:88a2002e-2ea7-4f07-912a-8d001832cfc0:5750:1869752384358272:0@lo:503: 00000040:00080000:0.0:1783134864.043575:0:5796:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 1 00000020:01000000:3.0:1783134864.043636:0:5750:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:3.0:1783134864.043655:0:5750:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.201.141@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1783134864.043665:0:5750:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.141@tcp lock: 000000000591dbd7/0xd6c4b8f05867e343 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd6c4b8f05867e34a expref: -99 pid: 5750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134864.043672:0:5750:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.141@tcp lock: 000000000591dbd7/0xd6c4b8f05867e343 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd6c4b8f05867e34a expref: -99 pid: 5750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783134864.043723:0:5750:0:(mgc_request.c:1945:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1783134864.043726:0:5750:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9fe9e0d14800 10000000:01000000:3.0:1783134864.043729:0:5750:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9fe9e0d14800 10000000:01000000:3.0:1783134864.043734:0:5750:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1783134864.043740:0:5750:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff9fe9e0d14800 from 1 10000000:01000000:3.0:1783134864.043743:0:5750:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1783134864.043762:0:5750:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.141@tcp lock: 000000003428774e/0xd6c4b8f05867e351 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134864.043768:0:5750:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.141@tcp lock: 000000003428774e/0xd6c4b8f05867e351 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134864.043781:0:5750:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.141@tcp lock: 000000003428774e/0xd6c4b8f05867e351 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783134864.043791:0:5750:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000b93b9cdc pname:cluuid:pid:xid:nid:opc:job mount.lustre:88a2002e-2ea7-4f07-912a-8d001832cfc0:5750:1869752384358400:0@lo:101: 00000100:00100000:3.0:1783134864.043816:0:5750:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783134864.043877:0:5750:0:(client.c:2701:ptlrpc_set_wait()) set 0000000020669351 going to sleep for 11 seconds 00000100:00100000:1.0:1783134864.043993:0:5762:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384358400 00000100:00100000:1.0:1783134864.044003:0:5762:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384358400 00000100:00100000:1.0:1783134864.044035:0:5762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1783134864.044042:0:5762:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002f259a5a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88a2002e-2ea7-4f07-912a-8d001832cfc0+11:5750:x1869752384358400:12345-0@lo:101: 00010000:00010000:1.0:1783134864.044051:0:5762:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783134864.044061:0:5762:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000000e2572db/0xd6c4b8f05867e358 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xd6c4b8f05867e351 expref: -99 pid: 5762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134864.044079:0:5762:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000000e2572db/0xd6c4b8f05867e358 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd6c4b8f05867e351 expref: 12 pid: 5762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134864.044087:0:5762:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000000e2572db/0xd6c4b8f05867e358 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd6c4b8f05867e351 expref: 12 pid: 5762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134864.044095:0:5762:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000000e2572db, rc 0) 00000100:00100000:1.0:1783134864.044165:0:5762:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002f259a5a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88a2002e-2ea7-4f07-912a-8d001832cfc0+12:5750:x1869752384358400:12345-0@lo:101: Request processed in 123us (347us total) trans 0 rc 0/0 00000100:00100000:1.0:1783134864.044171:0:5762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1783134864.044219:0:5750:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000b93b9cdc pname:cluuid:pid:xid:nid:opc:job mount.lustre:88a2002e-2ea7-4f07-912a-8d001832cfc0:5750:1869752384358400:0@lo:101: 00010000:00010000:3.0:1783134864.044229:0:5750:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.141@tcp lock: 000000003428774e/0xd6c4b8f05867e351 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd6c4b8f05867e358 expref: -99 pid: 5750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134864.044237:0:5750:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.141@tcp lock: 000000003428774e/0xd6c4b8f05867e351 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xd6c4b8f05867e358 expref: -99 pid: 5750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783134864.044274:0:5750:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000b93b9cdc pname:cluuid:pid:xid:nid:opc:job mount.lustre:88a2002e-2ea7-4f07-912a-8d001832cfc0:5750:1869752384358528:0@lo:501: 00000100:00100000:3.0:1783134864.044368:0:5750:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783134864.044408:0:5750:0:(client.c:2701:ptlrpc_set_wait()) set 0000000020669351 going to sleep for 11 seconds 00000100:00100000:1.0:1783134864.044430:0:5765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384358528 00000100:00100000:1.0:1783134864.044433:0:5765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384358528 00000100:00100000:1.0:1783134864.044459:0:5765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1783134864.044465:0:5765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000047dce69a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88a2002e-2ea7-4f07-912a-8d001832cfc0+12:5750:x1869752384358528:12345-0@lo:501: 00000100:00100000:1.0:1783134864.044719:0:5765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000047dce69a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88a2002e-2ea7-4f07-912a-8d001832cfc0+12:5750:x1869752384358528:12345-0@lo:501: Request processed in 255us (352us total) trans 0 rc 0/0 00000100:00100000:1.0:1783134864.044724:0:5765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1783134864.044757:0:5750:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000b93b9cdc pname:cluuid:pid:xid:nid:opc:job mount.lustre:88a2002e-2ea7-4f07-912a-8d001832cfc0:5750:1869752384358528:0@lo:501: 00000100:00100000:3.0:1783134864.044776:0:5750:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000b93b9cdc pname:cluuid:pid:xid:nid:opc:job mount.lustre:88a2002e-2ea7-4f07-912a-8d001832cfc0:5750:1869752384358656:0@lo:503: 00000100:00100000:3.0:1783134864.044801:0:5750:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783134864.044836:0:5750:0:(client.c:2701:ptlrpc_set_wait()) set 0000000020669351 going to sleep for 11 seconds 00000100:00100000:1.0:1783134864.044857:0:5762:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384358656 00000100:00100000:1.0:1783134864.044859:0:5762:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384358656 00000100:00100000:1.0:1783134864.044878:0:5762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1783134864.044940:0:5762:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001aa19413 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88a2002e-2ea7-4f07-912a-8d001832cfc0+12:5750:x1869752384358656:12345-0@lo:503: 00000100:00100000:1.0:1783134864.045219:0:5762:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001aa19413 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88a2002e-2ea7-4f07-912a-8d001832cfc0+12:5750:x1869752384358656:12345-0@lo:503: Request processed in 335us (416us total) trans 0 rc 0/0 00000100:00100000:1.0:1783134864.045231:0:5762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1783134864.045347:0:5750:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000b93b9cdc pname:cluuid:pid:xid:nid:opc:job mount.lustre:88a2002e-2ea7-4f07-912a-8d001832cfc0:5750:1869752384358656:0@lo:503: 00000100:00100000:1.0:1783134864.045663:0:5797:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000156a3468 pname:cluuid:pid:xid:nid:opc:job llog_process_th:88a2002e-2ea7-4f07-912a-8d001832cfc0:5797:1869752384358784:0@lo:502: 00000100:00100000:1.0:1783134864.045687:0:5797:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783134864.045731:0:5797:0:(client.c:2701:ptlrpc_set_wait()) set 00000000f0856e35 going to sleep for 11 seconds 00000100:00100000:3.0:1783134864.045753:0:5765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384358784 00000100:00100000:3.0:1783134864.045756:0:5765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384358784 00000100:00100000:3.0:1783134864.045777:0:5765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1783134864.045782:0:5765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009027ef26 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88a2002e-2ea7-4f07-912a-8d001832cfc0+12:5797:x1869752384358784:12345-0@lo:502: 00000100:00100000:3.0:1783134864.046011:0:5765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009027ef26 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88a2002e-2ea7-4f07-912a-8d001832cfc0+12:5797:x1869752384358784:12345-0@lo:502: Request processed in 229us (323us total) trans 0 rc 0/0 00000100:00100000:3.0:1783134864.046016:0:5765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1783134864.046061:0:5797:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000156a3468 pname:cluuid:pid:xid:nid:opc:job llog_process_th:88a2002e-2ea7-4f07-912a-8d001832cfc0:5797:1869752384358784:0@lo:502: 00000020:01000004:1.0:1783134864.046113:0:5797:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:1.0:1783134864.046125:0:5797:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (00000000bac4c3c0) 00000020:00000080:1.0:1783134864.046142:0:5797:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type lwp with refcount 2 00000020:01000004:1.0:1783134864.046384:0:5797:0:(tgt_mount.c:153:server_get_mount()) get mount 000000003c103942 from lustre-MDT0000, refs=4 00000020:01000004:1.0:1783134864.046389:0:5797:0:(tgt_mount.c:187:server_put_mount()) put mount 000000003c103942 from lustre-MDT0000, refs=4 00000020:01000004:1.0:1783134864.046392:0:5797:0:(obd_mount.c:701:lustre_put_lsi()) put 000000003c103942 4 00010000:00080000:1.0:1783134864.046427:0:5797:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000e4a55516@lustre-MDT0000-lwp-MDT0000: add connection 192.168.201.141@tcp at head 00010000:00010000:1.0:1783134864.048255:0:5797:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-1 is initialized 00000020:00000080:1.0:1783134864.048400:0:5797:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:1.0:1783134864.048424:0:5797:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1783134864.048434:0:5797:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0xd6c4b8f05867e366 00000100:00080000:1.0:1783134864.048445:0:5797:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1783134864.048449:0:5797:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 00000000e4a55516 using connection 192.168.201.141@tcp/0@lo 00000100:00100000:1.0:1783134864.048478:0:5797:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000156a3468 x1869752384358912/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1783134864.048540:0:3285:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000156a3468 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3285:1869752384358912:0@lo:38: 00000100:00080000:1.0:1783134864.048625:0:5797:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1783134864.048698:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783134864.048867:0:5769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384358912 00000100:00100000:1.0:1783134864.048872:0:5769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384358912 00000100:00100000:1.0:1783134864.048962:0:5769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1783134864.048967:0:5769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000566a7020 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3285:x1869752384358912:12345-0@lo:38: 00000100:00100000:1.0:1783134864.049007:0:5769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000566a7020 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3285:x1869752384358912:12345-0@lo:38: Request processed in 40us (310us total) trans 0 rc -11/-11 00000100:00100000:1.0:1783134864.049018:0:5769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1783134864.049081:0:3285:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1783134864.049088:0:3285:0:(import.c:65:import_set_state_nolock()) 00000000e4a55516 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1783134864.049093:0:3285:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:2.0:1783134864.049096:0:3285:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000156a3468 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3285:1869752384358912:0@lo:38: 00000100:00100000:1.0:1783134864.049398:0:5797:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000007d5db830 pname:cluuid:pid:xid:nid:opc:job llog_process_th:88a2002e-2ea7-4f07-912a-8d001832cfc0:5797:1869752384359040:0@lo:502: 00000100:00100000:1.0:1783134864.049430:0:5797:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783134864.049461:0:5797:0:(client.c:2701:ptlrpc_set_wait()) set 00000000f0856e35 going to sleep for 11 seconds 00000100:00100000:0.0:1783134864.049488:0:5762:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384359040 00000100:00100000:0.0:1783134864.049492:0:5762:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384359040 00000100:00100000:0.0:1783134864.049523:0:5762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1783134864.049527:0:5762:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000003ff106c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88a2002e-2ea7-4f07-912a-8d001832cfc0+12:5797:x1869752384359040:12345-0@lo:502: 00000100:00100000:0.0:1783134864.049744:0:5762:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000003ff106c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88a2002e-2ea7-4f07-912a-8d001832cfc0+12:5797:x1869752384359040:12345-0@lo:502: Request processed in 216us (313us total) trans 0 rc 0/0 00000100:00100000:0.0:1783134864.049752:0:5762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1783134864.049765:0:5797:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000007d5db830 pname:cluuid:pid:xid:nid:opc:job llog_process_th:88a2002e-2ea7-4f07-912a-8d001832cfc0:5797:1869752384359040:0@lo:502: 00000040:00080000:1.0:1783134864.049786:0:5797:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000020:01000000:0.0:1783134864.049872:0:5750:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-20 (rc=0) 10000000:01000000:0.0:1783134864.049893:0:5750:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.201.141@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1783134864.049913:0:5750:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.141@tcp lock: 000000003428774e/0xd6c4b8f05867e351 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd6c4b8f05867e358 expref: -99 pid: 5750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134864.049923:0:5750:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.141@tcp lock: 000000003428774e/0xd6c4b8f05867e351 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd6c4b8f05867e358 expref: -99 pid: 5750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1783134864.049963:0:5750:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1783134864.049966:0:5750:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1783134864.049967:0:5750:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1783134864.049969:0:5750:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1783134864.049970:0:5750:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1783134864.049971:0:5750:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1783134864.049972:0:5750:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1783134864.049974:0:5750:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1783134864.049975:0:5750:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1783134864.049977:0:5750:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1783134864.049982:0:5750:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1783134864.049983:0:5750:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1783134864.049987:0:5750:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020065 00000020:01000004:0.0:1783134864.049989:0:5750:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1783134864.049990:0:5750:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1783134864.049991:0:5750:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1783134864.049992:0:5750:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1783134864.049993:0:5750:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1783134864.049994:0:5750:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1783134864.049995:0:5750:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1783134864.049996:0:5750:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1783134864.049997:0:5750:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1783134864.049998:0:5750:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1783134864.049999:0:5750:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1783134864.050000:0:5750:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1783134864.050012:0:5750:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:0.0:1783134864.050019:0:5750:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000003d589276 pname:cluuid:pid:xid:nid:opc:job mount.lustre:88a2002e-2ea7-4f07-912a-8d001832cfc0:5750:1869752384359168:0@lo:253: 00000100:00100000:0.0:1783134864.050048:0:5750:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783134864.050066:0:5750:0:(client.c:2701:ptlrpc_set_wait()) set 00000000fe9c45f1 going to sleep for 11 seconds 00000100:00100000:1.0:1783134864.050079:0:5765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384359168 00000100:00100000:1.0:1783134864.050084:0:5765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384359168 00000100:00100000:1.0:1783134864.050117:0:5765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1783134864.050124:0:5765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000833cf452 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88a2002e-2ea7-4f07-912a-8d001832cfc0+12:5750:x1869752384359168:12345-0@lo:253: 20000000:01000000:1.0:1783134864.050142:0:5765:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:1.0:1783134864.050155:0:5765:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:3.0:1783134864.064865:0:5765:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1783134864.064918:0:5765:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:1.0:1783134864.064960:0:5785:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1783134864.064965:0:5785:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1783134864.064984:0:5785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 0000000081970a61/0xd6c4b8f05867e36d lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134864.065004:0:5785:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 0000000049b9c118/0xd6c4b8f05867e33c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd6c4b8f05867e335 expref: 12 pid: 5765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134864.065012:0:5785:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 0000000081970a61/0xd6c4b8f05867e36d lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134864.065050:0:5785:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 0000000049b9c118/0xd6c4b8f05867e33c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd6c4b8f05867e335 expref: 12 pid: 5765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134864.065081:0:5785:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 0000000049b9c118/0xd6c4b8f05867e33c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd6c4b8f05867e335 expref: 12 pid: 5765 timeout: 296 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783134864.065110:0:5785:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000007d5db830 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5785:1869752384359296:0@lo:104: 00000100:00100000:1.0:1783134864.065175:0:5785:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783134864.065243:0:5785:0:(client.c:2701:ptlrpc_set_wait()) set 00000000f0856e35 going to sleep for 11 seconds 00000100:00100000:3.0:1783134864.065547:0:5752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384359296 00000100:00100000:3.0:1783134864.065555:0:5752:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384359296 00000100:00100000:3.0:1783134864.065613:0:5752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1783134864.065621:0:5752:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000035d8cb7d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:88a2002e-2ea7-4f07-912a-8d001832cfc0+3:5785:x1869752384359296:12345-0@lo:104: 00010000:00010000:3.0:1783134864.065633:0:5752:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.141@tcp lock: 0000000023118ea0/0xd6c4b8f05867e335 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xd6c4b8f05867e33c expref: -99 pid: 5750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134864.065687:0:5752:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1783134864.065693:0:5752:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000035d8cb7d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:88a2002e-2ea7-4f07-912a-8d001832cfc0+3:5785:x1869752384359296:12345-0@lo:104: Request processed in 73us (518us total) trans 0 rc 0/0 00000100:00100000:3.0:1783134864.065700:0:5752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1783134864.065705:0:5785:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000007d5db830 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5785:1869752384359296:0@lo:104: 00010000:00010000:0.0:1783134864.065721:0:5785:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 0000000081970a61/0xd6c4b8f05867e36d lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134864.065764:0:5757:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783134864.065769:0:5757:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.141@tcp lock: 0000000023118ea0/0xd6c4b8f05867e335 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xd6c4b8f05867e33c expref: -99 pid: 5750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134864.065786:0:5757:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000023118ea0 already unused, calling callback (00000000bd935ddf) 10000000:00010000:2.0:1783134864.065788:0:5757:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.141@tcp lock: 0000000023118ea0/0xd6c4b8f05867e335 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xd6c4b8f05867e33c expref: -99 pid: 5750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134864.065795:0:5757:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.141@tcp lock: 0000000023118ea0/0xd6c4b8f05867e335 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xd6c4b8f05867e33c expref: -99 pid: 5750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783134864.065800:0:5757:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.141@tcp lock: 0000000023118ea0/0xd6c4b8f05867e335 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xd6c4b8f05867e33c expref: -99 pid: 5750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783134864.065805:0:5757:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1783134864.065836:0:5757:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.141@tcp lock: 0000000023118ea0/0xd6c4b8f05867e335 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd6c4b8f05867e33c expref: -99 pid: 5750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134864.065843:0:5757:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1783134864.065956:0:3287:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000cdccbd0a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:88a2002e-2ea7-4f07-912a-8d001832cfc0:3287:1869752384359424:0@lo:103: 00000100:00100000:0.0:1783134864.065985:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1783134864.066032:0:5757:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.141@tcp lock: 0000000023118ea0/0xd6c4b8f05867e335 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd6c4b8f05867e33c expref: -99 pid: 5750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134864.066039:0:5757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.141@tcp lock: 0000000023118ea0/0xd6c4b8f05867e335 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd6c4b8f05867e33c expref: -99 pid: 5750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134864.066054:0:5757:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783134864.066056:0:5757:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783134864.066058:0:5757:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783134864.066250:0:5754:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384359424 00000100:00100000:0.0:1783134864.066255:0:5754:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384359424 00010000:00010000:0.0:1783134864.066272:0:5754:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 0000000049b9c118/0xd6c4b8f05867e33c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd6c4b8f05867e335 expref: 13 pid: 5765 timeout: 296 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783134864.066350:0:5754:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1783134864.066356:0:5754:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000239edbd6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:88a2002e-2ea7-4f07-912a-8d001832cfc0+13:3287:x1869752384359424:12345-0@lo:103: 00010000:00010000:0.0:1783134864.066366:0:5754:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783134864.066376:0:5754:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 0000000049b9c118/0xd6c4b8f05867e33c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd6c4b8f05867e335 expref: 13 pid: 5765 timeout: 296 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134864.066385:0:5754:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 0000000049b9c118/0xd6c4b8f05867e33c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd6c4b8f05867e335 expref: 13 pid: 5765 timeout: 296 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134864.066397:0:5754:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000049b9c118/0xd6c4b8f05867e33c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd6c4b8f05867e335 expref: 13 pid: 5765 timeout: 296 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134864.066410:0:5754:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 0000000081970a61/0xd6c4b8f05867e36d lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134864.066417:0:5754:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000081970a61/0xd6c4b8f05867e36d lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1783134864.066429:0:5754:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001465305s 00010000:00010000:0.0:1783134864.066465:0:5754:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000081970a61/0xd6c4b8f05867e36d lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134864.066472:0:5754:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000081970a61/0xd6c4b8f05867e36d lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134864.066477:0:5754:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 0000000081970a61/0xd6c4b8f05867e36d lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134864.066483:0:5754:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 0000000081970a61/0xd6c4b8f05867e36d lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134864.066488:0:5754:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000081970a61 already unused, calling callback (000000000c24fdc4) 00010000:00010000:0.0:1783134864.066492:0:5754:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 0000000081970a61/0xd6c4b8f05867e36d lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134864.066498:0:5754:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 0000000081970a61/0xd6c4b8f05867e36d lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134864.066518:0:5754:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 0000000081970a61/0xd6c4b8f05867e36d lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134864.066527:0:5754:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783134864.066576:0:5754:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000239edbd6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:88a2002e-2ea7-4f07-912a-8d001832cfc0+12:3287:x1869752384359424:12345-0@lo:103: Request processed in 220us (590us total) trans 0 rc 0/0 00000100:00100000:0.0:1783134864.066583:0:5754:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1783134864.066635:0:3287:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000cdccbd0a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:88a2002e-2ea7-4f07-912a-8d001832cfc0:3287:1869752384359424:0@lo:103: 00010000:00010000:2.0:1783134864.066708:0:5785:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 0000000081970a61/0xd6c4b8f05867e36d lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134864.066716:0:5785:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 0000000081970a61/0xd6c4b8f05867e36d lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134864.066731:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000081970a61/0xd6c4b8f05867e36d lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783134864.072796:0:5765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000833cf452 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88a2002e-2ea7-4f07-912a-8d001832cfc0+11:5750:x1869752384359168:12345-0@lo:253: Request processed in 22665us (22739us total) trans 0 rc 0/0 00000100:00100000:2.0:1783134864.072811:0:5765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1783134864.072817:0:5750:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000003d589276 pname:cluuid:pid:xid:nid:opc:job mount.lustre:88a2002e-2ea7-4f07-912a-8d001832cfc0:5750:1869752384359168:0@lo:253: 10000000:01000000:0.0:1783134864.072831:0:5750:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:0.0:1783134864.072834:0:5750:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1783134864.072835:0:5750:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1783134864.072836:0:5750:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1783134864.072837:0:5750:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1783134864.072839:0:5750:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1783134864.072840:0:5750:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1783134864.072841:0:5750:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1783134864.072842:0:5750:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1783134864.072843:0:5750:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1783134864.072845:0:5750:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1783134864.072846:0:5750:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1783134864.072847:0:5750:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1783134864.072861:0:5750:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:0.0:1783134864.076493:0:5750:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:0.0:1783134864.076821:0:5750:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:0.0:1783134864.076981:0:5750:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:0.0:1783134864.077116:0:5750:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:0.0:1783134864.077345:0:5750:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:0.0:1783134864.077520:0:5750:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:1.0:1783134864.078390:0:5750:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:1.0:1783134864.078571:0:5750:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:1.0:1783134864.078896:0:5750:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:1.0:1783134864.079088:0:5750:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:1.0:1783134864.079310:0:5750:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:1.0:1783134864.079485:0:5750:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 40000000:02000000:2.0:1783134864.108004:0:5750:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt 00000040:01000000:2.0:1783134864.133046:0:5750:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:1.0:1783134864.133115:0:5802:0:(update_trans.c:1530:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 0 00000020:00080000:1.0:1783134864.133118:0:5802:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000040:01000000:1.0:1783134864.133344:0:5803:0:(llog_osd.c:2237:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:2.0:1783134864.138997:0:5750:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:2.0:1783134864.139602:0:5750:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:2.0:1783134864.140121:0:5750:0:(mdd_device.c:553:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:2.0:1783134864.140130:0:5750:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:3.0:1783134864.141365:0:5750:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1783134864.142413:0:5750:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:3.0:1783134864.143023:0:5750:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:3.0:1783134864.143060:0:5750:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:3.0:1783134864.143406:0:5750:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:3.0:1783134864.143625:0:5750:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x11:0x0] (8/8/4) registered 00100000:10000000:3.0:1783134864.144959:0:5750:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00100000:10000000:3.0:1783134864.145047:0:5750:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00100000:10000000:3.0:1783134864.145170:0:5750:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00100000:10000000:3.0:1783134864.145271:0:5750:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00100000:10000000:3.0:1783134864.145711:0:5750:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00100000:10000000:3.0:1783134864.145830:0:5750:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00100000:10000000:3.0:1783134864.145976:0:5750:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00100000:10000000:3.0:1783134864.146117:0:5750:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00100000:10000000:3.0:1783134864.146294:0:5750:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00100000:10000000:3.0:1783134864.146438:0:5750:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:3.0:1783134864.146612:0:5750:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00100000:10000000:3.0:1783134864.146738:0:5750:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00100000:10000000:3.0:1783134864.146837:0:5750:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00100000:10000000:3.0:1783134864.146936:0:5750:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00100000:10000000:3.0:1783134864.147059:0:5750:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00100000:10000000:3.0:1783134864.147190:0:5750:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00100000:10000000:3.0:1783134864.147512:0:5750:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00100000:10000000:3.0:1783134864.148066:0:5750:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00100000:10000000:3.0:1783134864.148238:0:5750:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00100000:10000000:3.0:1783134864.148402:0:5750:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00100000:10000000:3.0:1783134864.148522:0:5750:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:3.0:1783134864.148715:0:5750:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00100000:10000000:3.0:1783134864.148882:0:5750:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00100000:10000000:3.0:1783134864.149024:0:5750:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:3.0:1783134864.149187:0:5750:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00100000:10000000:3.0:1783134864.149453:0:5750:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00100000:10000000:3.0:1783134864.149625:0:5750:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00100000:10000000:3.0:1783134864.149769:0:5750:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00100000:10000000:3.0:1783134864.149998:0:5750:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:3.0:1783134864.150139:0:5750:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:3.0:1783134864.150454:0:5750:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:3.0:1783134864.150686:0:5750:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:3.0:1783134864.150958:0:5750:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000040:00080000:1.0:1783134864.159010:0:5803:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000001:00080000:2.0:1783134864.186989:0:5750:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:2.0:1783134864.187029:0:5750:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffb1f241c53988 00100000:10000000:2.0:1783134864.187037:0:5750:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:3.0:1783134864.188850:0:5750:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1783134864.188865:0:5750:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.141@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1783134864.188882:0:5750:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=45 00000080:00000004:3.0:1783134864.188898:0:5750:0:(super25.c:187:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00000040:00080000:2.0:1783134864.211981:0:5803:0:(llog.c:857:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1783134864.212110:0:5803:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:2.0:1783134864.212115:0:5803:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00010000:00010000:1.0:1783134864.643624:0:5758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783134865.670713:0:5757:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1783134866.404220:0:6045:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg141-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1783134866.694232:0:5758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783134867.715999:0:5757:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783134868.739826:0:5758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1783134869.123429:0:36:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1783134869.123439:0:36:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1783134869.123442:0:36:0:(import.c:65:import_set_state_nolock()) 00000000e4a55516 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1783134869.123453:0:36:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 00000000e4a55516 using connection 192.168.201.141@tcp/0@lo 00000100:00100000:1.0:1783134869.123484:0:36:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000004597cef7 x1869752384359680/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1783134869.123507:0:3288:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000cea2750d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:88a2002e-2ea7-4f07-912a-8d001832cfc0:3288:1869752384359552:0@lo:400: 00000100:00100000:1.0:1783134869.123516:0:3285:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000004597cef7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3285:1869752384359680:0@lo:38: 00000100:00100000:2.0:1783134869.123713:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783134869.123714:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783134869.123806:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384359680 00000100:00100000:2.0:1783134869.123814:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384359680 00000100:00100000:2.0:1783134869.123844:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1783134869.123850:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000fbf46381 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3285:x1869752384359680:12345-0@lo:38: 00000100:00100000:3.0:1783134869.123893:0:5762:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384359552 00000100:00100000:3.0:1783134869.123907:0:5762:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384359552 00000100:00100000:3.0:1783134869.123939:0:5762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1783134869.123945:0:5762:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000bb24b23b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88a2002e-2ea7-4f07-912a-8d001832cfc0+11:3288:x1869752384359552:12345-0@lo:400: 00000100:00100000:3.0:1783134869.123992:0:5762:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000bb24b23b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88a2002e-2ea7-4f07-912a-8d001832cfc0+11:3288:x1869752384359552:12345-0@lo:400: Request processed in 48us (280us total) trans 0 rc 0/0 00000100:00100000:3.0:1783134869.123999:0:5762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1783134869.124022:0:3288:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000cea2750d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:88a2002e-2ea7-4f07-912a-8d001832cfc0:3288:1869752384359552:0@lo:400: 00010000:00080000:1.0:1783134869.124161:0:5771:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 151 last 0 00000020:00000080:1.0:1783134869.124195:0:5771:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0xd6c4b8f05867e374 00000004:00100000:1.0:1783134869.124232:0:5771:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1783134869.124340:0:5771:0:(import.c:65:import_set_state_nolock()) 00000000863bb811 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1783134869.124381:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000fbf46381 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1869752384359680:12345-0@lo:38: Request processed in 529us (666us total) trans 0 rc 0/0 00000100:00100000:1.0:1783134869.124387:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1783134869.124403:0:3285:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@000000004597cef7 x1869752384359680/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1783134879 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1783134869.124428:0:3285:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 1 00000100:00080000:2.0:1783134869.124434:0:3285:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:2.0:1783134869.124438:0:3285:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1783134869.124440:0:3285:0:(import.c:65:import_set_state_nolock()) 00000000e4a55516 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1783134869.124445:0:3285:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000004597cef7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3285:1869752384359680:0@lo:38: 00000020:00000080:1.0:1783134869.404207:0:6246:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fffab6e5a30 20000000:00000080:1.0:1783134869.404226:0:6246:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9fe9ca88a800 uarg=0000000000000000 20000000:01000000:1.0:1783134869.404260:0:6246:0:(mgs_llog.c:6177:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:1.0:1783134869.404267:0:6246:0:(mgs_llog.c:4638:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:1.0:1783134869.404273:0:6246:0:(mgs_llog.c:1376:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:1.0:1783134869.404542:0:6246:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:02000000:1.0:1783134869.404552:0:6246:0:(mgs_llog.c:4111:mgs_wlp_lcfg()) Modifying parameter general.debug_raw_pointers=Y in log params 00000040:00080000:1.0:1783134869.407596:0:6246:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1783134869.407789:0:6246:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:1.0:1783134869.407837:0:6246:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 112 off8528 00000040:00080000:1.0:1783134869.407883:0:6246:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 224 off8752 10000000:01000000:1.0:1783134869.407900:0:6246:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1783134869.407917:0:6246:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 0000000081970a61/0xd6c4b8f05867e37b lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134869.407933:0:6246:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000e279b816/0xd6c4b8f05867e34a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd6c4b8f05867e343 expref: 10 pid: 5765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134869.407938:0:6246:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 0000000081970a61/0xd6c4b8f05867e37b lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134869.407967:0:6246:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000e279b816/0xd6c4b8f05867e34a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd6c4b8f05867e343 expref: 10 pid: 5765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134869.407985:0:6246:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000e279b816/0xd6c4b8f05867e34a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd6c4b8f05867e343 expref: 10 pid: 5765 timeout: 301 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783134869.407996:0:6246:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000cea2750d pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6246:1869752384359808:0@lo:104: 00000100:00100000:1.0:1783134869.408046:0:6246:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783134869.408124:0:6246:0:(client.c:2701:ptlrpc_set_wait()) set 000000001195757c going to sleep for 11 seconds 00000100:00100000:0.0:1783134869.408162:0:5753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384359808 00000100:00100000:0.0:1783134869.408167:0:5753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384359808 00000100:00100000:0.0:1783134869.408204:0:5753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1783134869.408218:0:5753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000440245e8 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:88a2002e-2ea7-4f07-912a-8d001832cfc0+3:6246:x1869752384359808:12345-0@lo:104: 00010000:00010000:0.0:1783134869.408227:0:5753:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.141@tcp lock: 000000000591dbd7/0xd6c4b8f05867e343 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xd6c4b8f05867e34a expref: -99 pid: 5750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134869.408275:0:5753:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1783134869.408298:0:5753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000440245e8 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:88a2002e-2ea7-4f07-912a-8d001832cfc0+3:6246:x1869752384359808:12345-0@lo:104: Request processed in 81us (252us total) trans 0 rc 0/0 00000100:00100000:0.0:1783134869.408306:0:5753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1783134869.408339:0:6246:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000cea2750d pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6246:1869752384359808:0@lo:104: 00010000:00010000:1.0:1783134869.408354:0:6246:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 0000000081970a61/0xd6c4b8f05867e37b lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134869.408377:0:5757:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783134869.408385:0:5757:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.141@tcp lock: 000000000591dbd7/0xd6c4b8f05867e343 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xd6c4b8f05867e34a expref: -99 pid: 5750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134869.408394:0:5757:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000000591dbd7 already unused, calling callback (00000000bd935ddf) 10000000:00010000:3.0:1783134869.408397:0:5757:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.141@tcp lock: 000000000591dbd7/0xd6c4b8f05867e343 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xd6c4b8f05867e34a expref: -99 pid: 5750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134869.408405:0:5757:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.141@tcp lock: 000000000591dbd7/0xd6c4b8f05867e343 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xd6c4b8f05867e34a expref: -99 pid: 5750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1783134869.408411:0:5757:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.141@tcp lock: 000000000591dbd7/0xd6c4b8f05867e343 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xd6c4b8f05867e34a expref: -99 pid: 5750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783134869.408428:0:5757:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1783134869.408459:0:5757:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.141@tcp lock: 000000000591dbd7/0xd6c4b8f05867e343 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd6c4b8f05867e34a expref: -99 pid: 5750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134869.408479:0:5757:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1783134869.408512:0:5757:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.141@tcp lock: 000000000591dbd7/0xd6c4b8f05867e343 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd6c4b8f05867e34a expref: -99 pid: 5750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134869.408520:0:5757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.141@tcp lock: 000000000591dbd7/0xd6c4b8f05867e343 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd6c4b8f05867e34a expref: -99 pid: 5750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783134869.408527:0:3289:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000b93b9cdc pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:88a2002e-2ea7-4f07-912a-8d001832cfc0:3289:1869752384359936:0@lo:103: 00010000:00010000:3.0:1783134869.408538:0:5757:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783134869.408542:0:5757:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783134869.408545:0:5757:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783134869.408557:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783134869.408583:0:5756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384359936 00000100:00100000:1.0:1783134869.408587:0:5756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384359936 00010000:00010000:1.0:1783134869.408602:0:5756:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000e279b816/0xd6c4b8f05867e34a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd6c4b8f05867e343 expref: 11 pid: 5765 timeout: 301 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783134869.408636:0:5756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1783134869.408643:0:5756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003d589276 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:88a2002e-2ea7-4f07-912a-8d001832cfc0+11:3289:x1869752384359936:12345-0@lo:103: 00010000:00010000:1.0:1783134869.408652:0:5756:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783134869.408656:0:5756:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000e279b816/0xd6c4b8f05867e34a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd6c4b8f05867e343 expref: 11 pid: 5765 timeout: 301 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134869.408664:0:5756:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000e279b816/0xd6c4b8f05867e34a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd6c4b8f05867e343 expref: 11 pid: 5765 timeout: 301 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134869.408675:0:5756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000e279b816/0xd6c4b8f05867e34a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd6c4b8f05867e343 expref: 11 pid: 5765 timeout: 301 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134869.408685:0:5756:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 0000000081970a61/0xd6c4b8f05867e37b lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134869.408698:0:5756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000081970a61/0xd6c4b8f05867e37b lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134869.408709:0:5756:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000081970a61/0xd6c4b8f05867e37b lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134869.408715:0:5756:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000081970a61/0xd6c4b8f05867e37b lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134869.408720:0:5756:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 0000000081970a61/0xd6c4b8f05867e37b lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134869.408726:0:5756:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 0000000081970a61/0xd6c4b8f05867e37b lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134869.408731:0:5756:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000081970a61 already unused, calling callback (000000000c24fdc4) 00010000:00010000:1.0:1783134869.408734:0:5756:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 0000000081970a61/0xd6c4b8f05867e37b lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134869.408741:0:5756:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 0000000081970a61/0xd6c4b8f05867e37b lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134869.408756:0:5756:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 0000000081970a61/0xd6c4b8f05867e37b lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134869.408764:0:5756:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1783134869.408780:0:6246:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 0000000081970a61/0xd6c4b8f05867e37b lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134869.408791:0:6246:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 0000000081970a61/0xd6c4b8f05867e37b lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134869.408797:0:6246:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000081970a61/0xd6c4b8f05867e37b lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783134869.408801:0:5756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003d589276 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:88a2002e-2ea7-4f07-912a-8d001832cfc0+10:3289:x1869752384359936:12345-0@lo:103: Request processed in 158us (243us total) trans 0 rc 0/0 00000100:00100000:1.0:1783134869.408819:0:5756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1783134869.409252:0:3289:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000b93b9cdc pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:88a2002e-2ea7-4f07-912a-8d001832cfc0:3289:1869752384359936:0@lo:103: 00010000:00010000:1.0:1783134869.764457:0:5758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783134870.792685:0:5757:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1783134871.811337:0:5767:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1783134871.811346:0:5767:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-mdtir-ffff9fe9e0d14800 from 3 10000000:01000000:1.0:1783134871.811351:0:5767:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1783134871.811391:0:5767:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.141@tcp lock: 000000001e5290b3/0xd6c4b8f05867e382 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134871.811403:0:5767:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.141@tcp lock: 000000001e5290b3/0xd6c4b8f05867e382 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134871.811413:0:5767:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.141@tcp lock: 000000001e5290b3/0xd6c4b8f05867e382 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783134871.811449:0:5767:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000cea2750d pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88a2002e-2ea7-4f07-912a-8d001832cfc0:5767:1869752384360064:0@lo:101: 00000100:00100000:1.0:1783134871.811515:0:5767:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1783134871.812570:0:5758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783134871.813321:0:5765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384360064 00000100:00100000:0.0:1783134871.813331:0:5765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384360064 00000100:00100000:1.0:1783134871.813352:0:5767:0:(client.c:2701:ptlrpc_set_wait()) set 00000000992d3f91 going to sleep for 11 seconds 00000100:00100000:0.0:1783134871.813384:0:5765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1783134871.813393:0:5765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000bbc59276 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88a2002e-2ea7-4f07-912a-8d001832cfc0+10:5767:x1869752384360064:12345-0@lo:101: 00010000:00010000:0.0:1783134871.813407:0:5765:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783134871.813423:0:5765:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000069027ef1/0xd6c4b8f05867e389 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd6c4b8f05867e382 expref: -99 pid: 5765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134871.813461:0:5765:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000069027ef1/0xd6c4b8f05867e389 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd6c4b8f05867e382 expref: 11 pid: 5765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134871.813470:0:5765:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000069027ef1/0xd6c4b8f05867e389 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd6c4b8f05867e382 expref: 11 pid: 5765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134871.813478:0:5765:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000069027ef1, rc 0) 00000100:00100000:0.0:1783134871.813542:0:5765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000bbc59276 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88a2002e-2ea7-4f07-912a-8d001832cfc0+11:5767:x1869752384360064:12345-0@lo:101: Request processed in 150us (2028us total) trans 0 rc 0/0 00000100:00100000:0.0:1783134871.813556:0:5765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1783134871.813766:0:5767:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000cea2750d pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88a2002e-2ea7-4f07-912a-8d001832cfc0:5767:1869752384360064:0@lo:101: 00010000:00010000:1.0:1783134871.813782:0:5767:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.141@tcp lock: 000000001e5290b3/0xd6c4b8f05867e382 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd6c4b8f05867e389 expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134871.813792:0:5767:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.141@tcp lock: 000000001e5290b3/0xd6c4b8f05867e382 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd6c4b8f05867e389 expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783134871.813844:0:5767:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000cea2750d pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88a2002e-2ea7-4f07-912a-8d001832cfc0:5767:1869752384360192:0@lo:256: 00000100:00100000:1.0:1783134871.813878:0:5767:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783134871.813900:0:5767:0:(client.c:2701:ptlrpc_set_wait()) set 00000000992d3f91 going to sleep for 11 seconds 00000100:00100000:3.0:1783134871.813926:0:5762:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384360192 00000100:00100000:3.0:1783134871.813932:0:5762:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384360192 00000100:00100000:3.0:1783134871.813968:0:5762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1783134871.813973:0:5762:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000dfc15cda pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88a2002e-2ea7-4f07-912a-8d001832cfc0+11:5767:x1869752384360192:12345-0@lo:256: 20000000:01000000:3.0:1783134871.813988:0:5762:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1783134871.814005:0:5762:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1783134871.814008:0:5762:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:3.0:1783134871.814102:0:5762:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000dfc15cda pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88a2002e-2ea7-4f07-912a-8d001832cfc0+11:5767:x1869752384360192:12345-0@lo:256: Request processed in 128us (224us total) trans 0 rc 0/0 00000100:00100000:3.0:1783134871.814122:0:5762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1783134871.814202:0:5767:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000cea2750d pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88a2002e-2ea7-4f07-912a-8d001832cfc0:5767:1869752384360192:0@lo:256: 10000000:01000000:0.0:1783134871.814243:0:5767:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.201.141@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1783134871.814248:0:5767:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.141@tcp lock: 000000001e5290b3/0xd6c4b8f05867e382 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd6c4b8f05867e389 expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134871.814254:0:5767:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.141@tcp lock: 000000001e5290b3/0xd6c4b8f05867e382 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd6c4b8f05867e389 expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783134871.814260:0:5767:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1783134871.814261:0:5767:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff9fe9e0d14800 from 1 10000000:01000000:0.0:1783134871.814263:0:5767:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1783134871.814301:0:5767:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.141@tcp lock: 000000007a6c42c4/0xd6c4b8f05867e390 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134871.814306:0:5767:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.141@tcp lock: 000000007a6c42c4/0xd6c4b8f05867e390 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134871.814311:0:5767:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.141@tcp lock: 000000007a6c42c4/0xd6c4b8f05867e390 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783134871.814321:0:5767:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000004167da5b pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88a2002e-2ea7-4f07-912a-8d001832cfc0:5767:1869752384360320:0@lo:101: 00000100:00100000:0.0:1783134871.814341:0:5767:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783134871.814361:0:5767:0:(client.c:2701:ptlrpc_set_wait()) set 0000000029615959 going to sleep for 11 seconds 00000100:00100000:1.0:1783134871.814389:0:5765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384360320 00000100:00100000:1.0:1783134871.814395:0:5765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384360320 00000100:00100000:1.0:1783134871.814434:0:5765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1783134871.814441:0:5765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006469e0d4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88a2002e-2ea7-4f07-912a-8d001832cfc0+11:5767:x1869752384360320:12345-0@lo:101: 00010000:00010000:1.0:1783134871.814470:0:5765:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783134871.814483:0:5765:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000003fb7a6e9/0xd6c4b8f05867e397 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd6c4b8f05867e390 expref: -99 pid: 5765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134871.814495:0:5765:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000003fb7a6e9/0xd6c4b8f05867e397 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd6c4b8f05867e390 expref: 12 pid: 5765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134871.814501:0:5765:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000003fb7a6e9/0xd6c4b8f05867e397 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd6c4b8f05867e390 expref: 12 pid: 5765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134871.814506:0:5765:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000003fb7a6e9, rc 0) 00000100:00100000:1.0:1783134871.814533:0:5765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006469e0d4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88a2002e-2ea7-4f07-912a-8d001832cfc0+12:5767:x1869752384360320:12345-0@lo:101: Request processed in 94us (191us total) trans 0 rc 0/0 00000100:00100000:1.0:1783134871.814549:0:5765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1783134871.814565:0:5767:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000004167da5b pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88a2002e-2ea7-4f07-912a-8d001832cfc0:5767:1869752384360320:0@lo:101: 00010000:00010000:2.0:1783134871.814578:0:5767:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.141@tcp lock: 000000007a6c42c4/0xd6c4b8f05867e390 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd6c4b8f05867e397 expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134871.814586:0:5767:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.141@tcp lock: 000000007a6c42c4/0xd6c4b8f05867e390 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd6c4b8f05867e397 expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783134871.814638:0:5767:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000005385a5e7 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88a2002e-2ea7-4f07-912a-8d001832cfc0:5767:1869752384360448:0@lo:501: 00000100:00100000:2.0:1783134871.814666:0:5767:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783134871.814693:0:5767:0:(client.c:2701:ptlrpc_set_wait()) set 000000001f1427ca going to sleep for 11 seconds 00000100:00100000:3.0:1783134871.814743:0:5763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384360448 00000100:00100000:3.0:1783134871.814748:0:5763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384360448 00000100:00100000:3.0:1783134871.814776:0:5763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1783134871.814782:0:5763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000002f84741 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88a2002e-2ea7-4f07-912a-8d001832cfc0+12:5767:x1869752384360448:12345-0@lo:501: 00000100:00100000:3.0:1783134871.815067:0:5763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000002f84741 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88a2002e-2ea7-4f07-912a-8d001832cfc0+12:5767:x1869752384360448:12345-0@lo:501: Request processed in 285us (400us total) trans 0 rc 0/0 00000100:00100000:3.0:1783134871.815074:0:5763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1783134871.815132:0:5767:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000005385a5e7 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88a2002e-2ea7-4f07-912a-8d001832cfc0:5767:1869752384360448:0@lo:501: 00000100:00100000:2.0:1783134871.815159:0:5767:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000005385a5e7 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88a2002e-2ea7-4f07-912a-8d001832cfc0:5767:1869752384360576:0@lo:503: 00000100:00100000:2.0:1783134871.815198:0:5767:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783134871.815215:0:5767:0:(client.c:2701:ptlrpc_set_wait()) set 000000001f1427ca going to sleep for 11 seconds 00000100:00100000:1.0:1783134871.815244:0:5765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384360576 00000100:00100000:1.0:1783134871.815248:0:5765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384360576 00000100:00100000:1.0:1783134871.815303:0:5765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1783134871.815310:0:5765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a8831da7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88a2002e-2ea7-4f07-912a-8d001832cfc0+12:5767:x1869752384360576:12345-0@lo:503: 00000100:00100000:1.0:1783134871.815458:0:5765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a8831da7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88a2002e-2ea7-4f07-912a-8d001832cfc0+12:5767:x1869752384360576:12345-0@lo:503: Request processed in 149us (260us total) trans 0 rc 0/0 00000100:00100000:1.0:1783134871.815466:0:5765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1783134871.815558:0:5767:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000005385a5e7 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88a2002e-2ea7-4f07-912a-8d001832cfc0:5767:1869752384360576:0@lo:503: 00000100:00100000:3.0:1783134871.815848:0:6535:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@0000000034b18313 pname:cluuid:pid:xid:nid:opc:job llog_process_th:88a2002e-2ea7-4f07-912a-8d001832cfc0:6535:1869752384360704:0@lo:502: 00000100:00100000:3.0:1783134871.815900:0:6535:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783134871.815930:0:6535:0:(client.c:2701:ptlrpc_set_wait()) set 000000005fb3cfa8 going to sleep for 11 seconds 00000100:00100000:1.0:1783134871.815944:0:5763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384360704 00000100:00100000:1.0:1783134871.815953:0:5763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384360704 00000100:00100000:1.0:1783134871.815993:0:5763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1783134871.816000:0:5763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ef2c4a4c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88a2002e-2ea7-4f07-912a-8d001832cfc0+12:6535:x1869752384360704:12345-0@lo:502: 00000100:00100000:1.0:1783134871.816146:0:5763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ef2c4a4c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88a2002e-2ea7-4f07-912a-8d001832cfc0+12:6535:x1869752384360704:12345-0@lo:502: Request processed in 147us (247us total) trans 0 rc 0/0 00000100:00100000:1.0:1783134871.816155:0:5763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1783134871.816183:0:6535:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@0000000034b18313 pname:cluuid:pid:xid:nid:opc:job llog_process_th:88a2002e-2ea7-4f07-912a-8d001832cfc0:6535:1869752384360704:0@lo:502: 00000020:01000000:3.0:1783134871.816208:0:6535:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1783134871.816216:0:6535:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783134871.816219:0:6535:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1783134871.816227:0:6535:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9fe9e0d14800 00000020:00000080:3.0:1783134871.816229:0:6535:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1783134871.816266:0:6535:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9e0477100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:88a2002e-2ea7-4f07-912a-8d001832cfc0:6535:1869752384360832:0@lo:502: 00000100:00100000:2.0:1783134871.816369:0:6535:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783134871.816394:0:6535:0:(client.c:2701:ptlrpc_set_wait()) set ffff9fe9d29d2240 going to sleep for 11 seconds 00000100:00100000:1.0:1783134871.816410:0:5765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384360832 00000100:00100000:1.0:1783134871.816415:0:5765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384360832 00000100:00100000:1.0:1783134871.816462:0:5765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1783134871.816469:0:5765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9d1650c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88a2002e-2ea7-4f07-912a-8d001832cfc0+12:6535:x1869752384360832:12345-0@lo:502: 00000100:00100000:1.0:1783134871.816607:0:5765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9d1650c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88a2002e-2ea7-4f07-912a-8d001832cfc0+12:6535:x1869752384360832:12345-0@lo:502: Request processed in 125us (226us total) trans 0 rc 0/0 00000100:00100000:1.0:1783134871.816616:0:5765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1783134871.816632:0:6535:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9e0477100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:88a2002e-2ea7-4f07-912a-8d001832cfc0:6535:1869752384360832:0@lo:502: 00000020:01000000:3.0:1783134871.816656:0:6535:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1783134871.816661:0:6535:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783134871.816662:0:6535:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:3.0:1783134871.816665:0:6535:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000020:01000000:2.0:1783134871.816877:0:5767:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:2.0:1783134871.816896:0:5767:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.201.141@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1783134871.816904:0:5767:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.141@tcp lock: ffff9fe9c0030400/0xd6c4b8f05867e390 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd6c4b8f05867e397 expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134871.816915:0:5767:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.141@tcp lock: ffff9fe9c0030400/0xd6c4b8f05867e390 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd6c4b8f05867e397 expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1783134872.317435:0:6572:0:(obd_mount.c:914:lmd_print()) mount data: 00000020:01000004:3.0:1783134872.317439:0:6572:0:(obd_mount.c:917:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:3.0:1783134872.317590:0:6572:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff9fea01d1b000 00000020:01000004:3.0:1783134872.317605:0:6572:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:3.0:1783134872.317616:0:6572:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:3.0:1783134872.317628:0:6572:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff9fe9d0e80000) 00000020:00000080:3.0:1783134872.317644:0:6572:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1783134872.332695:0:6572:0:(scrub.c:229:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:2.0:1783134872.333052:0:6572:0:(scrub.c:229:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:2.0:1783134872.349463:0:6572:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:2.0:1783134872.353242:0:6572:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:2.0:1783134872.353275:0:6572:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:2.0:1783134872.353373:0:6572:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:2.0:1783134872.353402:0:6572:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:2.0:1783134872.353716:0:6572:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:2.0:1783134872.353727:0:6572:0:(osd_handler.c:1569:osd_obd_connect()) connect #0 00000020:00000080:2.0:1783134872.353737:0:6572:0:(genops.c:1406:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xd6c4b8f05867e3a5 00000020:01000004:2.0:1783134872.353745:0:6572:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:2.0:1783134872.353762:0:6572:0:(obd_mount.c:394:lustre_start_mgc()) MGC192.168.201.141@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1783134872.353765:0:6572:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.201.141@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1783134872.353769:0:6572:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0000 00000020:01000004:2.0:1783134872.353772:0:6572:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:2.0:1783134872.353780:0:6572:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff9fe9ca89cd40) 00000020:00000080:2.0:1783134872.353787:0:6572:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type ost with refcount 2 00000100:00100000:2.0:1783134872.354975:0:6572:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1783134872.355180:0:6572:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:2.0:1783134872.355186:0:6572:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:3.0:1783134872.355706:0:6572:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:3.0:1783134872.355713:0:6572:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:2.0:1783134872.355899:0:6572:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:2.0:1783134872.355913:0:6572:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:3.0:1783134872.357026:0:6572:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1783134872.357184:0:6572:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:3.0:1783134872.357190:0:6572:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:2.0:1783134872.357575:0:6572:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:2.0:1783134872.357583:0:6572:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:3.0:1783134872.370233:0:6572:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1783134872.370509:0:6572:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:3.0:1783134872.370516:0:6572:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:3.0:1783134872.371983:0:6572:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:3.0:1783134872.371993:0:6572:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:3.0:1783134872.372559:0:6572:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1783134872.372566:0:6572:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:3.0:1783134872.374915:0:6572:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1783134872.375079:0:6572:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:3.0:1783134872.375086:0:6572:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:3.0:1783134872.375595:0:6572:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:3.0:1783134872.375602:0:6572:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:3.0:1783134872.405600:0:6572:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1783134872.405793:0:6572:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:3.0:1783134872.405799:0:6572:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:3.0:1783134872.406938:0:6572:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:3.0:1783134872.406947:0:6572:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:3.0:1783134872.407323:0:6572:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:3.0:1783134872.407343:0:6572:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:3.0:1783134872.407348:0:6572:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.141@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:3.0:1783134872.420579:0:6572:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.141@tcp ctxt 0 is initialized 00000020:01000004:3.0:1783134872.420613:0:6572:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.201.141@tcp, index=0000, flags=0x20062 00000020:01000004:3.0:1783134872.420618:0:6572:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1783134872.420619:0:6572:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1783134872.420620:0:6572:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1783134872.420621:0:6572:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1783134872.420623:0:6572:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1783134872.420624:0:6572:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1783134872.420625:0:6572:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1783134872.420626:0:6572:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1783134872.420627:0:6572:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1783134872.420629:0:6572:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1783134872.420634:0:6572:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1783134872.420638:0:6572:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020062 00000020:01000004:3.0:1783134872.420640:0:6572:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1783134872.420641:0:6572:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1783134872.420642:0:6572:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1783134872.420643:0:6572:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1783134872.420644:0:6572:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1783134872.420644:0:6572:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1783134872.420645:0:6572:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1783134872.420646:0:6572:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1783134872.420647:0:6572:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1783134872.420647:0:6572:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1783134872.420648:0:6572:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1783134872.420672:0:6572:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:3.0:1783134872.420689:0:6572:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9e0477100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:88a2002e-2ea7-4f07-912a-8d001832cfc0:6572:1869752384360960:0@lo:253: 00000100:00100000:3.0:1783134872.420755:0:6572:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783134872.420807:0:6572:0:(client.c:2701:ptlrpc_set_wait()) set ffff9fe9e046e480 going to sleep for 11 seconds 00000100:00100000:1.0:1783134872.421505:0:5763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384360960 00000100:00100000:1.0:1783134872.421511:0:5763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384360960 00000100:00100000:1.0:1783134872.421546:0:5763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1783134872.421553:0:5763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9d1650850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88a2002e-2ea7-4f07-912a-8d001832cfc0+12:6572:x1869752384360960:12345-0@lo:253: 20000000:01000000:1.0:1783134872.421575:0:5763:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:1.0:1783134872.421578:0:5763:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0000, index=0 20000000:01000000:1.0:1783134872.421582:0:5763:0:(mgs_llog.c:867:mgs_set_index()) Set index for lustre-OST0000 to 0 20000000:01000000:1.0:1783134872.421585:0:5763:0:(mgs_llog.c:3853:mgs_write_log_ost()) writing new ost lustre-OST0000 00000040:00080000:1.0:1783134872.422328:0:5763:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1783134872.422532:0:5763:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 20000000:01000000:1.0:1783134872.422551:0:5763:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-OST0000 0xcf001 obdfilter lustre-OST0000_UUID (null) (null) 00000040:00080000:1.0:1783134872.422589:0:5763:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 128 off8544 20000000:01000000:1.0:1783134872.422598:0:5763:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-OST0000 0xcf003 dev type f (null) 00000040:00080000:1.0:1783134872.422629:0:5763:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 112 off8656 00000040:00080000:1.0:1783134872.422680:0:5763:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8880 00000040:00080000:1.0:1783134872.422978:0:5763:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 224 off11152 20000000:01000000:1.0:1783134872.422992:0:5763:0:(mgs_llog.c:3806:mgs_write_log_osc_to_lov()) add nid 192.168.201.141@tcp 20000000:01000000:1.0:1783134872.422993:0:5763:0:(mgs_llog.c:1536:record_base_raw()) lcfg (null) 0xcf005 192.168.201.141@tcp (null) (null) (null) 00000040:00080000:1.0:1783134872.423011:0:5763:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 88 off11240 20000000:01000000:1.0:1783134872.423015:0:5763:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:1.0:1783134872.423056:0:5763:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 144 off11384 20000000:01000000:1.0:1783134872.423061:0:5763:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf003 lustre-OST0000_UUID 192.168.201.141@tcp (null) (null) 00000040:00080000:1.0:1783134872.423090:0:5763:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 152 off11536 20000000:01000000:1.0:1783134872.423112:0:5763:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:1.0:1783134872.423139:0:5763:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 136 off11672 00000040:00080000:1.0:1783134872.423184:0:5763:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11896 00000040:00080000:1.0:1783134872.423869:0:5763:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].21, 224 off11952 20000000:01000000:1.0:1783134872.423885:0:5763:0:(mgs_llog.c:3806:mgs_write_log_osc_to_lov()) add nid 192.168.201.141@tcp 20000000:01000000:1.0:1783134872.423887:0:5763:0:(mgs_llog.c:1536:record_base_raw()) lcfg (null) 0xcf005 192.168.201.141@tcp (null) (null) (null) 00000040:00080000:1.0:1783134872.423920:0:5763:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].22, 88 off12040 20000000:01000000:1.0:1783134872.423928:0:5763:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-OST0000-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:1.0:1783134872.423951:0:5763:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].23, 128 off12168 20000000:01000000:1.0:1783134872.423956:0:5763:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-OST0000-osc 0xcf003 lustre-OST0000_UUID 192.168.201.141@tcp (null) (null) 00000040:00080000:1.0:1783134872.423980:0:5763:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].24, 144 off12312 20000000:01000000:1.0:1783134872.423985:0:5763:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:1.0:1783134872.424000:0:5763:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].25, 128 off12440 00000040:00080000:1.0:1783134872.424017:0:5763:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].26, 224 off12664 20000000:01000000:1.0:1783134872.424026:0:5763:0:(mgs_llog.c:5244:mgs_write_log_target()) remaining string: ' sys.timeout=20 ', param: 'autodegrade=on' 20000000:01000000:1.0:1783134872.424028:0:5763:0:(mgs_llog.c:4738:mgs_write_log_param()) next param 'autodegrade=on' 20000000:01000000:1.0:1783134872.424032:0:5763:0:(mgs_llog.c:5244:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:1.0:1783134872.424033:0:5763:0:(mgs_llog.c:4738:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:1.0:1783134872.424035:0:5763:0:(mgs_llog.c:4172:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:1.0:1783134872.424044:0:5763:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:1.0:1783134872.424045:0:5763:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:1.0:1783134872.424066:0:5763:0:(mgs_llog.c:2541:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:1.0:1783134872.424068:0:5763:0:(mgs_llog.c:1106:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:3.0:1783134872.424580:0:6587:0:(mgs_llog.c:1073:mgs_modify_handler()) Changing rec 10 marker 8 1->4: lustre sys.timeout 20000000:01000000:3.0:1783134872.424634:0:6587:0:(mgs_llog.c:1073:mgs_modify_handler()) Changing rec 12 marker 8 2->4: lustre sys.timeout 00000040:00080000:3.0:1783134872.424698:0:6587:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 22 count 22 00000040:00080000:1.0:1783134872.424881:0:5763:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 224 off12120 00000040:00080000:1.0:1783134872.424936:0:5763:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 80 off12200 00000040:00080000:1.0:1783134872.424993:0:5763:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 224 off12424 20000000:01000000:1.0:1783134872.425006:0:5763:0:(mgs_llog.c:2541:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:1.0:1783134872.425008:0:5763:0:(mgs_llog.c:1106:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 00000040:00080000:1.0:1783134872.425382:0:6588:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 5 count 5 00000040:00080000:3.0:1783134872.425788:0:5763:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9104 00000040:00080000:3.0:1783134872.425830:0:5763:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 80 off9184 00000040:00080000:3.0:1783134872.425911:0:5763:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9408 20000000:01000000:3.0:1783134872.425925:0:5763:0:(mgs_llog.c:2541:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:3.0:1783134872.425927:0:5763:0:(mgs_llog.c:1106:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:1.0:1783134872.426978:0:6589:0:(mgs_llog.c:1073:mgs_modify_handler()) Changing rec 18 marker 9 1->4: lustre sys.timeout 20000000:01000000:1.0:1783134872.427032:0:6589:0:(mgs_llog.c:1073:mgs_modify_handler()) Changing rec 20 marker 9 2->4: lustre sys.timeout 00000040:00080000:1.0:1783134872.427074:0:6589:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 27 count 27 00000040:00080000:3.0:1783134872.427346:0:5763:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].27, 224 off12888 00000040:00080000:3.0:1783134872.427385:0:5763:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].28, 80 off12968 00000040:00080000:3.0:1783134872.427434:0:5763:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].29, 224 off13192 10000000:01000000:3.0:1783134872.427451:0:5763:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:3.0:1783134872.427471:0:5763:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9fe9d2b75600/0xd6c4b8f05867e3b3 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134872.427488:0:5763:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9fea02166200/0xd6c4b8f05867e2cc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd6c4b8f05867e2c5 expref: 12 pid: 5763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134872.427505:0:5763:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9fe9c1523000/0xd6c4b8f05867e2e8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd6c4b8f05867e2e1 expref: 12 pid: 5762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134872.427511:0:5763:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9fea02166400/0xd6c4b8f05867e358 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd6c4b8f05867e351 expref: 12 pid: 5762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134872.427518:0:5763:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9fe9d2b75600/0xd6c4b8f05867e3b3 lrc: 6/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134872.427555:0:5763:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9fea02166400/0xd6c4b8f05867e358 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd6c4b8f05867e351 expref: 12 pid: 5762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134872.427570:0:5763:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9fea02166400/0xd6c4b8f05867e358 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd6c4b8f05867e351 expref: 12 pid: 5762 timeout: 304 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783134872.427584:0:5763:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9e0474e00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5763:1869752384361088:0@lo:104: 00000100:00100000:3.0:1783134872.427645:0:5763:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783134872.427692:0:5752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384361088 00010000:00010000:3.0:1783134872.427696:0:5763:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9fe9c1523000/0xd6c4b8f05867e2e8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd6c4b8f05867e2e1 expref: 12 pid: 5762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783134872.427701:0:5752:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384361088 00010000:00010000:3.0:1783134872.427705:0:5763:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9fe9c1523000/0xd6c4b8f05867e2e8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd6c4b8f05867e2e1 expref: 12 pid: 5762 timeout: 304 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783134872.427712:0:5763:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9e0474380 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5763:1869752384361216:0@lo:104: 00000100:00100000:3.0:1783134872.427730:0:5763:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783134872.428466:0:5752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384361216 00000100:00100000:1.0:1783134872.428472:0:5752:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384361216 00010000:00010000:3.0:1783134872.428498:0:5763:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9fea02166200/0xd6c4b8f05867e2cc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd6c4b8f05867e2c5 expref: 12 pid: 5763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783134872.428500:0:5752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1783134872.428512:0:5752:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9e0477800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:88a2002e-2ea7-4f07-912a-8d001832cfc0+4:5763:x1869752384361088:12345-0@lo:104: 00010000:00010000:3.0:1783134872.428513:0:5763:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9fea02166200/0xd6c4b8f05867e2cc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd6c4b8f05867e2c5 expref: 12 pid: 5763 timeout: 304 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134872.428526:0:5752:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.141@tcp lock: ffff9fe9d2b74400/0xd6c4b8f05867e351 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xd6c4b8f05867e358 expref: -99 pid: 5750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783134872.428534:0:5763:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9e0474a80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5763:1869752384361344:0@lo:104: 00000100:00100000:3.0:1783134872.428567:0:5763:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783134872.428584:0:5763:0:(client.c:2701:ptlrpc_set_wait()) set ffff9fe9cb6b5d80 going to sleep for 11 seconds 00000100:00100000:3.0:1783134872.428607:0:5763:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9e0474e00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5763:1869752384361088:0@lo:104: 00000100:00100000:0.0:1783134872.428609:0:5753:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 2 min 2 max 56 00000100:00100000:0.0:1783134872.428619:0:5753:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_002' 00010000:00010000:2.0:1783134872.428903:0:5757:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783134872.428910:0:5757:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.141@tcp lock: ffff9fe9d2b74400/0xd6c4b8f05867e351 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xd6c4b8f05867e358 expref: -99 pid: 5750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134872.428917:0:5757:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe9d2b74400 already unused, calling callback (ffffffffc1b40c20) 10000000:00010000:2.0:1783134872.428921:0:5757:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.141@tcp lock: ffff9fe9d2b74400/0xd6c4b8f05867e351 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xd6c4b8f05867e358 expref: -99 pid: 5750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134872.428929:0:5757:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.141@tcp lock: ffff9fe9d2b74400/0xd6c4b8f05867e351 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xd6c4b8f05867e358 expref: -99 pid: 5750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783134872.428935:0:5757:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.141@tcp lock: ffff9fe9d2b74400/0xd6c4b8f05867e351 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xd6c4b8f05867e358 expref: -99 pid: 5750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783134872.428941:0:5757:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1783134872.428970:0:5757:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.141@tcp lock: ffff9fe9d2b74400/0xd6c4b8f05867e351 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd6c4b8f05867e358 expref: -99 pid: 5750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134872.428977:0:5757:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1783134872.428999:0:5757:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.141@tcp lock: ffff9fe9d2b74400/0xd6c4b8f05867e351 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd6c4b8f05867e358 expref: -99 pid: 5750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134872.429006:0:5757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.141@tcp lock: ffff9fe9d2b74400/0xd6c4b8f05867e351 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd6c4b8f05867e358 expref: -99 pid: 5750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783134872.429017:0:3287:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00010000:00010000:2.0:1783134872.429028:0:5757:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783134872.429032:0:5757:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783134872.429034:0:5757:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783134872.429036:0:3287:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9ca88ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:88a2002e-2ea7-4f07-912a-8d001832cfc0:3287:1869752384361472:0@lo:103: 00000100:00100000:2.0:1783134872.429062:0:5753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384361344 00000100:00100000:2.0:1783134872.429067:0:5753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384361344 00000100:00100000:3.0:1783134872.429071:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783134872.429143:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1783134872.429150:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9e0476d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:88a2002e-2ea7-4f07-912a-8d001832cfc0+5:5763:x1869752384361216:12345-0@lo:104: 00010000:00010000:2.0:1783134872.429157:0:6590:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.141@tcp lock: ffff9fe9c0031600/0xd6c4b8f05867e2e1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xd6c4b8f05867e2e8 expref: -99 pid: 5750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134872.429203:0:6590:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1783134872.429211:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9e0476d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:88a2002e-2ea7-4f07-912a-8d001832cfc0+5:5763:x1869752384361216:12345-0@lo:104: Request processed in 60us (1478us total) trans 0 rc 0/0 00000100:00100000:2.0:1783134872.429218:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:0.0:1783134872.429222:0:5758:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:3.0:1783134872.429226:0:5763:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9e0474380 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5763:1869752384361216:0@lo:104: 00010000:00010000:0.0:1783134872.429230:0:5758:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.141@tcp lock: ffff9fe9c0031600/0xd6c4b8f05867e2e1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xd6c4b8f05867e2e8 expref: -99 pid: 5750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783134872.429241:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1783134872.429248:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9e0474000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:88a2002e-2ea7-4f07-912a-8d001832cfc0+4:5763:x1869752384361344:12345-0@lo:104: 00010000:00010000:2.0:1783134872.429254:0:6590:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.141@tcp lock: ffff9fe9c0030200/0xd6c4b8f05867e2c5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xd6c4b8f05867e2cc expref: -99 pid: 5750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783134872.429324:0:5755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384361472 00000100:00100000:3.0:1783134872.429327:0:5755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384361472 00010000:00010000:2.0:1783134872.429338:0:6590:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1783134872.429344:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9e0474000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:88a2002e-2ea7-4f07-912a-8d001832cfc0+4:5763:x1869752384361344:12345-0@lo:104: Request processed in 97us (777us total) trans 0 rc 0/0 00010000:00010000:0.0:1783134872.429348:0:5758:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe9c0031600 already unused, calling callback (ffffffffc1b40c20) 00010000:00010000:3.0:1783134872.429353:0:5755:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9fea02166400/0xd6c4b8f05867e358 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd6c4b8f05867e351 expref: 13 pid: 5762 timeout: 304 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783134872.429354:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 10000000:00010000:0.0:1783134872.429354:0:5758:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.141@tcp lock: ffff9fe9c0031600/0xd6c4b8f05867e2e1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xd6c4b8f05867e2e8 expref: -99 pid: 5750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134872.429372:0:5757:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:3.0:1783134872.429385:0:5755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00010000:00010000:0.0:1783134872.429386:0:5758:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.141@tcp lock: ffff9fe9c0031600/0xd6c4b8f05867e2e1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xd6c4b8f05867e2e8 expref: -99 pid: 5750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783134872.429393:0:5755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9e0476680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:88a2002e-2ea7-4f07-912a-8d001832cfc0+13:3287:x1869752384361472:12345-0@lo:103: 10000000:00010000:0.0:1783134872.429399:0:5758:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.141@tcp lock: ffff9fe9c0031600/0xd6c4b8f05867e2e1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xd6c4b8f05867e2e8 expref: -99 pid: 5750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134872.429404:0:5755:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 10000000:01000000:0.0:1783134872.429406:0:5758:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1783134872.429410:0:5755:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9fea02166400/0xd6c4b8f05867e358 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd6c4b8f05867e351 expref: 13 pid: 5762 timeout: 304 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134872.429431:0:5755:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9fea02166400/0xd6c4b8f05867e358 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd6c4b8f05867e351 expref: 13 pid: 5762 timeout: 304 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134872.429446:0:5755:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fea02166400/0xd6c4b8f05867e358 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd6c4b8f05867e351 expref: 13 pid: 5762 timeout: 304 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134872.429461:0:5755:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1783134872.429483:0:5758:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.141@tcp lock: ffff9fe9c0031600/0xd6c4b8f05867e2e1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd6c4b8f05867e2e8 expref: -99 pid: 5750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134872.429492:0:5758:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1783134872.429493:0:5755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9e0476680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:88a2002e-2ea7-4f07-912a-8d001832cfc0+12:3287:x1869752384361472:12345-0@lo:103: Request processed in 102us (424us total) trans 0 rc 0/0 00010000:00010000:2.0:1783134872.429502:0:6591:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783134872.429508:0:5755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:2.0:1783134872.429509:0:5757:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.141@tcp lock: ffff9fe9c0030200/0xd6c4b8f05867e2c5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xd6c4b8f05867e2cc expref: -99 pid: 5750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134872.429528:0:5757:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe9c0030200 already unused, calling callback (ffffffffc1b40c20) 10000000:00010000:2.0:1783134872.429531:0:5757:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.141@tcp lock: ffff9fe9c0030200/0xd6c4b8f05867e2c5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xd6c4b8f05867e2cc expref: -99 pid: 5750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134872.429539:0:5757:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.141@tcp lock: ffff9fe9c0030200/0xd6c4b8f05867e2c5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xd6c4b8f05867e2cc expref: -99 pid: 5750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783134872.429543:0:3287:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9f5ca5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:88a2002e-2ea7-4f07-912a-8d001832cfc0:3287:1869752384361600:0@lo:103: 00010000:00010000:0.0:1783134872.429546:0:5758:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.141@tcp lock: ffff9fe9c0031600/0xd6c4b8f05867e2e1 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd6c4b8f05867e2e8 expref: -99 pid: 5750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783134872.429551:0:5757:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.141@tcp lock: ffff9fe9c0030200/0xd6c4b8f05867e2c5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xd6c4b8f05867e2cc expref: -99 pid: 5750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783134872.429558:0:5757:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:3.0:1783134872.429566:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1783134872.429574:0:5758:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.141@tcp lock: ffff9fe9c0031600/0xd6c4b8f05867e2e1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd6c4b8f05867e2e8 expref: -99 pid: 5750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783134872.429591:0:3287:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9ca88ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:88a2002e-2ea7-4f07-912a-8d001832cfc0:3287:1869752384361472:0@lo:103: 00010000:00010000:2.0:1783134872.429591:0:5757:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.141@tcp lock: ffff9fe9c0030200/0xd6c4b8f05867e2c5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd6c4b8f05867e2cc expref: -99 pid: 5750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134872.429597:0:5758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783134872.429601:0:5758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783134872.429605:0:5757:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1783134872.429606:0:5758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783134872.429628:0:5757:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.141@tcp lock: ffff9fe9c0030200/0xd6c4b8f05867e2c5 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd6c4b8f05867e2cc expref: -99 pid: 5750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783134872.429636:0:5763:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9e0474a80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5763:1869752384361344:0@lo:104: 00010000:00010000:2.0:1783134872.429637:0:5757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.141@tcp lock: ffff9fe9c0030200/0xd6c4b8f05867e2c5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd6c4b8f05867e2cc expref: -99 pid: 5750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134872.429659:0:5763:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9fe9d2b75600/0xd6c4b8f05867e3b3 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134872.429672:0:5757:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783134872.429676:0:5757:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783134872.429678:0:5757:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783134872.429686:0:3289:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1783134872.429696:0:3289:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9ca88f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:88a2002e-2ea7-4f07-912a-8d001832cfc0:3289:1869752384361728:0@lo:103: 00000100:00100000:2.0:1783134872.429722:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1783134872.429748:0:6591:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783134872.429752:0:6591:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783134872.429754:0:5755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384361600 00000100:00100000:3.0:1783134872.429760:0:5755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384361600 00010000:00010000:3.0:1783134872.429772:0:5755:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9fe9c1523000/0xd6c4b8f05867e2e8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd6c4b8f05867e2e1 expref: 12 pid: 5762 timeout: 304 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783134872.429788:0:5755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384361728 00000100:00100000:3.0:1783134872.429790:0:5755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384361728 00010000:00010000:3.0:1783134872.429797:0:5755:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9fea02166200/0xd6c4b8f05867e2cc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd6c4b8f05867e2c5 expref: 13 pid: 5763 timeout: 304 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134872.429802:0:5752:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1783134872.429807:0:5755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1783134872.429812:0:5752:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9e0477800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:88a2002e-2ea7-4f07-912a-8d001832cfc0+3:5763:x1869752384361088:12345-0@lo:104: Request processed in 1300us (2164us total) trans 0 rc 0/0 00000100:00100000:3.0:1783134872.429819:0:5755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9e0474700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:88a2002e-2ea7-4f07-912a-8d001832cfc0+13:3287:x1869752384361600:12345-0@lo:103: 00000100:00100000:1.0:1783134872.429825:0:5752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:3.0:1783134872.429831:0:5755:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783134872.429837:0:5755:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9fe9c1523000/0xd6c4b8f05867e2e8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd6c4b8f05867e2e1 expref: 13 pid: 5762 timeout: 304 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134872.429847:0:5755:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9fe9c1523000/0xd6c4b8f05867e2e8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd6c4b8f05867e2e1 expref: 13 pid: 5762 timeout: 304 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783134872.429850:0:5756:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:1.0:1783134872.429859:0:5756:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00010000:00010000:3.0:1783134872.429862:0:5755:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fe9c1523000/0xd6c4b8f05867e2e8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd6c4b8f05867e2e1 expref: 13 pid: 5762 timeout: 304 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783134872.429869:0:5754:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00010000:00010000:3.0:1783134872.429876:0:5755:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783134872.429900:0:5755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9e0474700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:88a2002e-2ea7-4f07-912a-8d001832cfc0+12:3287:x1869752384361600:12345-0@lo:103: Request processed in 84us (333us total) trans 0 rc 0/0 00000100:00100000:3.0:1783134872.429907:0:5755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1783134872.429944:0:5754:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1783134872.430018:0:3287:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9f5ca5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:88a2002e-2ea7-4f07-912a-8d001832cfc0:3287:1869752384361600:0@lo:103: 00000100:00100000:0.0:1783134872.430023:0:5754:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9ca88c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:88a2002e-2ea7-4f07-912a-8d001832cfc0+11:3289:x1869752384361728:12345-0@lo:103: 00010000:00010000:0.0:1783134872.430062:0:5754:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783134872.430076:0:5754:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9fea02166200/0xd6c4b8f05867e2cc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd6c4b8f05867e2c5 expref: 11 pid: 5763 timeout: 304 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134872.430083:0:5754:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9fea02166200/0xd6c4b8f05867e2cc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd6c4b8f05867e2c5 expref: 11 pid: 5763 timeout: 304 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134872.430090:0:5754:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fea02166200/0xd6c4b8f05867e2cc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd6c4b8f05867e2c5 expref: 11 pid: 5763 timeout: 304 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134872.430103:0:5754:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9fe9d2b75600/0xd6c4b8f05867e3b3 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134872.430111:0:5754:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fe9d2b75600/0xd6c4b8f05867e3b3 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134872.430128:0:5754:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9fe9d2b75600/0xd6c4b8f05867e3b3 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134872.430135:0:5754:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9fe9d2b75600/0xd6c4b8f05867e3b3 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134872.430142:0:5754:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9fe9d2b75600/0xd6c4b8f05867e3b3 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134872.430148:0:5754:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9fe9d2b75600/0xd6c4b8f05867e3b3 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134872.430161:0:5754:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe9d2b75600 already unused, calling callback (ffffffffc1527ce0) 00010000:00010000:0.0:1783134872.430167:0:5754:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9fe9d2b75600/0xd6c4b8f05867e3b3 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134872.430174:0:5754:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9fe9d2b75600/0xd6c4b8f05867e3b3 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134872.430197:0:5754:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9fe9d2b75600/0xd6c4b8f05867e3b3 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134872.430204:0:5754:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1783134872.430229:0:5763:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9fe9d2b75600/0xd6c4b8f05867e3b3 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134872.430239:0:5763:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9fe9d2b75600/0xd6c4b8f05867e3b3 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783134872.430245:0:5754:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9ca88c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:88a2002e-2ea7-4f07-912a-8d001832cfc0+10:3289:x1869752384361728:12345-0@lo:103: Request processed in 240us (521us total) trans 0 rc 0/0 00010000:00010000:3.0:1783134872.430254:0:5763:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fe9d2b75600/0xd6c4b8f05867e3b3 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783134872.430254:0:5754:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1783134872.430260:0:3289:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9ca88f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:88a2002e-2ea7-4f07-912a-8d001832cfc0:3289:1869752384361728:0@lo:103: 20000000:01000000:3.0:1783134872.430303:0:5763:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:1.0:1783134872.459899:0:5763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9d1650850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88a2002e-2ea7-4f07-912a-8d001832cfc0+9:6572:x1869752384360960:12345-0@lo:253: Request processed in 38337us (39134us total) trans 0 rc 0/0 00000100:00100000:1.0:1783134872.459915:0:5763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1783134872.459921:0:6572:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9e0477100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:88a2002e-2ea7-4f07-912a-8d001832cfc0:6572:1869752384360960:0@lo:253: 10000000:01000000:2.0:1783134872.459934:0:6572:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1783134872.459936:0:6572:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1783134872.459938:0:6572:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1783134872.459939:0:6572:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1783134872.459940:0:6572:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0000_UUID 00000020:01000004:2.0:1783134872.459941:0:6572:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1783134872.459943:0:6572:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1783134872.459945:0:6572:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1783134872.459946:0:6572:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:2.0:1783134872.459947:0:6572:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1783134872.459948:0:6572:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1783134872.459968:0:6572:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9fea01d1b000 from lustre-OST0000 10000000:01000000:2.0:1783134872.460007:0:6572:0:(mgc_request.c:1945:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:2.0:1783134872.460009:0:6572:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:2.0:1783134872.460016:0:6572:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9fe9d13819c0 local copy 10000000:01000000:2.0:1783134872.460020:0:6572:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1783134872.460053:0:6572:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.141@tcp lock: ffff9fe9c1523e00/0xd6c4b8f05867e3ba lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134872.460064:0:6572:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.201.141@tcp lock: ffff9fe9c1523e00/0xd6c4b8f05867e3ba lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134872.460073:0:6572:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.141@tcp lock: ffff9fe9c1523e00/0xd6c4b8f05867e3ba lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783134872.460091:0:6572:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9ca88f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:88a2002e-2ea7-4f07-912a-8d001832cfc0:6572:1869752384361856:0@lo:101: 00000100:00100000:2.0:1783134872.460127:0:6572:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783134872.460465:0:5762:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384361856 00000100:00100000:1.0:1783134872.460472:0:5762:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384361856 00000100:00100000:2.0:1783134872.460506:0:6572:0:(client.c:2701:ptlrpc_set_wait()) set ffff9fe9c33e1480 going to sleep for 11 seconds 00000100:00100000:1.0:1783134872.460536:0:5762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1783134872.460548:0:5762:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9d1653050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88a2002e-2ea7-4f07-912a-8d001832cfc0+9:6572:x1869752384361856:12345-0@lo:101: 00010000:00010000:1.0:1783134872.460561:0:5762:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783134872.460576:0:5762:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fea02166800/0xd6c4b8f05867e3c1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd6c4b8f05867e3ba expref: -99 pid: 5762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134872.460599:0:5762:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fea02166800/0xd6c4b8f05867e3c1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd6c4b8f05867e3ba expref: 10 pid: 5762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134872.460608:0:5762:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fea02166800/0xd6c4b8f05867e3c1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd6c4b8f05867e3ba expref: 10 pid: 5762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134872.460630:0:5762:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fea02166800, rc 0) 00000100:00100000:1.0:1783134872.460665:0:5762:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9d1653050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88a2002e-2ea7-4f07-912a-8d001832cfc0+10:6572:x1869752384361856:12345-0@lo:101: Request processed in 120us (538us total) trans 0 rc 0/0 00000100:00100000:1.0:1783134872.460671:0:5762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1783134872.460702:0:6572:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9ca88f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:88a2002e-2ea7-4f07-912a-8d001832cfc0:6572:1869752384361856:0@lo:101: 00010000:00010000:2.0:1783134872.460777:0:6572:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.141@tcp lock: ffff9fe9c1523e00/0xd6c4b8f05867e3ba lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xd6c4b8f05867e3c1 expref: -99 pid: 6572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134872.460794:0:6572:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.141@tcp lock: ffff9fe9c1523e00/0xd6c4b8f05867e3ba lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xd6c4b8f05867e3c1 expref: -99 pid: 6572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783134872.460885:0:6572:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9ca88f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:88a2002e-2ea7-4f07-912a-8d001832cfc0:6572:1869752384361984:0@lo:501: 00000100:00100000:2.0:1783134872.460909:0:6572:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783134872.460928:0:6572:0:(client.c:2701:ptlrpc_set_wait()) set ffff9fe9c33e1480 going to sleep for 11 seconds 00000100:00100000:1.0:1783134872.460959:0:5763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384361984 00000100:00100000:1.0:1783134872.460963:0:5763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384361984 00000100:00100000:1.0:1783134872.460994:0:5763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1783134872.461001:0:5763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9d1653c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88a2002e-2ea7-4f07-912a-8d001832cfc0+10:6572:x1869752384361984:12345-0@lo:501: 00000100:00100000:1.0:1783134872.461195:0:5763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9d1653c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88a2002e-2ea7-4f07-912a-8d001832cfc0+10:6572:x1869752384361984:12345-0@lo:501: Request processed in 194us (284us total) trans 0 rc -2/-2 00000100:00100000:1.0:1783134872.461203:0:5763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1783134872.461227:0:6572:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9ca88f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:88a2002e-2ea7-4f07-912a-8d001832cfc0:6572:1869752384361984:0@lo:501: 10000000:01000000:2.0:1783134872.461239:0:6572:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.201.141@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1783134872.461267:0:6572:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.201.141@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1783134872.461273:0:6572:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.141@tcp lock: ffff9fe9c1523e00/0xd6c4b8f05867e3ba lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xd6c4b8f05867e3c1 expref: -99 pid: 6572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134872.461301:0:6572:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.141@tcp lock: ffff9fe9c1523e00/0xd6c4b8f05867e3ba lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xd6c4b8f05867e3c1 expref: -99 pid: 6572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134872.461308:0:6572:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.141@tcp lock: ffff9fe9c1523e00/0xd6c4b8f05867e3ba lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xd6c4b8f05867e3c1 expref: -99 pid: 6572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134872.461330:0:6572:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1783134872.461347:0:6572:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9fea01d1b000 10000000:01000000:2.0:1783134872.461352:0:6572:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1783134872.461365:0:6572:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff9fe9d13819c0 10000000:01000000:2.0:1783134872.461368:0:6572:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:2.0:1783134872.461371:0:6572:0:(mgc_request.c:1803:mgc_process_log()) Process log nodemap-ffff9fe9d13819c0 from 1 10000000:01000000:2.0:1783134872.461373:0:6572:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:2.0:1783134872.461390:0:6572:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.141@tcp lock: ffff9fe9c1523800/0xd6c4b8f05867e3c8 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134872.461399:0:5758:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783134872.461409:0:5758:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.141@tcp lock: ffff9fe9c1523e00/0xd6c4b8f05867e3ba lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0xd6c4b8f05867e3c1 expref: -99 pid: 6572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134872.461411:0:6572:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.141@tcp lock: ffff9fe9c1523800/0xd6c4b8f05867e3c8 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134872.461442:0:5758:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe9c1523e00 already unused, calling callback (ffffffffc1b40c20) 00010000:00010000:2.0:1783134872.461444:0:6572:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.141@tcp lock: ffff9fe9c1523800/0xd6c4b8f05867e3c8 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1783134872.461448:0:5758:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.141@tcp lock: ffff9fe9c1523e00/0xd6c4b8f05867e3ba lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0xd6c4b8f05867e3c1 expref: -99 pid: 6572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134872.461461:0:5758:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.141@tcp lock: ffff9fe9c1523e00/0xd6c4b8f05867e3ba lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x8400000000 nid: local remote: 0xd6c4b8f05867e3c1 expref: -99 pid: 6572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783134872.461466:0:6572:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9ca88f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:88a2002e-2ea7-4f07-912a-8d001832cfc0:6572:1869752384362112:0@lo:101: 10000000:00010000:0.0:1783134872.461473:0:5758:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.141@tcp lock: ffff9fe9c1523e00/0xd6c4b8f05867e3ba lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x9400000000 nid: local remote: 0xd6c4b8f05867e3c1 expref: -99 pid: 6572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783134872.461480:0:5758:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:2.0:1783134872.461497:0:6572:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1783134872.461501:0:5758:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.141@tcp lock: ffff9fe9c1523e00/0xd6c4b8f05867e3ba lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0xd6c4b8f05867e3c1 expref: -99 pid: 6572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134872.461508:0:5758:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1783134872.461524:0:6572:0:(client.c:2701:ptlrpc_set_wait()) set ffff9fe9c33e1a80 going to sleep for 11 seconds 00010000:00010000:0.0:1783134872.461535:0:5758:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.141@tcp lock: ffff9fe9c1523e00/0xd6c4b8f05867e3ba lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0xd6c4b8f05867e3c1 expref: -99 pid: 6572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134872.461543:0:5758:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.141@tcp lock: ffff9fe9c1523e00/0xd6c4b8f05867e3ba lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0xd6c4b8f05867e3c1 expref: -99 pid: 6572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783134872.461565:0:3289:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9f5ca5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:88a2002e-2ea7-4f07-912a-8d001832cfc0:3289:1869752384362240:0@lo:103: 00010000:00010000:0.0:1783134872.461565:0:5758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783134872.461568:0:5758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783134872.461571:0:5758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783134872.461599:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783134872.461666:0:5755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384362240 00000100:00100000:2.0:1783134872.461671:0:5755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384362240 00000100:00100000:1.0:1783134872.461693:0:5762:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384362112 00000100:00100000:1.0:1783134872.461698:0:5762:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384362112 00000100:00100000:3.0:1783134872.461753:0:5756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1783134872.461761:0:5756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9e0474a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:88a2002e-2ea7-4f07-912a-8d001832cfc0+11:3289:x1869752384362240:12345-0@lo:103: 00010000:00010000:3.0:1783134872.461771:0:5756:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783134872.461784:0:5756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fea02166800/0xd6c4b8f05867e3c1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xd6c4b8f05867e3ba expref: 11 pid: 5762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783134872.461880:0:5762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1783134872.461887:0:5762:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9d1651c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88a2002e-2ea7-4f07-912a-8d001832cfc0+11:6572:x1869752384362112:12345-0@lo:101: 00010000:00010000:1.0:1783134872.461894:0:5762:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783134872.461901:0:5762:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fea02166000/0xd6c4b8f05867e3cf lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd6c4b8f05867e3c8 expref: -99 pid: 5762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134872.461915:0:5762:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fea02166000/0xd6c4b8f05867e3cf lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd6c4b8f05867e3c8 expref: 12 pid: 5762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134872.461922:0:5762:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fea02166000/0xd6c4b8f05867e3cf lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd6c4b8f05867e3c8 expref: 12 pid: 5762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134872.461929:0:5762:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fea02166000, rc 0) 00000100:00100000:1.0:1783134872.461962:0:5762:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9d1651c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88a2002e-2ea7-4f07-912a-8d001832cfc0+12:6572:x1869752384362112:12345-0@lo:101: Request processed in 76us (465us total) trans 0 rc 0/0 00000100:00100000:1.0:1783134872.461975:0:5762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1783134872.461996:0:6572:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9ca88f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:88a2002e-2ea7-4f07-912a-8d001832cfc0:6572:1869752384362112:0@lo:101: 00010000:00010000:2.0:1783134872.462009:0:6572:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.141@tcp lock: ffff9fe9c1523800/0xd6c4b8f05867e3c8 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd6c4b8f05867e3cf expref: -99 pid: 6572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134872.462018:0:6572:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.141@tcp lock: ffff9fe9c1523800/0xd6c4b8f05867e3c8 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd6c4b8f05867e3cf expref: -99 pid: 6572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783134872.462033:0:6572:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.201.141@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1783134872.462040:0:5756:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1783134872.462051:0:6572:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.141@tcp lock: ffff9fe9c1523800/0xd6c4b8f05867e3c8 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd6c4b8f05867e3cf expref: -99 pid: 6572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134872.462060:0:6572:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.141@tcp lock: ffff9fe9c1523800/0xd6c4b8f05867e3c8 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd6c4b8f05867e3cf expref: -99 pid: 6572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783134872.462067:0:6572:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:2.0:1783134872.462071:0:6572:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1783134872.462076:0:6572:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 00000100:00100000:3.0:1783134872.462082:0:5756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9e0474a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:88a2002e-2ea7-4f07-912a-8d001832cfc0+10:3289:x1869752384362240:12345-0@lo:103: Request processed in 322us (483us total) trans 0 rc 0/0 10000000:01000000:2.0:1783134872.462085:0:6572:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00000100:00100000:3.0:1783134872.462093:0:5756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:2.0:1783134872.462115:0:6572:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.141@tcp lock: ffff9fe9c1523000/0xd6c4b8f05867e3d6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134872.462123:0:6572:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.141@tcp lock: ffff9fe9c1523000/0xd6c4b8f05867e3d6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134872.462129:0:6572:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.141@tcp lock: ffff9fe9c1523000/0xd6c4b8f05867e3d6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783134872.462140:0:6572:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9ca88f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:88a2002e-2ea7-4f07-912a-8d001832cfc0:6572:1869752384362368:0@lo:101: 00000100:00100000:2.0:1783134872.462163:0:6572:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783134872.462189:0:6572:0:(client.c:2701:ptlrpc_set_wait()) set ffff9fe9c33e1a80 going to sleep for 11 seconds 00000100:00100000:1.0:1783134872.462210:0:3289:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9f5ca5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:88a2002e-2ea7-4f07-912a-8d001832cfc0:3289:1869752384362240:0@lo:103: 00000100:00100000:3.0:1783134872.462259:0:5763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384362368 00000100:00100000:3.0:1783134872.462263:0:5763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384362368 00000100:00100000:3.0:1783134872.462319:0:5763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1783134872.462327:0:5763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9d1652c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88a2002e-2ea7-4f07-912a-8d001832cfc0+10:6572:x1869752384362368:12345-0@lo:101: 00010000:00010000:3.0:1783134872.462334:0:5763:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783134872.462343:0:5763:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fe9d2b75600/0xd6c4b8f05867e3dd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd6c4b8f05867e3d6 expref: -99 pid: 5763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134872.462358:0:5763:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fe9d2b75600/0xd6c4b8f05867e3dd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd6c4b8f05867e3d6 expref: 11 pid: 5763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134872.462366:0:5763:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fe9d2b75600/0xd6c4b8f05867e3dd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd6c4b8f05867e3d6 expref: 11 pid: 5763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134872.462372:0:5763:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fe9d2b75600, rc 0) 00000100:00100000:3.0:1783134872.462403:0:5763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9d1652c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88a2002e-2ea7-4f07-912a-8d001832cfc0+11:6572:x1869752384362368:12345-0@lo:101: Request processed in 76us (237us total) trans 0 rc 0/0 00000100:00100000:3.0:1783134872.462409:0:5763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1783134872.462426:0:6572:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9ca88f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:88a2002e-2ea7-4f07-912a-8d001832cfc0:6572:1869752384362368:0@lo:101: 00010000:00010000:0.0:1783134872.462440:0:6572:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.141@tcp lock: ffff9fe9c1523000/0xd6c4b8f05867e3d6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd6c4b8f05867e3dd expref: -99 pid: 6572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134872.462446:0:6572:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.141@tcp lock: ffff9fe9c1523000/0xd6c4b8f05867e3d6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd6c4b8f05867e3dd expref: -99 pid: 6572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783134872.462511:0:6572:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9f5ca5880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:88a2002e-2ea7-4f07-912a-8d001832cfc0:6572:1869752384362496:0@lo:501: 00000100:00100000:0.0:1783134872.462553:0:6572:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783134872.462599:0:5762:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384362496 00000100:00100000:1.0:1783134872.462602:0:5762:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384362496 00000100:00100000:1.0:1783134872.462626:0:5762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1783134872.462630:0:5762:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9d1653450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88a2002e-2ea7-4f07-912a-8d001832cfc0+11:6572:x1869752384362496:12345-0@lo:501: 00000100:00100000:1.0:1783134872.462748:0:5762:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9d1653450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88a2002e-2ea7-4f07-912a-8d001832cfc0+11:6572:x1869752384362496:12345-0@lo:501: Request processed in 117us (196us total) trans 0 rc 0/0 00000100:00100000:1.0:1783134872.462752:0:5762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1783134872.462809:0:6572:0:(client.c:2701:ptlrpc_set_wait()) set ffff9fe9ca8ae840 going to sleep for 11 seconds 00000100:00100000:0.0:1783134872.462825:0:6572:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9f5ca5880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:88a2002e-2ea7-4f07-912a-8d001832cfc0:6572:1869752384362496:0@lo:501: 00000100:00100000:0.0:1783134872.462850:0:6572:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9f5ca5880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:88a2002e-2ea7-4f07-912a-8d001832cfc0:6572:1869752384362624:0@lo:503: 00000100:00100000:0.0:1783134872.462887:0:6572:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783134872.462903:0:6572:0:(client.c:2701:ptlrpc_set_wait()) set ffff9fe9ca8ae840 going to sleep for 11 seconds 00000100:00100000:3.0:1783134872.462910:0:5763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384362624 00000100:00100000:3.0:1783134872.462914:0:5763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384362624 00000100:00100000:3.0:1783134872.462935:0:5763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1783134872.462939:0:5763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9d1650050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88a2002e-2ea7-4f07-912a-8d001832cfc0+11:6572:x1869752384362624:12345-0@lo:503: 00000100:00100000:3.0:1783134872.463161:0:5763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9d1650050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88a2002e-2ea7-4f07-912a-8d001832cfc0+11:6572:x1869752384362624:12345-0@lo:503: Request processed in 221us (274us total) trans 0 rc 0/0 00000100:00100000:3.0:1783134872.463167:0:5763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1783134872.463175:0:6572:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9f5ca5880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:88a2002e-2ea7-4f07-912a-8d001832cfc0:6572:1869752384362624:0@lo:503: 00000040:00080000:0.0:1783134872.463504:0:6572:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1783134872.463560:0:6572:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9f5ca5880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:88a2002e-2ea7-4f07-912a-8d001832cfc0:6572:1869752384362752:0@lo:502: 00000100:00100000:0.0:1783134872.463605:0:6572:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783134872.463628:0:6572:0:(client.c:2701:ptlrpc_set_wait()) set ffff9fe9ca8ae840 going to sleep for 11 seconds 00000100:00100000:3.0:1783134872.463639:0:5765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384362752 00000100:00100000:3.0:1783134872.463645:0:5765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384362752 00000100:00100000:3.0:1783134872.463713:0:5765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1783134872.463720:0:5765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9d1651050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88a2002e-2ea7-4f07-912a-8d001832cfc0+11:6572:x1869752384362752:12345-0@lo:502: 00000100:00100000:3.0:1783134872.463850:0:5765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9d1651050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88a2002e-2ea7-4f07-912a-8d001832cfc0+11:6572:x1869752384362752:12345-0@lo:502: Request processed in 129us (244us total) trans 0 rc 0/0 00000100:00100000:3.0:1783134872.463857:0:5765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1783134872.463881:0:6572:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9f5ca5880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:88a2002e-2ea7-4f07-912a-8d001832cfc0:6572:1869752384362752:0@lo:502: 00000040:00080000:0.0:1783134872.464099:0:6572:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:0.0:1783134872.464243:0:6572:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:0.0:1783134872.464264:0:6572:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:0.0:1783134872.464318:0:6572:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:0.0:1783134872.464350:0:6572:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:0.0:1783134872.464383:0:6572:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:0.0:1783134872.464406:0:6572:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9f5ca5880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:88a2002e-2ea7-4f07-912a-8d001832cfc0:6572:1869752384362880:0@lo:502: 00000100:00100000:0.0:1783134872.464451:0:6572:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783134872.465219:0:5762:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384362880 00000100:00100000:1.0:1783134872.465224:0:5762:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384362880 00000100:00100000:0.0:1783134872.465236:0:6572:0:(client.c:2701:ptlrpc_set_wait()) set ffff9fe9ca8ae840 going to sleep for 11 seconds 00000100:00100000:1.0:1783134872.465253:0:5762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1783134872.465259:0:5762:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9d1653850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88a2002e-2ea7-4f07-912a-8d001832cfc0+11:6572:x1869752384362880:12345-0@lo:502: 00000100:00100000:1.0:1783134872.465390:0:5762:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9d1653850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88a2002e-2ea7-4f07-912a-8d001832cfc0+11:6572:x1869752384362880:12345-0@lo:502: Request processed in 130us (938us total) trans 0 rc 0/0 00000100:00100000:1.0:1783134872.465396:0:5762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1783134872.465404:0:6572:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9f5ca5880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:88a2002e-2ea7-4f07-912a-8d001832cfc0:6572:1869752384362880:0@lo:502: 00000040:00080000:0.0:1783134872.465496:0:6572:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:0.0:1783134872.465505:0:6572:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 7 count 8 00000020:01000000:0.0:1783134872.465879:0:6593:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1783134872.465886:0:6593:0:(obd_mount.c:952:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:0.0:1783134872.465893:0:6593:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783134872.465895:0:6593:0:(obd_config.c:1561:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:0.0:1783134872.465899:0:6593:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1783134872.465911:0:6593:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff9fea00c40000) 00000020:00000080:0.0:1783134872.465929:0:6593:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type obdfilter with refcount 2 00000020:00000080:0.0:1783134872.465933:0:6593:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1783134872.465973:0:6593:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9fea01d1b000 from lustre-OST0000, refs=2 00080000:01000000:0.0:1783134872.465977:0:6593:0:(osd_handler.c:1569:osd_obd_connect()) connect #1 00000020:00000080:0.0:1783134872.465981:0:6593:0:(genops.c:1406:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xd6c4b8f05867e3eb 00010000:00010000:0.0:1783134872.469338:0:6593:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:02000400:0.0:1783134872.469997:0:6593:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0000: new disk, initializing 00000001:00000004:0.0:1783134872.471869:0:6593:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 0 40000000:02000000:0.0:1783134872.472017:0:6593:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0000: No data found on store. Initialize space. 00080000:10000000:0.0:1783134872.475000:0:6593:0:(osd_index.c:2102:osd_index_try()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:0.0:1783134872.475589:0:6593:0:(osd_index.c:2102:osd_index_try()) lustre-OST0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:2.0:1783134872.477058:0:6593:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:2.0:1783134872.477070:0:6593:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1783134872.477078:0:6593:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783134872.477080:0:6593:0:(obd_config.c:1561:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:2.0:1783134872.477083:0:6593:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1783134872.477087:0:6593:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783134872.477089:0:6593:0:(obd_config.c:1561:class_process_config()) marker 15 (0x1) lustre sys.timeout 00000020:00000080:2.0:1783134872.477743:0:6593:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1783134872.477746:0:6593:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1783134872.477793:0:6593:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1783134872.477797:0:6593:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783134872.477798:0:6593:0:(obd_config.c:1561:class_process_config()) marker 15 (0x2) lustre sys.timeout 00000040:00080000:2.0:1783134872.477801:0:6593:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:0.0:1783134872.480484:0:6572:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-7 (rc=0) 10000000:01000000:0.0:1783134872.480519:0:6572:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.201.141@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:0.0:1783134872.480537:0:6572:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.141@tcp lock: ffff9fe9c1523000/0xd6c4b8f05867e3d6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd6c4b8f05867e3dd expref: -99 pid: 6572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134872.480556:0:6572:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.141@tcp lock: ffff9fe9c1523000/0xd6c4b8f05867e3d6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd6c4b8f05867e3dd expref: -99 pid: 6572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783134872.480582:0:6572:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff9fea01d1b000 from 1 10000000:01000000:0.0:1783134872.480586:0:6572:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1783134872.480622:0:6572:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.141@tcp lock: ffff9fe9c0031600/0xd6c4b8f05867e3f2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134872.480631:0:6572:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.141@tcp lock: ffff9fe9c0031600/0xd6c4b8f05867e3f2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134872.480642:0:6572:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.141@tcp lock: ffff9fe9c0031600/0xd6c4b8f05867e3f2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783134872.480665:0:6572:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9f5ca5880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:88a2002e-2ea7-4f07-912a-8d001832cfc0:6572:1869752384363008:0@lo:101: 00000100:00100000:0.0:1783134872.480728:0:6572:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783134872.480775:0:6572:0:(client.c:2701:ptlrpc_set_wait()) set ffff9fe9ca8ae180 going to sleep for 11 seconds 00000100:00100000:3.0:1783134872.482796:0:5763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384363008 00000100:00100000:3.0:1783134872.482807:0:5763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384363008 00000100:00100000:3.0:1783134872.482860:0:5763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1783134872.482871:0:5763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9d1651850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88a2002e-2ea7-4f07-912a-8d001832cfc0+11:6572:x1869752384363008:12345-0@lo:101: 00010000:00010000:3.0:1783134872.482887:0:5763:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783134872.482957:0:5763:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fe9d2b74800/0xd6c4b8f05867e3f9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xd6c4b8f05867e3f2 expref: -99 pid: 5763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134872.482981:0:5763:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fe9d2b74800/0xd6c4b8f05867e3f9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd6c4b8f05867e3f2 expref: 12 pid: 5763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134872.482989:0:5763:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fe9d2b74800/0xd6c4b8f05867e3f9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd6c4b8f05867e3f2 expref: 12 pid: 5763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134872.482996:0:5763:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fe9d2b74800, rc 0) 00000100:00100000:3.0:1783134872.483048:0:5763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9d1651850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88a2002e-2ea7-4f07-912a-8d001832cfc0+12:6572:x1869752384363008:12345-0@lo:101: Request processed in 180us (2321us total) trans 0 rc 0/0 00000100:00100000:3.0:1783134872.483053:0:5763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1783134872.483274:0:6572:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9f5ca5880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:88a2002e-2ea7-4f07-912a-8d001832cfc0:6572:1869752384363008:0@lo:101: 00010000:00010000:0.0:1783134872.483329:0:6572:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.141@tcp lock: ffff9fe9c0031600/0xd6c4b8f05867e3f2 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd6c4b8f05867e3f9 expref: -99 pid: 6572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134872.483341:0:6572:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.141@tcp lock: ffff9fe9c0031600/0xd6c4b8f05867e3f2 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xd6c4b8f05867e3f9 expref: -99 pid: 6572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783134872.483450:0:6572:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9f5ca5880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:88a2002e-2ea7-4f07-912a-8d001832cfc0:6572:1869752384363136:0@lo:501: 00000100:00100000:0.0:1783134872.483482:0:6572:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783134872.483520:0:6572:0:(client.c:2701:ptlrpc_set_wait()) set ffff9fe9ca8ae180 going to sleep for 11 seconds 00000100:00100000:3.0:1783134872.483576:0:5765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384363136 00000100:00100000:3.0:1783134872.483580:0:5765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384363136 00000100:00100000:3.0:1783134872.483650:0:5765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1783134872.483660:0:5765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9d1652850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88a2002e-2ea7-4f07-912a-8d001832cfc0+12:6572:x1869752384363136:12345-0@lo:501: 00000100:00100000:3.0:1783134872.483968:0:5765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9d1652850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88a2002e-2ea7-4f07-912a-8d001832cfc0+12:6572:x1869752384363136:12345-0@lo:501: Request processed in 310us (484us total) trans 0 rc 0/0 00000100:00100000:3.0:1783134872.483977:0:5765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1783134872.484072:0:6572:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9f5ca5880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:88a2002e-2ea7-4f07-912a-8d001832cfc0:6572:1869752384363136:0@lo:501: 00000100:00100000:3.0:1783134872.484103:0:6572:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9e0474380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:88a2002e-2ea7-4f07-912a-8d001832cfc0:6572:1869752384363264:0@lo:503: 00000100:00100000:3.0:1783134872.484138:0:6572:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783134872.484162:0:6572:0:(client.c:2701:ptlrpc_set_wait()) set ffff9fe9f418ab40 going to sleep for 11 seconds 00000100:00100000:2.0:1783134872.484207:0:5762:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384363264 00000100:00100000:2.0:1783134872.484212:0:5762:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384363264 00000100:00100000:2.0:1783134872.484241:0:5762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1783134872.484248:0:5762:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9d1652050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88a2002e-2ea7-4f07-912a-8d001832cfc0+12:6572:x1869752384363264:12345-0@lo:503: 00000100:00100000:2.0:1783134872.484584:0:5762:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9d1652050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88a2002e-2ea7-4f07-912a-8d001832cfc0+12:6572:x1869752384363264:12345-0@lo:503: Request processed in 336us (445us total) trans 0 rc 0/0 00000100:00100000:2.0:1783134872.484596:0:5762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1783134872.484652:0:6572:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9e0474380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:88a2002e-2ea7-4f07-912a-8d001832cfc0:6572:1869752384363264:0@lo:503: 00000040:00080000:3.0:1783134872.484908:0:6572:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1783134872.484963:0:6572:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9e0474380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:88a2002e-2ea7-4f07-912a-8d001832cfc0:6572:1869752384363392:0@lo:502: 00000100:00100000:3.0:1783134872.484996:0:6572:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783134872.485028:0:6572:0:(client.c:2701:ptlrpc_set_wait()) set ffff9fe9f418ab40 going to sleep for 11 seconds 00000100:00100000:0.0:1783134872.485075:0:5765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384363392 00000100:00100000:0.0:1783134872.485079:0:5765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384363392 00000100:00100000:0.0:1783134872.485107:0:5765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1783134872.485113:0:5765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9d1650450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88a2002e-2ea7-4f07-912a-8d001832cfc0+12:6572:x1869752384363392:12345-0@lo:502: 00000100:00100000:0.0:1783134872.485247:0:5765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9d1650450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88a2002e-2ea7-4f07-912a-8d001832cfc0+12:6572:x1869752384363392:12345-0@lo:502: Request processed in 133us (249us total) trans 0 rc 0/0 00000100:00100000:0.0:1783134872.485255:0:5765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1783134872.485272:0:6572:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9e0474380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:88a2002e-2ea7-4f07-912a-8d001832cfc0:6572:1869752384363392:0@lo:502: 00000040:00080000:1.0:1783134872.485571:0:6572:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:1.0:1783134872.485608:0:6572:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:1.0:1783134872.485624:0:6572:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9f6730e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:88a2002e-2ea7-4f07-912a-8d001832cfc0:6572:1869752384363520:0@lo:502: 00000100:00100000:1.0:1783134872.485651:0:6572:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783134872.485673:0:6572:0:(client.c:2701:ptlrpc_set_wait()) set ffff9fe9ca37ad80 going to sleep for 11 seconds 00000100:00100000:2.0:1783134872.485682:0:5762:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384363520 00000100:00100000:2.0:1783134872.485687:0:5762:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384363520 00000100:00100000:2.0:1783134872.485713:0:5762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1783134872.485720:0:5762:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9d1652450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88a2002e-2ea7-4f07-912a-8d001832cfc0+12:6572:x1869752384363520:12345-0@lo:502: 00000100:00100000:2.0:1783134872.485817:0:5762:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9d1652450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88a2002e-2ea7-4f07-912a-8d001832cfc0+12:6572:x1869752384363520:12345-0@lo:502: Request processed in 97us (164us total) trans 0 rc 0/0 00000100:00100000:2.0:1783134872.485824:0:5762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1783134872.485841:0:6572:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9f6730e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:88a2002e-2ea7-4f07-912a-8d001832cfc0:6572:1869752384363520:0@lo:502: 00000040:00080000:1.0:1783134872.485901:0:6572:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:1.0:1783134872.485907:0:6572:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:1.0:1783134872.486324:0:6597:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1783134872.486333:0:6597:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783134872.486336:0:6597:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1783134872.486344:0:6597:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9fea01d1b000 00000020:00000080:1.0:1783134872.486346:0:6597:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1783134872.486365:0:6597:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1783134872.486368:0:6597:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783134872.486369:0:6597:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:1.0:1783134872.486371:0:6597:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:3.0:1783134872.486451:0:6572:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:3.0:1783134872.486468:0:6572:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.201.141@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1783134872.486488:0:6572:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.141@tcp lock: ffff9fe9c0031600/0xd6c4b8f05867e3f2 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd6c4b8f05867e3f9 expref: -99 pid: 6572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134872.486500:0:6572:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.141@tcp lock: ffff9fe9c0031600/0xd6c4b8f05867e3f2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd6c4b8f05867e3f9 expref: -99 pid: 6572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783134872.486537:0:6572:0:(mgc_request.c:1945:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1783134872.486539:0:6572:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9fea01d1b000 10000000:01000000:3.0:1783134872.486541:0:6572:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9fea01d1b000 10000000:01000000:3.0:1783134872.486544:0:6572:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1783134872.486547:0:6572:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff9fea01d1b000 from 1 10000000:01000000:3.0:1783134872.486549:0:6572:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1783134872.486567:0:6572:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.141@tcp lock: ffff9fe9d2b75800/0xd6c4b8f05867e400 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134872.486572:0:6572:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.141@tcp lock: ffff9fe9d2b75800/0xd6c4b8f05867e400 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134872.486587:0:6572:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.141@tcp lock: ffff9fe9d2b75800/0xd6c4b8f05867e400 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783134872.486599:0:6572:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9e0474e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:88a2002e-2ea7-4f07-912a-8d001832cfc0:6572:1869752384363648:0@lo:101: 00000100:00100000:3.0:1783134872.486628:0:6572:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783134872.486935:0:6572:0:(client.c:2701:ptlrpc_set_wait()) set ffff9fe9f418aa80 going to sleep for 11 seconds 00000100:00100000:0.0:1783134872.488536:0:5763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384363648 00000100:00100000:0.0:1783134872.488545:0:5763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384363648 00000100:00100000:0.0:1783134872.488596:0:5763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1783134872.488604:0:5763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9d17a7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88a2002e-2ea7-4f07-912a-8d001832cfc0+12:6572:x1869752384363648:12345-0@lo:101: 00010000:00010000:0.0:1783134872.488617:0:5763:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783134872.488630:0:5763:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fe9c0030000/0xd6c4b8f05867e407 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xd6c4b8f05867e400 expref: -99 pid: 5763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134872.488654:0:5763:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fe9c0030000/0xd6c4b8f05867e407 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd6c4b8f05867e400 expref: 13 pid: 5763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134872.488664:0:5763:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fe9c0030000/0xd6c4b8f05867e407 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd6c4b8f05867e400 expref: 13 pid: 5763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134872.488673:0:5763:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fe9c0030000, rc 0) 00000100:00100000:0.0:1783134872.488734:0:5763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9d17a7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88a2002e-2ea7-4f07-912a-8d001832cfc0+13:6572:x1869752384363648:12345-0@lo:101: Request processed in 130us (2105us total) trans 0 rc 0/0 00000100:00100000:0.0:1783134872.488740:0:5763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1783134872.490097:0:6572:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9e0474e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:88a2002e-2ea7-4f07-912a-8d001832cfc0:6572:1869752384363648:0@lo:101: 00010000:00010000:1.0:1783134872.490118:0:6572:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.141@tcp lock: ffff9fe9d2b75800/0xd6c4b8f05867e400 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd6c4b8f05867e407 expref: -99 pid: 6572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134872.490130:0:6572:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.141@tcp lock: ffff9fe9d2b75800/0xd6c4b8f05867e400 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xd6c4b8f05867e407 expref: -99 pid: 6572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783134872.490227:0:6572:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9f6730e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:88a2002e-2ea7-4f07-912a-8d001832cfc0:6572:1869752384363776:0@lo:501: 00000100:00100000:1.0:1783134872.490263:0:6572:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783134872.490343:0:5762:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384363776 00000100:00100000:3.0:1783134872.490347:0:5762:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384363776 00000100:00100000:3.0:1783134872.490375:0:5762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1783134872.490380:0:5762:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9d17a7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88a2002e-2ea7-4f07-912a-8d001832cfc0+13:6572:x1869752384363776:12345-0@lo:501: 00000100:00100000:3.0:1783134872.490594:0:5762:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9d17a7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88a2002e-2ea7-4f07-912a-8d001832cfc0+13:6572:x1869752384363776:12345-0@lo:501: Request processed in 212us (330us total) trans 0 rc 0/0 00000100:00100000:3.0:1783134872.490601:0:5762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1783134872.490636:0:6572:0:(client.c:2701:ptlrpc_set_wait()) set ffff9fe9cbabc840 going to sleep for 11 seconds 00000100:00100000:1.0:1783134872.490650:0:6572:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9f6730e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:88a2002e-2ea7-4f07-912a-8d001832cfc0:6572:1869752384363776:0@lo:501: 00000100:00100000:1.0:1783134872.490676:0:6572:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9f6730e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:88a2002e-2ea7-4f07-912a-8d001832cfc0:6572:1869752384363904:0@lo:503: 00000100:00100000:1.0:1783134872.491055:0:6572:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783134872.491077:0:6572:0:(client.c:2701:ptlrpc_set_wait()) set ffff9fe9cbabc840 going to sleep for 11 seconds 00000100:00100000:3.0:1783134872.491121:0:5765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384363904 00000100:00100000:3.0:1783134872.491126:0:5765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384363904 00000100:00100000:3.0:1783134872.491193:0:5765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1783134872.491201:0:5765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9d17a5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88a2002e-2ea7-4f07-912a-8d001832cfc0+13:6572:x1869752384363904:12345-0@lo:503: 00000100:00100000:3.0:1783134872.491402:0:5765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9d17a5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88a2002e-2ea7-4f07-912a-8d001832cfc0+13:6572:x1869752384363904:12345-0@lo:503: Request processed in 202us (347us total) trans 0 rc 0/0 00000100:00100000:3.0:1783134872.491409:0:5765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1783134872.491454:0:6572:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9f6730e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:88a2002e-2ea7-4f07-912a-8d001832cfc0:6572:1869752384363904:0@lo:503: 00000040:00080000:1.0:1783134872.492154:0:6572:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1783134872.492226:0:6572:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9f6730e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:88a2002e-2ea7-4f07-912a-8d001832cfc0:6572:1869752384364032:0@lo:502: 00000100:00100000:1.0:1783134872.492269:0:6572:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783134872.492320:0:6572:0:(client.c:2701:ptlrpc_set_wait()) set ffff9fe9ca37ad80 going to sleep for 11 seconds 00000100:00100000:3.0:1783134872.492369:0:5763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384364032 00000100:00100000:3.0:1783134872.492375:0:5763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384364032 00000100:00100000:3.0:1783134872.492403:0:5763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1783134872.492411:0:5763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9d17a6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88a2002e-2ea7-4f07-912a-8d001832cfc0+13:6572:x1869752384364032:12345-0@lo:502: 00000100:00100000:3.0:1783134872.492593:0:5763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9d17a6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88a2002e-2ea7-4f07-912a-8d001832cfc0+13:6572:x1869752384364032:12345-0@lo:502: Request processed in 182us (323us total) trans 0 rc 0/0 00000100:00100000:3.0:1783134872.492616:0:5763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1783134872.492658:0:6572:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9f6730e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:88a2002e-2ea7-4f07-912a-8d001832cfc0:6572:1869752384364032:0@lo:502: 00000040:00080000:1.0:1783134872.492840:0:6572:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:1.0:1783134872.492871:0:6572:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:1.0:1783134872.492887:0:6572:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:1.0:1783134872.492919:0:6572:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:1.0:1783134872.492941:0:6572:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:1.0:1783134872.492965:0:6572:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:1.0:1783134872.492994:0:6572:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:1.0:1783134872.493013:0:6572:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:1.0:1783134872.493037:0:6572:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:1.0:1783134872.493054:0:6572:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:1.0:1783134872.493069:0:6572:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:1.0:1783134872.493091:0:6572:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:1.0:1783134872.493107:0:6572:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:1.0:1783134872.493131:0:6572:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:1.0:1783134872.493179:0:6572:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:1.0:1783134872.493207:0:6572:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:1.0:1783134872.493224:0:6572:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:1.0:1783134872.493248:0:6572:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:1.0:1783134872.493265:0:6572:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:1.0:1783134872.493297:0:6572:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:1.0:1783134872.493324:0:6572:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:1.0:1783134872.493341:0:6572:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:1.0:1783134872.493361:0:6572:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:0.0:1783134872.493477:0:6572:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:0.0:1783134872.493520:0:6572:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:0.0:1783134872.493553:0:6572:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:0.0:1783134872.493617:0:6572:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:0.0:1783134872.493662:0:6572:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000100:00100000:0.0:1783134872.493690:0:6572:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9f5ca6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:88a2002e-2ea7-4f07-912a-8d001832cfc0:6572:1869752384364160:0@lo:502: 00000100:00100000:0.0:1783134872.493747:0:6572:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783134872.493776:0:6572:0:(client.c:2701:ptlrpc_set_wait()) set ffff9fe9ca8aecc0 going to sleep for 11 seconds 00000100:00100000:3.0:1783134872.493875:0:5765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384364160 00000100:00100000:3.0:1783134872.493880:0:5765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384364160 00000100:00100000:3.0:1783134872.493916:0:5765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1783134872.493924:0:5765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9d17a7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88a2002e-2ea7-4f07-912a-8d001832cfc0+13:6572:x1869752384364160:12345-0@lo:502: 00000100:00100000:3.0:1783134872.494091:0:5765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9d17a7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88a2002e-2ea7-4f07-912a-8d001832cfc0+13:6572:x1869752384364160:12345-0@lo:502: Request processed in 167us (343us total) trans 0 rc 0/0 00000100:00100000:3.0:1783134872.494098:0:5765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1783134872.494129:0:6572:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9f5ca6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:88a2002e-2ea7-4f07-912a-8d001832cfc0:6572:1869752384364160:0@lo:502: 00000040:00080000:1.0:1783134872.494191:0:6572:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:1.0:1783134872.494200:0:6572:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 29 count 30 00000020:01000004:2.0:1783134872.494559:0:6598:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:2.0:1783134872.494570:0:6598:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff9fe9ca89b380) 00000020:00000080:2.0:1783134872.494584:0:6598:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type lwp with refcount 2 00000020:01000004:2.0:1783134872.494771:0:6598:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9fea01d1b000 from lustre-OST0000, refs=3 00000020:01000004:2.0:1783134872.494774:0:6598:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9fea01d1b000 from lustre-OST0000, refs=3 00000020:01000004:2.0:1783134872.494776:0:6598:0:(obd_mount.c:701:lustre_put_lsi()) put ffff9fea01d1b000 3 00010000:00080000:2.0:1783134872.494794:0:6598:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9fe8c47e2800@lustre-MDT0000-lwp-OST0000: add connection 192.168.201.141@tcp at head 00010000:00010000:2.0:1783134872.496680:0:6598:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-2 is initialized 00000020:00000080:2.0:1783134872.496994:0:6598:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:2.0:1783134872.497029:0:6598:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1783134872.497039:0:6598:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0xd6c4b8f05867e415 00000100:00080000:2.0:1783134872.497047:0:6598:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1783134872.497052:0:6598:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9fe8c47e2800 using connection 192.168.201.141@tcp/0@lo 00000100:00100000:2.0:1783134872.497081:0:6598:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9fe9ca88ed80 x1869752384364288/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1783134872.497106:0:6598:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1783134872.497147:0:3285:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9ca88ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3285:1869752384364288:0@lo:38: 00000100:00100000:3.0:1783134872.497209:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783134872.497343:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384364288 00000040:00080000:2.0:1783134872.497345:0:6598:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000100:00100000:3.0:1783134872.497350:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384364288 00000100:00100000:3.0:1783134872.497383:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1783134872.497390:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9e0477b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3285:x1869752384364288:12345-0@lo:38: 00010000:00080000:3.0:1783134872.497410:0:5770:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 154 last 0 00000020:00000080:3.0:1783134872.497451:0:5770:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0xd6c4b8f05867e41c 00000004:00100000:3.0:1783134872.497465:0:5770:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1783134872.497494:0:5770:0:(import.c:65:import_set_state_nolock()) ffff9fe9dff18800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1783134872.497595:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9e0477b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3285:x1869752384364288:12345-0@lo:38: Request processed in 203us (385us total) trans 0 rc 0/0 00000100:00100000:3.0:1783134872.497602:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1783134872.497630:0:3286:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9e0475180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3286:1869752384364416:0@lo:400: 00000100:00100000:3.0:1783134872.497659:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783134872.497716:0:5769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384364416 00000100:00100000:3.0:1783134872.497720:0:5769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384364416 00000100:00100000:3.0:1783134872.497745:0:5769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1783134872.497757:0:5769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9e0476a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3286:x1869752384364416:12345-0@lo:400: 00000100:00100000:3.0:1783134872.497791:0:5769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9e0476a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3286:x1869752384364416:12345-0@lo:400: Request processed in 35us (132us total) trans 0 rc 0/0 00000100:00100000:3.0:1783134872.497797:0:5769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1783134872.497830:0:3286:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9fe9e0475180 x1869752384364416/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783134888 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783134872.497843:0:3286:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9e0475180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3286:1869752384364416:0@lo:400: 00010000:00080000:2.0:1783134872.498026:0:3285:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9fe9ca88ed80 x1869752384364288/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1783134882 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783134872.498045:0:3285:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1783134872.498062:0:3285:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 1 00000100:00080000:2.0:1783134872.498068:0:3285:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1783134872.498072:0:3285:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1783134872.498074:0:3285:0:(import.c:65:import_set_state_nolock()) ffff9fe8c47e2800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1783134872.498080:0:3285:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9ca88ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3285:1869752384364288:0@lo:38: 00000020:01000000:1.0:1783134872.499561:0:6572:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-29 (rc=0) 10000000:01000000:1.0:1783134872.499591:0:6572:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.201.141@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1783134872.499614:0:6572:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.141@tcp lock: ffff9fe9d2b75800/0xd6c4b8f05867e400 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd6c4b8f05867e407 expref: -99 pid: 6572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134872.499636:0:6572:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.141@tcp lock: ffff9fe9d2b75800/0xd6c4b8f05867e400 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd6c4b8f05867e407 expref: -99 pid: 6572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1783134872.499676:0:6572:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1783134872.499678:0:6572:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1783134872.499679:0:6572:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1783134872.499681:0:6572:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1783134872.499682:0:6572:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1783134872.499683:0:6572:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1783134872.499685:0:6572:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1783134872.499686:0:6572:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1783134872.499688:0:6572:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1783134872.499690:0:6572:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1783134872.499691:0:6572:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1783134872.499695:0:6572:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020062 00000020:01000004:1.0:1783134872.499697:0:6572:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1783134872.499699:0:6572:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1783134872.499700:0:6572:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1783134872.499701:0:6572:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1783134872.499702:0:6572:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1783134872.499703:0:6572:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1783134872.499704:0:6572:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1783134872.499705:0:6572:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1783134872.499706:0:6572:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1783134872.499707:0:6572:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1783134872.499708:0:6572:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1783134872.499726:0:6572:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:1.0:1783134872.499740:0:6572:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9f6730e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:88a2002e-2ea7-4f07-912a-8d001832cfc0:6572:1869752384364544:0@lo:253: 00000100:00100000:1.0:1783134872.499785:0:6572:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783134872.499857:0:6572:0:(client.c:2701:ptlrpc_set_wait()) set ffff9fe9cbabccc0 going to sleep for 11 seconds 00000100:00100000:3.0:1783134872.499888:0:5762:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384364544 00000100:00100000:3.0:1783134872.499894:0:5762:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384364544 00000100:00100000:3.0:1783134872.499928:0:5762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1783134872.499935:0:5762:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9d17a4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88a2002e-2ea7-4f07-912a-8d001832cfc0+13:6572:x1869752384364544:12345-0@lo:253: 20000000:01000000:3.0:1783134872.499955:0:5762:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:3.0:1783134872.499966:0:5762:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1783134872.514207:0:5762:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1783134872.514225:0:5762:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:3.0:1783134872.514247:0:5785:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1783134872.514252:0:5785:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1783134872.514272:0:5785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9fe9d2b74c00/0xd6c4b8f05867e423 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134872.514310:0:5785:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9fe9c0030800/0xd6c4b8f05867e389 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd6c4b8f05867e382 expref: 13 pid: 5765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134872.514320:0:5785:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9fe9d2b74c00/0xd6c4b8f05867e423 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134872.514353:0:5785:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9fe9c0030800/0xd6c4b8f05867e389 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd6c4b8f05867e382 expref: 13 pid: 5765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134872.514366:0:5785:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9fe9c0030800/0xd6c4b8f05867e389 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd6c4b8f05867e382 expref: 13 pid: 5765 timeout: 304 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783134872.514391:0:5785:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9e0475180 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5785:1869752384364672:0@lo:104: 00000100:00100000:3.0:1783134872.514470:0:5785:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783134872.514529:0:5785:0:(client.c:2701:ptlrpc_set_wait()) set ffff9fe9ea64c600 going to sleep for 11 seconds 00000100:00100000:2.0:1783134872.514579:0:5753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384364672 00000100:00100000:2.0:1783134872.514584:0:5753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384364672 00000100:00100000:2.0:1783134872.514620:0:5753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1783134872.514626:0:5753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9e0475500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:88a2002e-2ea7-4f07-912a-8d001832cfc0+3:5785:x1869752384364672:12345-0@lo:104: 00010000:00010000:2.0:1783134872.514635:0:5753:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.141@tcp lock: ffff9fea02167600/0xd6c4b8f05867e382 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xd6c4b8f05867e389 expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134872.514681:0:5753:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1783134872.514686:0:5753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9e0475500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:88a2002e-2ea7-4f07-912a-8d001832cfc0+3:5785:x1869752384364672:12345-0@lo:104: Request processed in 60us (219us total) trans 0 rc 0/0 00000100:00100000:2.0:1783134872.514690:0:5753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:2.0:1783134872.514709:0:5757:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783134872.514713:0:5757:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.141@tcp lock: ffff9fea02167600/0xd6c4b8f05867e382 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xd6c4b8f05867e389 expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134872.514718:0:5757:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fea02167600 already unused, calling callback (ffffffffc1b40c20) 10000000:00010000:2.0:1783134872.514720:0:5757:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.141@tcp lock: ffff9fea02167600/0xd6c4b8f05867e382 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xd6c4b8f05867e389 expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134872.514736:0:5757:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.141@tcp lock: ffff9fea02167600/0xd6c4b8f05867e382 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xd6c4b8f05867e389 expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783134872.514744:0:5757:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.141@tcp lock: ffff9fea02167600/0xd6c4b8f05867e382 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xd6c4b8f05867e389 expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783134872.514749:0:5757:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1783134872.514776:0:5757:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.141@tcp lock: ffff9fea02167600/0xd6c4b8f05867e382 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd6c4b8f05867e389 expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134872.514782:0:5757:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1783134872.514799:0:5757:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.141@tcp lock: ffff9fea02167600/0xd6c4b8f05867e382 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd6c4b8f05867e389 expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134872.514819:0:5757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.141@tcp lock: ffff9fea02167600/0xd6c4b8f05867e382 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd6c4b8f05867e389 expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134872.514832:0:5757:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783134872.514833:0:5757:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783134872.514834:0:5757:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783134872.514852:0:3287:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9ca88ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:88a2002e-2ea7-4f07-912a-8d001832cfc0:3287:1869752384364800:0@lo:103: 00000100:00100000:2.0:1783134872.514879:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783134872.514921:0:5785:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9e0475180 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5785:1869752384364672:0@lo:104: 00000100:00100000:1.0:1783134872.514925:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384364800 00000100:00100000:1.0:1783134872.514930:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384364800 00010000:00010000:2.0:1783134872.514936:0:5785:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9fe9d2b74c00/0xd6c4b8f05867e423 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134872.514948:0:6592:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9fe9c0030800/0xd6c4b8f05867e389 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd6c4b8f05867e382 expref: 14 pid: 5765 timeout: 304 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783134872.514994:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1783134872.515006:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9d1623850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:88a2002e-2ea7-4f07-912a-8d001832cfc0+14:3287:x1869752384364800:12345-0@lo:103: 00010000:00010000:1.0:1783134872.515018:0:6592:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783134872.515023:0:6592:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9fe9c0030800/0xd6c4b8f05867e389 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd6c4b8f05867e382 expref: 14 pid: 5765 timeout: 304 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134872.515036:0:6592:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9fe9c0030800/0xd6c4b8f05867e389 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd6c4b8f05867e382 expref: 14 pid: 5765 timeout: 304 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134872.515055:0:6592:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fe9c0030800/0xd6c4b8f05867e389 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd6c4b8f05867e382 expref: 14 pid: 5765 timeout: 304 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134872.515068:0:6592:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9fe9d2b74c00/0xd6c4b8f05867e423 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134872.515076:0:6592:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fe9d2b74c00/0xd6c4b8f05867e423 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1783134872.515089:0:6592:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001465305s 00010000:00010000:1.0:1783134872.515094:0:6592:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9fe9d2b74c00/0xd6c4b8f05867e423 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134872.515101:0:6592:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9fe9d2b74c00/0xd6c4b8f05867e423 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134872.515107:0:6592:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9fe9d2b74c00/0xd6c4b8f05867e423 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134872.515123:0:6592:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9fe9d2b74c00/0xd6c4b8f05867e423 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134872.515135:0:6592:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe9d2b74c00 already unused, calling callback (ffffffffc1527ce0) 00010000:00010000:1.0:1783134872.515140:0:6592:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9fe9d2b74c00/0xd6c4b8f05867e423 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134872.515151:0:6592:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9fe9d2b74c00/0xd6c4b8f05867e423 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134872.515166:0:6592:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9fe9d2b74c00/0xd6c4b8f05867e423 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134872.515176:0:6592:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1783134872.515186:0:5785:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9fe9d2b74c00/0xd6c4b8f05867e423 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134872.515201:0:5785:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9fe9d2b74c00/0xd6c4b8f05867e423 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134872.515206:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fe9d2b74c00/0xd6c4b8f05867e423 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783134872.515215:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9d1623850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:88a2002e-2ea7-4f07-912a-8d001832cfc0+13:3287:x1869752384364800:12345-0@lo:103: Request processed in 211us (333us total) trans 0 rc 0/0 00000100:00100000:1.0:1783134872.515224:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1783134872.515253:0:3287:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9ca88ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:88a2002e-2ea7-4f07-912a-8d001832cfc0:3287:1869752384364800:0@lo:103: 00000100:00100000:2.0:1783134872.518607:0:5762:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9d17a4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88a2002e-2ea7-4f07-912a-8d001832cfc0+12:6572:x1869752384364544:12345-0@lo:253: Request processed in 18667us (18816us total) trans 0 rc 0/0 00000100:00100000:2.0:1783134872.518618:0:5762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1783134872.518638:0:6572:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9f6730e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:88a2002e-2ea7-4f07-912a-8d001832cfc0:6572:1869752384364544:0@lo:253: 10000000:01000000:1.0:1783134872.518654:0:6572:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:1.0:1783134872.518657:0:6572:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1783134872.518659:0:6572:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1783134872.518660:0:6572:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1783134872.518661:0:6572:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1783134872.518662:0:6572:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1783134872.518664:0:6572:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1783134872.518665:0:6572:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1783134872.518667:0:6572:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1783134872.518668:0:6572:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1783134872.518670:0:6572:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1783134872.518671:0:6572:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1783134872.518685:0:6572:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:1.0:1783134872.522272:0:6572:0:(osd_index.c:2102:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:1.0:1783134872.522516:0:6572:0:(osd_index.c:2102:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:0.0:1783134872.522844:0:6572:0:(osd_index.c:2102:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:0.0:1783134872.523036:0:6572:0:(osd_index.c:2102:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:0.0:1783134872.523329:0:6572:0:(osd_index.c:2102:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:0.0:1783134872.523593:0:6572:0:(osd_index.c:2102:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:0.0:1783134872.524400:0:6572:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:0.0:1783134872.626302:0:6572:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:0.0:1783134872.626311:0:6572:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:0.0:1783134872.626355:0:6572:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1783134872.626406:0:6572:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.141@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1783134872.626433:0:6572:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=48 00000080:00000004:0.0:1783134872.626460:0:6572:0:(super25.c:187:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00010000:00010000:2.0:1783134872.835793:0:6591:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783134873.859493:0:5758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783134874.883405:0:5757:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1783134875.363846:0:6940:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg141-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1783134875.907365:0:6591:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783134876.935418:0:5758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783134877.830751:0:3288:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9ca88ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:88a2002e-2ea7-4f07-912a-8d001832cfc0:3288:1869752384364928:0@lo:400: 00000100:00100000:2.0:1783134877.830861:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783134877.830926:0:3288:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1783134877.830933:0:3288:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9ca88c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3288:1869752384365056:0@lo:400: 00000100:00100000:2.0:1783134877.830961:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783134877.830994:0:3286:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9ca88e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3286:1869752384365184:0@lo:400: 00000100:00100000:2.0:1783134877.831016:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783134877.831064:0:5769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384365056 00000100:00100000:2.0:1783134877.831071:0:5769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384365056 00000100:00100000:2.0:1783134877.831108:0:5769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384365184 00000100:00100000:2.0:1783134877.831111:0:5769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384365184 00000100:00100000:2.0:1783134877.831138:0:5769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1783134877.831146:0:5769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9ca88c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3288:x1869752384365056:12345-0@lo:400: 00000100:00100000:2.0:1783134877.831204:0:5769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9ca88c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3288:x1869752384365056:12345-0@lo:400: Request processed in 59us (241us total) trans 0 rc 0/0 00000100:00100000:2.0:1783134877.831217:0:5769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1783134877.831247:0:5769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1783134877.831255:0:5769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9ca88fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3286:x1869752384365184:12345-0@lo:400: 00000100:00100000:2.0:1783134877.831300:0:5769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9ca88fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3286:x1869752384365184:12345-0@lo:400: Request processed in 46us (283us total) trans 0 rc 0/0 00000100:00100000:2.0:1783134877.831306:0:5769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:2.0:1783134877.831339:0:5766:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1783134877.831381:0:3286:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9fe9ca88e680 x1869752384365184/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783134893 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783134877.831393:0:3286:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9ca88e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3286:1869752384365184:0@lo:400: 00010000:00080000:2.0:1783134877.831414:0:3288:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9fe9ca88c000 x1869752384365056/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783134893 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783134877.831428:0:3288:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9ca88c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3288:1869752384365056:0@lo:400: 00000100:00100000:1.0:1783134877.831879:0:5765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384364928 00000100:00100000:1.0:1783134877.831890:0:5765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384364928 00000100:00100000:1.0:1783134877.831930:0:5765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1783134877.831938:0:5765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9d17a5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88a2002e-2ea7-4f07-912a-8d001832cfc0+12:3288:x1869752384364928:12345-0@lo:400: 00000100:00100000:1.0:1783134877.832000:0:5765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9d17a5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88a2002e-2ea7-4f07-912a-8d001832cfc0+12:3288:x1869752384364928:12345-0@lo:400: Request processed in 63us (1138us total) trans 0 rc 0/0 00000100:00100000:1.0:1783134877.832007:0:5765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1783134877.832035:0:3288:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9ca88ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:88a2002e-2ea7-4f07-912a-8d001832cfc0:3288:1869752384364928:0@lo:400: 00010000:00010000:2.0:1783134877.955612:0:5757:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1783134878.852648:0:5767:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1783134878.852656:0:5767:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff9fe9e0d14800 from 21 10000000:01000000:3.0:1783134878.852662:0:5767:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1783134878.852705:0:5767:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.141@tcp lock: ffff9fe9d2b75a00/0xd6c4b8f05867e42a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134878.852717:0:5767:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.141@tcp lock: ffff9fe9d2b75a00/0xd6c4b8f05867e42a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134878.852727:0:5767:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.141@tcp lock: ffff9fe9d2b75a00/0xd6c4b8f05867e42a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783134878.852750:0:5767:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9e0475c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88a2002e-2ea7-4f07-912a-8d001832cfc0:5767:1869752384365312:0@lo:101: 00000100:00100000:3.0:1783134878.852815:0:5767:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783134878.852960:0:5762:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384365312 00000100:00100000:2.0:1783134878.852967:0:5762:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384365312 00000100:00100000:2.0:1783134878.853006:0:5762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1783134878.853013:0:5762:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9d17a7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88a2002e-2ea7-4f07-912a-8d001832cfc0+12:5767:x1869752384365312:12345-0@lo:101: 00010000:00010000:2.0:1783134878.853026:0:5762:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783134878.853037:0:5762:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fe9c1523400/0xd6c4b8f05867e431 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xd6c4b8f05867e42a expref: -99 pid: 5762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134878.853057:0:5762:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fe9c1523400/0xd6c4b8f05867e431 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd6c4b8f05867e42a expref: 13 pid: 5762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134878.853085:0:5762:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fe9c1523400/0xd6c4b8f05867e431 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd6c4b8f05867e42a expref: 13 pid: 5762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134878.853094:0:5762:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fe9c1523400, rc 0) 00000100:00100000:2.0:1783134878.853129:0:5762:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9d17a7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88a2002e-2ea7-4f07-912a-8d001832cfc0+13:5767:x1869752384365312:12345-0@lo:101: Request processed in 116us (314us total) trans 0 rc 0/0 00000100:00100000:2.0:1783134878.853135:0:5762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1783134878.853214:0:5767:0:(client.c:2701:ptlrpc_set_wait()) set ffff9fe9e2f3ba80 going to sleep for 11 seconds 00000100:00100000:3.0:1783134878.853238:0:5767:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9e0475c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88a2002e-2ea7-4f07-912a-8d001832cfc0:5767:1869752384365312:0@lo:101: 00010000:00010000:3.0:1783134878.853252:0:5767:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.141@tcp lock: ffff9fe9d2b75a00/0xd6c4b8f05867e42a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd6c4b8f05867e431 expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134878.853262:0:5767:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.141@tcp lock: ffff9fe9d2b75a00/0xd6c4b8f05867e42a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xd6c4b8f05867e431 expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783134878.853342:0:5767:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9e0475c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88a2002e-2ea7-4f07-912a-8d001832cfc0:5767:1869752384365440:0@lo:501: 00000100:00100000:3.0:1783134878.853368:0:5767:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783134878.853419:0:5765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384365440 00000100:00100000:1.0:1783134878.853423:0:5765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384365440 00000100:00100000:1.0:1783134878.853452:0:5765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1783134878.853459:0:5765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9d17a5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88a2002e-2ea7-4f07-912a-8d001832cfc0+13:5767:x1869752384365440:12345-0@lo:501: 00000100:00100000:1.0:1783134878.853784:0:5765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9d17a5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88a2002e-2ea7-4f07-912a-8d001832cfc0+13:5767:x1869752384365440:12345-0@lo:501: Request processed in 325us (414us total) trans 0 rc 0/0 00000100:00100000:1.0:1783134878.853791:0:5765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1783134878.854116:0:5767:0:(client.c:2701:ptlrpc_set_wait()) set ffff9fe9e2f3ba80 going to sleep for 11 seconds 00000100:00100000:3.0:1783134878.854130:0:5767:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9e0475c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88a2002e-2ea7-4f07-912a-8d001832cfc0:5767:1869752384365440:0@lo:501: 00000100:00100000:3.0:1783134878.854154:0:5767:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9e0475c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88a2002e-2ea7-4f07-912a-8d001832cfc0:5767:1869752384365568:0@lo:503: 00000100:00100000:3.0:1783134878.854185:0:5767:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783134878.854234:0:5767:0:(client.c:2701:ptlrpc_set_wait()) set ffff9fe9e2f3ba80 going to sleep for 11 seconds 00000100:00100000:1.0:1783134878.854266:0:5765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384365568 00000100:00100000:1.0:1783134878.854269:0:5765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384365568 00000100:00100000:1.0:1783134878.854393:0:5765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1783134878.854401:0:5765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9d17a6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88a2002e-2ea7-4f07-912a-8d001832cfc0+13:5767:x1869752384365568:12345-0@lo:503: 00000100:00100000:1.0:1783134878.854677:0:5765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9d17a6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88a2002e-2ea7-4f07-912a-8d001832cfc0+13:5767:x1869752384365568:12345-0@lo:503: Request processed in 277us (490us total) trans 0 rc 0/0 00000100:00100000:1.0:1783134878.854684:0:5765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1783134878.854741:0:5767:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9e0475c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88a2002e-2ea7-4f07-912a-8d001832cfc0:5767:1869752384365568:0@lo:503: 00000100:00100000:3.0:1783134878.855033:0:7165:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9e0475c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:88a2002e-2ea7-4f07-912a-8d001832cfc0:7165:1869752384365696:0@lo:502: 00000100:00100000:3.0:1783134878.855062:0:7165:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783134878.855199:0:7165:0:(client.c:2701:ptlrpc_set_wait()) set ffff9fe9e2f3be40 going to sleep for 11 seconds 00000100:00100000:2.0:1783134878.855264:0:5762:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384365696 00000100:00100000:2.0:1783134878.855269:0:5762:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384365696 00000100:00100000:2.0:1783134878.855326:0:5762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1783134878.855333:0:5762:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9d17a6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88a2002e-2ea7-4f07-912a-8d001832cfc0+13:7165:x1869752384365696:12345-0@lo:502: 00000100:00100000:2.0:1783134878.855619:0:5762:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9d17a6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88a2002e-2ea7-4f07-912a-8d001832cfc0+13:7165:x1869752384365696:12345-0@lo:502: Request processed in 286us (555us total) trans 0 rc 0/0 00000100:00100000:2.0:1783134878.855625:0:5762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1783134878.855705:0:7165:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9e0475c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:88a2002e-2ea7-4f07-912a-8d001832cfc0:7165:1869752384365696:0@lo:502: 00000100:00100000:3.0:1783134878.855739:0:7165:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9e0475c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:88a2002e-2ea7-4f07-912a-8d001832cfc0:7165:1869752384365824:0@lo:502: 00000100:00100000:3.0:1783134878.855764:0:7165:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783134878.855788:0:7165:0:(client.c:2701:ptlrpc_set_wait()) set ffff9fe9e2f3be40 going to sleep for 11 seconds 00000100:00100000:2.0:1783134878.855828:0:5762:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384365824 00000100:00100000:2.0:1783134878.855831:0:5762:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384365824 00000100:00100000:2.0:1783134878.855845:0:5762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1783134878.855850:0:5762:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9d17a4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88a2002e-2ea7-4f07-912a-8d001832cfc0+13:7165:x1869752384365824:12345-0@lo:502: 00000100:00100000:2.0:1783134878.855955:0:5762:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9d17a4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88a2002e-2ea7-4f07-912a-8d001832cfc0+13:7165:x1869752384365824:12345-0@lo:502: Request processed in 104us (190us total) trans 0 rc 0/0 00000100:00100000:2.0:1783134878.855961:0:5762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1783134878.856128:0:7165:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9e0475c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:88a2002e-2ea7-4f07-912a-8d001832cfc0:7165:1869752384365824:0@lo:502: 00000040:00080000:3.0:1783134878.856144:0:7165:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 30 count 30 00000020:01000000:2.0:1783134878.856428:0:5767:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 21-29 (rc=0) 10000000:01000000:2.0:1783134878.856444:0:5767:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.201.141@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1783134878.856454:0:5767:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.141@tcp lock: ffff9fe9d2b75a00/0xd6c4b8f05867e42a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd6c4b8f05867e431 expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134878.856463:0:5767:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.141@tcp lock: ffff9fe9d2b75a00/0xd6c4b8f05867e42a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd6c4b8f05867e431 expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783134878.856479:0:5767:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1783134878.856481:0:5767:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-mdtir-ffff9fe9e0d14800 from 4 10000000:01000000:2.0:1783134878.856483:0:5767:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1783134878.856519:0:5767:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.141@tcp lock: ffff9fe9c1523200/0xd6c4b8f05867e438 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134878.856528:0:5767:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.141@tcp lock: ffff9fe9c1523200/0xd6c4b8f05867e438 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134878.856537:0:5767:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.141@tcp lock: ffff9fe9c1523200/0xd6c4b8f05867e438 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783134878.856550:0:5767:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9ca88ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88a2002e-2ea7-4f07-912a-8d001832cfc0:5767:1869752384365952:0@lo:101: 00000100:00100000:2.0:1783134878.856577:0:5767:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783134878.856607:0:5767:0:(client.c:2701:ptlrpc_set_wait()) set ffff9fe9c9d16a80 going to sleep for 11 seconds 00000100:00100000:3.0:1783134878.856707:0:5762:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384365952 00000100:00100000:3.0:1783134878.856712:0:5762:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384365952 00000100:00100000:3.0:1783134878.856733:0:5762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1783134878.856740:0:5762:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9d17a6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88a2002e-2ea7-4f07-912a-8d001832cfc0+13:5767:x1869752384365952:12345-0@lo:101: 00010000:00010000:3.0:1783134878.856749:0:5762:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783134878.856761:0:5762:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fe9d2b74600/0xd6c4b8f05867e43f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd6c4b8f05867e438 expref: -99 pid: 5762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134878.856780:0:5762:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fe9d2b74600/0xd6c4b8f05867e43f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd6c4b8f05867e438 expref: 14 pid: 5762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134878.856797:0:5762:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fe9d2b74600/0xd6c4b8f05867e43f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd6c4b8f05867e438 expref: 14 pid: 5762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134878.856805:0:5762:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fe9d2b74600, rc 0) 00000100:00100000:3.0:1783134878.856844:0:5762:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9d17a6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88a2002e-2ea7-4f07-912a-8d001832cfc0+14:5767:x1869752384365952:12345-0@lo:101: Request processed in 105us (266us total) trans 0 rc 0/0 00000100:00100000:3.0:1783134878.856849:0:5762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1783134878.857000:0:5767:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9ca88ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88a2002e-2ea7-4f07-912a-8d001832cfc0:5767:1869752384365952:0@lo:101: 00010000:00010000:2.0:1783134878.857012:0:5767:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.141@tcp lock: ffff9fe9c1523200/0xd6c4b8f05867e438 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd6c4b8f05867e43f expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134878.857021:0:5767:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.141@tcp lock: ffff9fe9c1523200/0xd6c4b8f05867e438 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd6c4b8f05867e43f expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783134878.857063:0:5767:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9ca88ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88a2002e-2ea7-4f07-912a-8d001832cfc0:5767:1869752384366080:0@lo:256: 00000100:00100000:2.0:1783134878.857091:0:5767:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783134878.857112:0:5767:0:(client.c:2701:ptlrpc_set_wait()) set ffff9fe9c9d16a80 going to sleep for 11 seconds 00000100:00100000:3.0:1783134878.857157:0:5762:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384366080 00000100:00100000:3.0:1783134878.857161:0:5762:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384366080 00000100:00100000:3.0:1783134878.857188:0:5762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1783134878.857194:0:5762:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9d17a5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88a2002e-2ea7-4f07-912a-8d001832cfc0+14:5767:x1869752384366080:12345-0@lo:256: 20000000:01000000:3.0:1783134878.857207:0:5762:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1783134878.857225:0:5762:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1783134878.857228:0:5762:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:3.0:1783134878.857336:0:5762:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9d17a5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88a2002e-2ea7-4f07-912a-8d001832cfc0+14:5767:x1869752384366080:12345-0@lo:256: Request processed in 141us (244us total) trans 0 rc 0/0 00000100:00100000:3.0:1783134878.857343:0:5762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1783134878.857454:0:5767:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9ca88ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88a2002e-2ea7-4f07-912a-8d001832cfc0:5767:1869752384366080:0@lo:256: 10000000:01000000:2.0:1783134878.857505:0:5767:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.201.141@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1783134878.857515:0:5767:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.141@tcp lock: ffff9fe9c1523200/0xd6c4b8f05867e438 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd6c4b8f05867e43f expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134878.857523:0:5767:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.141@tcp lock: ffff9fe9c1523200/0xd6c4b8f05867e438 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd6c4b8f05867e43f expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783134878.857530:0:5767:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:2.0:1783134878.857532:0:5767:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 16 10000000:01000000:2.0:1783134878.857534:0:5767:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1783134878.857550:0:5767:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.141@tcp lock: ffff9fe9c1523a00/0xd6c4b8f05867e446 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134878.857556:0:5767:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.141@tcp lock: ffff9fe9c1523a00/0xd6c4b8f05867e446 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134878.857564:0:5767:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.141@tcp lock: ffff9fe9c1523a00/0xd6c4b8f05867e446 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783134878.857576:0:5767:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9ca88ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88a2002e-2ea7-4f07-912a-8d001832cfc0:5767:1869752384366208:0@lo:101: 00000100:00100000:2.0:1783134878.857597:0:5767:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783134878.857623:0:5767:0:(client.c:2701:ptlrpc_set_wait()) set ffff9fe9c9d16a80 going to sleep for 11 seconds 00000100:00100000:3.0:1783134878.857720:0:5762:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384366208 00000100:00100000:3.0:1783134878.857724:0:5762:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384366208 00000100:00100000:3.0:1783134878.857753:0:5762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1783134878.857759:0:5762:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9d17a4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88a2002e-2ea7-4f07-912a-8d001832cfc0+14:5767:x1869752384366208:12345-0@lo:101: 00010000:00010000:3.0:1783134878.857766:0:5762:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783134878.857773:0:5762:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fe9d2b75400/0xd6c4b8f05867e44d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xd6c4b8f05867e446 expref: -99 pid: 5762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134878.857786:0:5762:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fe9d2b75400/0xd6c4b8f05867e44d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd6c4b8f05867e446 expref: 15 pid: 5762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134878.857804:0:5762:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fe9d2b75400/0xd6c4b8f05867e44d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd6c4b8f05867e446 expref: 15 pid: 5762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134878.857811:0:5762:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fe9d2b75400, rc 0) 00000100:00100000:3.0:1783134878.857843:0:5762:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9d17a4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88a2002e-2ea7-4f07-912a-8d001832cfc0+15:5767:x1869752384366208:12345-0@lo:101: Request processed in 84us (244us total) trans 0 rc 0/0 00000100:00100000:3.0:1783134878.857848:0:5762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1783134878.857942:0:5767:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9ca88ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88a2002e-2ea7-4f07-912a-8d001832cfc0:5767:1869752384366208:0@lo:101: 00010000:00010000:2.0:1783134878.857951:0:5767:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.141@tcp lock: ffff9fe9c1523a00/0xd6c4b8f05867e446 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xd6c4b8f05867e44d expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134878.857958:0:5767:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.141@tcp lock: ffff9fe9c1523a00/0xd6c4b8f05867e446 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xd6c4b8f05867e44d expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783134878.857994:0:5767:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9ca88ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88a2002e-2ea7-4f07-912a-8d001832cfc0:5767:1869752384366336:0@lo:501: 00000100:00100000:2.0:1783134878.858022:0:5767:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783134878.858040:0:5767:0:(client.c:2701:ptlrpc_set_wait()) set ffff9fe9c9d16a80 going to sleep for 11 seconds 00000100:00100000:3.0:1783134878.858077:0:5762:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384366336 00000100:00100000:3.0:1783134878.858081:0:5762:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384366336 00000100:00100000:3.0:1783134878.858108:0:5762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1783134878.858115:0:5762:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9d17a4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88a2002e-2ea7-4f07-912a-8d001832cfc0+15:5767:x1869752384366336:12345-0@lo:501: 00000100:00100000:3.0:1783134878.858356:0:5762:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9d17a4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88a2002e-2ea7-4f07-912a-8d001832cfc0+15:5767:x1869752384366336:12345-0@lo:501: Request processed in 240us (332us total) trans 0 rc 0/0 00000100:00100000:3.0:1783134878.858362:0:5762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1783134878.858467:0:5767:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9ca88ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88a2002e-2ea7-4f07-912a-8d001832cfc0:5767:1869752384366336:0@lo:501: 00000100:00100000:2.0:1783134878.858502:0:5767:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9ca88ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88a2002e-2ea7-4f07-912a-8d001832cfc0:5767:1869752384366464:0@lo:503: 00000100:00100000:2.0:1783134878.858533:0:5767:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783134878.858559:0:5767:0:(client.c:2701:ptlrpc_set_wait()) set ffff9fe9c9d16a80 going to sleep for 11 seconds 00000100:00100000:3.0:1783134878.858647:0:5762:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384366464 00000100:00100000:3.0:1783134878.858650:0:5762:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384366464 00000100:00100000:3.0:1783134878.858674:0:5762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1783134878.858680:0:5762:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9d286b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88a2002e-2ea7-4f07-912a-8d001832cfc0+15:5767:x1869752384366464:12345-0@lo:503: 00000100:00100000:3.0:1783134878.858931:0:5762:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9d286b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88a2002e-2ea7-4f07-912a-8d001832cfc0+15:5767:x1869752384366464:12345-0@lo:503: Request processed in 251us (396us total) trans 0 rc 0/0 00000100:00100000:3.0:1783134878.858938:0:5762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1783134878.859040:0:5767:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9ca88ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88a2002e-2ea7-4f07-912a-8d001832cfc0:5767:1869752384366464:0@lo:503: 00000100:00100000:2.0:1783134878.859369:0:7166:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9ca88ca80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:88a2002e-2ea7-4f07-912a-8d001832cfc0:7166:1869752384366592:0@lo:502: 00000100:00100000:2.0:1783134878.859402:0:7166:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783134878.859426:0:7166:0:(client.c:2701:ptlrpc_set_wait()) set ffff9fe9c9d166c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783134878.859606:0:5762:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384366592 00000100:00100000:3.0:1783134878.859611:0:5762:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384366592 00000100:00100000:3.0:1783134878.859708:0:5762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1783134878.859715:0:5762:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9d2869850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88a2002e-2ea7-4f07-912a-8d001832cfc0+15:7166:x1869752384366592:12345-0@lo:502: 00000100:00100000:3.0:1783134878.859904:0:5762:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9d2869850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88a2002e-2ea7-4f07-912a-8d001832cfc0+15:7166:x1869752384366592:12345-0@lo:502: Request processed in 188us (500us total) trans 0 rc 0/0 00000100:00100000:3.0:1783134878.859916:0:5762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1783134878.859977:0:7166:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9ca88ca80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:88a2002e-2ea7-4f07-912a-8d001832cfc0:7166:1869752384366592:0@lo:502: 00000020:01000000:2.0:1783134878.859997:0:7166:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1783134878.860003:0:7166:0:(obd_mount.c:952:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:2.0:1783134878.860009:0:7166:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783134878.860011:0:7166:0:(obd_config.c:1561:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:2.0:1783134878.860015:0:7166:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1783134878.860018:0:7166:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.201.141@tcp to nid 0x20000c0a8c98d (192.168.201.141@tcp) 00000020:01000000:2.0:1783134878.860040:0:7166:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1783134878.860042:0:7166:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1783134878.860054:0:7166:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff9fe9ca8999c0) 00000020:00000080:2.0:1783134878.860072:0:7166:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type osp with refcount 2 00000020:00000080:2.0:1783134878.860077:0:7166:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1783134878.860139:0:7166:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:2.0:1783134878.860144:0:7166:0:(osd_handler.c:1569:osd_obd_connect()) connect #5 00000020:00000080:2.0:1783134878.860150:0:7166:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xd6c4b8f05867e45b 00010000:00080000:2.0:1783134878.860174:0:7166:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9fe8c451c800@lustre-OST0000-osc-MDT0000: add connection 192.168.201.141@tcp at head 00010000:00010000:2.0:1783134878.860422:0:7166:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-3 is initialized 00000040:01000000:3.0:1783134878.893342:0:7166:0:(llog_osd.c:2237:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:3.0:1783134878.893362:0:7166:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:3.0:1783134878.893807:0:7166:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1783134878.893913:0:7166:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1783134878.893943:0:7166:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:3.0:1783134878.893998:0:7166:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000040:00080000:1.0:1783134878.894378:0:7169:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1783134878.894383:0:7169:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000020:00000080:3.0:1783134878.894938:0:7166:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1783134878.894949:0:7166:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1783134878.894978:0:7166:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:3.0:1783134878.894997:0:7166:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xd6c4b8f05867e462 00000100:00080000:3.0:1783134878.895008:0:7166:0:(import.c:512:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1783134878.895014:0:7166:0:(import.c:626:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9fe8c451c800 using connection 192.168.201.141@tcp/0@lo 00000100:00100000:3.0:1783134878.895046:0:7166:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9fe9e0475c00 x1869752384366720/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1783134878.895070:0:7166:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00100000:0.0:1783134878.895108:0:3285:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9e0475c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3285:1869752384366720:0@lo:8: 00000020:01000000:3.0:1783134878.895138:0:7166:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1783134878.895144:0:7166:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783134878.895146:0:7166:0:(obd_config.c:1561:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:3.0:1783134878.895149:0:7166:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1783134878.895154:0:7166:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783134878.895156:0:7166:0:(obd_config.c:1561:class_process_config()) marker 14 (0x1) lustre sys.timeout 00000020:00000080:3.0:1783134878.895159:0:7166:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1783134878.895161:0:7166:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:0.0:1783134878.895177:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783134878.895188:0:7166:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9e0475880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:88a2002e-2ea7-4f07-912a-8d001832cfc0:7166:1869752384366848:0@lo:502: 00000100:00100000:3.0:1783134878.895241:0:7166:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783134878.895250:0:6574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384366720 00000100:00100000:0.0:1783134878.895257:0:6574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384366720 00000100:00100000:3.0:1783134878.895261:0:7166:0:(client.c:2701:ptlrpc_set_wait()) set ffff9fe9f42c3240 going to sleep for 11 seconds 00000100:00100000:3.0:1783134878.895312:0:5765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384366848 00000100:00100000:3.0:1783134878.895317:0:5765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384366848 00000100:00100000:0.0:1783134878.895333:0:6574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1783134878.895342:0:6574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9f5ca5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3285:x1869752384366720:12345-0@lo:8: 00000100:00100000:3.0:1783134878.895358:0:5765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00010000:00080000:0.0:1783134878.895365:0:6574:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 161 last 0 00000100:00100000:3.0:1783134878.895369:0:5765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9d286a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88a2002e-2ea7-4f07-912a-8d001832cfc0+15:7166:x1869752384366848:12345-0@lo:502: 00000020:00000080:0.0:1783134878.895392:0:6574:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xd6c4b8f05867e469 00002000:00100000:0.0:1783134878.895421:0:6574:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff9fe8c4e42800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113653 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:0.0:1783134878.895426:0:6574:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00000001:00000004:0.0:1783134878.895431:0:6574:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:0.0:1783134878.895590:0:6574:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00000100:00100000:3.0:1783134878.895630:0:5765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9d286a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88a2002e-2ea7-4f07-912a-8d001832cfc0+15:7166:x1869752384366848:12345-0@lo:502: Request processed in 264us (388us total) trans 0 rc 0/0 00000100:00100000:3.0:1783134878.895640:0:5765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1783134878.895708:0:7166:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9e0475880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:88a2002e-2ea7-4f07-912a-8d001832cfc0:7166:1869752384366848:0@lo:502: 00000020:01000000:3.0:1783134878.895735:0:7166:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1783134878.895740:0:7166:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783134878.895742:0:7166:0:(obd_config.c:1561:class_process_config()) marker 14 (0x2) lustre sys.timeout 00000040:00080000:3.0:1783134878.895746:0:7166:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 25 count 25 00002000:00080000:0.0:1783134878.895785:0:6574:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1783134878.895811:0:6574:0:(import.c:65:import_set_state_nolock()) ffff9fe8c4e40800 : changing import state from RECOVER to FULL 00000020:01000000:3.0:1783134878.895839:0:5767:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 16-24 (rc=0) 10000000:01000000:3.0:1783134878.895860:0:5767:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.201.141@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00000100:00100000:0.0:1783134878.895861:0:6574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9f5ca5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3285:x1869752384366720:12345-0@lo:8: Request processed in 517us (683us total) trans 0 rc 0/0 00010000:00010000:3.0:1783134878.895871:0:5767:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.141@tcp lock: ffff9fe9c1523a00/0xd6c4b8f05867e446 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xd6c4b8f05867e44d expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783134878.895873:0:6574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:3.0:1783134878.895886:0:5767:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.141@tcp lock: ffff9fe9c1523a00/0xd6c4b8f05867e446 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xd6c4b8f05867e44d expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783134878.895896:0:5767:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:3.0:1783134878.895899:0:5767:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-sptlrpc-ffff9fe9d13819c0 from 1 10000000:01000000:3.0:1783134878.895902:0:5767:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00080000:0.0:1783134878.895922:0:3285:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9fe9e0475c00 x1869752384366720/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1783134888 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00010000:00010000:3.0:1783134878.895925:0:5767:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.141@tcp lock: ffff9fe9d2b74a00/0xd6c4b8f05867e470 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783134878.895943:0:3285:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00010000:00010000:3.0:1783134878.895944:0:5767:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.141@tcp lock: ffff9fe9d2b74a00/0xd6c4b8f05867e470 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1783134878.895950:0:3285:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 1 00010000:00010000:3.0:1783134878.895955:0:5767:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.141@tcp lock: ffff9fe9d2b74a00/0xd6c4b8f05867e470 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1783134878.895959:0:3285:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1783134878.895965:0:3285:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:0.0:1783134878.895967:0:3285:0:(import.c:65:import_set_state_nolock()) ffff9fe8c451c800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1783134878.895978:0:3285:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1783134878.895986:0:5767:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9e0475880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88a2002e-2ea7-4f07-912a-8d001832cfc0:5767:1869752384366976:0@lo:101: 00000100:00100000:0.0:1783134878.895986:0:3285:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9e0475c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3285:1869752384366720:0@lo:8: 00000100:00100000:3.0:1783134878.896019:0:5767:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783134878.896049:0:5767:0:(client.c:2701:ptlrpc_set_wait()) set ffff9fe9f42c3240 going to sleep for 11 seconds 00000100:00100000:1.0:1783134878.896134:0:3287:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9f6730e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3287:1869752384367104:0@lo:400: 00000100:00100000:1.0:1783134878.896168:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783134878.896216:0:3288:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9f6733800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3288:1869752384367232:0@lo:400: 00000100:00100000:1.0:1783134878.896241:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783134878.896272:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384367104 00000100:00100000:1.0:1783134878.896312:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384367104 00000100:00100000:1.0:1783134878.896340:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384367232 00000100:00100000:1.0:1783134878.896343:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384367232 00000100:00100000:1.0:1783134878.896358:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1783134878.896364:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9f6730380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3287:x1869752384367104:12345-0@lo:400: 00000100:00100000:1.0:1783134878.896400:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9f6730380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3287:x1869752384367104:12345-0@lo:400: Request processed in 36us (231us total) trans 0 rc 0/0 00000100:00100000:1.0:1783134878.896407:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1783134878.896419:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1783134878.896425:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9f6732d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3288:x1869752384367232:12345-0@lo:400: 00000100:00100000:1.0:1783134878.896455:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9f6732d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3288:x1869752384367232:12345-0@lo:400: Request processed in 31us (213us total) trans 0 rc 0/0 00000100:00100000:1.0:1783134878.896461:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:1.0:1783134878.896489:0:3288:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9fe9f6733800 x1869752384367232/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783134894 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783134878.896499:0:3288:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9f6733800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3288:1869752384367232:0@lo:400: 00010000:00080000:1.0:1783134878.896521:0:3287:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9fe9f6730e00 x1869752384367104/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783134894 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783134878.896530:0:3287:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9f6730e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3287:1869752384367104:0@lo:400: 00000004:00080000:1.0:1783134878.896546:0:7169:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1783134878.896638:0:7169:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 161292357815ns, next at 0ns, rc = 0 00000100:00100000:0.0:1783134878.896788:0:5763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384366976 00000100:00100000:0.0:1783134878.896793:0:5763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384366976 00000100:00100000:0.0:1783134878.896828:0:5763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1783134878.896835:0:5763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9d286a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88a2002e-2ea7-4f07-912a-8d001832cfc0+15:5767:x1869752384366976:12345-0@lo:101: 00010000:00010000:0.0:1783134878.896843:0:5763:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783134878.896855:0:5763:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fe9c0030200/0xd6c4b8f05867e477 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xd6c4b8f05867e470 expref: -99 pid: 5763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134878.896876:0:5763:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fe9c0030200/0xd6c4b8f05867e477 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd6c4b8f05867e470 expref: 16 pid: 5763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134878.896887:0:5763:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fe9c0030200/0xd6c4b8f05867e477 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd6c4b8f05867e470 expref: 16 pid: 5763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134878.896907:0:5763:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fe9c0030200, rc 0) 00000100:00100000:0.0:1783134878.896937:0:5763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9d286a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88a2002e-2ea7-4f07-912a-8d001832cfc0+16:5767:x1869752384366976:12345-0@lo:101: Request processed in 102us (917us total) trans 0 rc 0/0 00000100:00100000:0.0:1783134878.896944:0:5763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1783134878.899541:0:5767:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9e0475880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88a2002e-2ea7-4f07-912a-8d001832cfc0:5767:1869752384366976:0@lo:101: 00010000:00010000:3.0:1783134878.899571:0:5767:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.141@tcp lock: ffff9fe9d2b74a00/0xd6c4b8f05867e470 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xd6c4b8f05867e477 expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134878.899585:0:5767:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.141@tcp lock: ffff9fe9d2b74a00/0xd6c4b8f05867e470 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xd6c4b8f05867e477 expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783134878.899660:0:5767:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9e0475880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88a2002e-2ea7-4f07-912a-8d001832cfc0:5767:1869752384367360:0@lo:501: 00000100:00100000:3.0:1783134878.899714:0:5767:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783134878.899750:0:5767:0:(client.c:2701:ptlrpc_set_wait()) set ffff9fe9f42c3240 going to sleep for 11 seconds 00000100:00100000:0.0:1783134878.899809:0:5762:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384367360 00000100:00100000:0.0:1783134878.899816:0:5762:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384367360 00000100:00100000:0.0:1783134878.899854:0:5762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1783134878.899864:0:5762:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9d2868450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88a2002e-2ea7-4f07-912a-8d001832cfc0+16:5767:x1869752384367360:12345-0@lo:501: 00000100:00100000:0.0:1783134878.900156:0:5762:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9d2868450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88a2002e-2ea7-4f07-912a-8d001832cfc0+16:5767:x1869752384367360:12345-0@lo:501: Request processed in 292us (439us total) trans 0 rc -2/-2 00000100:00100000:0.0:1783134878.900165:0:5762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1783134878.900377:0:5767:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9e0475880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88a2002e-2ea7-4f07-912a-8d001832cfc0:5767:1869752384367360:0@lo:501: 10000000:01000000:3.0:1783134878.900403:0:5767:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.201.141@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1783134878.900411:0:5767:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.141@tcp lock: ffff9fe9d2b74a00/0xd6c4b8f05867e470 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xd6c4b8f05867e477 expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134878.900420:0:5767:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.141@tcp lock: ffff9fe9d2b74a00/0xd6c4b8f05867e470 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xd6c4b8f05867e477 expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1783134878.923519:0:5791:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000004:00080000:3.0:1783134878.924632:0:7170:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x100000000:0x1:0x0] 00000100:00100000:3.0:1783134878.924659:0:7170:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9e0475c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7170:1869752384367616:0@lo:7: 00000100:00100000:1.0:1783134878.924659:0:3289:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9e0475880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1869752384367488:0@lo:13: 00000100:00100000:3.0:1783134878.924730:0:7170:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783134878.924730:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783134878.924770:0:7170:0:(client.c:2701:ptlrpc_set_wait()) set ffff9fe9f42c36c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783134878.924799:0:6578:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384367488 00000100:00100000:1.0:1783134878.924805:0:6578:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384367488 00000100:00080000:3.0:1783134878.924840:0:5766:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1783134878.924862:0:6578:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1783134878.924870:0:6578:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9f6730e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3289:x1869752384367488:12345-0@lo:13: 00002000:00000024:1.0:1783134878.924901:0:6578:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3860856832 avail 3858759680 00000100:00100000:1.0:1783134878.924996:0:6578:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9f6730e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3289:x1869752384367488:12345-0@lo:13: Request processed in 126us (267us total) trans 0 rc 0/0 00000100:00100000:1.0:1783134878.925004:0:6578:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1783134878.925048:0:3289:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9fe9e0475880 x1869752384367488/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783134894 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783134878.925063:0:3289:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9e0475880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1869752384367488:0@lo:13: 00000100:00100000:3.0:1783134878.925350:0:6577:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384367616 00000100:00100000:3.0:1783134878.925554:0:6577:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384367616 00000100:00100000:3.0:1783134878.925594:0:6577:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1783134878.925602:0:6577:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9e0476680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:7170:x1869752384367616:12345-0@lo:7: 00002000:00080000:2.0:1783134878.936938:0:6577:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x0 00002000:00080000:2.0:1783134878.936946:0:6577:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x100000000:0x0:0x0] 00000100:00100000:2.0:1783134878.937032:0:6577:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9e0476680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:7170:x1869752384367616:12345-0@lo:7: Request processed in 11427us (12300us total) trans 0 rc 0/0 00000100:00100000:2.0:1783134878.937044:0:6577:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1783134878.937130:0:7170:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9fe9e0475c00 x1869752384367616/t0(0) o7->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1783134894 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783134878.937146:0:7170:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9e0475c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7170:1869752384367616:0@lo:7: 00000004:00080000:3.0:1783134878.937158:0:7170:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0000: Got last_fid [0x100000000:0x0:0x0] 00000100:00100000:3.0:1783134878.937252:0:7170:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9e0475c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7170:1869752384367744:0@lo:5: 00000100:00100000:3.0:1783134878.937325:0:7170:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783134878.937417:0:7170:0:(client.c:2701:ptlrpc_set_wait()) set ffff9fe9f42c36c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783134878.937459:0:6574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384367744 00000100:00100000:2.0:1783134878.937466:0:6574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384367744 00000100:00100000:2.0:1783134878.937686:0:6574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1783134878.937697:0:6574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9e0475880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:7170:x1869752384367744:12345-0@lo:5: 00002000:00080000:2.0:1783134878.937724:0:6574:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:2.0:1783134878.937728:0:6574:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 1 objects in group 0x0 at 1 00000100:00100000:2.0:1783134878.937965:0:6574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9e0475880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:7170:x1869752384367744:12345-0@lo:5: Request processed in 270us (638us total) trans 4294967297 rc 0/0 00000100:00100000:2.0:1783134878.937972:0:6574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1783134878.938042:0:7170:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9fe9e0475c00 x1869752384367744/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1783134894 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783134878.938054:0:7170:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9e0475c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7170:1869752384367744:0@lo:5: 00000004:00080000:3.0:1783134878.938062:0:7170:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x100000000:0x1:0x0] from OST, last_created [0x100000000:0x1:0x0]last_used is [0x100000000:0x1:0x0] 00000100:00100000:3.0:1783134878.938085:0:7170:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9e0474700 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7170:1869752384367872:0@lo:700: 00000100:00100000:3.0:1783134878.938114:0:7170:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783134878.938140:0:7170:0:(client.c:2701:ptlrpc_set_wait()) set ffff9fe9f42c36c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783134878.938194:0:6583:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384367872 00000100:00100000:0.0:1783134878.938199:0:6583:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384367872 00000100:00100000:0.0:1783134878.938233:0:6583:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1783134878.938241:0:6583:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9e0474a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:7170:x1869752384367872:12345-0@lo:700: 00000100:00100000:0.0:1783134878.938363:0:6583:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9f5ca7480 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6583:1869752384368000:0@lo:700: 00000100:00100000:0.0:1783134878.938398:0:6583:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783134878.938419:0:6583:0:(client.c:2701:ptlrpc_set_wait()) set ffff9fe9f8bb3300 going to sleep for 11 seconds 00000100:00100000:1.0:1783134878.938521:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384368000 00000100:00100000:1.0:1783134878.938526:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384368000 00000100:00100000:1.0:1783134878.938552:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1783134878.938559:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9f5ca7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6583:x1869752384368000:12345-0@lo:700: 40000000:02000000:3.0:1783134878.961717:0:5776:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:0:ost 00000100:00100000:3.0:1783134878.965123:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9f5ca7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6583:x1869752384368000:12345-0@lo:700: Request processed in 26555us (26715us total) trans 0 rc 0/0 00000100:00100000:3.0:1783134878.965160:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1783134878.965182:0:6583:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9fe9f5ca7480 x1869752384368000/t0(0) o700->lustre-MDT0000-lwp-OST0000@0@lo:32/10 lens 264/248 e 0 to 0 dl 1783134894 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783134878.965198:0:6583:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9f5ca7480 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6583:1869752384368000:0@lo:700: 40000000:02000000:1.0:1783134878.965211:0:6583:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0000-super: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:0:ost] 00010000:00010000:2.0:1783134878.980475:0:6591:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1783134879.014797:0:6602:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:0.0:1783134879.014822:0:6602:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967297 is committed 00000100:00100000:3.0:1783134879.015082:0:6583:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9e0474a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:7170:x1869752384367872:12345-0@lo:700: Request processed in 76837us (76962us total) trans 0 rc 0/0 00010000:00080000:0.0:1783134879.015111:0:7170:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9fe9e0474700 x1869752384367872/t0(0) o700->lustre-OST0000-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1783134894 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783134879.015115:0:6583:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1783134879.015122:0:7170:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:0.0:1783134879.015156:0:7170:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9e0474700 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7170:1869752384367872:0@lo:700: 00000004:02000040:2.0:1783134879.023762:0:7170:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x240000400 00000100:00100000:2.0:1783134879.025890:0:7170:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9ca88ca80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7170:1869752384368128:0@lo:5: 00000100:00100000:2.0:1783134879.025951:0:7170:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783134879.026000:0:7170:0:(client.c:2701:ptlrpc_set_wait()) set ffff9fe9c9d163c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783134879.026010:0:6577:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384368128 00000100:00100000:0.0:1783134879.026031:0:6577:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384368128 00000100:00100000:0.0:1783134879.026080:0:6577:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1783134879.026088:0:6577:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9ca88c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:7170:x1869752384368128:12345-0@lo:5: 00002000:00080000:0.0:1783134879.028844:0:6577:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:0.0:1783134879.028859:0:6577:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 2 00000100:00100000:0.0:1783134879.030517:0:6577:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9ca88c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:7170:x1869752384368128:12345-0@lo:5: Request processed in 4425us (4560us total) trans 4294967298 rc 0/0 00000100:00100000:0.0:1783134879.030527:0:6577:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:2.0:1783134879.030542:0:7170:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9fe9ca88ca80 x1869752384368128/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1783134895 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783134879.030559:0:7170:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9ca88ca80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7170:1869752384368128:0@lo:5: 00000004:00080000:2.0:1783134879.030574:0:7170:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x1:0x0]-[0x240000400:0x21:0x0] 00010000:00010000:0.0:1783134880.004562:0:5758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783134881.027602:0:5757:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1783134881.549892:0:7455:0:(obd_mount.c:914:lmd_print()) mount data: 00000020:01000004:3.0:1783134881.549896:0:7455:0:(obd_mount.c:917:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:3.0:1783134881.550032:0:7455:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff9fe8c47e1800 00000020:01000004:3.0:1783134881.550047:0:7455:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:3.0:1783134881.550059:0:7455:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:3.0:1783134881.550071:0:7455:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff9fe9d0e84d40) 00000020:00000080:3.0:1783134881.550085:0:7455:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1783134881.567720:0:7455:0:(scrub.c:229:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:2.0:1783134881.567956:0:7455:0:(scrub.c:229:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:2.0:1783134881.582315:0:7455:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:2.0:1783134881.584679:0:7455:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:2.0:1783134881.584707:0:7455:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:2.0:1783134881.584741:0:7455:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:2.0:1783134881.584755:0:7455:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:2.0:1783134881.584998:0:7455:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:2.0:1783134881.585007:0:7455:0:(osd_handler.c:1569:osd_obd_connect()) connect #0 00000020:00000080:2.0:1783134881.585015:0:7455:0:(genops.c:1406:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xd6c4b8f05867e485 00000020:01000004:2.0:1783134881.585021:0:7455:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:2.0:1783134881.585039:0:7455:0:(obd_mount.c:394:lustre_start_mgc()) MGC192.168.201.141@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1783134881.585041:0:7455:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.201.141@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1783134881.585045:0:7455:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0001 00000020:01000004:2.0:1783134881.585060:0:7455:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:2.0:1783134881.585063:0:7455:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.141@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:1.0:1783134881.599603:0:7455:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.141@tcp ctxt 0 is initialized 00000020:01000004:1.0:1783134881.599641:0:7455:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.201.141@tcp, index=0001, flags=0x20062 00000020:01000004:1.0:1783134881.599646:0:7455:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1783134881.599648:0:7455:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1783134881.599649:0:7455:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1783134881.599650:0:7455:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1783134881.599651:0:7455:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1783134881.599653:0:7455:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1783134881.599654:0:7455:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1783134881.599655:0:7455:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1783134881.599657:0:7455:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1783134881.599658:0:7455:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1783134881.599659:0:7455:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1783134881.599663:0:7455:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020062 00000020:01000004:1.0:1783134881.599665:0:7455:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1783134881.599667:0:7455:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1783134881.599668:0:7455:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1783134881.599674:0:7455:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1783134881.599675:0:7455:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1783134881.599676:0:7455:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1783134881.599677:0:7455:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1783134881.599678:0:7455:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1783134881.599678:0:7455:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1783134881.599679:0:7455:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1783134881.599680:0:7455:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1783134881.599707:0:7455:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:1.0:1783134881.599724:0:7455:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9f6733800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:88a2002e-2ea7-4f07-912a-8d001832cfc0:7455:1869752384368256:0@lo:253: 00000100:00100000:1.0:1783134881.599791:0:7455:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783134881.599842:0:7455:0:(client.c:2701:ptlrpc_set_wait()) set ffff9fe9fe99e180 going to sleep for 11 seconds 00000100:00100000:3.0:1783134881.601424:0:5765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384368256 00000100:00100000:3.0:1783134881.601434:0:5765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384368256 00000100:00100000:3.0:1783134881.601501:0:5765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1783134881.601511:0:5765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9d0e61050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88a2002e-2ea7-4f07-912a-8d001832cfc0+16:7455:x1869752384368256:12345-0@lo:253: 20000000:01000000:3.0:1783134881.601545:0:5765:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:3.0:1783134881.601549:0:5765:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0001, index=1 20000000:01000000:3.0:1783134881.601554:0:5765:0:(mgs_llog.c:867:mgs_set_index()) Set index for lustre-OST0001 to 1 20000000:01000000:3.0:1783134881.601558:0:5765:0:(mgs_llog.c:3853:mgs_write_log_ost()) writing new ost lustre-OST0001 00000040:00080000:3.0:1783134881.602546:0:5765:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1783134881.602757:0:5765:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 20000000:01000000:3.0:1783134881.602772:0:5765:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-OST0001 0xcf001 obdfilter lustre-OST0001_UUID (null) (null) 00000040:00080000:3.0:1783134881.602812:0:5765:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 128 off8544 20000000:01000000:3.0:1783134881.602821:0:5765:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-OST0001 0xcf003 dev type f (null) 00000040:00080000:3.0:1783134881.602853:0:5765:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 112 off8656 00000040:00080000:3.0:1783134881.602917:0:5765:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8880 00000040:00080000:3.0:1783134881.603191:0:5765:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 224 off12648 20000000:01000000:3.0:1783134881.603210:0:5765:0:(mgs_llog.c:3806:mgs_write_log_osc_to_lov()) add nid 192.168.201.141@tcp 20000000:01000000:3.0:1783134881.603212:0:5765:0:(mgs_llog.c:1536:record_base_raw()) lcfg (null) 0xcf005 192.168.201.141@tcp (null) (null) (null) 00000040:00080000:3.0:1783134881.603246:0:5765:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 88 off12736 20000000:01000000:3.0:1783134881.603273:0:5765:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:3.0:1783134881.604385:0:5765:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 144 off12880 20000000:01000000:3.0:1783134881.604397:0:5765:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf003 lustre-OST0001_UUID 192.168.201.141@tcp (null) (null) 00000040:00080000:3.0:1783134881.604448:0:5765:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 152 off13032 20000000:01000000:3.0:1783134881.604458:0:5765:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:3.0:1783134881.604490:0:5765:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 136 off13168 00000040:00080000:3.0:1783134881.604543:0:5765:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13392 00000040:00080000:3.0:1783134881.605205:0:5765:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].30, 224 off13416 20000000:01000000:3.0:1783134881.605224:0:5765:0:(mgs_llog.c:3806:mgs_write_log_osc_to_lov()) add nid 192.168.201.141@tcp 20000000:01000000:3.0:1783134881.605225:0:5765:0:(mgs_llog.c:1536:record_base_raw()) lcfg (null) 0xcf005 192.168.201.141@tcp (null) (null) (null) 00000040:00080000:3.0:1783134881.605455:0:5765:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].31, 88 off13504 20000000:01000000:3.0:1783134881.605465:0:5765:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-OST0001-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:3.0:1783134881.605501:0:5765:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].32, 128 off13632 20000000:01000000:3.0:1783134881.605509:0:5765:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-OST0001-osc 0xcf003 lustre-OST0001_UUID 192.168.201.141@tcp (null) (null) 00000040:00080000:3.0:1783134881.605539:0:5765:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].33, 144 off13776 20000000:01000000:3.0:1783134881.605548:0:5765:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:3.0:1783134881.605595:0:5765:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].34, 128 off13904 00000040:00080000:3.0:1783134881.605634:0:5765:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].35, 224 off14128 20000000:01000000:3.0:1783134881.605649:0:5765:0:(mgs_llog.c:5244:mgs_write_log_target()) remaining string: ' sys.timeout=20 ', param: 'autodegrade=on' 20000000:01000000:3.0:1783134881.605652:0:5765:0:(mgs_llog.c:4738:mgs_write_log_param()) next param 'autodegrade=on' 20000000:01000000:3.0:1783134881.605658:0:5765:0:(mgs_llog.c:5244:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:3.0:1783134881.605660:0:5765:0:(mgs_llog.c:4738:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:3.0:1783134881.605662:0:5765:0:(mgs_llog.c:4172:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:3.0:1783134881.605674:0:5765:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:3.0:1783134881.605677:0:5765:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:3.0:1783134881.605712:0:5765:0:(mgs_llog.c:2541:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:3.0:1783134881.605715:0:5765:0:(mgs_llog.c:1106:mgs_modify()) modify lustre-OST0001/lustre/sys.timeout fl=4 00000040:00080000:1.0:1783134881.606592:0:7457:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 5 count 5 00000040:00080000:3.0:1783134881.606802:0:5765:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9104 00000040:00080000:3.0:1783134881.606824:0:5765:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 80 off9184 00000040:00080000:3.0:1783134881.606858:0:5765:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 224 off9408 20000000:01000000:3.0:1783134881.606865:0:5765:0:(mgs_llog.c:2541:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:3.0:1783134881.606866:0:5765:0:(mgs_llog.c:1106:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:1.0:1783134881.607795:0:7458:0:(mgs_llog.c:1073:mgs_modify_handler()) Changing rec 22 marker 14 1->4: lustre sys.timeout 20000000:01000000:1.0:1783134881.607833:0:7458:0:(mgs_llog.c:1073:mgs_modify_handler()) Changing rec 24 marker 14 2->4: lustre sys.timeout 00000040:00080000:1.0:1783134881.607863:0:7458:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 31 count 31 00000040:00080000:3.0:1783134881.608023:0:5765:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 224 off13616 00000040:00080000:3.0:1783134881.608061:0:5765:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 80 off13696 00000040:00080000:3.0:1783134881.608114:0:5765:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 224 off13920 20000000:01000000:3.0:1783134881.608126:0:5765:0:(mgs_llog.c:2541:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:3.0:1783134881.608128:0:5765:0:(mgs_llog.c:1106:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 20000000:01000000:3.0:1783134881.608954:0:7459:0:(mgs_llog.c:1073:mgs_modify_handler()) Changing rec 5 marker 15 1->4: lustre sys.timeout 20000000:01000000:3.0:1783134881.609017:0:7459:0:(mgs_llog.c:1073:mgs_modify_handler()) Changing rec 7 marker 15 2->4: lustre sys.timeout 00000040:00080000:3.0:1783134881.609050:0:7459:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 8 count 8 00000040:00080000:1.0:1783134881.609592:0:5765:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 224 off9632 00000040:00080000:1.0:1783134881.609637:0:5765:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 80 off9712 00000040:00080000:1.0:1783134881.609689:0:5765:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off9936 20000000:01000000:1.0:1783134881.609702:0:5765:0:(mgs_llog.c:2541:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:1.0:1783134881.609704:0:5765:0:(mgs_llog.c:1106:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:2.0:1783134881.610137:0:7460:0:(mgs_llog.c:1073:mgs_modify_handler()) Changing rec 27 marker 16 1->4: lustre sys.timeout 20000000:01000000:2.0:1783134881.610177:0:7460:0:(mgs_llog.c:1073:mgs_modify_handler()) Changing rec 29 marker 16 2->4: lustre sys.timeout 00000040:00080000:2.0:1783134881.610226:0:7460:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 36 count 36 00000040:00080000:1.0:1783134881.610637:0:5765:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].36, 224 off14352 00000040:00080000:1.0:1783134881.610674:0:5765:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].37, 80 off14432 00000040:00080000:1.0:1783134881.610706:0:5765:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].38, 224 off14656 10000000:01000000:1.0:1783134881.610722:0:5765:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:1.0:1783134881.610739:0:5765:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9fea02167a00/0xd6c4b8f05867e48c lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134881.610756:0:5765:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9fe9d2b75600/0xd6c4b8f05867e3dd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd6c4b8f05867e3d6 expref: 16 pid: 5763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134881.610764:0:5765:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9fe9c0030000/0xd6c4b8f05867e407 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd6c4b8f05867e400 expref: 16 pid: 5763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134881.610781:0:5765:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9fe9c1523400/0xd6c4b8f05867e431 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd6c4b8f05867e42a expref: 16 pid: 5762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134881.610787:0:5765:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9fe9d2b75400/0xd6c4b8f05867e44d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd6c4b8f05867e446 expref: 16 pid: 5762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134881.610793:0:5765:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9fe9c0030200/0xd6c4b8f05867e477 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd6c4b8f05867e470 expref: 16 pid: 5763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134881.610801:0:5765:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9fea02167a00/0xd6c4b8f05867e48c lrc: 8/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134881.610836:0:5765:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9fe9c0030200/0xd6c4b8f05867e477 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd6c4b8f05867e470 expref: 16 pid: 5763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134881.610849:0:5765:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9fe9c0030200/0xd6c4b8f05867e477 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd6c4b8f05867e470 expref: 16 pid: 5763 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783134881.610863:0:5765:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9f6730a80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5765:1869752384368384:0@lo:104: 00000100:00100000:1.0:1783134881.610926:0:5765:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1783134881.610977:0:5765:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9fe9d2b75400/0xd6c4b8f05867e44d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd6c4b8f05867e446 expref: 16 pid: 5762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134881.610986:0:5765:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9fe9d2b75400/0xd6c4b8f05867e44d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd6c4b8f05867e446 expref: 16 pid: 5762 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783134881.610994:0:5765:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9f6730000 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5765:1869752384368512:0@lo:104: 00010000:00010000:1.0:1783134881.611019:0:5765:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9fe9c1523400/0xd6c4b8f05867e431 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd6c4b8f05867e42a expref: 16 pid: 5762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134881.611038:0:5765:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9fe9c1523400/0xd6c4b8f05867e431 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd6c4b8f05867e42a expref: 16 pid: 5762 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783134881.611046:0:5765:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9f6732680 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5765:1869752384368640:0@lo:104: 00010000:00010000:1.0:1783134881.611073:0:5765:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9fe9c0030000/0xd6c4b8f05867e407 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd6c4b8f05867e400 expref: 16 pid: 5763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134881.611081:0:5765:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9fe9c0030000/0xd6c4b8f05867e407 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd6c4b8f05867e400 expref: 16 pid: 5763 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783134881.611088:0:5765:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9f6730700 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5765:1869752384368768:0@lo:104: 00010000:00010000:1.0:1783134881.611111:0:5765:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9fe9d2b75600/0xd6c4b8f05867e3dd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd6c4b8f05867e3d6 expref: 16 pid: 5763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134881.611119:0:5765:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9fe9d2b75600/0xd6c4b8f05867e3dd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd6c4b8f05867e3d6 expref: 16 pid: 5763 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783134881.611127:0:5765:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9f6733b80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5765:1869752384368896:0@lo:104: 00000100:00100000:1.0:1783134881.611144:0:5765:0:(client.c:2701:ptlrpc_set_wait()) set ffff9fe9fe99e600 going to sleep for 11 seconds 00000100:00100000:2.0:1783134881.611202:0:5753:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1783134881.611220:0:5753:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783134881.611246:0:5753:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783134881.611274:0:5753:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783134881.611314:0:5753:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783134881.611324:0:5753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384368384 00000100:00100000:3.0:1783134881.611330:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384368512 00000100:00100000:2.0:1783134881.611331:0:5753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384368384 00000100:00100000:3.0:1783134881.611337:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384368512 00000100:00100000:3.0:1783134881.611367:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384368640 00000100:00100000:3.0:1783134881.611369:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384368640 00000100:00100000:2.0:1783134881.611370:0:5753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384368768 00000100:00100000:2.0:1783134881.611375:0:5753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384368768 00000100:00100000:3.0:1783134881.611380:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384368896 00000100:00100000:3.0:1783134881.611383:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384368896 00000100:00100000:2.0:1783134881.611400:0:5753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1783134881.611473:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1783134881.611486:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9ca88e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:88a2002e-2ea7-4f07-912a-8d001832cfc0+7:5765:x1869752384368512:12345-0@lo:104: 00000100:00100000:2.0:1783134881.611486:0:5753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9d1762050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:88a2002e-2ea7-4f07-912a-8d001832cfc0+7:5765:x1869752384368384:12345-0@lo:104: 00010000:00010000:3.0:1783134881.611499:0:6590:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.141@tcp lock: ffff9fe9c1523a00/0xd6c4b8f05867e446 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xd6c4b8f05867e44d expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134881.611501:0:5753:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.141@tcp lock: ffff9fe9d2b74a00/0xd6c4b8f05867e470 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0xd6c4b8f05867e477 expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134881.611568:0:6590:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1783134881.611572:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9ca88e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:88a2002e-2ea7-4f07-912a-8d001832cfc0+7:5765:x1869752384368512:12345-0@lo:104: Request processed in 94us (352us total) trans 0 rc 0/0 00000100:00100000:3.0:1783134881.611578:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1783134881.611592:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1783134881.611596:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9ca88d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:88a2002e-2ea7-4f07-912a-8d001832cfc0+6:5765:x1869752384368640:12345-0@lo:104: 00010000:00010000:3.0:1783134881.611601:0:6590:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.141@tcp lock: ffff9fe9d2b75a00/0xd6c4b8f05867e42a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xd6c4b8f05867e431 expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134881.611682:0:5753:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1783134881.611694:0:5753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9d1762050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:88a2002e-2ea7-4f07-912a-8d001832cfc0+6:5765:x1869752384368384:12345-0@lo:104: Request processed in 286us (768us total) trans 0 rc 0/0 00000100:00100000:2.0:1783134881.611706:0:5753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1783134881.611743:0:5753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1783134881.611749:0:5753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9ca88ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:88a2002e-2ea7-4f07-912a-8d001832cfc0+5:5765:x1869752384368768:12345-0@lo:104: 00010000:00010000:2.0:1783134881.611757:0:5753:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.141@tcp lock: ffff9fe9d2b75800/0xd6c4b8f05867e400 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xd6c4b8f05867e407 expref: -99 pid: 6572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134881.611794:0:5753:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1783134881.611799:0:5753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9ca88ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:88a2002e-2ea7-4f07-912a-8d001832cfc0+5:5765:x1869752384368768:12345-0@lo:104: Request processed in 51us (524us total) trans 0 rc 0/0 00000100:00100000:2.0:1783134881.611804:0:5753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1783134881.611815:0:5753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1783134881.611820:0:5753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9ca88d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:88a2002e-2ea7-4f07-912a-8d001832cfc0+4:5765:x1869752384368896:12345-0@lo:104: 00010000:00010000:2.0:1783134881.611827:0:5753:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.141@tcp lock: ffff9fe9c1523000/0xd6c4b8f05867e3d6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xd6c4b8f05867e3dd expref: -99 pid: 6572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134881.611860:0:6590:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00010000:00010000:2.0:1783134881.611861:0:5753:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:3.0:1783134881.611871:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9ca88d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:88a2002e-2ea7-4f07-912a-8d001832cfc0+4:5765:x1869752384368640:12345-0@lo:104: Request processed in 271us (621us total) trans 0 rc 0/0 00000100:00100000:2.0:1783134881.611872:0:5753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9ca88d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:88a2002e-2ea7-4f07-912a-8d001832cfc0+4:5765:x1869752384368896:12345-0@lo:104: Request processed in 48us (555us total) trans 0 rc 0/0 00000100:00100000:2.0:1783134881.611880:0:5753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1783134881.611890:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00010000:2.0:1783134881.611916:0:6591:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:2.0:1783134881.611922:0:6591:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.141@tcp lock: ffff9fe9c1523a00/0xd6c4b8f05867e446 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xd6c4b8f05867e44d expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134881.611930:0:6591:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe9c1523a00 already unused, calling callback (ffffffffc1b40c20) 10000000:00010000:2.0:1783134881.611933:0:6591:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.141@tcp lock: ffff9fe9c1523a00/0xd6c4b8f05867e446 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0xd6c4b8f05867e44d expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134881.611952:0:6591:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.141@tcp lock: ffff9fe9c1523a00/0xd6c4b8f05867e446 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0xd6c4b8f05867e44d expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783134881.611960:0:6591:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.141@tcp lock: ffff9fe9c1523a00/0xd6c4b8f05867e446 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0xd6c4b8f05867e44d expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783134881.611966:0:6591:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1783134881.611999:0:6591:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.141@tcp lock: ffff9fe9c1523a00/0xd6c4b8f05867e446 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd6c4b8f05867e44d expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134881.612006:0:6591:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1783134881.612021:0:6591:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.141@tcp lock: ffff9fe9c1523a00/0xd6c4b8f05867e446 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd6c4b8f05867e44d expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134881.612027:0:6591:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.141@tcp lock: ffff9fe9c1523a00/0xd6c4b8f05867e446 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd6c4b8f05867e44d expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134881.612039:0:6591:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1783134881.612041:0:6591:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.141@tcp lock: ffff9fe9d2b74a00/0xd6c4b8f05867e470 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xd6c4b8f05867e477 expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134881.612046:0:6591:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe9d2b74a00 already unused, calling callback (ffffffffc1b40c20) 10000000:00010000:2.0:1783134881.612049:0:6591:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.141@tcp lock: ffff9fe9d2b74a00/0xd6c4b8f05867e470 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xd6c4b8f05867e477 expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134881.612055:0:6591:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.141@tcp lock: ffff9fe9d2b74a00/0xd6c4b8f05867e470 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xd6c4b8f05867e477 expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783134881.612061:0:6591:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.141@tcp lock: ffff9fe9d2b74a00/0xd6c4b8f05867e470 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xd6c4b8f05867e477 expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783134881.612073:0:6591:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1783134881.612086:0:6591:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.141@tcp lock: ffff9fe9d2b74a00/0xd6c4b8f05867e470 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd6c4b8f05867e477 expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134881.612092:0:6591:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1783134881.612098:0:6591:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.141@tcp lock: ffff9fe9d2b74a00/0xd6c4b8f05867e470 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd6c4b8f05867e477 expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134881.612104:0:6591:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.141@tcp lock: ffff9fe9d2b74a00/0xd6c4b8f05867e470 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd6c4b8f05867e477 expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134881.612113:0:6591:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1783134881.612116:0:6591:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.141@tcp lock: ffff9fe9d2b75800/0xd6c4b8f05867e400 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xd6c4b8f05867e407 expref: -99 pid: 6572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134881.612122:0:6591:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe9d2b75800 already unused, calling callback (ffffffffc1b40c20) 10000000:00010000:2.0:1783134881.612125:0:6591:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.141@tcp lock: ffff9fe9d2b75800/0xd6c4b8f05867e400 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xd6c4b8f05867e407 expref: -99 pid: 6572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134881.612131:0:6591:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.141@tcp lock: ffff9fe9d2b75800/0xd6c4b8f05867e400 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xd6c4b8f05867e407 expref: -99 pid: 6572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783134881.612137:0:6591:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.141@tcp lock: ffff9fe9d2b75800/0xd6c4b8f05867e400 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xd6c4b8f05867e407 expref: -99 pid: 6572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783134881.612142:0:6591:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1783134881.612153:0:6591:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.141@tcp lock: ffff9fe9d2b75800/0xd6c4b8f05867e400 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd6c4b8f05867e407 expref: -99 pid: 6572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134881.612159:0:6591:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1783134881.612174:0:6591:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.141@tcp lock: ffff9fe9d2b75800/0xd6c4b8f05867e400 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd6c4b8f05867e407 expref: -99 pid: 6572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134881.612180:0:6591:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.141@tcp lock: ffff9fe9d2b75800/0xd6c4b8f05867e400 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd6c4b8f05867e407 expref: -99 pid: 6572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134881.612188:0:6591:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1783134881.612191:0:6591:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.141@tcp lock: ffff9fe9d2b75a00/0xd6c4b8f05867e42a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xd6c4b8f05867e431 expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134881.612196:0:6591:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe9d2b75a00 already unused, calling callback (ffffffffc1b40c20) 10000000:00010000:2.0:1783134881.612199:0:6591:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.141@tcp lock: ffff9fe9d2b75a00/0xd6c4b8f05867e42a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xd6c4b8f05867e431 expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134881.612205:0:6591:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.141@tcp lock: ffff9fe9d2b75a00/0xd6c4b8f05867e42a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xd6c4b8f05867e431 expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783134881.612210:0:6591:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.141@tcp lock: ffff9fe9d2b75a00/0xd6c4b8f05867e42a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xd6c4b8f05867e431 expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783134881.612215:0:6591:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1783134881.612227:0:6591:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.141@tcp lock: ffff9fe9d2b75a00/0xd6c4b8f05867e42a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd6c4b8f05867e431 expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134881.612232:0:6591:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1783134881.612236:0:6591:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.141@tcp lock: ffff9fe9d2b75a00/0xd6c4b8f05867e42a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd6c4b8f05867e431 expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134881.612242:0:6591:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.141@tcp lock: ffff9fe9d2b75a00/0xd6c4b8f05867e42a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd6c4b8f05867e431 expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134881.612250:0:6591:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783134881.612268:0:6591:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.141@tcp lock: ffff9fe9c1523000/0xd6c4b8f05867e3d6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xd6c4b8f05867e3dd expref: -99 pid: 6572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134881.612274:0:6591:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe9c1523000 already unused, calling callback (ffffffffc1b40c20) 10000000:00010000:2.0:1783134881.612277:0:6591:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.141@tcp lock: ffff9fe9c1523000/0xd6c4b8f05867e3d6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xd6c4b8f05867e3dd expref: -99 pid: 6572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134881.612313:0:6591:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.141@tcp lock: ffff9fe9c1523000/0xd6c4b8f05867e3d6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xd6c4b8f05867e3dd expref: -99 pid: 6572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783134881.612319:0:6591:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.141@tcp lock: ffff9fe9c1523000/0xd6c4b8f05867e3d6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xd6c4b8f05867e3dd expref: -99 pid: 6572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783134881.612325:0:6591:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1783134881.612339:0:6591:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.141@tcp lock: ffff9fe9c1523000/0xd6c4b8f05867e3d6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd6c4b8f05867e3dd expref: -99 pid: 6572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134881.612345:0:6591:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1783134881.612349:0:6591:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.141@tcp lock: ffff9fe9c1523000/0xd6c4b8f05867e3d6 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd6c4b8f05867e3dd expref: -99 pid: 6572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134881.612355:0:6591:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.141@tcp lock: ffff9fe9c1523000/0xd6c4b8f05867e3d6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd6c4b8f05867e3dd expref: -99 pid: 6572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134881.612368:0:6591:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783134881.612369:0:6591:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783134881.612371:0:6591:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783134881.612433:0:5758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783134881.612446:0:3286:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9ca88dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:88a2002e-2ea7-4f07-912a-8d001832cfc0:3286:1869752384369024:0@lo:103: 00000100:00100000:1.0:1783134881.612479:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783134881.612515:0:3286:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9ca88c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:88a2002e-2ea7-4f07-912a-8d001832cfc0:3286:1869752384369536:0@lo:103: 00000100:00100000:1.0:1783134881.612534:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783134881.612593:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1783134881.612600:0:3286:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9ca88d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:88a2002e-2ea7-4f07-912a-8d001832cfc0:3286:1869752384369152:0@lo:103: 00000100:00100000:1.0:1783134881.612653:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783134881.612682:0:3288:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9ca88e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:88a2002e-2ea7-4f07-912a-8d001832cfc0:3288:1869752384369280:0@lo:103: 00000100:00100000:1.0:1783134881.612716:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783134881.612734:0:3288:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1783134881.612740:0:3288:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9ca88ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:88a2002e-2ea7-4f07-912a-8d001832cfc0:3288:1869752384369408:0@lo:103: 00000100:00100000:1.0:1783134881.612759:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783134881.612781:0:5754:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384369024 00000100:00100000:1.0:1783134881.612786:0:5754:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384369024 00010000:00010000:1.0:1783134881.612806:0:5754:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9fe9d2b75400/0xd6c4b8f05867e44d lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd6c4b8f05867e446 expref: 17 pid: 5762 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783134881.612821:0:5754:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384369536 00000100:00100000:1.0:1783134881.612823:0:5754:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384369536 00010000:00010000:1.0:1783134881.612833:0:5754:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9fe9d2b75600/0xd6c4b8f05867e3dd lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd6c4b8f05867e3d6 expref: 18 pid: 5763 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783134881.612842:0:5754:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384369152 00000100:00100000:1.0:1783134881.612844:0:5754:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384369152 00010000:00010000:1.0:1783134881.612853:0:5754:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9fe9c0030200/0xd6c4b8f05867e477 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd6c4b8f05867e470 expref: 19 pid: 5763 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783134881.612862:0:5754:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384369280 00000100:00100000:1.0:1783134881.612864:0:5754:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384369280 00010000:00010000:1.0:1783134881.612872:0:5754:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9fe9c0030000/0xd6c4b8f05867e407 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd6c4b8f05867e400 expref: 20 pid: 5763 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783134881.612881:0:5754:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384369408 00000100:00100000:1.0:1783134881.612883:0:5754:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384369408 00010000:00010000:1.0:1783134881.612891:0:5754:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9fe9c1523400/0xd6c4b8f05867e431 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd6c4b8f05867e42a expref: 21 pid: 5762 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783134881.612914:0:5754:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1783134881.612921:0:5754:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9f6731180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:88a2002e-2ea7-4f07-912a-8d001832cfc0+21:3286:x1869752384369024:12345-0@lo:103: 00010000:00010000:1.0:1783134881.612932:0:5754:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783134881.612937:0:5754:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9fe9d2b75400/0xd6c4b8f05867e44d lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd6c4b8f05867e446 expref: 21 pid: 5762 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134881.612945:0:5754:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9fe9d2b75400/0xd6c4b8f05867e44d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd6c4b8f05867e446 expref: 21 pid: 5762 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134881.612960:0:5754:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783134881.612987:0:5754:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9f6731180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:88a2002e-2ea7-4f07-912a-8d001832cfc0+21:3286:x1869752384369024:12345-0@lo:103: Request processed in 67us (508us total) trans 0 rc 0/0 00000100:00100000:1.0:1783134881.612993:0:5754:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1783134881.613006:0:5754:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1783134881.613012:0:5754:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9f6732a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:88a2002e-2ea7-4f07-912a-8d001832cfc0+20:3286:x1869752384369536:12345-0@lo:103: 00010000:00010000:1.0:1783134881.613019:0:5754:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783134881.613023:0:5754:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9fe9d2b75600/0xd6c4b8f05867e3dd lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd6c4b8f05867e3d6 expref: 20 pid: 5763 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134881.613031:0:5754:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9fe9d2b75600/0xd6c4b8f05867e3dd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd6c4b8f05867e3d6 expref: 20 pid: 5763 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134881.613040:0:5754:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783134881.613062:0:5754:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9f6732a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:88a2002e-2ea7-4f07-912a-8d001832cfc0+20:3286:x1869752384369536:12345-0@lo:103: Request processed in 51us (527us total) trans 0 rc 0/0 00000100:00100000:1.0:1783134881.613068:0:5754:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1783134881.613080:0:5754:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1783134881.613093:0:5754:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9f6731880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:88a2002e-2ea7-4f07-912a-8d001832cfc0+19:3286:x1869752384369152:12345-0@lo:103: 00010000:00010000:1.0:1783134881.613101:0:5754:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783134881.613106:0:5754:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9fe9c0030200/0xd6c4b8f05867e477 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd6c4b8f05867e470 expref: 19 pid: 5763 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134881.613115:0:5754:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9fe9c0030200/0xd6c4b8f05867e477 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd6c4b8f05867e470 expref: 19 pid: 5763 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134881.613124:0:5754:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783134881.613146:0:5754:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9f6731880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:88a2002e-2ea7-4f07-912a-8d001832cfc0+19:3286:x1869752384369152:12345-0@lo:103: Request processed in 54us (492us total) trans 0 rc 0/0 00000100:00100000:1.0:1783134881.613152:0:5754:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1783134881.613164:0:5754:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1783134881.613170:0:5754:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9f6733100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:88a2002e-2ea7-4f07-912a-8d001832cfc0+18:3288:x1869752384369280:12345-0@lo:103: 00010000:00010000:1.0:1783134881.613177:0:5754:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783134881.613181:0:5754:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9fe9c0030000/0xd6c4b8f05867e407 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd6c4b8f05867e400 expref: 18 pid: 5763 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134881.613189:0:5754:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9fe9c0030000/0xd6c4b8f05867e407 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd6c4b8f05867e400 expref: 18 pid: 5763 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134881.613198:0:5754:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783134881.613223:0:5754:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9f6733100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:88a2002e-2ea7-4f07-912a-8d001832cfc0+18:3288:x1869752384369280:12345-0@lo:103: Request processed in 54us (507us total) trans 0 rc 0/0 00000100:00100000:1.0:1783134881.613230:0:5754:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1783134881.613242:0:5754:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1783134881.613248:0:5754:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9f6732300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:88a2002e-2ea7-4f07-912a-8d001832cfc0+17:3288:x1869752384369408:12345-0@lo:103: 00010000:00010000:1.0:1783134881.613270:0:5754:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783134881.613304:0:5754:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9fe9c1523400/0xd6c4b8f05867e431 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd6c4b8f05867e42a expref: 17 pid: 5762 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134881.613314:0:5754:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9fe9c1523400/0xd6c4b8f05867e431 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd6c4b8f05867e42a expref: 17 pid: 5762 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134881.613326:0:5754:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9fea02167a00/0xd6c4b8f05867e48c lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134881.613334:0:5754:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fea02167a00/0xd6c4b8f05867e48c lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134881.613348:0:5754:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9fea02167a00/0xd6c4b8f05867e48c lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134881.613355:0:5754:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9fea02167a00/0xd6c4b8f05867e48c lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134881.613365:0:5754:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9fea02167a00/0xd6c4b8f05867e48c lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134881.613371:0:5754:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9fea02167a00/0xd6c4b8f05867e48c lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134881.613377:0:5754:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fea02167a00 already unused, calling callback (ffffffffc1527ce0) 00010000:00010000:1.0:1783134881.613381:0:5754:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9fea02167a00/0xd6c4b8f05867e48c lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134881.613389:0:5754:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9fea02167a00/0xd6c4b8f05867e48c lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134881.613397:0:5754:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9fea02167a00/0xd6c4b8f05867e48c lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134881.613423:0:5754:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783134881.613449:0:5754:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9f6732300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:88a2002e-2ea7-4f07-912a-8d001832cfc0+17:3288:x1869752384369408:12345-0@lo:103: Request processed in 201us (688us total) trans 0 rc 0/0 00000100:00100000:1.0:1783134881.613457:0:5754:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00010000:0.0:1783134881.613472:0:5765:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fe9c0030200/0xd6c4b8f05867e477 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd6c4b8f05867e470 expref: 16 pid: 5763 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783134881.613490:0:5765:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9f6730a80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5765:1869752384368384:0@lo:104: 00000100:00100000:1.0:1783134881.613497:0:3288:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9ca88ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:88a2002e-2ea7-4f07-912a-8d001832cfc0:3288:1869752384369408:0@lo:103: 00010000:00010000:0.0:1783134881.613503:0:5757:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783134881.613508:0:3288:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9ca88e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:88a2002e-2ea7-4f07-912a-8d001832cfc0:3288:1869752384369280:0@lo:103: 00010000:00010000:0.0:1783134881.613532:0:5765:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fe9d2b75400/0xd6c4b8f05867e44d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd6c4b8f05867e446 expref: 15 pid: 5762 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783134881.613544:0:5765:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9f6730000 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5765:1869752384368512:0@lo:104: 00000100:00100000:1.0:1783134881.613545:0:3286:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9ca88d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:88a2002e-2ea7-4f07-912a-8d001832cfc0:3286:1869752384369152:0@lo:103: 00010000:00010000:0.0:1783134881.613565:0:5765:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fe9c1523400/0xd6c4b8f05867e431 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd6c4b8f05867e42a expref: 14 pid: 5762 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783134881.613566:0:3286:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9ca88dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:88a2002e-2ea7-4f07-912a-8d001832cfc0:3286:1869752384369024:0@lo:103: 00000100:00100000:1.0:1783134881.613580:0:3286:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9ca88c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:88a2002e-2ea7-4f07-912a-8d001832cfc0:3286:1869752384369536:0@lo:103: 00000100:00100000:0.0:1783134881.613584:0:5765:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9f6732680 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5765:1869752384368640:0@lo:104: 00010000:00010000:0.0:1783134881.613603:0:5765:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fe9c0030000/0xd6c4b8f05867e407 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd6c4b8f05867e400 expref: 13 pid: 5763 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783134881.613611:0:5765:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9f6730700 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5765:1869752384368768:0@lo:104: 00010000:00010000:0.0:1783134881.613620:0:5765:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fe9d2b75600/0xd6c4b8f05867e3dd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd6c4b8f05867e3d6 expref: 12 pid: 5763 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783134881.613640:0:5765:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9f6733b80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5765:1869752384368896:0@lo:104: 00010000:00010000:0.0:1783134881.613661:0:5765:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9fea02167a00/0xd6c4b8f05867e48c lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134881.613670:0:5765:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9fea02167a00/0xd6c4b8f05867e48c lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134881.613677:0:5765:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9fea02167a00/0xd6c4b8f05867e48c lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134881.613683:0:5765:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fea02167a00/0xd6c4b8f05867e48c lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1783134881.613698:0:5765:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:2.0:1783134881.653621:0:5765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9d0e61050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88a2002e-2ea7-4f07-912a-8d001832cfc0+11:7455:x1869752384368256:12345-0@lo:253: Request processed in 52101us (53820us total) trans 0 rc 0/0 00000100:00100000:2.0:1783134881.653636:0:5765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1783134881.653826:0:7455:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9f6733800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:88a2002e-2ea7-4f07-912a-8d001832cfc0:7455:1869752384368256:0@lo:253: 10000000:01000000:0.0:1783134881.653841:0:7455:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:0.0:1783134881.653845:0:7455:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1783134881.653846:0:7455:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1783134881.653847:0:7455:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1783134881.653848:0:7455:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0001_UUID 00000020:01000004:0.0:1783134881.653850:0:7455:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1783134881.653851:0:7455:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1783134881.653853:0:7455:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1783134881.653854:0:7455:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:0.0:1783134881.653855:0:7455:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1783134881.653856:0:7455:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1783134881.653878:0:7455:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9fe8c47e1800 from lustre-OST0001 10000000:01000000:0.0:1783134881.653902:0:7455:0:(mgc_request.c:1945:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:0.0:1783134881.653904:0:7455:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:0.0:1783134881.653913:0:7455:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9fe9d13819c0 local copy 10000000:01000000:0.0:1783134881.653917:0:7455:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1783134881.653962:0:7455:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.141@tcp lock: ffff9fe9c0030000/0xd6c4b8f05867e493 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134881.653974:0:7455:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.201.141@tcp lock: ffff9fe9c0030000/0xd6c4b8f05867e493 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134881.653984:0:7455:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.141@tcp lock: ffff9fe9c0030000/0xd6c4b8f05867e493 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783134881.654002:0:7455:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9f5ca4e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:88a2002e-2ea7-4f07-912a-8d001832cfc0:7455:1869752384369664:0@lo:101: 00000100:00100000:0.0:1783134881.654037:0:7455:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783134881.654089:0:7455:0:(client.c:2701:ptlrpc_set_wait()) set ffff9fe8c4fb9000 going to sleep for 11 seconds 00000100:00100000:2.0:1783134881.654150:0:5763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384369664 00000100:00100000:2.0:1783134881.654162:0:5763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384369664 00000100:00100000:2.0:1783134881.654206:0:5763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1783134881.654215:0:5763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9d0e63850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88a2002e-2ea7-4f07-912a-8d001832cfc0+11:7455:x1869752384369664:12345-0@lo:101: 00010000:00010000:2.0:1783134881.654226:0:5763:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783134881.654239:0:5763:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fe9c1523000/0xd6c4b8f05867e49a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd6c4b8f05867e493 expref: -99 pid: 5763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134881.654399:0:5763:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fe9c1523000/0xd6c4b8f05867e49a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd6c4b8f05867e493 expref: 12 pid: 5763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134881.654411:0:5763:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fe9c1523000/0xd6c4b8f05867e49a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd6c4b8f05867e493 expref: 12 pid: 5763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134881.654420:0:5763:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fe9c1523000, rc 0) 00000100:00100000:2.0:1783134881.654450:0:5763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9d0e63850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88a2002e-2ea7-4f07-912a-8d001832cfc0+12:7455:x1869752384369664:12345-0@lo:101: Request processed in 237us (413us total) trans 0 rc 0/0 00000100:00100000:2.0:1783134881.654456:0:5763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1783134881.654522:0:7455:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9f5ca4e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:88a2002e-2ea7-4f07-912a-8d001832cfc0:7455:1869752384369664:0@lo:101: 00010000:00010000:0.0:1783134881.654535:0:7455:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.141@tcp lock: ffff9fe9c0030000/0xd6c4b8f05867e493 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xd6c4b8f05867e49a expref: -99 pid: 7455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134881.654543:0:7455:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.141@tcp lock: ffff9fe9c0030000/0xd6c4b8f05867e493 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xd6c4b8f05867e49a expref: -99 pid: 7455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783134881.654629:0:7455:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9f5ca4e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:88a2002e-2ea7-4f07-912a-8d001832cfc0:7455:1869752384369792:0@lo:501: 00000100:00100000:0.0:1783134881.654651:0:7455:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783134881.654677:0:7455:0:(client.c:2701:ptlrpc_set_wait()) set ffff9fe8c4fb9000 going to sleep for 11 seconds 00000100:00100000:2.0:1783134881.654723:0:5765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384369792 00000100:00100000:2.0:1783134881.654727:0:5765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384369792 00000100:00100000:2.0:1783134881.654753:0:5765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1783134881.654759:0:5765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9d0e61850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88a2002e-2ea7-4f07-912a-8d001832cfc0+12:7455:x1869752384369792:12345-0@lo:501: 00000100:00100000:2.0:1783134881.654991:0:5765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9d0e61850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88a2002e-2ea7-4f07-912a-8d001832cfc0+12:7455:x1869752384369792:12345-0@lo:501: Request processed in 231us (338us total) trans 0 rc -2/-2 00000100:00100000:2.0:1783134881.654998:0:5765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1783134881.655129:0:7455:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9f5ca4e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:88a2002e-2ea7-4f07-912a-8d001832cfc0:7455:1869752384369792:0@lo:501: 10000000:01000000:3.0:1783134881.655144:0:7455:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.201.141@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1783134881.655169:0:7455:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.201.141@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1783134881.655174:0:7455:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.141@tcp lock: ffff9fe9c0030000/0xd6c4b8f05867e493 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xd6c4b8f05867e49a expref: -99 pid: 7455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134881.655182:0:7455:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.141@tcp lock: ffff9fe9c0030000/0xd6c4b8f05867e493 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xd6c4b8f05867e49a expref: -99 pid: 7455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134881.655188:0:7455:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.141@tcp lock: ffff9fe9c0030000/0xd6c4b8f05867e493 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xd6c4b8f05867e49a expref: -99 pid: 7455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134881.655243:0:7455:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1783134881.655270:0:7455:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9fe8c47e1800 10000000:01000000:3.0:1783134881.655308:0:7455:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1783134881.655313:0:7455:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:3.0:1783134881.655316:0:7455:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1783134881.655320:0:7455:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:3.0:1783134881.655322:0:7455:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:3.0:1783134881.655337:0:7455:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.141@tcp lock: ffff9fe9d2b74c00/0xd6c4b8f05867e4a1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134881.655344:0:7455:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.141@tcp lock: ffff9fe9d2b74c00/0xd6c4b8f05867e4a1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134881.655352:0:7455:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.141@tcp lock: ffff9fe9d2b74c00/0xd6c4b8f05867e4a1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783134881.655374:0:7455:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9e0475180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:88a2002e-2ea7-4f07-912a-8d001832cfc0:7455:1869752384369920:0@lo:101: 00000100:00100000:3.0:1783134881.655402:0:7455:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783134881.655419:0:7455:0:(client.c:2701:ptlrpc_set_wait()) set ffff9fe9c33e1b40 going to sleep for 11 seconds 00000100:00100000:0.0:1783134881.655526:0:5763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384369920 00000100:00100000:0.0:1783134881.655531:0:5763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384369920 00000100:00100000:0.0:1783134881.655562:0:5763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1783134881.655569:0:5763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9d0e62850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88a2002e-2ea7-4f07-912a-8d001832cfc0+12:7455:x1869752384369920:12345-0@lo:101: 00010000:00010000:0.0:1783134881.655576:0:5763:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783134881.655584:0:5763:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fe9c0030200/0xd6c4b8f05867e4a8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xd6c4b8f05867e4a1 expref: -99 pid: 5763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134881.655608:0:5763:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fe9c0030200/0xd6c4b8f05867e4a8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd6c4b8f05867e4a1 expref: 13 pid: 5763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134881.655616:0:5763:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fe9c0030200/0xd6c4b8f05867e4a8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd6c4b8f05867e4a1 expref: 13 pid: 5763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134881.655623:0:5763:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fe9c0030200, rc 0) 00000100:00100000:0.0:1783134881.655658:0:5763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9d0e62850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88a2002e-2ea7-4f07-912a-8d001832cfc0+13:7455:x1869752384369920:12345-0@lo:101: Request processed in 89us (255us total) trans 0 rc 0/0 00000100:00100000:0.0:1783134881.655664:0:5763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1783134881.655772:0:7455:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9e0475180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:88a2002e-2ea7-4f07-912a-8d001832cfc0:7455:1869752384369920:0@lo:101: 00010000:00010000:3.0:1783134881.655783:0:7455:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.141@tcp lock: ffff9fe9d2b74c00/0xd6c4b8f05867e4a1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd6c4b8f05867e4a8 expref: -99 pid: 7455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134881.655791:0:7455:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.141@tcp lock: ffff9fe9d2b74c00/0xd6c4b8f05867e4a1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xd6c4b8f05867e4a8 expref: -99 pid: 7455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783134881.655847:0:7455:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9e0475180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:88a2002e-2ea7-4f07-912a-8d001832cfc0:7455:1869752384370048:0@lo:501: 00000100:00100000:3.0:1783134881.655871:0:7455:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783134881.655891:0:7455:0:(client.c:2701:ptlrpc_set_wait()) set ffff9fe9c33e1b40 going to sleep for 11 seconds 00000100:00100000:0.0:1783134881.655939:0:5762:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384370048 00000100:00100000:0.0:1783134881.655943:0:5762:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384370048 00000100:00100000:0.0:1783134881.655973:0:5762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1783134881.655980:0:5762:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9d0e62050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88a2002e-2ea7-4f07-912a-8d001832cfc0+13:7455:x1869752384370048:12345-0@lo:501: 00000100:00100000:0.0:1783134881.656147:0:5762:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9d0e62050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88a2002e-2ea7-4f07-912a-8d001832cfc0+13:7455:x1869752384370048:12345-0@lo:501: Request processed in 167us (274us total) trans 0 rc 0/0 00000100:00100000:0.0:1783134881.656154:0:5762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1783134881.656251:0:7455:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9e0475180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:88a2002e-2ea7-4f07-912a-8d001832cfc0:7455:1869752384370048:0@lo:501: 00000100:00100000:3.0:1783134881.656324:0:7455:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9e0475180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:88a2002e-2ea7-4f07-912a-8d001832cfc0:7455:1869752384370176:0@lo:503: 00000100:00100000:3.0:1783134881.656361:0:7455:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783134881.656420:0:7455:0:(client.c:2701:ptlrpc_set_wait()) set ffff9fe9c33e1b40 going to sleep for 11 seconds 00000100:00100000:1.0:1783134881.656543:0:5765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384370176 00000100:00100000:1.0:1783134881.656548:0:5765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384370176 00000100:00100000:1.0:1783134881.656610:0:5765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1783134881.656618:0:5765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9d0e60450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88a2002e-2ea7-4f07-912a-8d001832cfc0+13:7455:x1869752384370176:12345-0@lo:503: 00000100:00100000:1.0:1783134881.656772:0:5765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9d0e60450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88a2002e-2ea7-4f07-912a-8d001832cfc0+13:7455:x1869752384370176:12345-0@lo:503: Request processed in 155us (409us total) trans 0 rc 0/0 00000100:00100000:1.0:1783134881.656779:0:5765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1783134881.656843:0:7455:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9e0475180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:88a2002e-2ea7-4f07-912a-8d001832cfc0:7455:1869752384370176:0@lo:503: 00000040:00080000:3.0:1783134881.657143:0:7455:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1783134881.657198:0:7455:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9e0475180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:88a2002e-2ea7-4f07-912a-8d001832cfc0:7455:1869752384370304:0@lo:502: 00000100:00100000:3.0:1783134881.657233:0:7455:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1783134881.657298:0:6591:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783134881.657305:0:6591:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.141@tcp lock: ffff9fe9c0030000/0xd6c4b8f05867e493 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0xd6c4b8f05867e49a expref: -99 pid: 7455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134881.657317:0:6591:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe9c0030000 already unused, calling callback (ffffffffc1b40c20) 10000000:00010000:2.0:1783134881.657328:0:6591:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.141@tcp lock: ffff9fe9c0030000/0xd6c4b8f05867e493 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0xd6c4b8f05867e49a expref: -99 pid: 7455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134881.657338:0:6591:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.141@tcp lock: ffff9fe9c0030000/0xd6c4b8f05867e493 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0xd6c4b8f05867e49a expref: -99 pid: 7455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783134881.657346:0:6591:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.141@tcp lock: ffff9fe9c0030000/0xd6c4b8f05867e493 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0xd6c4b8f05867e49a expref: -99 pid: 7455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783134881.657360:0:6591:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1783134881.657384:0:6591:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.141@tcp lock: ffff9fe9c0030000/0xd6c4b8f05867e493 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xd6c4b8f05867e49a expref: -99 pid: 7455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134881.657391:0:6591:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1783134881.657418:0:6591:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.141@tcp lock: ffff9fe9c0030000/0xd6c4b8f05867e493 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xd6c4b8f05867e49a expref: -99 pid: 7455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134881.657425:0:6591:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.141@tcp lock: ffff9fe9c0030000/0xd6c4b8f05867e493 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xd6c4b8f05867e49a expref: -99 pid: 7455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134881.657439:0:6591:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783134881.657441:0:6591:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783134881.657443:0:6591:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783134881.657454:0:3287:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9ca88f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:88a2002e-2ea7-4f07-912a-8d001832cfc0:3287:1869752384370432:0@lo:103: 00000100:00100000:2.0:1783134881.657484:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783134881.657522:0:5756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384370432 00000100:00100000:2.0:1783134881.657525:0:5756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384370432 00000100:00100000:2.0:1783134881.657549:0:5756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1783134881.657555:0:5756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9ca88ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:88a2002e-2ea7-4f07-912a-8d001832cfc0+13:3287:x1869752384370432:12345-0@lo:103: 00010000:00010000:2.0:1783134881.657563:0:5756:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783134881.657578:0:5756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fe9c1523000/0xd6c4b8f05867e49a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xd6c4b8f05867e493 expref: 13 pid: 5763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134881.657588:0:5756:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783134881.657611:0:5756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9ca88ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:88a2002e-2ea7-4f07-912a-8d001832cfc0+12:3287:x1869752384370432:12345-0@lo:103: Request processed in 56us (126us total) trans 0 rc 0/0 00000100:00100000:2.0:1783134881.657617:0:5756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1783134881.657639:0:3287:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9ca88f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:88a2002e-2ea7-4f07-912a-8d001832cfc0:3287:1869752384370432:0@lo:103: 00000100:00100000:3.0:1783134881.657792:0:7455:0:(client.c:2701:ptlrpc_set_wait()) set ffff9fe9c33e1b40 going to sleep for 11 seconds 00000100:00100000:0.0:1783134881.657834:0:5762:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384370304 00000100:00100000:0.0:1783134881.657839:0:5762:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384370304 00000100:00100000:0.0:1783134881.657871:0:5762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1783134881.657876:0:5762:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9d0e62450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88a2002e-2ea7-4f07-912a-8d001832cfc0+12:7455:x1869752384370304:12345-0@lo:502: 00000100:00100000:0.0:1783134881.658028:0:5762:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9d0e62450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88a2002e-2ea7-4f07-912a-8d001832cfc0+12:7455:x1869752384370304:12345-0@lo:502: Request processed in 151us (794us total) trans 0 rc 0/0 00000100:00100000:0.0:1783134881.658033:0:5762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1783134881.658052:0:7455:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9e0475180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:88a2002e-2ea7-4f07-912a-8d001832cfc0:7455:1869752384370304:0@lo:502: 00000040:00080000:3.0:1783134881.658409:0:7455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:3.0:1783134881.658469:0:7455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:3.0:1783134881.658503:0:7455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:3.0:1783134881.658550:0:7455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:3.0:1783134881.658585:0:7455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:3.0:1783134881.658617:0:7455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:3.0:1783134881.658639:0:7455:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9e0475180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:88a2002e-2ea7-4f07-912a-8d001832cfc0:7455:1869752384370560:0@lo:502: 00000100:00100000:3.0:1783134881.658674:0:7455:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783134881.658766:0:7455:0:(client.c:2701:ptlrpc_set_wait()) set ffff9fe9c33e1b40 going to sleep for 11 seconds 00000100:00100000:2.0:1783134881.658806:0:5763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384370560 00000100:00100000:2.0:1783134881.658811:0:5763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384370560 00000100:00100000:2.0:1783134881.658839:0:5763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1783134881.658845:0:5763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9d0e61450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88a2002e-2ea7-4f07-912a-8d001832cfc0+12:7455:x1869752384370560:12345-0@lo:502: 00000100:00100000:2.0:1783134881.658980:0:5763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9d0e61450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88a2002e-2ea7-4f07-912a-8d001832cfc0+12:7455:x1869752384370560:12345-0@lo:502: Request processed in 134us (305us total) trans 0 rc 0/0 00000100:00100000:2.0:1783134881.658987:0:5763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1783134881.659102:0:7455:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9e0475180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:88a2002e-2ea7-4f07-912a-8d001832cfc0:7455:1869752384370560:0@lo:502: 00000040:00080000:3.0:1783134881.659181:0:7455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:3.0:1783134881.659190:0:7455:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 7 count 8 00000020:01000000:1.0:1783134881.659778:0:7461:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1783134881.659786:0:7461:0:(obd_mount.c:952:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:1.0:1783134881.659793:0:7461:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783134881.659795:0:7461:0:(obd_config.c:1561:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:1.0:1783134881.659801:0:7461:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1783134881.659822:0:7461:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff9fe8c456b380) 00000020:00000080:1.0:1783134881.659843:0:7461:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type obdfilter with refcount 2 00000020:00000080:1.0:1783134881.659851:0:7461:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1783134881.659907:0:7461:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9fe8c47e1800 from lustre-OST0001, refs=2 00080000:01000000:1.0:1783134881.659921:0:7461:0:(osd_handler.c:1569:osd_obd_connect()) connect #1 00000020:00000080:1.0:1783134881.659928:0:7461:0:(genops.c:1406:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xd6c4b8f05867e4b6 00010000:00010000:1.0:1783134881.663506:0:7461:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:02000400:1.0:1783134881.663787:0:7461:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0001: new disk, initializing 00000001:00000004:1.0:1783134881.666058:0:7461:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 0 40000000:02000000:1.0:1783134881.666444:0:7461:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0001: No data found on store. Initialize space. 00080000:10000000:1.0:1783134881.668737:0:7461:0:(osd_index.c:2102:osd_index_try()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:1.0:1783134881.669118:0:7461:0:(osd_index.c:2102:osd_index_try()) lustre-OST0001: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:1.0:1783134881.670689:0:7461:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:1.0:1783134881.670701:0:7461:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1783134881.670707:0:7461:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783134881.670709:0:7461:0:(obd_config.c:1561:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:1.0:1783134881.670713:0:7461:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1783134881.670716:0:7461:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783134881.670717:0:7461:0:(obd_config.c:1561:class_process_config()) marker 20 (0x1) lustre sys.timeout 00000020:00000080:1.0:1783134881.670720:0:7461:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1783134881.670722:0:7461:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1783134881.670773:0:7461:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1783134881.670776:0:7461:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783134881.670778:0:7461:0:(obd_config.c:1561:class_process_config()) marker 20 (0x2) lustre sys.timeout 00000040:00080000:1.0:1783134881.670781:0:7461:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:3.0:1783134881.670964:0:7455:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-7 (rc=0) 10000000:01000000:3.0:1783134881.670989:0:7455:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.201.141@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:3.0:1783134881.671009:0:7455:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.141@tcp lock: ffff9fe9d2b74c00/0xd6c4b8f05867e4a1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd6c4b8f05867e4a8 expref: -99 pid: 7455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134881.671021:0:7455:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.141@tcp lock: ffff9fe9d2b74c00/0xd6c4b8f05867e4a1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd6c4b8f05867e4a8 expref: -99 pid: 7455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783134881.671029:0:7455:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff9fe8c47e1800 from 1 10000000:01000000:3.0:1783134881.671032:0:7455:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1783134881.671064:0:7455:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.141@tcp lock: ffff9fe9d2b74000/0xd6c4b8f05867e4bd lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134881.671071:0:7455:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.141@tcp lock: ffff9fe9d2b74000/0xd6c4b8f05867e4bd lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134881.671080:0:7455:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.141@tcp lock: ffff9fe9d2b74000/0xd6c4b8f05867e4bd lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783134881.671102:0:7455:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9e0475180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:88a2002e-2ea7-4f07-912a-8d001832cfc0:7455:1869752384370688:0@lo:101: 00000100:00100000:3.0:1783134881.671173:0:7455:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783134881.671207:0:7455:0:(client.c:2701:ptlrpc_set_wait()) set ffff9fe9c33e1cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1783134881.673415:0:5762:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384370688 00000100:00100000:0.0:1783134881.673429:0:5762:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384370688 00000100:00100000:0.0:1783134881.673486:0:5762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1783134881.673503:0:5762:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9d0e60c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88a2002e-2ea7-4f07-912a-8d001832cfc0+12:7455:x1869752384370688:12345-0@lo:101: 00010000:00010000:0.0:1783134881.673522:0:5762:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783134881.673539:0:5762:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fe9c0030000/0xd6c4b8f05867e4c4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xd6c4b8f05867e4bd expref: -99 pid: 5762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134881.673568:0:5762:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fe9c0030000/0xd6c4b8f05867e4c4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd6c4b8f05867e4bd expref: 13 pid: 5762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134881.673580:0:5762:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fe9c0030000/0xd6c4b8f05867e4c4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd6c4b8f05867e4bd expref: 13 pid: 5762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134881.673588:0:5762:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fe9c0030000, rc 0) 00000100:00100000:0.0:1783134881.673655:0:5762:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9d0e60c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88a2002e-2ea7-4f07-912a-8d001832cfc0+13:7455:x1869752384370688:12345-0@lo:101: Request processed in 154us (2481us total) trans 0 rc 0/0 00000100:00100000:0.0:1783134881.673662:0:5762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1783134881.673887:0:7455:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9e0475180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:88a2002e-2ea7-4f07-912a-8d001832cfc0:7455:1869752384370688:0@lo:101: 00010000:00010000:3.0:1783134881.673905:0:7455:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.141@tcp lock: ffff9fe9d2b74000/0xd6c4b8f05867e4bd lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd6c4b8f05867e4c4 expref: -99 pid: 7455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134881.673914:0:7455:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.141@tcp lock: ffff9fe9d2b74000/0xd6c4b8f05867e4bd lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xd6c4b8f05867e4c4 expref: -99 pid: 7455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783134881.674013:0:7455:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9e0475180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:88a2002e-2ea7-4f07-912a-8d001832cfc0:7455:1869752384370816:0@lo:501: 00000100:00100000:3.0:1783134881.674046:0:7455:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783134881.674084:0:7455:0:(client.c:2701:ptlrpc_set_wait()) set ffff9fe9c33e1cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1783134881.674100:0:5763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384370816 00000100:00100000:3.0:1783134881.674104:0:5763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384370816 00000100:00100000:3.0:1783134881.674128:0:5763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1783134881.674136:0:5763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9d1657450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88a2002e-2ea7-4f07-912a-8d001832cfc0+13:7455:x1869752384370816:12345-0@lo:501: 00000100:00100000:3.0:1783134881.674425:0:5763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9d1657450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88a2002e-2ea7-4f07-912a-8d001832cfc0+13:7455:x1869752384370816:12345-0@lo:501: Request processed in 288us (378us total) trans 0 rc 0/0 00000100:00100000:3.0:1783134881.674432:0:5763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1783134881.674467:0:7455:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9e0475180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:88a2002e-2ea7-4f07-912a-8d001832cfc0:7455:1869752384370816:0@lo:501: 00000100:00100000:3.0:1783134881.674493:0:7455:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9e0475180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:88a2002e-2ea7-4f07-912a-8d001832cfc0:7455:1869752384370944:0@lo:503: 00000100:00100000:3.0:1783134881.674530:0:7455:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783134881.674542:0:7455:0:(client.c:2701:ptlrpc_set_wait()) set ffff9fe9ca92a780 going to sleep for 11 seconds 00000100:00100000:3.0:1783134881.674555:0:5763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384370944 00000100:00100000:3.0:1783134881.674558:0:5763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384370944 00000100:00100000:3.0:1783134881.674579:0:5763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1783134881.674585:0:5763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9d1654050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88a2002e-2ea7-4f07-912a-8d001832cfc0+13:7455:x1869752384370944:12345-0@lo:503: 00000100:00100000:3.0:1783134881.674870:0:5763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9d1654050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88a2002e-2ea7-4f07-912a-8d001832cfc0+13:7455:x1869752384370944:12345-0@lo:503: Request processed in 284us (339us total) trans 0 rc 0/0 00000100:00100000:3.0:1783134881.674876:0:5763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1783134881.674914:0:7455:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9e0475180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:88a2002e-2ea7-4f07-912a-8d001832cfc0:7455:1869752384370944:0@lo:503: 00000040:00080000:3.0:1783134881.675152:0:7455:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1783134881.675200:0:7455:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9e0475180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:88a2002e-2ea7-4f07-912a-8d001832cfc0:7455:1869752384371072:0@lo:502: 00000100:00100000:3.0:1783134881.675232:0:7455:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783134881.675246:0:7455:0:(client.c:2701:ptlrpc_set_wait()) set ffff9fe9ca92a780 going to sleep for 11 seconds 00000100:00100000:3.0:1783134881.675272:0:5763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384371072 00000100:00100000:3.0:1783134881.675276:0:5763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384371072 00000100:00100000:3.0:1783134881.675319:0:5763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1783134881.675324:0:5763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9d1655050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88a2002e-2ea7-4f07-912a-8d001832cfc0+13:7455:x1869752384371072:12345-0@lo:502: 00000100:00100000:3.0:1783134881.675485:0:5763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9d1655050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88a2002e-2ea7-4f07-912a-8d001832cfc0+13:7455:x1869752384371072:12345-0@lo:502: Request processed in 159us (250us total) trans 0 rc 0/0 00000100:00100000:3.0:1783134881.675491:0:5763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1783134881.675647:0:7455:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9e0475180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:88a2002e-2ea7-4f07-912a-8d001832cfc0:7455:1869752384371072:0@lo:502: 00000040:00080000:1.0:1783134881.675925:0:7455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:1.0:1783134881.675974:0:7455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:1.0:1783134881.675997:0:7455:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9f6731f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:88a2002e-2ea7-4f07-912a-8d001832cfc0:7455:1869752384371200:0@lo:502: 00000100:00100000:1.0:1783134881.676033:0:7455:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783134881.676069:0:7455:0:(client.c:2701:ptlrpc_set_wait()) set ffff9fe9fe99e900 going to sleep for 11 seconds 00000100:00100000:0.0:1783134881.676308:0:5763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384371200 00000100:00100000:0.0:1783134881.676313:0:5763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384371200 00000100:00100000:0.0:1783134881.676348:0:5763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1783134881.676355:0:5763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9d1657850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88a2002e-2ea7-4f07-912a-8d001832cfc0+13:7455:x1869752384371200:12345-0@lo:502: 00000100:00100000:0.0:1783134881.676474:0:5763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9d1657850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88a2002e-2ea7-4f07-912a-8d001832cfc0+13:7455:x1869752384371200:12345-0@lo:502: Request processed in 120us (441us total) trans 0 rc 0/0 00000100:00100000:0.0:1783134881.676481:0:5763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1783134881.676741:0:7455:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9f6731f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:88a2002e-2ea7-4f07-912a-8d001832cfc0:7455:1869752384371200:0@lo:502: 00000040:00080000:1.0:1783134881.676825:0:7455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:1.0:1783134881.676834:0:7455:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:1.0:1783134881.678479:0:7465:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1783134881.678491:0:7465:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783134881.678493:0:7465:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1783134881.678500:0:7465:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9fe8c47e1800 00000020:00000080:1.0:1783134881.678502:0:7465:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1783134881.678522:0:7465:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1783134881.678525:0:7465:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783134881.678526:0:7465:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:1.0:1783134881.678529:0:7465:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:0.0:1783134881.678821:0:7455:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:0.0:1783134881.678843:0:7455:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.201.141@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1783134881.678917:0:7455:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.141@tcp lock: ffff9fe9d2b74000/0xd6c4b8f05867e4bd lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd6c4b8f05867e4c4 expref: -99 pid: 7455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134881.678928:0:7455:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.141@tcp lock: ffff9fe9d2b74000/0xd6c4b8f05867e4bd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd6c4b8f05867e4c4 expref: -99 pid: 7455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783134881.678978:0:7455:0:(mgc_request.c:1945:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1783134881.678981:0:7455:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9fe8c47e1800 10000000:01000000:0.0:1783134881.678984:0:7455:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9fe8c47e1800 10000000:01000000:0.0:1783134881.678988:0:7455:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1783134881.678992:0:7455:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff9fe8c47e1800 from 1 10000000:01000000:0.0:1783134881.678995:0:7455:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1783134881.679023:0:7455:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.141@tcp lock: ffff9fe9c0031400/0xd6c4b8f05867e4cb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134881.679031:0:7455:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.141@tcp lock: ffff9fe9c0031400/0xd6c4b8f05867e4cb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134881.679039:0:7455:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.141@tcp lock: ffff9fe9c0031400/0xd6c4b8f05867e4cb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783134881.679059:0:7455:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9f5ca7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:88a2002e-2ea7-4f07-912a-8d001832cfc0:7455:1869752384371328:0@lo:101: 00000100:00100000:0.0:1783134881.679115:0:7455:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783134881.679154:0:7455:0:(client.c:2701:ptlrpc_set_wait()) set ffff9fe9c7b5fe40 going to sleep for 11 seconds 00000100:00100000:1.0:1783134881.679235:0:5765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384371328 00000100:00100000:1.0:1783134881.679242:0:5765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384371328 00000100:00100000:1.0:1783134881.679323:0:5765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1783134881.679333:0:5765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9d1655850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88a2002e-2ea7-4f07-912a-8d001832cfc0+13:7455:x1869752384371328:12345-0@lo:101: 00010000:00010000:1.0:1783134881.679345:0:5765:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783134881.679357:0:5765:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fea02166c00/0xd6c4b8f05867e4d2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xd6c4b8f05867e4cb expref: -99 pid: 5765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134881.679380:0:5765:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fea02166c00/0xd6c4b8f05867e4d2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd6c4b8f05867e4cb expref: 14 pid: 5765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134881.679391:0:5765:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fea02166c00/0xd6c4b8f05867e4d2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd6c4b8f05867e4cb expref: 14 pid: 5765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134881.679399:0:5765:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fea02166c00, rc 0) 00000100:00100000:1.0:1783134881.679440:0:5765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9d1655850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88a2002e-2ea7-4f07-912a-8d001832cfc0+14:7455:x1869752384371328:12345-0@lo:101: Request processed in 109us (325us total) trans 0 rc 0/0 00000100:00100000:1.0:1783134881.679446:0:5765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1783134881.679503:0:7455:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9f5ca7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:88a2002e-2ea7-4f07-912a-8d001832cfc0:7455:1869752384371328:0@lo:101: 00010000:00010000:0.0:1783134881.679516:0:7455:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.141@tcp lock: ffff9fe9c0031400/0xd6c4b8f05867e4cb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd6c4b8f05867e4d2 expref: -99 pid: 7455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134881.679525:0:7455:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.141@tcp lock: ffff9fe9c0031400/0xd6c4b8f05867e4cb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xd6c4b8f05867e4d2 expref: -99 pid: 7455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783134881.679601:0:7455:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9f5ca7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:88a2002e-2ea7-4f07-912a-8d001832cfc0:7455:1869752384371456:0@lo:501: 00000100:00100000:0.0:1783134881.679625:0:7455:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783134881.679657:0:7455:0:(client.c:2701:ptlrpc_set_wait()) set ffff9fe9c7b5fe40 going to sleep for 11 seconds 00000100:00100000:1.0:1783134881.679691:0:5762:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384371456 00000100:00100000:1.0:1783134881.679695:0:5762:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384371456 00000100:00100000:1.0:1783134881.679723:0:5762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1783134881.679730:0:5762:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9d1656850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88a2002e-2ea7-4f07-912a-8d001832cfc0+14:7455:x1869752384371456:12345-0@lo:501: 00000100:00100000:1.0:1783134881.679938:0:5762:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9d1656850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88a2002e-2ea7-4f07-912a-8d001832cfc0+14:7455:x1869752384371456:12345-0@lo:501: Request processed in 208us (311us total) trans 0 rc 0/0 00000100:00100000:1.0:1783134881.679945:0:5762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1783134881.681151:0:7455:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9f5ca7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:88a2002e-2ea7-4f07-912a-8d001832cfc0:7455:1869752384371456:0@lo:501: 00000100:00100000:0.0:1783134881.681189:0:7455:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9f5ca7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:88a2002e-2ea7-4f07-912a-8d001832cfc0:7455:1869752384371584:0@lo:503: 00000100:00100000:0.0:1783134881.681235:0:7455:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783134881.681296:0:7455:0:(client.c:2701:ptlrpc_set_wait()) set ffff9fe9c7b5fe40 going to sleep for 11 seconds 00000100:00100000:2.0:1783134881.681399:0:5765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384371584 00000100:00100000:2.0:1783134881.681404:0:5765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384371584 00000100:00100000:2.0:1783134881.681442:0:5765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1783134881.681449:0:5765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9d1656050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88a2002e-2ea7-4f07-912a-8d001832cfc0+14:7455:x1869752384371584:12345-0@lo:503: 00000100:00100000:2.0:1783134881.681607:0:5765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9d1656050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88a2002e-2ea7-4f07-912a-8d001832cfc0+14:7455:x1869752384371584:12345-0@lo:503: Request processed in 158us (371us total) trans 0 rc 0/0 00000100:00100000:2.0:1783134881.681615:0:5765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1783134881.681663:0:7455:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9f5ca7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:88a2002e-2ea7-4f07-912a-8d001832cfc0:7455:1869752384371584:0@lo:503: 00000040:00080000:2.0:1783134881.682000:0:7455:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1783134881.682053:0:7455:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9ca88f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:88a2002e-2ea7-4f07-912a-8d001832cfc0:7455:1869752384371712:0@lo:502: 00000100:00100000:2.0:1783134881.682089:0:7455:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783134881.682147:0:7455:0:(client.c:2701:ptlrpc_set_wait()) set ffff9fe8c55ea780 going to sleep for 11 seconds 00000100:00100000:0.0:1783134881.682474:0:5763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384371712 00000100:00100000:0.0:1783134881.682480:0:5763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384371712 00000100:00100000:0.0:1783134881.682570:0:5763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1783134881.682578:0:5763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9d1654450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88a2002e-2ea7-4f07-912a-8d001832cfc0+14:7455:x1869752384371712:12345-0@lo:502: 00000100:00100000:0.0:1783134881.682767:0:5763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9d1654450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88a2002e-2ea7-4f07-912a-8d001832cfc0+14:7455:x1869752384371712:12345-0@lo:502: Request processed in 189us (677us total) trans 0 rc 0/0 00000100:00100000:0.0:1783134881.682775:0:5763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1783134881.682839:0:7455:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9ca88f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:88a2002e-2ea7-4f07-912a-8d001832cfc0:7455:1869752384371712:0@lo:502: 00000040:00080000:3.0:1783134881.683097:0:7455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:3.0:1783134881.683146:0:7455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:3.0:1783134881.683183:0:7455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:3.0:1783134881.683231:0:7455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:3.0:1783134881.683310:0:7455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:3.0:1783134881.683362:0:7455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:3.0:1783134881.683397:0:7455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:3.0:1783134881.683431:0:7455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:3.0:1783134881.683479:0:7455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:3.0:1783134881.683515:0:7455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:3.0:1783134881.683552:0:7455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:3.0:1783134881.683615:0:7455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:3.0:1783134881.683652:0:7455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:3.0:1783134881.683687:0:7455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:3.0:1783134881.683750:0:7455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:3.0:1783134881.683789:0:7455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:3.0:1783134881.683824:0:7455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:3.0:1783134881.683872:0:7455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:3.0:1783134881.683910:0:7455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:3.0:1783134881.683965:0:7455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:3.0:1783134881.684018:0:7455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:3.0:1783134881.684060:0:7455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:3.0:1783134881.684095:0:7455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:3.0:1783134881.684145:0:7455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:3.0:1783134881.684184:0:7455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:3.0:1783134881.684217:0:7455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:3.0:1783134881.684301:0:7455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:3.0:1783134881.684340:0:7455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000040:00080000:3.0:1783134881.684380:0:7455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:3.0:1783134881.684423:0:7455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13416 00000040:00080000:3.0:1783134881.684457:0:7455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13504 00000040:00080000:3.0:1783134881.684490:0:7455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13632 00000040:00080000:3.0:1783134881.684521:0:7455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13776 00000040:00080000:3.0:1783134881.684561:0:7455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13904 00000040:00080000:3.0:1783134881.684591:0:7455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14128 00000040:00080000:3.0:1783134881.684634:0:7455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14352 00000040:00080000:3.0:1783134881.684671:0:7455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14432 00000100:00100000:3.0:1783134881.684712:0:7455:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9e0474e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:88a2002e-2ea7-4f07-912a-8d001832cfc0:7455:1869752384371840:0@lo:502: 00000100:00100000:3.0:1783134881.684777:0:7455:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783134881.685132:0:7455:0:(client.c:2701:ptlrpc_set_wait()) set ffff9fe9ca92a780 going to sleep for 11 seconds 00000100:00100000:2.0:1783134881.685176:0:5765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384371840 00000100:00100000:2.0:1783134881.685185:0:5765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384371840 00000100:00100000:2.0:1783134881.685221:0:5765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1783134881.685229:0:5765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9d1656450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88a2002e-2ea7-4f07-912a-8d001832cfc0+14:7455:x1869752384371840:12345-0@lo:502: 00000100:00100000:2.0:1783134881.685591:0:5765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9d1656450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88a2002e-2ea7-4f07-912a-8d001832cfc0+14:7455:x1869752384371840:12345-0@lo:502: Request processed in 362us (813us total) trans 0 rc 0/0 00000100:00100000:2.0:1783134881.685599:0:5765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1783134881.685715:0:7455:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9e0474e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:88a2002e-2ea7-4f07-912a-8d001832cfc0:7455:1869752384371840:0@lo:502: 00000040:00080000:3.0:1783134881.685785:0:7455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14656 00000040:00080000:3.0:1783134881.685800:0:7455:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 38 count 39 00000020:01000004:2.0:1783134881.686654:0:7466:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:2.0:1783134881.686675:0:7466:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff9fe8c57c19c0) 00000020:00000080:2.0:1783134881.686695:0:7466:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type lwp with refcount 2 00000020:01000004:2.0:1783134881.686901:0:7466:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9fe8c47e1800 from lustre-OST0001, refs=3 00000020:01000004:2.0:1783134881.686906:0:7466:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9fe8c47e1800 from lustre-OST0001, refs=3 00000020:01000004:2.0:1783134881.686908:0:7466:0:(obd_mount.c:701:lustre_put_lsi()) put ffff9fe8c47e1800 3 00010000:00080000:2.0:1783134881.686936:0:7466:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9fe8c57da800@lustre-MDT0000-lwp-OST0001: add connection 192.168.201.141@tcp at head 00010000:00010000:2.0:1783134881.688480:0:7466:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-4 is initialized 00000020:00000080:2.0:1783134881.688555:0:7466:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:2.0:1783134881.688584:0:7466:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1783134881.688595:0:7466:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0xd6c4b8f05867e4e0 00000100:00080000:2.0:1783134881.688602:0:7466:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1783134881.688608:0:7466:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9fe8c57da800 using connection 192.168.201.141@tcp/0@lo 00000100:00100000:2.0:1783134881.688642:0:7466:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9fe9ca88f100 x1869752384371968/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1783134881.688666:0:7466:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1783134881.688826:0:3285:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9ca88f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3285:1869752384371968:0@lo:38: 00000100:00100000:0.0:1783134881.688886:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783134881.689057:0:3289:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9e0474380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3289:1869752384372224:0@lo:400: 00000100:00100000:3.0:1783134881.689085:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783134881.689105:0:3289:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1783134881.689111:0:3289:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9e0474e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3289:1869752384372096:0@lo:400: 00000100:00100000:3.0:1783134881.689129:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783134881.689150:0:3286:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9e0477100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1869752384372352:0@lo:400: 00000100:00100000:3.0:1783134881.689173:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783134881.689207:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384371968 00000100:00100000:3.0:1783134881.689213:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384371968 00000100:00100000:3.0:1783134881.689231:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384372224 00000100:00100000:3.0:1783134881.689234:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384372224 00000100:00100000:3.0:1783134881.689270:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384372096 00000100:00100000:3.0:1783134881.689274:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384372096 00000100:00100000:3.0:1783134881.689314:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1783134881.689323:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9e0477480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3289:x1869752384372224:12345-0@lo:400: 00000100:00100000:3.0:1783134881.689371:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9e0477480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3289:x1869752384372224:12345-0@lo:400: Request processed in 48us (284us total) trans 0 rc 0/0 00000100:00100000:3.0:1783134881.689378:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1783134881.689392:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1783134881.689398:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9e0475f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3289:x1869752384372096:12345-0@lo:400: 00000100:00100000:3.0:1783134881.689425:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9e0475f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3289:x1869752384372096:12345-0@lo:400: Request processed in 28us (294us total) trans 0 rc 0/0 00000100:00100000:3.0:1783134881.689431:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1783134881.689444:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1783134881.689449:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9f5ca4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3285:x1869752384371968:12345-0@lo:38: 00010000:00080000:3.0:1783134881.689466:0:5770:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 164 last 0 00000020:00000080:3.0:1783134881.689501:0:5770:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0xd6c4b8f05867e4e7 00000004:00100000:3.0:1783134881.689517:0:5770:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1783134881.689543:0:5770:0:(import.c:65:import_set_state_nolock()) ffff9fe8c5fcf000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1783134881.689579:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9f5ca4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3285:x1869752384371968:12345-0@lo:38: Request processed in 129us (692us total) trans 0 rc 0/0 00000100:00100000:3.0:1783134881.689585:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1783134881.689605:0:6574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384372352 00000100:00100000:3.0:1783134881.689608:0:6574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384372352 00000100:00100000:3.0:1783134881.689635:0:6574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1783134881.689642:0:6574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9e0476300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3286:x1869752384372352:12345-0@lo:400: 00000100:00100000:3.0:1783134881.689674:0:6574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9e0476300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3286:x1869752384372352:12345-0@lo:400: Request processed in 33us (500us total) trans 0 rc 0/0 00000100:00100000:3.0:1783134881.689680:0:6574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:3.0:1783134881.689697:0:5766:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1783134881.689700:0:5766:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1783134881.689733:0:3286:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9fe9e0477100 x1869752384372352/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783134897 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783134881.689746:0:3286:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9e0477100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1869752384372352:0@lo:400: 00010000:00080000:3.0:1783134881.689770:0:3289:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9fe9e0474e00 x1869752384372096/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783134897 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783134881.689778:0:3289:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9e0474e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3289:1869752384372096:0@lo:400: 00010000:00080000:3.0:1783134881.689785:0:3289:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9fe9e0474380 x1869752384372224/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783134897 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783134881.689793:0:3289:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9e0474380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3289:1869752384372224:0@lo:400: 00010000:00080000:3.0:1783134881.689816:0:3285:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9fe9ca88f100 x1869752384371968/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1783134891 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783134881.689829:0:3285:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1783134881.689835:0:3285:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 1 00000100:00080000:3.0:1783134881.689841:0:3285:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1783134881.689845:0:3285:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1783134881.689847:0:3285:0:(import.c:65:import_set_state_nolock()) ffff9fe8c57da800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1783134881.689853:0:3285:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9ca88f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3285:1869752384371968:0@lo:38: 00000040:00080000:0.0:1783134881.690239:0:7466:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000020:01000000:3.0:1783134881.690451:0:7455:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-38 (rc=0) 10000000:01000000:3.0:1783134881.690475:0:7455:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.201.141@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1783134881.690497:0:7455:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.141@tcp lock: ffff9fe9c0031400/0xd6c4b8f05867e4cb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd6c4b8f05867e4d2 expref: -99 pid: 7455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134881.690507:0:7455:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.141@tcp lock: ffff9fe9c0031400/0xd6c4b8f05867e4cb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd6c4b8f05867e4d2 expref: -99 pid: 7455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1783134881.690549:0:7455:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1783134881.690551:0:7455:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1783134881.690552:0:7455:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1783134881.690554:0:7455:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1783134881.690555:0:7455:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1783134881.690556:0:7455:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1783134881.690557:0:7455:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1783134881.690559:0:7455:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1783134881.690560:0:7455:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1783134881.690561:0:7455:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1783134881.690563:0:7455:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1783134881.690566:0:7455:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020062 00000020:01000004:3.0:1783134881.690568:0:7455:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1783134881.690570:0:7455:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1783134881.690571:0:7455:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1783134881.690572:0:7455:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1783134881.690573:0:7455:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1783134881.690574:0:7455:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1783134881.690580:0:7455:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1783134881.690581:0:7455:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1783134881.690582:0:7455:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1783134881.690582:0:7455:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1783134881.690583:0:7455:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1783134881.690596:0:7455:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:3.0:1783134881.690608:0:7455:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9e0474380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:88a2002e-2ea7-4f07-912a-8d001832cfc0:7455:1869752384372480:0@lo:253: 00000100:00100000:3.0:1783134881.690646:0:7455:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783134881.690673:0:7455:0:(client.c:2701:ptlrpc_set_wait()) set ffff9fe9ca92ae40 going to sleep for 11 seconds 00000100:00100000:3.0:1783134881.690689:0:5765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384372480 00000100:00100000:3.0:1783134881.690693:0:5765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384372480 00000100:00100000:3.0:1783134881.690719:0:5765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1783134881.690726:0:5765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9d1655450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88a2002e-2ea7-4f07-912a-8d001832cfc0+14:7455:x1869752384372480:12345-0@lo:253: 20000000:01000000:3.0:1783134881.690744:0:5765:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:3.0:1783134881.690756:0:5765:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:3.0:1783134881.693802:0:7467:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9e0474e00 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:7467:1869752384372608:0@lo:901: 00000100:00100000:3.0:1783134881.693876:0:7467:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783134881.693903:0:7467:0:(client.c:2701:ptlrpc_set_wait()) set ffff9fea01d529c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783134881.695012:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384372608 00000100:00100000:2.0:1783134881.695019:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384372608 00000100:00100000:2.0:1783134881.695119:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1783134881.695129:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9e0477100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7467:x1869752384372608:12345-0@lo:901: 00000100:00100000:2.0:1783134881.695448:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9e0477100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7467:x1869752384372608:12345-0@lo:901: Request processed in 321us (1572us total) trans 0 rc 0/0 00000100:00100000:2.0:1783134881.695462:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1783134881.696546:0:7467:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9fe9e0474e00 x1869752384372608/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 1783134897 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783134881.696562:0:7467:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9e0474e00 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:7467:1869752384372608:0@lo:901: 00000100:00080000:3.0:1783134881.696765:0:5766:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 20000000:01000000:2.0:1783134881.719956:0:5765:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1783134881.719970:0:5765:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:3.0:1783134881.720009:0:5785:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1783134881.720012:0:5785:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1783134881.720029:0:5785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9fe9d2b74400/0xd6c4b8f05867e4ee lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134881.720043:0:5785:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9fe9d2b74600/0xd6c4b8f05867e43f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd6c4b8f05867e438 expref: 14 pid: 5762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134881.720049:0:5785:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9fe9d2b74400/0xd6c4b8f05867e4ee lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134881.720078:0:5785:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9fe9d2b74600/0xd6c4b8f05867e43f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd6c4b8f05867e438 expref: 14 pid: 5762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134881.720101:0:5785:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9fe9d2b74600/0xd6c4b8f05867e43f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd6c4b8f05867e438 expref: 14 pid: 5762 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783134881.720111:0:5785:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9e0474e00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5785:1869752384372736:0@lo:104: 00000100:00100000:3.0:1783134881.720160:0:5785:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783134881.720202:0:5785:0:(client.c:2701:ptlrpc_set_wait()) set ffff9fe9ca290f00 going to sleep for 11 seconds 00000100:00100000:2.0:1783134881.720352:0:5752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384372736 00000100:00100000:2.0:1783134881.720360:0:5752:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384372736 00000100:00100000:2.0:1783134881.720411:0:5752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1783134881.720419:0:5752:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9e0475180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:88a2002e-2ea7-4f07-912a-8d001832cfc0+3:5785:x1869752384372736:12345-0@lo:104: 00010000:00010000:2.0:1783134881.720432:0:5752:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.141@tcp lock: ffff9fe9c1523200/0xd6c4b8f05867e438 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xd6c4b8f05867e43f expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134881.720481:0:5752:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1783134881.720487:0:5752:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9e0475180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:88a2002e-2ea7-4f07-912a-8d001832cfc0+3:5785:x1869752384372736:12345-0@lo:104: Request processed in 69us (326us total) trans 0 rc 0/0 00000100:00100000:2.0:1783134881.720492:0:5752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1783134881.720495:0:5785:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9e0474e00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5785:1869752384372736:0@lo:104: 00010000:00010000:2.0:1783134881.720512:0:5758:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783134881.720514:0:5785:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9fe9d2b74400/0xd6c4b8f05867e4ee lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134881.720518:0:5758:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.141@tcp lock: ffff9fe9c1523200/0xd6c4b8f05867e438 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xd6c4b8f05867e43f expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134881.720524:0:5758:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe9c1523200 already unused, calling callback (ffffffffc1b40c20) 10000000:00010000:2.0:1783134881.720528:0:5758:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.141@tcp lock: ffff9fe9c1523200/0xd6c4b8f05867e438 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xd6c4b8f05867e43f expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134881.720536:0:5758:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.141@tcp lock: ffff9fe9c1523200/0xd6c4b8f05867e438 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xd6c4b8f05867e43f expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783134881.720554:0:5758:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.141@tcp lock: ffff9fe9c1523200/0xd6c4b8f05867e438 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xd6c4b8f05867e43f expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783134881.720560:0:5758:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1783134881.720594:0:5758:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.141@tcp lock: ffff9fe9c1523200/0xd6c4b8f05867e438 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd6c4b8f05867e43f expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134881.720600:0:5758:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1783134881.720617:0:5758:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.141@tcp lock: ffff9fe9c1523200/0xd6c4b8f05867e438 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd6c4b8f05867e43f expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134881.720623:0:5758:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.141@tcp lock: ffff9fe9c1523200/0xd6c4b8f05867e438 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd6c4b8f05867e43f expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134881.720636:0:5758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783134881.720638:0:5758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783134881.720639:0:5758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783134881.720742:0:3287:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9ca88f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:88a2002e-2ea7-4f07-912a-8d001832cfc0:3287:1869752384372864:0@lo:103: 00000100:00100000:0.0:1783134881.720773:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783134881.720809:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384372864 00000100:00100000:0.0:1783134881.720813:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384372864 00010000:00010000:0.0:1783134881.720829:0:6592:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9fe9d2b74600/0xd6c4b8f05867e43f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd6c4b8f05867e438 expref: 15 pid: 5762 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783134881.720849:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1783134881.720855:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9d1621850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:88a2002e-2ea7-4f07-912a-8d001832cfc0+15:3287:x1869752384372864:12345-0@lo:103: 00010000:00010000:0.0:1783134881.720871:0:6592:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783134881.720877:0:6592:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9fe9d2b74600/0xd6c4b8f05867e43f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd6c4b8f05867e438 expref: 15 pid: 5762 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134881.720886:0:6592:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9fe9d2b74600/0xd6c4b8f05867e43f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd6c4b8f05867e438 expref: 15 pid: 5762 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134881.720898:0:6592:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fe9d2b74600/0xd6c4b8f05867e43f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd6c4b8f05867e438 expref: 15 pid: 5762 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134881.720909:0:6592:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9fe9d2b74400/0xd6c4b8f05867e4ee lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134881.720916:0:6592:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fe9d2b74400/0xd6c4b8f05867e4ee lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1783134881.720928:0:6592:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001465305s 00010000:00010000:0.0:1783134881.720931:0:6592:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9fe9d2b74400/0xd6c4b8f05867e4ee lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134881.720938:0:6592:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9fe9d2b74400/0xd6c4b8f05867e4ee lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134881.720944:0:6592:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9fe9d2b74400/0xd6c4b8f05867e4ee lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134881.720950:0:6592:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9fe9d2b74400/0xd6c4b8f05867e4ee lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134881.720954:0:6592:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe9d2b74400 already unused, calling callback (ffffffffc1527ce0) 00010000:00010000:0.0:1783134881.720958:0:6592:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9fe9d2b74400/0xd6c4b8f05867e4ee lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134881.720972:0:6592:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9fe9d2b74400/0xd6c4b8f05867e4ee lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134881.720984:0:6592:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9fe9d2b74400/0xd6c4b8f05867e4ee lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134881.720992:0:6592:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783134881.721018:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9d1621850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:88a2002e-2ea7-4f07-912a-8d001832cfc0+14:3287:x1869752384372864:12345-0@lo:103: Request processed in 164us (244us total) trans 0 rc 0/0 00000100:00100000:0.0:1783134881.721024:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1783134881.721070:0:3287:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9ca88f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:88a2002e-2ea7-4f07-912a-8d001832cfc0:3287:1869752384372864:0@lo:103: 00010000:00010000:0.0:1783134881.721085:0:5785:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9fe9d2b74400/0xd6c4b8f05867e4ee lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134881.721092:0:5785:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9fe9d2b74400/0xd6c4b8f05867e4ee lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134881.721098:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fe9d2b74400/0xd6c4b8f05867e4ee lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783134881.728016:0:5765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9d1655450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88a2002e-2ea7-4f07-912a-8d001832cfc0+13:7455:x1869752384372480:12345-0@lo:253: Request processed in 37282us (37360us total) trans 0 rc 0/0 00000100:00100000:2.0:1783134881.728030:0:5765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1783134881.728040:0:7455:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9e0474380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:88a2002e-2ea7-4f07-912a-8d001832cfc0:7455:1869752384372480:0@lo:253: 10000000:01000000:3.0:1783134881.728058:0:7455:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:3.0:1783134881.728061:0:7455:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1783134881.728063:0:7455:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1783134881.728065:0:7455:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1783134881.728067:0:7455:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1783134881.728068:0:7455:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1783134881.728070:0:7455:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1783134881.728072:0:7455:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1783134881.728073:0:7455:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1783134881.728075:0:7455:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1783134881.728077:0:7455:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1783134881.728078:0:7455:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1783134881.728090:0:7455:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:3.0:1783134881.730926:0:7455:0:(osd_index.c:2102:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:3.0:1783134881.731080:0:7455:0:(osd_index.c:2102:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:3.0:1783134881.731239:0:7455:0:(osd_index.c:2102:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:3.0:1783134881.731678:0:7455:0:(osd_index.c:2102:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:3.0:1783134881.731846:0:7455:0:(osd_index.c:2102:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:3.0:1783134881.732039:0:7455:0:(osd_index.c:2102:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:3.0:1783134881.733673:0:7455:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:2.0:1783134881.839415:0:7455:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:2.0:1783134881.839421:0:7455:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:2.0:1783134881.839470:0:7455:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1783134881.839555:0:7455:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.141@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1783134881.839572:0:7455:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=49 00000080:00000004:2.0:1783134881.839598:0:7455:0:(super25.c:187:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00010000:00010000:1.0:1783134882.051384:0:5757:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783134883.075728:0:6591:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783134883.971643:0:3288:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9e0474380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1869752384372992:0@lo:13: 00000100:00100000:3.0:1783134883.971715:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783134883.971827:0:6579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384372992 00000100:00100000:3.0:1783134883.971842:0:6579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384372992 00000100:00100000:3.0:1783134883.971908:0:6579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1783134883.971927:0:6579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9e0476d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3288:x1869752384372992:12345-0@lo:13: 00002000:00000024:3.0:1783134883.971967:0:6579:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1783134883.972026:0:6579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9e0476d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3288:x1869752384372992:12345-0@lo:13: Request processed in 110us (311us total) trans 0 rc 0/0 00000100:00100000:3.0:1783134883.972033:0:6579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:3.0:1783134883.972052:0:5766:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1783134883.972118:0:3288:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fe9e0474380 x1869752384372992/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783134899 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783134883.972153:0:3288:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9e0474380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1869752384372992:0@lo:13: 10000000:01000000:3.0:1783134883.973267:0:5767:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1783134883.973272:0:5767:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff9fea01d1b000 from 30 10000000:01000000:3.0:1783134883.973307:0:5767:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1783134883.973350:0:5767:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.141@tcp lock: ffff9fe9d2b75c00/0xd6c4b8f05867e4f5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134883.973362:0:5767:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.141@tcp lock: ffff9fe9d2b75c00/0xd6c4b8f05867e4f5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134883.973371:0:5767:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.141@tcp lock: ffff9fe9d2b75c00/0xd6c4b8f05867e4f5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783134883.973390:0:5767:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9e0474380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88a2002e-2ea7-4f07-912a-8d001832cfc0:5767:1869752384373120:0@lo:101: 00000100:00100000:3.0:1783134883.973528:0:5767:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783134883.973577:0:5767:0:(client.c:2701:ptlrpc_set_wait()) set ffff9fe9f426c3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783134883.973678:0:5762:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384373120 00000100:00100000:1.0:1783134883.973684:0:5762:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384373120 00000100:00100000:1.0:1783134883.973734:0:5762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1783134883.973743:0:5762:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9d1654c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88a2002e-2ea7-4f07-912a-8d001832cfc0+13:5767:x1869752384373120:12345-0@lo:101: 00010000:00010000:1.0:1783134883.973753:0:5762:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783134883.973772:0:5762:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fea02167800/0xd6c4b8f05867e4fc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xd6c4b8f05867e4f5 expref: -99 pid: 5762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134883.973817:0:5762:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fea02167800/0xd6c4b8f05867e4fc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd6c4b8f05867e4f5 expref: 14 pid: 5762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134883.973845:0:5762:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fea02167800/0xd6c4b8f05867e4fc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd6c4b8f05867e4f5 expref: 14 pid: 5762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134883.973854:0:5762:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fea02167800, rc 0) 00000100:00100000:1.0:1783134883.973908:0:5762:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9d1654c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88a2002e-2ea7-4f07-912a-8d001832cfc0+14:5767:x1869752384373120:12345-0@lo:101: Request processed in 166us (471us total) trans 0 rc 0/0 00000100:00100000:1.0:1783134883.973915:0:5762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1783134883.974060:0:5767:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9e0474380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88a2002e-2ea7-4f07-912a-8d001832cfc0:5767:1869752384373120:0@lo:101: 00010000:00010000:3.0:1783134883.974086:0:5767:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.141@tcp lock: ffff9fe9d2b75c00/0xd6c4b8f05867e4f5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd6c4b8f05867e4fc expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134883.974112:0:5767:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.141@tcp lock: ffff9fe9d2b75c00/0xd6c4b8f05867e4f5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xd6c4b8f05867e4fc expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783134883.974174:0:5767:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9e0474380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88a2002e-2ea7-4f07-912a-8d001832cfc0:5767:1869752384373248:0@lo:501: 00000100:00100000:3.0:1783134883.974242:0:5767:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783134883.974307:0:5767:0:(client.c:2701:ptlrpc_set_wait()) set ffff9fe9f426c3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783134883.974372:0:5765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384373248 00000100:00100000:1.0:1783134883.974376:0:5765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384373248 00000100:00100000:1.0:1783134883.974398:0:5765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1783134883.974406:0:5765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9d1654850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88a2002e-2ea7-4f07-912a-8d001832cfc0+14:5767:x1869752384373248:12345-0@lo:501: 00000100:00100000:1.0:1783134883.974965:0:5765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9d1654850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88a2002e-2ea7-4f07-912a-8d001832cfc0+14:5767:x1869752384373248:12345-0@lo:501: Request processed in 551us (713us total) trans 0 rc 0/0 00000100:00100000:1.0:1783134883.974981:0:5765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1783134883.975359:0:5767:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9e0474380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88a2002e-2ea7-4f07-912a-8d001832cfc0:5767:1869752384373248:0@lo:501: 00000100:00100000:3.0:1783134883.975421:0:5767:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9e0474380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88a2002e-2ea7-4f07-912a-8d001832cfc0:5767:1869752384373376:0@lo:503: 00000100:00100000:3.0:1783134883.975536:0:5767:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783134883.975571:0:5767:0:(client.c:2701:ptlrpc_set_wait()) set ffff9fe9f426c3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783134883.975655:0:5763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384373376 00000100:00100000:2.0:1783134883.975662:0:5763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384373376 00000100:00100000:2.0:1783134883.975705:0:5763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1783134883.975727:0:5763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9d1657050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88a2002e-2ea7-4f07-912a-8d001832cfc0+14:5767:x1869752384373376:12345-0@lo:503: 00000100:00100000:2.0:1783134883.976007:0:5763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9d1657050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88a2002e-2ea7-4f07-912a-8d001832cfc0+14:5767:x1869752384373376:12345-0@lo:503: Request processed in 281us (477us total) trans 0 rc 0/0 00000100:00100000:2.0:1783134883.976014:0:5763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1783134883.976098:0:5767:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9e0474380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88a2002e-2ea7-4f07-912a-8d001832cfc0:5767:1869752384373376:0@lo:503: 00000100:00100000:3.0:1783134883.988868:0:7670:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9e0474380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:88a2002e-2ea7-4f07-912a-8d001832cfc0:7670:1869752384373504:0@lo:502: 00000100:00100000:3.0:1783134883.991631:0:7670:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783134883.991688:0:7670:0:(client.c:2701:ptlrpc_set_wait()) set ffff9fe9f426cf00 going to sleep for 11 seconds 00000100:00100000:2.0:1783134883.991717:0:5762:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384373504 00000100:00100000:2.0:1783134883.991727:0:5762:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384373504 00000100:00100000:2.0:1783134883.991783:0:5762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1783134883.991793:0:5762:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9d1657c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88a2002e-2ea7-4f07-912a-8d001832cfc0+14:7670:x1869752384373504:12345-0@lo:502: 00000100:00100000:2.0:1783134883.992164:0:5762:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9d1657c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88a2002e-2ea7-4f07-912a-8d001832cfc0+14:7670:x1869752384373504:12345-0@lo:502: Request processed in 371us (538us total) trans 0 rc 0/0 00000100:00100000:2.0:1783134883.992172:0:5762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1783134883.997112:0:7670:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9e0474380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:88a2002e-2ea7-4f07-912a-8d001832cfc0:7670:1869752384373504:0@lo:502: 00000100:00100000:3.0:1783134883.997194:0:7670:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9e0474380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:88a2002e-2ea7-4f07-912a-8d001832cfc0:7670:1869752384373632:0@lo:502: 00000100:00100000:3.0:1783134883.997427:0:7670:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783134883.997462:0:5765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384373632 00000100:00100000:3.0:1783134883.997471:0:5765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384373632 00000100:00100000:3.0:1783134883.997515:0:5765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1783134883.997525:0:5765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9d1655c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88a2002e-2ea7-4f07-912a-8d001832cfc0+14:7670:x1869752384373632:12345-0@lo:502: 00000100:00100000:3.0:1783134883.997732:0:5765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9d1655c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88a2002e-2ea7-4f07-912a-8d001832cfc0+14:7670:x1869752384373632:12345-0@lo:502: Request processed in 208us (305us total) trans 0 rc 0/0 00000100:00100000:3.0:1783134883.997749:0:5765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1783134883.997797:0:7670:0:(client.c:2701:ptlrpc_set_wait()) set ffff9fe9f426cf00 going to sleep for 11 seconds 00000100:00100000:3.0:1783134883.997808:0:7670:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9e0474380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:88a2002e-2ea7-4f07-912a-8d001832cfc0:7670:1869752384373632:0@lo:502: 00000040:00080000:3.0:1783134883.997825:0:7670:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:2.0:1783134883.997902:0:5767:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:2.0:1783134883.997921:0:5767:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.201.141@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1783134883.997931:0:5767:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.141@tcp lock: ffff9fe9d2b75c00/0xd6c4b8f05867e4f5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd6c4b8f05867e4fc expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134883.997939:0:5767:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.141@tcp lock: ffff9fe9d2b75c00/0xd6c4b8f05867e4f5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd6c4b8f05867e4fc expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783134883.997947:0:5767:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:2.0:1783134883.997949:0:5767:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 8 10000000:01000000:2.0:1783134883.997951:0:5767:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:2.0:1783134883.997970:0:5767:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.141@tcp lock: ffff9fe9c1523400/0xd6c4b8f05867e503 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134883.997975:0:5767:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.141@tcp lock: ffff9fe9c1523400/0xd6c4b8f05867e503 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134883.997981:0:5767:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.141@tcp lock: ffff9fe9c1523400/0xd6c4b8f05867e503 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783134883.997995:0:5767:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9ca88f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88a2002e-2ea7-4f07-912a-8d001832cfc0:5767:1869752384373760:0@lo:101: 00000100:00100000:2.0:1783134883.998017:0:5767:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783134883.998032:0:5767:0:(client.c:2701:ptlrpc_set_wait()) set ffff9fe8c55ea600 going to sleep for 11 seconds 00000100:00100000:3.0:1783134883.998057:0:5763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384373760 00000100:00100000:3.0:1783134883.998062:0:5763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384373760 00000100:00100000:3.0:1783134883.998092:0:5763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1783134883.998100:0:5763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9d1656c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88a2002e-2ea7-4f07-912a-8d001832cfc0+14:5767:x1869752384373760:12345-0@lo:101: 00010000:00010000:3.0:1783134883.998108:0:5763:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783134883.998122:0:5763:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fe9d2b74e00/0xd6c4b8f05867e50a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xd6c4b8f05867e503 expref: -99 pid: 5763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134883.998143:0:5763:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fe9d2b74e00/0xd6c4b8f05867e50a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd6c4b8f05867e503 expref: 15 pid: 5763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134883.998154:0:5763:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fe9d2b74e00/0xd6c4b8f05867e50a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd6c4b8f05867e503 expref: 15 pid: 5763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134883.998163:0:5763:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fe9d2b74e00, rc 0) 00000100:00100000:3.0:1783134883.998193:0:5763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9d1656c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88a2002e-2ea7-4f07-912a-8d001832cfc0+15:5767:x1869752384373760:12345-0@lo:101: Request processed in 94us (174us total) trans 0 rc 0/0 00000100:00100000:3.0:1783134883.998200:0:5763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1783134883.998221:0:5767:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9ca88f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88a2002e-2ea7-4f07-912a-8d001832cfc0:5767:1869752384373760:0@lo:101: 00010000:00010000:2.0:1783134883.998299:0:5767:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.141@tcp lock: ffff9fe9c1523400/0xd6c4b8f05867e503 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xd6c4b8f05867e50a expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134883.998307:0:5767:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.141@tcp lock: ffff9fe9c1523400/0xd6c4b8f05867e503 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xd6c4b8f05867e50a expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783134883.998338:0:5767:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9ca88f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88a2002e-2ea7-4f07-912a-8d001832cfc0:5767:1869752384373888:0@lo:501: 00000100:00100000:2.0:1783134883.998355:0:5767:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783134883.998366:0:5767:0:(client.c:2701:ptlrpc_set_wait()) set ffff9fe8c55ea600 going to sleep for 11 seconds 00000100:00100000:3.0:1783134883.998380:0:5762:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384373888 00000100:00100000:3.0:1783134883.998385:0:5762:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384373888 00000100:00100000:3.0:1783134883.998416:0:5762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1783134883.998425:0:5762:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9ea689c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88a2002e-2ea7-4f07-912a-8d001832cfc0+15:5767:x1869752384373888:12345-0@lo:501: 00000100:00100000:3.0:1783134883.998616:0:5762:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9ea689c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88a2002e-2ea7-4f07-912a-8d001832cfc0+15:5767:x1869752384373888:12345-0@lo:501: Request processed in 192us (257us total) trans 0 rc 0/0 00000100:00100000:3.0:1783134883.998630:0:5762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1783134883.998636:0:5767:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9ca88f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88a2002e-2ea7-4f07-912a-8d001832cfc0:5767:1869752384373888:0@lo:501: 00000100:00100000:2.0:1783134883.998658:0:5767:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9ca88f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88a2002e-2ea7-4f07-912a-8d001832cfc0:5767:1869752384374016:0@lo:503: 00000100:00100000:2.0:1783134883.998681:0:5767:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783134883.998704:0:5763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384374016 00000100:00100000:2.0:1783134883.998704:0:5767:0:(client.c:2701:ptlrpc_set_wait()) set ffff9fe8c55ea600 going to sleep for 11 seconds 00000100:00100000:3.0:1783134883.998711:0:5763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384374016 00000100:00100000:3.0:1783134883.998740:0:5763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1783134883.998747:0:5763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9ea68ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88a2002e-2ea7-4f07-912a-8d001832cfc0+15:5767:x1869752384374016:12345-0@lo:503: 00000100:00100000:3.0:1783134883.999002:0:5763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9ea68ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88a2002e-2ea7-4f07-912a-8d001832cfc0+15:5767:x1869752384374016:12345-0@lo:503: Request processed in 255us (318us total) trans 0 rc 0/0 00000100:00100000:3.0:1783134883.999010:0:5763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1783134883.999022:0:5767:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9ca88f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88a2002e-2ea7-4f07-912a-8d001832cfc0:5767:1869752384374016:0@lo:503: 00000100:00100000:2.0:1783134883.999226:0:7671:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9ca88f480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:88a2002e-2ea7-4f07-912a-8d001832cfc0:7671:1869752384374144:0@lo:502: 00000100:00100000:2.0:1783134883.999327:0:7671:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783134883.999336:0:7671:0:(client.c:2701:ptlrpc_set_wait()) set ffff9fe8c55ea840 going to sleep for 11 seconds 00000100:00100000:3.0:1783134883.999399:0:5762:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384374144 00000100:00100000:3.0:1783134883.999405:0:5762:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384374144 00000100:00100000:3.0:1783134883.999435:0:5762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1783134883.999442:0:5762:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9d1651450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88a2002e-2ea7-4f07-912a-8d001832cfc0+15:7671:x1869752384374144:12345-0@lo:502: 00000100:00100000:3.0:1783134883.999592:0:5762:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9d1651450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88a2002e-2ea7-4f07-912a-8d001832cfc0+15:7671:x1869752384374144:12345-0@lo:502: Request processed in 150us (262us total) trans 0 rc 0/0 00000100:00100000:3.0:1783134883.999599:0:5762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1783134883.999606:0:7671:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9ca88f480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:88a2002e-2ea7-4f07-912a-8d001832cfc0:7671:1869752384374144:0@lo:502: 00000020:01000000:2.0:1783134883.999626:0:7671:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1783134883.999633:0:7671:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783134883.999638:0:7671:0:(obd_config.c:1561:class_process_config()) marker 22 (0x1) lustre sys.timeout 00000020:00000080:2.0:1783134883.999641:0:7671:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1783134883.999643:0:7671:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:2.0:1783134883.999652:0:7671:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9ca88f480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:88a2002e-2ea7-4f07-912a-8d001832cfc0:7671:1869752384374272:0@lo:502: 00000100:00100000:2.0:1783134883.999673:0:7671:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783134883.999695:0:7671:0:(client.c:2701:ptlrpc_set_wait()) set ffff9fe8c55ea840 going to sleep for 11 seconds 00000100:00100000:3.0:1783134884.000058:0:5763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384374272 00000100:00100000:3.0:1783134884.000062:0:5763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384374272 00000100:00100000:3.0:1783134884.000087:0:5763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1783134884.000093:0:5763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9d1650c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88a2002e-2ea7-4f07-912a-8d001832cfc0+15:7671:x1869752384374272:12345-0@lo:502: 00000100:00100000:3.0:1783134884.000226:0:5763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9d1650c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88a2002e-2ea7-4f07-912a-8d001832cfc0+15:7671:x1869752384374272:12345-0@lo:502: Request processed in 131us (550us total) trans 0 rc 0/0 00000100:00100000:3.0:1783134884.000233:0:5763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1783134884.000314:0:7671:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9ca88f480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:88a2002e-2ea7-4f07-912a-8d001832cfc0:7671:1869752384374272:0@lo:502: 00000020:01000000:2.0:1783134884.000328:0:7671:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1783134884.000331:0:7671:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783134884.000332:0:7671:0:(obd_config.c:1561:class_process_config()) marker 22 (0x2) lustre sys.timeout 00000040:00080000:2.0:1783134884.000335:0:7671:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000020:01000000:3.0:1783134884.000511:0:5767:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 8-10 (rc=0) 10000000:01000000:3.0:1783134884.000526:0:5767:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.201.141@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1783134884.000536:0:5767:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.141@tcp lock: ffff9fe9c1523400/0xd6c4b8f05867e503 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xd6c4b8f05867e50a expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134884.000558:0:5767:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.141@tcp lock: ffff9fe9c1523400/0xd6c4b8f05867e503 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xd6c4b8f05867e50a expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783134884.000567:0:5767:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1783134884.000570:0:5767:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff9fe9e0d14800 from 30 10000000:01000000:3.0:1783134884.000573:0:5767:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1783134884.000595:0:5767:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.141@tcp lock: ffff9fe9d2b74200/0xd6c4b8f05867e511 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134884.000603:0:5767:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.141@tcp lock: ffff9fe9d2b74200/0xd6c4b8f05867e511 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134884.000612:0:5767:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.141@tcp lock: ffff9fe9d2b74200/0xd6c4b8f05867e511 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783134884.000624:0:5767:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9e0474380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88a2002e-2ea7-4f07-912a-8d001832cfc0:5767:1869752384374400:0@lo:101: 00000100:00100000:3.0:1783134884.000657:0:5767:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783134884.000815:0:5767:0:(client.c:2701:ptlrpc_set_wait()) set ffff9fe9e9c68c00 going to sleep for 11 seconds 00000100:00100000:2.0:1783134884.000840:0:5765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384374400 00000100:00100000:2.0:1783134884.000843:0:5765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384374400 00000100:00100000:2.0:1783134884.000998:0:5765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1783134884.001004:0:5765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9d1650850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88a2002e-2ea7-4f07-912a-8d001832cfc0+15:5767:x1869752384374400:12345-0@lo:101: 00010000:00010000:2.0:1783134884.001011:0:5765:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783134884.001020:0:5765:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fe9c1523200/0xd6c4b8f05867e518 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xd6c4b8f05867e511 expref: -99 pid: 5765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134884.001035:0:5765:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fe9c1523200/0xd6c4b8f05867e518 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd6c4b8f05867e511 expref: 16 pid: 5765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134884.001042:0:5765:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fe9c1523200/0xd6c4b8f05867e518 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd6c4b8f05867e511 expref: 16 pid: 5765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134884.001048:0:5765:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fe9c1523200, rc 0) 00000100:00100000:2.0:1783134884.001071:0:5765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9d1650850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88a2002e-2ea7-4f07-912a-8d001832cfc0+16:5767:x1869752384374400:12345-0@lo:101: Request processed in 69us (415us total) trans 0 rc 0/0 00000100:00100000:2.0:1783134884.001075:0:5765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1783134884.001112:0:5767:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9e0474380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88a2002e-2ea7-4f07-912a-8d001832cfc0:5767:1869752384374400:0@lo:101: 00010000:00010000:3.0:1783134884.001120:0:5767:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.141@tcp lock: ffff9fe9d2b74200/0xd6c4b8f05867e511 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xd6c4b8f05867e518 expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134884.001126:0:5767:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.141@tcp lock: ffff9fe9d2b74200/0xd6c4b8f05867e511 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xd6c4b8f05867e518 expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783134884.001155:0:5767:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9e0474380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88a2002e-2ea7-4f07-912a-8d001832cfc0:5767:1869752384374528:0@lo:501: 00000100:00100000:3.0:1783134884.001179:0:5767:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783134884.001200:0:5767:0:(client.c:2701:ptlrpc_set_wait()) set ffff9fe9e9c68c00 going to sleep for 11 seconds 00000100:00100000:3.0:1783134884.001221:0:5763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384374528 00000100:00100000:3.0:1783134884.001225:0:5763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384374528 00000100:00100000:3.0:1783134884.001255:0:5763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1783134884.001261:0:5763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9d1653050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88a2002e-2ea7-4f07-912a-8d001832cfc0+16:5767:x1869752384374528:12345-0@lo:501: 00000100:00100000:3.0:1783134884.001419:0:5763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9d1653050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88a2002e-2ea7-4f07-912a-8d001832cfc0+16:5767:x1869752384374528:12345-0@lo:501: Request processed in 159us (239us total) trans 0 rc 0/0 00000100:00100000:3.0:1783134884.001424:0:5763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1783134884.001548:0:5767:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9e0474380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88a2002e-2ea7-4f07-912a-8d001832cfc0:5767:1869752384374528:0@lo:501: 00000100:00100000:3.0:1783134884.001566:0:5767:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9e0474380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88a2002e-2ea7-4f07-912a-8d001832cfc0:5767:1869752384374656:0@lo:503: 00000100:00100000:3.0:1783134884.001589:0:5767:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783134884.001597:0:5767:0:(client.c:2701:ptlrpc_set_wait()) set ffff9fe9e9c68c00 going to sleep for 11 seconds 00000100:00100000:3.0:1783134884.001605:0:5763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384374656 00000100:00100000:3.0:1783134884.001607:0:5763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384374656 00000100:00100000:3.0:1783134884.001620:0:5763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1783134884.001624:0:5763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9d1653c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88a2002e-2ea7-4f07-912a-8d001832cfc0+16:5767:x1869752384374656:12345-0@lo:503: 00000100:00100000:3.0:1783134884.001714:0:5763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9d1653c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88a2002e-2ea7-4f07-912a-8d001832cfc0+16:5767:x1869752384374656:12345-0@lo:503: Request processed in 89us (123us total) trans 0 rc 0/0 00000100:00100000:3.0:1783134884.001720:0:5763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1783134884.001753:0:5767:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9e0474380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88a2002e-2ea7-4f07-912a-8d001832cfc0:5767:1869752384374656:0@lo:503: 00000100:00100000:3.0:1783134884.001897:0:7672:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9e0474380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:88a2002e-2ea7-4f07-912a-8d001832cfc0:7672:1869752384374784:0@lo:502: 00000100:00100000:3.0:1783134884.001919:0:7672:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783134884.001931:0:5763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384374784 00000100:00100000:3.0:1783134884.001933:0:5763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384374784 00000100:00100000:3.0:1783134884.001945:0:5763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1783134884.001949:0:5763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9d1651c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88a2002e-2ea7-4f07-912a-8d001832cfc0+16:7672:x1869752384374784:12345-0@lo:502: 00000100:00100000:3.0:1783134884.002067:0:5763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9d1651c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88a2002e-2ea7-4f07-912a-8d001832cfc0+16:7672:x1869752384374784:12345-0@lo:502: Request processed in 117us (146us total) trans 0 rc 0/0 00000100:00100000:3.0:1783134884.002072:0:5763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1783134884.002108:0:7672:0:(client.c:2701:ptlrpc_set_wait()) set ffff9fe9e9c68d80 going to sleep for 11 seconds 00000100:00100000:3.0:1783134884.002117:0:7672:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9e0474380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:88a2002e-2ea7-4f07-912a-8d001832cfc0:7672:1869752384374784:0@lo:502: 00000100:00100000:3.0:1783134884.002148:0:7672:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9e0474380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:88a2002e-2ea7-4f07-912a-8d001832cfc0:7672:1869752384374912:0@lo:502: 00000100:00100000:3.0:1783134884.002185:0:7672:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783134884.002206:0:5763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384374912 00000100:00100000:3.0:1783134884.002209:0:5763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384374912 00000100:00100000:3.0:1783134884.002330:0:5763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1783134884.002334:0:5763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9d1652c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88a2002e-2ea7-4f07-912a-8d001832cfc0+16:7672:x1869752384374912:12345-0@lo:502: 00000100:00100000:3.0:1783134884.002432:0:5763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9d1652c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88a2002e-2ea7-4f07-912a-8d001832cfc0+16:7672:x1869752384374912:12345-0@lo:502: Request processed in 97us (247us total) trans 0 rc 0/0 00000100:00100000:3.0:1783134884.002698:0:5763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1783134884.002759:0:7672:0:(client.c:2701:ptlrpc_set_wait()) set ffff9fe9c97dc6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783134884.002777:0:7672:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9e0474380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:88a2002e-2ea7-4f07-912a-8d001832cfc0:7672:1869752384374912:0@lo:502: 00000040:00080000:3.0:1783134884.002804:0:7672:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:2.0:1783134884.002951:0:5767:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:2.0:1783134884.002979:0:5767:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.201.141@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1783134884.002986:0:5767:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.141@tcp lock: ffff9fe9d2b74200/0xd6c4b8f05867e511 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xd6c4b8f05867e518 expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134884.002993:0:5767:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.141@tcp lock: ffff9fe9d2b74200/0xd6c4b8f05867e511 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xd6c4b8f05867e518 expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783134884.002999:0:5767:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1783134884.003001:0:5767:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-mdtir-ffff9fe9e0d14800 from 5 10000000:01000000:2.0:1783134884.003004:0:5767:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1783134884.003023:0:5767:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.141@tcp lock: ffff9fe9c1523000/0xd6c4b8f05867e51f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134884.003028:0:5767:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.141@tcp lock: ffff9fe9c1523000/0xd6c4b8f05867e51f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134884.003034:0:5767:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.141@tcp lock: ffff9fe9c1523000/0xd6c4b8f05867e51f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783134884.003044:0:5767:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9ca88f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88a2002e-2ea7-4f07-912a-8d001832cfc0:5767:1869752384375040:0@lo:101: 00000100:00100000:2.0:1783134884.003070:0:5767:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783134884.003113:0:5767:0:(client.c:2701:ptlrpc_set_wait()) set ffff9fe8c55ea3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783134884.003133:0:5765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384375040 00000100:00100000:3.0:1783134884.003135:0:5765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384375040 00000100:00100000:3.0:1783134884.003186:0:5765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1783134884.003194:0:5765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9d1653450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88a2002e-2ea7-4f07-912a-8d001832cfc0+16:5767:x1869752384375040:12345-0@lo:101: 00010000:00010000:3.0:1783134884.003203:0:5765:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783134884.003223:0:5765:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fe9d2b75e00/0xd6c4b8f05867e526 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd6c4b8f05867e51f expref: -99 pid: 5765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134884.003248:0:5765:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fe9d2b75e00/0xd6c4b8f05867e526 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd6c4b8f05867e51f expref: 17 pid: 5765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134884.003265:0:5765:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fe9d2b75e00/0xd6c4b8f05867e526 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd6c4b8f05867e51f expref: 17 pid: 5765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134884.003272:0:5765:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fe9d2b75e00, rc 0) 00000100:00100000:3.0:1783134884.003310:0:5765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9d1653450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88a2002e-2ea7-4f07-912a-8d001832cfc0+17:5767:x1869752384375040:12345-0@lo:101: Request processed in 118us (241us total) trans 0 rc 0/0 00000100:00100000:3.0:1783134884.003315:0:5765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1783134884.003410:0:5767:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9ca88f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88a2002e-2ea7-4f07-912a-8d001832cfc0:5767:1869752384375040:0@lo:101: 00010000:00010000:3.0:1783134884.003418:0:5767:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.141@tcp lock: ffff9fe9c1523000/0xd6c4b8f05867e51f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd6c4b8f05867e526 expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134884.003423:0:5767:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.141@tcp lock: ffff9fe9c1523000/0xd6c4b8f05867e51f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd6c4b8f05867e526 expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783134884.003509:0:5767:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9e0474380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88a2002e-2ea7-4f07-912a-8d001832cfc0:5767:1869752384375168:0@lo:256: 00000100:00100000:3.0:1783134884.003532:0:5767:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783134884.003570:0:5767:0:(client.c:2701:ptlrpc_set_wait()) set ffff9fe9c97dc780 going to sleep for 11 seconds 00000100:00100000:2.0:1783134884.003592:0:5762:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384375168 00000100:00100000:2.0:1783134884.003595:0:5762:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384375168 00000100:00100000:2.0:1783134884.003634:0:5762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1783134884.003638:0:5762:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9d1650050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88a2002e-2ea7-4f07-912a-8d001832cfc0+17:5767:x1869752384375168:12345-0@lo:256: 20000000:01000000:2.0:1783134884.003648:0:5762:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1783134884.003662:0:5762:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1783134884.003664:0:5762:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:2.0:1783134884.003711:0:5762:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9d1650050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88a2002e-2ea7-4f07-912a-8d001832cfc0+17:5767:x1869752384375168:12345-0@lo:256: Request processed in 73us (177us total) trans 0 rc 0/0 00000100:00100000:2.0:1783134884.003721:0:5762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1783134884.003764:0:5767:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9e0474380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88a2002e-2ea7-4f07-912a-8d001832cfc0:5767:1869752384375168:0@lo:256: 10000000:01000000:3.0:1783134884.003801:0:5767:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.201.141@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1783134884.003806:0:5767:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.141@tcp lock: ffff9fe9c1523000/0xd6c4b8f05867e51f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd6c4b8f05867e526 expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134884.003814:0:5767:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.141@tcp lock: ffff9fe9c1523000/0xd6c4b8f05867e51f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd6c4b8f05867e526 expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783134884.003821:0:5767:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:3.0:1783134884.003826:0:5767:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 25 10000000:01000000:3.0:1783134884.003828:0:5767:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1783134884.003839:0:5767:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.141@tcp lock: ffff9fe9d2b75000/0xd6c4b8f05867e52d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134884.003843:0:5767:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.141@tcp lock: ffff9fe9d2b75000/0xd6c4b8f05867e52d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134884.003848:0:5767:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.141@tcp lock: ffff9fe9d2b75000/0xd6c4b8f05867e52d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783134884.003854:0:5767:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9e0474380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88a2002e-2ea7-4f07-912a-8d001832cfc0:5767:1869752384375296:0@lo:101: 00000100:00100000:3.0:1783134884.003869:0:5767:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783134884.003878:0:5767:0:(client.c:2701:ptlrpc_set_wait()) set ffff9fe9cb6b5d80 going to sleep for 11 seconds 00000100:00100000:3.0:1783134884.003885:0:5765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384375296 00000100:00100000:3.0:1783134884.003887:0:5765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384375296 00000100:00100000:3.0:1783134884.003901:0:5765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1783134884.003904:0:5765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9d1651050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88a2002e-2ea7-4f07-912a-8d001832cfc0+17:5767:x1869752384375296:12345-0@lo:101: 00010000:00010000:3.0:1783134884.003909:0:5765:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783134884.003913:0:5765:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fe9d2b74400/0xd6c4b8f05867e534 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xd6c4b8f05867e52d expref: -99 pid: 5765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134884.003922:0:5765:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fe9d2b74400/0xd6c4b8f05867e534 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd6c4b8f05867e52d expref: 18 pid: 5765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134884.003927:0:5765:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fe9d2b74400/0xd6c4b8f05867e534 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd6c4b8f05867e52d expref: 18 pid: 5765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134884.003931:0:5765:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fe9d2b74400, rc 0) 00000100:00100000:3.0:1783134884.003947:0:5765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9d1651050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88a2002e-2ea7-4f07-912a-8d001832cfc0+18:5767:x1869752384375296:12345-0@lo:101: Request processed in 42us (76us total) trans 0 rc 0/0 00000100:00100000:3.0:1783134884.003954:0:5765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1783134884.003973:0:5767:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9e0474380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88a2002e-2ea7-4f07-912a-8d001832cfc0:5767:1869752384375296:0@lo:101: 00010000:00010000:3.0:1783134884.003979:0:5767:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.141@tcp lock: ffff9fe9d2b75000/0xd6c4b8f05867e52d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xd6c4b8f05867e534 expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134884.003984:0:5767:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.141@tcp lock: ffff9fe9d2b75000/0xd6c4b8f05867e52d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xd6c4b8f05867e534 expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783134884.004008:0:5767:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9e0474380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88a2002e-2ea7-4f07-912a-8d001832cfc0:5767:1869752384375424:0@lo:501: 00000100:00100000:3.0:1783134884.004021:0:5767:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783134884.004029:0:5767:0:(client.c:2701:ptlrpc_set_wait()) set ffff9fe9cb6b5d80 going to sleep for 11 seconds 00000100:00100000:3.0:1783134884.004036:0:5765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384375424 00000100:00100000:3.0:1783134884.004038:0:5765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384375424 00000100:00100000:3.0:1783134884.004048:0:5765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1783134884.004052:0:5765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9d1653850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88a2002e-2ea7-4f07-912a-8d001832cfc0+18:5767:x1869752384375424:12345-0@lo:501: 00000100:00100000:3.0:1783134884.004206:0:5765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9d1653850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88a2002e-2ea7-4f07-912a-8d001832cfc0+18:5767:x1869752384375424:12345-0@lo:501: Request processed in 152us (181us total) trans 0 rc 0/0 00000100:00100000:3.0:1783134884.004222:0:5765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1783134884.004341:0:5767:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9e0474380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88a2002e-2ea7-4f07-912a-8d001832cfc0:5767:1869752384375424:0@lo:501: 00000100:00100000:3.0:1783134884.004357:0:5767:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9e0474380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88a2002e-2ea7-4f07-912a-8d001832cfc0:5767:1869752384375552:0@lo:503: 00000100:00100000:3.0:1783134884.004380:0:5767:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783134884.004417:0:5767:0:(client.c:2701:ptlrpc_set_wait()) set ffff9fe9cb6b5d80 going to sleep for 11 seconds 00000100:00100000:2.0:1783134884.004506:0:5762:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384375552 00000100:00100000:2.0:1783134884.004511:0:5762:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384375552 00000100:00100000:2.0:1783134884.004538:0:5762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1783134884.004546:0:5762:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9d1651850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88a2002e-2ea7-4f07-912a-8d001832cfc0+18:5767:x1869752384375552:12345-0@lo:503: 00000100:00100000:2.0:1783134884.005013:0:5762:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9d1651850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88a2002e-2ea7-4f07-912a-8d001832cfc0+18:5767:x1869752384375552:12345-0@lo:503: Request processed in 468us (630us total) trans 0 rc 0/0 00000100:00100000:2.0:1783134884.005018:0:5762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1783134884.005079:0:5767:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9e0474380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88a2002e-2ea7-4f07-912a-8d001832cfc0:5767:1869752384375552:0@lo:503: 00000100:00100000:2.0:1783134884.005387:0:7673:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9ca88ce00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:88a2002e-2ea7-4f07-912a-8d001832cfc0:7673:1869752384375680:0@lo:502: 00000100:00100000:2.0:1783134884.005419:0:7673:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783134884.005479:0:7673:0:(client.c:2701:ptlrpc_set_wait()) set ffff9fe9ca37a000 going to sleep for 11 seconds 00000100:00100000:3.0:1783134884.006047:0:5762:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384375680 00000100:00100000:3.0:1783134884.006052:0:5762:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384375680 00000100:00100000:3.0:1783134884.006102:0:5762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1783134884.006107:0:5762:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9d1652850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88a2002e-2ea7-4f07-912a-8d001832cfc0+18:7673:x1869752384375680:12345-0@lo:502: 00000100:00100000:3.0:1783134884.006368:0:5762:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9d1652850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88a2002e-2ea7-4f07-912a-8d001832cfc0+18:7673:x1869752384375680:12345-0@lo:502: Request processed in 261us (949us total) trans 0 rc 0/0 00000100:00100000:3.0:1783134884.006373:0:5762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1783134884.006674:0:7673:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9ca88ce00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:88a2002e-2ea7-4f07-912a-8d001832cfc0:7673:1869752384375680:0@lo:502: 00000020:01000000:3.0:1783134884.006695:0:7673:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1783134884.006700:0:7673:0:(obd_mount.c:952:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:3.0:1783134884.006705:0:7673:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783134884.006707:0:7673:0:(obd_config.c:1561:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:3.0:1783134884.006712:0:7673:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1783134884.006715:0:7673:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.201.141@tcp to nid 0x20000c0a8c98d (192.168.201.141@tcp) 00000020:01000000:3.0:1783134884.006735:0:7673:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1783134884.006738:0:7673:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1783134884.006752:0:7673:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff9fe9d0e83380) 00000020:00000080:3.0:1783134884.006773:0:7673:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type osp with refcount 2 00000020:00000080:3.0:1783134884.006778:0:7673:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1783134884.006847:0:7673:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:3.0:1783134884.006854:0:7673:0:(osd_handler.c:1569:osd_obd_connect()) connect #6 00000020:00000080:3.0:1783134884.006860:0:7673:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xd6c4b8f05867e542 00010000:00080000:3.0:1783134884.006890:0:7673:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9fe8c4e44000@lustre-OST0001-osc-MDT0000: add connection 192.168.201.141@tcp at head 00010000:00010000:3.0:1783134884.007078:0:7673:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-5 is initialized 00000040:01000000:3.0:1783134884.012518:0:7673:0:(llog_osd.c:2237:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:3.0:1783134884.012531:0:7673:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:3.0:1783134884.012940:0:7673:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1783134884.013065:0:7673:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1783134884.013098:0:7673:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:3.0:1783134884.013133:0:7673:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000040:00080000:2.0:1783134884.013698:0:7674:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1783134884.013702:0:7674:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000020:00000080:2.0:1783134884.014495:0:7673:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1783134884.014504:0:7673:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1783134884.014531:0:7673:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:2.0:1783134884.014546:0:7673:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xd6c4b8f05867e549 00000100:00080000:2.0:1783134884.014553:0:7673:0:(import.c:512:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1783134884.014558:0:7673:0:(import.c:626:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9fe8c4e44000 using connection 192.168.201.141@tcp/0@lo 00000100:00100000:2.0:1783134884.014584:0:7673:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9fe9ca88f100 x1869752384375808/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1783134884.014625:0:3285:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9ca88f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3285:1869752384375808:0@lo:8: 00000100:00100000:3.0:1783134884.014683:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783134884.014720:0:6577:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384375808 00000100:00080000:2.0:1783134884.014724:0:7673:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00100000:0.0:1783134884.014729:0:6577:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384375808 00000020:01000000:2.0:1783134884.014777:0:7673:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1783134884.014781:0:7673:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783134884.014783:0:7673:0:(obd_config.c:1561:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:2.0:1783134884.014787:0:7673:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1783134884.014791:0:7673:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783134884.014797:0:7673:0:(obd_config.c:1561:class_process_config()) marker 21 (0x1) lustre sys.timeout 00000020:00000080:2.0:1783134884.014802:0:7673:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1783134884.014804:0:7673:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:2.0:1783134884.014828:0:7673:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9ca88f800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:88a2002e-2ea7-4f07-912a-8d001832cfc0:7673:1869752384375936:0@lo:502: 00000100:00100000:2.0:1783134884.014864:0:7673:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783134884.014923:0:5765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384375936 00000100:00100000:3.0:1783134884.014927:0:5765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384375936 00000100:00100000:3.0:1783134884.014953:0:5765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1783134884.014961:0:5765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9d1652050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88a2002e-2ea7-4f07-912a-8d001832cfc0+18:7673:x1869752384375936:12345-0@lo:502: 00000100:00100000:0.0:1783134884.015097:0:6577:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1783134884.015105:0:6577:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9e0474380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3285:x1869752384375808:12345-0@lo:8: 00010000:00080000:0.0:1783134884.015126:0:6577:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 166 last 0 00000020:00000080:0.0:1783134884.015152:0:6577:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xd6c4b8f05867e550 00000100:00100000:3.0:1783134884.015159:0:5765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9d1652050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88a2002e-2ea7-4f07-912a-8d001832cfc0+18:7673:x1869752384375936:12345-0@lo:502: Request processed in 197us (292us total) trans 0 rc 0/0 00002000:00100000:0.0:1783134884.015166:0:6577:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff9fea01d79000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113653 ocd_grant: 0 ocd_index: 1 ocd_group 0 00000100:00100000:3.0:1783134884.015167:0:5765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00002000:00080000:0.0:1783134884.015181:0:6577:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00000001:00000004:0.0:1783134884.015186:0:6577:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00000100:00100000:3.0:1783134884.015514:0:3289:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9ca88c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3289:1869752384376064:0@lo:400: 00000100:00100000:3.0:1783134884.015542:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783134884.015718:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384376064 00000100:00100000:3.0:1783134884.015723:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384376064 00000100:00100000:3.0:1783134884.015755:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1783134884.015764:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9e0474000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3289:x1869752384376064:12345-0@lo:400: 00000100:00100000:3.0:1783134884.015804:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9e0474000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3289:x1869752384376064:12345-0@lo:400: Request processed in 42us (261us total) trans 0 rc 0/0 00000100:00100000:3.0:1783134884.015811:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1783134884.015829:0:3286:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9ca88dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3286:1869752384376192:0@lo:400: 00000100:00100000:3.0:1783134884.015851:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783134884.015867:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1783134884.015871:0:3286:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9ca88d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3286:1869752384376320:0@lo:400: 00000100:00100000:3.0:1783134884.015882:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783134884.015896:0:5769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384376192 00000100:00100000:3.0:1783134884.015899:0:5769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384376192 00000100:00100000:3.0:1783134884.015912:0:5769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384376320 00000100:00100000:3.0:1783134884.015913:0:5769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384376320 00000100:00100000:3.0:1783134884.015922:0:5769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1783134884.015925:0:5769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9e0477800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3286:x1869752384376192:12345-0@lo:400: 00000100:00100000:3.0:1783134884.015952:0:5769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9e0477800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3286:x1869752384376192:12345-0@lo:400: Request processed in 27us (101us total) trans 0 rc 0/0 00000100:00100000:3.0:1783134884.015956:0:5769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1783134884.015965:0:5769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1783134884.015968:0:5769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9e0475500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3286:x1869752384376320:12345-0@lo:400: 00000100:00100000:3.0:1783134884.015981:0:5769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9e0475500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3286:x1869752384376320:12345-0@lo:400: Request processed in 13us (99us total) trans 0 rc 0/0 00000100:00100000:3.0:1783134884.015985:0:5769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00080000:3.0:1783134884.016004:0:3289:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fe9ca88c380 x1869752384376064/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783134900 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783134884.016013:0:3289:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9ca88c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3289:1869752384376064:0@lo:400: 00000100:00080000:3.0:1783134884.016027:0:5766:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1783134884.016035:0:3286:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fe9ca88d880 x1869752384376320/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783134900 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783134884.016052:0:3286:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9ca88d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3286:1869752384376320:0@lo:400: 00010000:00080000:3.0:1783134884.016059:0:3286:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fe9ca88dc00 x1869752384376192/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783134900 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783134884.016064:0:3286:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9ca88dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3286:1869752384376192:0@lo:400: 00000100:00100000:2.0:1783134884.016427:0:7673:0:(client.c:2701:ptlrpc_set_wait()) set ffff9fe9e2f2b3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783134884.016540:0:7673:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9ca88f800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:88a2002e-2ea7-4f07-912a-8d001832cfc0:7673:1869752384375936:0@lo:502: 00000020:01000000:2.0:1783134884.016559:0:7673:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1783134884.016563:0:7673:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783134884.016564:0:7673:0:(obd_config.c:1561:class_process_config()) marker 21 (0x2) lustre sys.timeout 00000040:00080000:2.0:1783134884.016567:0:7673:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000020:01000000:3.0:1783134884.016683:0:5767:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 25-33 (rc=0) 10000000:01000000:3.0:1783134884.016697:0:5767:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.201.141@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1783134884.016704:0:5767:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.141@tcp lock: ffff9fe9d2b75000/0xd6c4b8f05867e52d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xd6c4b8f05867e534 expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134884.016711:0:5767:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.141@tcp lock: ffff9fe9d2b75000/0xd6c4b8f05867e52d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xd6c4b8f05867e534 expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783134884.016731:0:5767:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:3.0:1783134884.016733:0:5767:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-sptlrpc-ffff9fe9d13819c0 from 1 10000000:01000000:3.0:1783134884.016736:0:5767:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1783134884.016758:0:5767:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.141@tcp lock: ffff9fe9d2b74600/0xd6c4b8f05867e557 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134884.016766:0:5767:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.141@tcp lock: ffff9fe9d2b74600/0xd6c4b8f05867e557 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134884.016774:0:5767:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.141@tcp lock: ffff9fe9d2b74600/0xd6c4b8f05867e557 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783134884.016787:0:5767:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9e0474700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88a2002e-2ea7-4f07-912a-8d001832cfc0:5767:1869752384376448:0@lo:101: 00000100:00100000:3.0:1783134884.016815:0:5767:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783134884.016856:0:5767:0:(client.c:2701:ptlrpc_set_wait()) set ffff9fe9e0436000 going to sleep for 11 seconds 00000100:00100000:2.0:1783134884.016878:0:5762:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384376448 00000100:00100000:2.0:1783134884.016881:0:5762:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384376448 00000100:00100000:2.0:1783134884.016920:0:5762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1783134884.016925:0:5762:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9d1650450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88a2002e-2ea7-4f07-912a-8d001832cfc0+18:5767:x1869752384376448:12345-0@lo:101: 00010000:00010000:2.0:1783134884.016932:0:5762:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783134884.016941:0:5762:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fe9c1523a00/0xd6c4b8f05867e55e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xd6c4b8f05867e557 expref: -99 pid: 5762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134884.016955:0:5762:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fe9c1523a00/0xd6c4b8f05867e55e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd6c4b8f05867e557 expref: 19 pid: 5762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134884.016962:0:5762:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fe9c1523a00/0xd6c4b8f05867e55e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd6c4b8f05867e557 expref: 19 pid: 5762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134884.016968:0:5762:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fe9c1523a00, rc 0) 00000100:00100000:2.0:1783134884.016989:0:5762:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9d1650450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88a2002e-2ea7-4f07-912a-8d001832cfc0+19:5767:x1869752384376448:12345-0@lo:101: Request processed in 64us (174us total) trans 0 rc 0/0 00000100:00100000:2.0:1783134884.016993:0:5762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00002000:00100000:0.0:1783134884.017146:0:6577:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00000100:00100000:3.0:1783134884.017150:0:5767:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9e0474700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88a2002e-2ea7-4f07-912a-8d001832cfc0:5767:1869752384376448:0@lo:101: 00010000:00010000:3.0:1783134884.017163:0:5767:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.141@tcp lock: ffff9fe9d2b74600/0xd6c4b8f05867e557 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xd6c4b8f05867e55e expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134884.017173:0:5767:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.141@tcp lock: ffff9fe9d2b74600/0xd6c4b8f05867e557 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xd6c4b8f05867e55e expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783134884.017302:0:5767:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9e0474700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88a2002e-2ea7-4f07-912a-8d001832cfc0:5767:1869752384376576:0@lo:501: 00000100:00100000:3.0:1783134884.017324:0:5767:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783134884.017339:0:5767:0:(client.c:2701:ptlrpc_set_wait()) set ffff9fe9e0436000 going to sleep for 11 seconds 00000100:00100000:3.0:1783134884.017352:0:5763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384376576 00000100:00100000:3.0:1783134884.017354:0:5763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384376576 00000100:00100000:3.0:1783134884.017371:0:5763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1783134884.017381:0:5763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9d1652450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88a2002e-2ea7-4f07-912a-8d001832cfc0+19:5767:x1869752384376576:12345-0@lo:501: 00000100:00100000:3.0:1783134884.017512:0:5763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9d1652450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88a2002e-2ea7-4f07-912a-8d001832cfc0+19:5767:x1869752384376576:12345-0@lo:501: Request processed in 130us (187us total) trans 0 rc -2/-2 00000100:00100000:3.0:1783134884.017517:0:5763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1783134884.017546:0:5767:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9e0474700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88a2002e-2ea7-4f07-912a-8d001832cfc0:5767:1869752384376576:0@lo:501: 10000000:01000000:3.0:1783134884.017561:0:5767:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.201.141@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1783134884.017565:0:5767:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.141@tcp lock: ffff9fe9d2b74600/0xd6c4b8f05867e557 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xd6c4b8f05867e55e expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134884.017570:0:5767:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.141@tcp lock: ffff9fe9d2b74600/0xd6c4b8f05867e557 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xd6c4b8f05867e55e expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:0.0:1783134884.017579:0:6577:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1783134884.017603:0:6577:0:(import.c:65:import_set_state_nolock()) ffff9fea01d7e800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1783134884.017643:0:6577:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9e0474380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3285:x1869752384375808:12345-0@lo:8: Request processed in 2539us (2959us total) trans 0 rc 0/0 00000100:00100000:0.0:1783134884.017651:0:6577:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:3.0:1783134884.017737:0:3285:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fe9ca88f100 x1869752384375808/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1783134894 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783134884.017746:0:3285:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1783134884.017752:0:3285:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000100:00080000:3.0:1783134884.017759:0:3285:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1783134884.017764:0:3285:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:3.0:1783134884.017767:0:3285:0:(import.c:65:import_set_state_nolock()) ffff9fe8c4e44000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1783134884.017816:0:3285:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1783134884.017821:0:3285:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9ca88f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3285:1869752384375808:0@lo:8: 00000004:00080000:3.0:1783134884.017836:0:7674:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1783134884.017901:0:7674:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 166413620523ns, next at 0ns, rc = 0 00000004:00080000:2.0:1783134884.040146:0:5791:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000001:00080000:1.0:1783134884.050016:0:6602:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967298 is committed 00000004:00080000:2.0:1783134884.059115:0:7675:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x100010000:0x1:0x0] 00000100:00100000:2.0:1783134884.059146:0:7675:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9ca88e300 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7675:1869752384376832:0@lo:7: 00000100:00100000:2.0:1783134884.059224:0:7675:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783134884.059298:0:7675:0:(client.c:2701:ptlrpc_set_wait()) set ffff9fe9e9c68c00 going to sleep for 11 seconds 00000100:00100000:2.0:1783134884.059329:0:3288:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9ca88f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1869752384376704:0@lo:13: 00000100:00100000:2.0:1783134884.059355:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783134884.059400:0:6576:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384376832 00000100:00100000:2.0:1783134884.059407:0:6576:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384376832 00000100:00100000:2.0:1783134884.059464:0:6576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1783134884.059469:0:6577:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:2.0:1783134884.059475:0:6576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9ca88ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:7675:x1869752384376832:12345-0@lo:7: 00000100:00100000:0.0:1783134884.059482:0:6577:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:3.0:1783134884.063380:0:6579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384376704 00000100:00100000:3.0:1783134884.063392:0:6579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384376704 00000100:00100000:3.0:1783134884.063439:0:6579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1783134884.063451:0:6579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9ca88f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3288:x1869752384376704:12345-0@lo:13: 00002000:00000024:3.0:1783134884.063491:0:6579:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3860856832 avail 3858759680 00000100:00100000:3.0:1783134884.063574:0:6579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9ca88f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3288:x1869752384376704:12345-0@lo:13: Request processed in 126us (4217us total) trans 0 rc 0/0 00000100:00100000:3.0:1783134884.063582:0:6579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1783134884.063670:0:3288:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fe9ca88f800 x1869752384376704/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783134900 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783134884.063692:0:3288:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9ca88f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1869752384376704:0@lo:13: 00000100:00080000:2.0:1783134884.063719:0:5766:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00080000:2.0:1783134884.065183:0:6576:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x0 00002000:00080000:2.0:1783134884.065189:0:6576:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x100010000:0x0:0x0] 00000100:00100000:2.0:1783134884.065443:0:6576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9ca88ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:7675:x1869752384376832:12345-0@lo:7: Request processed in 5968us (6217us total) trans 0 rc 0/0 00000100:00100000:2.0:1783134884.065452:0:6576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:3.0:1783134884.065513:0:7675:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fe9ca88e300 x1869752384376832/t0(0) o7->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1783134900 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783134884.065527:0:7675:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9ca88e300 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7675:1869752384376832:0@lo:7: 00000004:00080000:3.0:1783134884.065538:0:7675:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0000: Got last_fid [0x100010000:0x0:0x0] 00000100:00100000:3.0:1783134884.065569:0:7675:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9e0474700 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7675:1869752384376960:0@lo:5: 00000100:00100000:3.0:1783134884.065596:0:7675:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783134884.065662:0:7675:0:(client.c:2701:ptlrpc_set_wait()) set ffff9fe9e01b8240 going to sleep for 11 seconds 00000100:00100000:2.0:1783134884.065693:0:6574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384376960 00000100:00100000:2.0:1783134884.065699:0:6574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384376960 00000100:00100000:2.0:1783134884.065732:0:6574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1783134884.065739:0:6574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9e0475c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:7675:x1869752384376960:12345-0@lo:5: 00002000:00080000:2.0:1783134884.065760:0:6574:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:2.0:1783134884.065763:0:6574:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 1 objects in group 0x0 at 1 00000100:00100000:2.0:1783134884.065989:0:6574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9e0475c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:7675:x1869752384376960:12345-0@lo:5: Request processed in 249us (391us total) trans 4294967297 rc 0/0 00000100:00100000:2.0:1783134884.065995:0:6574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:3.0:1783134884.066097:0:7675:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fe9e0474700 x1869752384376960/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1783134900 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783134884.066109:0:7675:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9e0474700 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7675:1869752384376960:0@lo:5: 00000004:00080000:3.0:1783134884.066116:0:7675:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x100010000:0x1:0x0] from OST, last_created [0x100010000:0x1:0x0]last_used is [0x100010000:0x1:0x0] 00000100:00100000:3.0:1783134884.066135:0:7675:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9e0474e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7675:1869752384377088:0@lo:700: 00000100:00100000:3.0:1783134884.066205:0:7675:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783134884.066345:0:7675:0:(client.c:2701:ptlrpc_set_wait()) set ffff9fe9e01b8240 going to sleep for 11 seconds 00000100:00100000:3.0:1783134884.066361:0:6584:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384377088 00000100:00100000:3.0:1783134884.066365:0:6584:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384377088 00000100:00100000:1.0:1783134884.066498:0:6583:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1783134884.066511:0:6583:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9cb338a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:7675:x1869752384377088:12345-0@lo:700: 00000100:00100000:1.0:1783134884.066542:0:6583:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9f6731f80 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6583:1869752384377216:0@lo:700: 00000100:00100000:1.0:1783134884.066573:0:6583:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783134884.066601:0:6583:0:(client.c:2701:ptlrpc_set_wait()) set ffff9fe9f42c3540 going to sleep for 11 seconds 00000100:00100000:3.0:1783134884.066610:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384377216 00000100:00100000:3.0:1783134884.066615:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384377216 00000100:00100000:3.0:1783134884.066647:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1783134884.066654:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9f6731c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0001:lustre-MDT0000-lwp-OST0001_UUID+5:6583:x1869752384377216:12345-0@lo:700: 40000000:02000000:2.0:1783134884.093024:0:5777:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:1:ost 00000100:00100000:2.0:1783134884.098151:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9f6731c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0001:lustre-MDT0000-lwp-OST0001_UUID+5:6583:x1869752384377216:12345-0@lo:700: Request processed in 31489us (31568us total) trans 0 rc 0/0 00000100:00100000:2.0:1783134884.098170:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1783134884.098298:0:6583:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fe9f6731f80 x1869752384377216/t0(0) o700->lustre-MDT0000-lwp-OST0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1783134900 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783134884.098315:0:6583:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9f6731f80 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6583:1869752384377216:0@lo:700: 40000000:02000000:1.0:1783134884.098330:0:6583:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0001-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:1:ost] 00010000:00010000:2.0:1783134884.101272:0:5758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783134884.151693:0:6583:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9cb338a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:7675:x1869752384377088:12345-0@lo:700: Request processed in 85179us (85479us total) trans 0 rc 0/0 00000100:00100000:3.0:1783134884.151712:0:6583:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1783134884.151718:0:7675:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fe9e0474e00 x1869752384377088/t0(0) o700->lustre-OST0001-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1783134900 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783134884.151732:0:7675:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9e0474e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7675:1869752384377088:0@lo:700: 00000001:00100000:2.0:1783134884.152074:0:7470:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:2.0:1783134884.152093:0:7470:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967297 is committed 00000004:02000040:3.0:1783134884.169088:0:7675:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x280000400 00000100:00100000:0.0:1783134884.171814:0:7675:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9f5ca6d80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7675:1869752384377344:0@lo:5: 00000100:00100000:0.0:1783134884.171883:0:7675:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783134884.171921:0:6576:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384377344 00000100:00100000:0.0:1783134884.171925:0:7675:0:(client.c:2701:ptlrpc_set_wait()) set ffff9fe9ca791c00 going to sleep for 11 seconds 00000100:00100000:2.0:1783134884.171930:0:6576:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384377344 00000100:00100000:2.0:1783134884.171983:0:6576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1783134884.171993:0:6576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9f5ca4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:7675:x1869752384377344:12345-0@lo:5: 00002000:00080000:2.0:1783134884.176175:0:6576:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:2.0:1783134884.176194:0:6576:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 2 00000100:00100000:0.0:1783134884.181317:0:6576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9f5ca4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:7675:x1869752384377344:12345-0@lo:5: Request processed in 9318us (9425us total) trans 4294967298 rc 0/0 00000100:00100000:0.0:1783134884.181329:0:6576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:1.0:1783134884.181433:0:7675:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fe9f5ca6d80 x1869752384377344/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1783134900 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783134884.181448:0:7675:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:1.0:1783134884.181462:0:7675:0:(client.c:3155:ptlrpc_free_committed()) @@@ stopping search req@ffff9fe9f5ca6d80 x1869752384377344/t4294967298(4294967298) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1783134900 ref 3 fl Rpc:RQU/204/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783134884.181474:0:7675:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9f5ca6d80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7675:1869752384377344:0@lo:5: 00000004:00080000:1.0:1783134884.181486:0:7675:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x1:0x0]-[0x280000400:0x21:0x0] 00000001:02000400:3.0:1783134885.095849:0:7816:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg141-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1783134885.123716:0:5757:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783134886.148355:0:6591:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783134887.171391:0:5758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1783134888.126186:0:7470:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967298 is committed 00010000:00010000:2.0:1783134888.198295:0:5757:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783134888.333387:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:1.0:1783134888.333551:0:5763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373870720 00000100:00100000:1.0:1783134888.333560:0:5763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373870720 00000100:00100000:1.0:1783134888.333598:0:5763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 107 00000100:00100000:1.0:1783134888.333608:0:5763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9d17a7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0+-99:2366:x1869752373870720:12345-192.168.201.41@tcp:250: 00010000:00080000:1.0:1783134888.333707:0:5763:0:(ldlm_lib.c:1432:target_handle_connect()) MGS: connection from f39b22bc-4faf-4b59-bb00-2a11f91e37c0@192.168.201.41@tcp t0 exp 0000000000000000 cur 170 last 0 00000020:00000080:1.0:1783134888.333734:0:5763:0:(genops.c:1406:class_connect()) connect: client f39b22bc-4faf-4b59-bb00-2a11f91e37c0, cookie 0xd6c4b8f05867e565 00000100:00080000:1.0:1783134888.333868:0:5763:0:(import.c:65:import_set_state_nolock()) ffff9fe8c5ff9000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1783134888.333935:0:5763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9d17a7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f39b22bc-4faf-4b59-bb00-2a11f91e37c0+5:2366:x1869752373870720:12345-192.168.201.41@tcp:250: Request processed in 327us (557us total) trans 0 rc 0/0 00000100:00100000:1.0:1783134888.333942:0:5763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 107 00000100:00100000:1.0:1783134888.336975:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:3.0:1783134888.337064:0:5762:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373870848 00000100:00100000:3.0:1783134888.337073:0:5762:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373870848 00000100:00100000:3.0:1783134888.337125:0:5762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 108 00000100:00100000:3.0:1783134888.337135:0:5762:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9d17a7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f39b22bc-4faf-4b59-bb00-2a11f91e37c0+5:5561:x1869752373870848:12345-192.168.201.41@tcp:101: 00010000:00010000:3.0:1783134888.337161:0:5762:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783134888.337178:0:5762:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fe9d2b75800/0xd6c4b8f05867e56c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x4428da03f5eb7066 expref: -99 pid: 5762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134888.337206:0:5762:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fe9d2b75800/0xd6c4b8f05867e56c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb7066 expref: 6 pid: 5762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134888.337218:0:5762:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fe9d2b75800/0xd6c4b8f05867e56c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb7066 expref: 6 pid: 5762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134888.337228:0:5762:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fe9d2b75800, rc 0) 00000100:00100000:3.0:1783134888.337303:0:5762:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9d17a7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f39b22bc-4faf-4b59-bb00-2a11f91e37c0+6:5561:x1869752373870848:12345-192.168.201.41@tcp:101: Request processed in 144us (310us total) trans 0 rc 0/0 00000100:00100000:3.0:1783134888.337311:0:5762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 108 00000100:00100000:3.0:1783134888.339887:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:1.0:1783134888.341073:0:5763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373870976 00000100:00100000:1.0:1783134888.341084:0:5763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373870976 00000100:00100000:1.0:1783134888.341324:0:5763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 109 00000100:00100000:1.0:1783134888.341336:0:5763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9d17a5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f39b22bc-4faf-4b59-bb00-2a11f91e37c0+6:5561:x1869752373870976:12345-192.168.201.41@tcp:501: 00000100:00100000:1.0:1783134888.341901:0:5763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9d17a5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f39b22bc-4faf-4b59-bb00-2a11f91e37c0+6:5561:x1869752373870976:12345-192.168.201.41@tcp:501: Request processed in 566us (2019us total) trans 0 rc -2/-2 00000100:00100000:1.0:1783134888.341910:0:5763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 109 00000100:00100000:3.0:1783134888.343790:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:3.0:1783134888.343910:0:5762:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373871104 00000100:00100000:3.0:1783134888.343919:0:5762:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373871104 00000100:00100000:3.0:1783134888.343964:0:5762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 110 00000100:00100000:3.0:1783134888.344081:0:5762:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9d17a6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f39b22bc-4faf-4b59-bb00-2a11f91e37c0+6:5561:x1869752373871104:12345-192.168.201.41@tcp:101: 00010000:00010000:3.0:1783134888.344099:0:5762:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783134888.344114:0:5762:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fe9d2b75a00/0xd6c4b8f05867e573 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x4428da03f5eb706d expref: -99 pid: 5762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134888.344169:0:5762:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fe9d2b75a00/0xd6c4b8f05867e573 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb706d expref: 7 pid: 5762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134888.344182:0:5762:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fe9d2b75a00/0xd6c4b8f05867e573 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb706d expref: 7 pid: 5762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134888.344190:0:5762:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fe9d2b75a00, rc 0) 00000100:00100000:3.0:1783134888.344388:0:5762:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9d17a6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f39b22bc-4faf-4b59-bb00-2a11f91e37c0+7:5561:x1869752373871104:12345-192.168.201.41@tcp:101: Request processed in 397us (604us total) trans 0 rc 0/0 00000100:00100000:3.0:1783134888.344395:0:5762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 110 00000100:00100000:2.0:1783134888.346403:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:1.0:1783134888.346485:0:5763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373871232 00000100:00100000:1.0:1783134888.346495:0:5763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373871232 00000100:00100000:1.0:1783134888.346544:0:5763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 111 00000100:00100000:1.0:1783134888.346556:0:5763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9d17a7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f39b22bc-4faf-4b59-bb00-2a11f91e37c0+7:5561:x1869752373871232:12345-192.168.201.41@tcp:501: 00000100:00100000:1.0:1783134888.347092:0:5763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9d17a7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f39b22bc-4faf-4b59-bb00-2a11f91e37c0+8:5561:x1869752373871232:12345-192.168.201.41@tcp:501: Request processed in 537us (691us total) trans 0 rc 0/0 00000100:00100000:1.0:1783134888.347099:0:5763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 111 00000100:00100000:3.0:1783134888.348823:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:1.0:1783134888.348900:0:5762:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373871360 00000100:00100000:1.0:1783134888.348907:0:5762:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373871360 00000100:00100000:1.0:1783134888.348939:0:5762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 112 00000100:00100000:1.0:1783134888.348945:0:5762:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9d17a4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f39b22bc-4faf-4b59-bb00-2a11f91e37c0+8:5561:x1869752373871360:12345-192.168.201.41@tcp:503: 00000100:00100000:1.0:1783134888.349320:0:5762:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9d17a4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f39b22bc-4faf-4b59-bb00-2a11f91e37c0+8:5561:x1869752373871360:12345-192.168.201.41@tcp:503: Request processed in 373us (501us total) trans 0 rc 0/0 00000100:00100000:1.0:1783134888.349329:0:5762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 112 00000100:00100000:0.0:1783134888.351612:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:1.0:1783134888.352234:0:5763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373871488 00000100:00100000:1.0:1783134888.352244:0:5763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373871488 00000100:00100000:1.0:1783134888.352313:0:5763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 113 00000100:00100000:1.0:1783134888.352324:0:5763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9d17a5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f39b22bc-4faf-4b59-bb00-2a11f91e37c0+8:5579:x1869752373871488:12345-192.168.201.41@tcp:502: 00000100:00100000:1.0:1783134888.352644:0:5763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9d17a5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f39b22bc-4faf-4b59-bb00-2a11f91e37c0+8:5579:x1869752373871488:12345-192.168.201.41@tcp:502: Request processed in 321us (1035us total) trans 0 rc 0/0 00000100:00100000:1.0:1783134888.352652:0:5763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 113 00000100:00100000:3.0:1783134888.377576:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:1.0:1783134888.377622:0:5762:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373871616 00000100:00100000:1.0:1783134888.377630:0:5762:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373871616 00000100:00100000:1.0:1783134888.377684:0:5762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 114 00000100:00100000:1.0:1783134888.377694:0:5762:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9d17a7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f39b22bc-4faf-4b59-bb00-2a11f91e37c0+8:5579:x1869752373871616:12345-192.168.201.41@tcp:502: 00000100:00100000:1.0:1783134888.377997:0:5762:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9d17a7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f39b22bc-4faf-4b59-bb00-2a11f91e37c0+8:5579:x1869752373871616:12345-192.168.201.41@tcp:502: Request processed in 305us (430us total) trans 0 rc 0/0 00000100:00100000:1.0:1783134888.378004:0:5762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 114 00000100:00100000:0.0:1783134888.380792:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:1.0:1783134888.380876:0:5763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373871744 00000100:00100000:1.0:1783134888.380884:0:5763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373871744 00000100:00100000:1.0:1783134888.380927:0:5763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 115 00000100:00100000:1.0:1783134888.380937:0:5763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9d17a5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f39b22bc-4faf-4b59-bb00-2a11f91e37c0+8:5561:x1869752373871744:12345-192.168.201.41@tcp:101: 00010000:00010000:1.0:1783134888.380950:0:5763:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783134888.380965:0:5763:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fea02167400/0xd6c4b8f05867e57a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x4428da03f5eb7097 expref: -99 pid: 5763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134888.380990:0:5763:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fea02167400/0xd6c4b8f05867e57a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb7097 expref: 9 pid: 5763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134888.381012:0:5763:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fea02167400/0xd6c4b8f05867e57a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb7097 expref: 9 pid: 5763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134888.381021:0:5763:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fea02167400, rc 0) 00000100:00100000:1.0:1783134888.381067:0:5763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9d17a5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f39b22bc-4faf-4b59-bb00-2a11f91e37c0+9:5561:x1869752373871744:12345-192.168.201.41@tcp:101: Request processed in 132us (278us total) trans 0 rc 0/0 00000100:00100000:1.0:1783134888.381073:0:5763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 115 00000100:00100000:0.0:1783134888.382700:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:1.0:1783134888.382745:0:5762:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373871872 00000100:00100000:1.0:1783134888.382753:0:5762:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373871872 00000100:00100000:1.0:1783134888.382799:0:5762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 116 00000100:00100000:1.0:1783134888.382810:0:5762:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9d17a6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f39b22bc-4faf-4b59-bb00-2a11f91e37c0+9:5561:x1869752373871872:12345-192.168.201.41@tcp:256: 20000000:01000000:1.0:1783134888.382828:0:5762:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:1.0:1783134888.382842:0:5762:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1783134888.382846:0:5762:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:1.0:1783134888.382849:0:5762:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:1.0:1783134888.382852:0:5762:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:1.0:1783134888.384390:0:5762:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9d17a6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f39b22bc-4faf-4b59-bb00-2a11f91e37c0+9:5561:x1869752373871872:12345-192.168.201.41@tcp:256: Request processed in 1579us (1688us total) trans 0 rc 0/0 00000100:00100000:1.0:1783134888.384398:0:5762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 116 00000100:00100000:3.0:1783134888.386682:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:1.0:1783134888.386738:0:5763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373872000 00000100:00100000:1.0:1783134888.386746:0:5763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373872000 00000100:00100000:1.0:1783134888.386790:0:5763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 117 00000100:00100000:1.0:1783134888.386799:0:5763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9d17a6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f39b22bc-4faf-4b59-bb00-2a11f91e37c0+9:5561:x1869752373872000:12345-192.168.201.41@tcp:101: 00010000:00010000:1.0:1783134888.386810:0:5763:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783134888.386824:0:5763:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fea02167c00/0xd6c4b8f05867e581 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x4428da03f5eb709e expref: -99 pid: 5763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134888.386862:0:5763:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fea02167c00/0xd6c4b8f05867e581 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb709e expref: 10 pid: 5763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134888.386874:0:5763:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fea02167c00/0xd6c4b8f05867e581 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb709e expref: 10 pid: 5763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134888.386882:0:5763:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fea02167c00, rc 0) 00000100:00100000:1.0:1783134888.386918:0:5763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9d17a6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f39b22bc-4faf-4b59-bb00-2a11f91e37c0+10:5561:x1869752373872000:12345-192.168.201.41@tcp:101: Request processed in 122us (241us total) trans 0 rc 0/0 00000100:00100000:1.0:1783134888.386924:0:5763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 117 00000100:00100000:2.0:1783134888.388648:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:3.0:1783134888.388710:0:5762:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373872128 00000100:00100000:3.0:1783134888.388716:0:5762:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373872128 00000100:00100000:3.0:1783134888.388760:0:5762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 118 00000100:00100000:3.0:1783134888.388772:0:5762:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9d17a4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f39b22bc-4faf-4b59-bb00-2a11f91e37c0+10:5561:x1869752373872128:12345-192.168.201.41@tcp:501: 00000100:00100000:3.0:1783134888.389181:0:5762:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9d17a4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f39b22bc-4faf-4b59-bb00-2a11f91e37c0+10:5561:x1869752373872128:12345-192.168.201.41@tcp:501: Request processed in 412us (537us total) trans 0 rc 0/0 00000100:00100000:3.0:1783134888.389197:0:5762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 118 00000100:00100000:2.0:1783134888.390126:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:1.0:1783134888.390229:0:5763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373872256 00000100:00100000:1.0:1783134888.390235:0:5763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373872256 00000100:00100000:1.0:1783134888.390275:0:5763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 119 00000100:00100000:1.0:1783134888.390312:0:5763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9d17a6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f39b22bc-4faf-4b59-bb00-2a11f91e37c0+10:5561:x1869752373872256:12345-192.168.201.41@tcp:503: 00000100:00100000:1.0:1783134888.390602:0:5763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9d17a6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f39b22bc-4faf-4b59-bb00-2a11f91e37c0+10:5561:x1869752373872256:12345-192.168.201.41@tcp:503: Request processed in 298us (476us total) trans 0 rc 0/0 00000100:00100000:1.0:1783134888.390610:0:5763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 119 00000100:00100000:0.0:1783134888.399676:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:3.0:1783134888.399828:0:5762:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373872384 00000100:00100000:3.0:1783134888.399838:0:5762:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373872384 00000100:00100000:3.0:1783134888.399894:0:5762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 120 00000100:00100000:3.0:1783134888.399906:0:5762:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9d17a5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f39b22bc-4faf-4b59-bb00-2a11f91e37c0+10:5585:x1869752373872384:12345-192.168.201.41@tcp:502: 00000100:00100000:3.0:1783134888.400276:0:5762:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9d17a5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f39b22bc-4faf-4b59-bb00-2a11f91e37c0+10:5585:x1869752373872384:12345-192.168.201.41@tcp:502: Request processed in 370us (607us total) trans 0 rc 0/0 00000100:00100000:3.0:1783134888.400313:0:5762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 120 00000100:00100000:2.0:1783134888.402629:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:2.0:1783134888.402668:0:5763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373872512 00000100:00100000:2.0:1783134888.402676:0:5763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373872512 00000100:00100000:2.0:1783134888.402731:0:5763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 121 00000100:00100000:2.0:1783134888.402741:0:5763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9d17a4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f39b22bc-4faf-4b59-bb00-2a11f91e37c0+10:5585:x1869752373872512:12345-192.168.201.41@tcp:502: 00000100:00100000:2.0:1783134888.402951:0:5763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9d17a4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f39b22bc-4faf-4b59-bb00-2a11f91e37c0+10:5585:x1869752373872512:12345-192.168.201.41@tcp:502: Request processed in 210us (328us total) trans 0 rc 0/0 00000100:00100000:2.0:1783134888.402960:0:5763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 121 00000100:00100000:2.0:1783134888.406215:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:3.0:1783134888.406309:0:5769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373872640 00000100:00100000:3.0:1783134888.406319:0:5769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373872640 00000100:00100000:3.0:1783134888.406365:0:5769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 4 00000100:00100000:3.0:1783134888.406375:0:5769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9ca88f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2366:x1869752373872640:12345-192.168.201.41@tcp:38: 00010000:00080000:3.0:1783134888.406402:0:5769:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from 28f4ba61-cfae-499e-ab3d-81cb8215f7bb@192.168.201.41@tcp t0 exp 0000000000000000 cur 170 last 0 00000020:00000080:3.0:1783134888.406455:0:5769:0:(genops.c:1406:class_connect()) connect: client 28f4ba61-cfae-499e-ab3d-81cb8215f7bb, cookie 0xd6c4b8f05867e588 00000004:00100000:3.0:1783134888.406498:0:5769:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000001:00000004:3.0:1783134888.406505:0:5769:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000100:00080000:3.0:1783134888.421347:0:5769:0:(import.c:65:import_set_state_nolock()) ffff9fe9fe80d000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1783134888.421466:0:5769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9ca88f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+6:2366:x1869752373872640:12345-192.168.201.41@tcp:38: Request processed in 15089us (15256us total) trans 0 rc 0/0 00000100:00100000:3.0:1783134888.421478:0:5769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 4 00000100:00100000:3.0:1783134889.091473:0:3289:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9cb338000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1869752384377472:0@lo:13: 00000100:00100000:0.0:1783134889.091494:0:3287:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9f5ca6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3287:1869752384377728:0@lo:400: 00000100:00100000:3.0:1783134889.091555:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783134889.091555:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783134889.091615:0:3287:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9f5ca7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1869752384378240:0@lo:400: 00000100:00100000:3.0:1783134889.091627:0:3289:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9f5ca7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1869752384377984:0@lo:400: 00000100:00100000:2.0:1783134889.091660:0:3288:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9f5ca4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3288:1869752384377856:0@lo:400: 00000100:00100000:0.0:1783134889.091674:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783134889.091676:0:3286:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9f5ca4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:88a2002e-2ea7-4f07-912a-8d001832cfc0:3286:1869752384377600:0@lo:400: 00000100:00100000:2.0:1783134889.091690:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783134889.091715:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783134889.091718:0:3288:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9f6731f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1869752384378368:0@lo:13: 00000100:00100000:2.0:1783134889.091738:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783134889.091740:0:3286:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9f5ca4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3286:1869752384378112:0@lo:400: 00000100:00100000:0.0:1783134889.091756:0:5762:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384377600 00000100:00100000:3.0:1783134889.091762:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783134889.091771:0:6574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384378240 00000100:00100000:0.0:1783134889.091774:0:5762:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384377600 00000100:00100000:2.0:1783134889.091775:0:6574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384378240 00000100:00100000:3.0:1783134889.091787:0:5769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384377728 00000100:00100000:3.0:1783134889.091790:0:5769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384377728 00000100:00100000:3.0:1783134889.091815:0:5769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384377856 00000100:00100000:3.0:1783134889.091823:0:5769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384377856 00000100:00100000:0.0:1783134889.091827:0:5762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:2.0:1783134889.091837:0:6574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1783134889.091842:0:5769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384378112 00000100:00100000:0.0:1783134889.091842:0:5762:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9d17a4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88a2002e-2ea7-4f07-912a-8d001832cfc0+19:3286:x1869752384377600:12345-0@lo:400: 00000100:00100000:2.0:1783134889.091849:0:6574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9f5ca7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3287:x1869752384378240:12345-0@lo:400: 00000100:00100000:3.0:1783134889.091857:0:5769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384378112 00000100:00100000:3.0:1783134889.091872:0:5769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1783134889.091878:0:5769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9f5ca5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3287:x1869752384377728:12345-0@lo:400: 00000100:00100000:2.0:1783134889.091911:0:6574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9f5ca7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3287:x1869752384378240:12345-0@lo:400: Request processed in 66us (237us total) trans 0 rc 0/0 00000100:00100000:3.0:1783134889.091914:0:5769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9f5ca5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3287:x1869752384377728:12345-0@lo:400: Request processed in 36us (364us total) trans 0 rc 0/0 00000100:00100000:2.0:1783134889.091918:0:6574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1783134889.091920:0:5769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1783134889.091926:0:5762:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9d17a4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88a2002e-2ea7-4f07-912a-8d001832cfc0+19:3286:x1869752384377600:12345-0@lo:400: Request processed in 86us (208us total) trans 0 rc 0/0 00000100:00100000:0.0:1783134889.091935:0:5762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:3.0:1783134889.091939:0:5769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1783134889.091944:0:5771:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:3.0:1783134889.091946:0:5769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9ca88dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3288:x1869752384377856:12345-0@lo:400: 00000100:00100000:2.0:1783134889.091961:0:5771:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:0.0:1783134889.091980:0:6579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384377472 00000100:00100000:2.0:1783134889.091984:0:6578:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384378368 00000100:00100000:3.0:1783134889.091985:0:5769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9ca88dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3288:x1869752384377856:12345-0@lo:400: Request processed in 37us (292us total) trans 0 rc 0/0 00000100:00100000:0.0:1783134889.091986:0:6579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384377472 00000100:00100000:2.0:1783134889.091988:0:6578:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384378368 00000100:00100000:3.0:1783134889.091993:0:5769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1783134889.092006:0:5769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1783134889.092009:0:6578:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1783134889.092013:0:5769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9cb338700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3286:x1869752384378112:12345-0@lo:400: 00000100:00100000:2.0:1783134889.092015:0:6578:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9ca88d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3288:x1869752384378368:12345-0@lo:13: 00002000:00000024:2.0:1783134889.092036:0:6578:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1783134889.092039:0:5769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9cb338700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3286:x1869752384378112:12345-0@lo:400: Request processed in 27us (277us total) trans 0 rc 0/0 00000100:00100000:3.0:1783134889.092044:0:5769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1783134889.092079:0:3286:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9f5ca4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:88a2002e-2ea7-4f07-912a-8d001832cfc0:3286:1869752384377600:0@lo:400: 00000100:00100000:2.0:1783134889.092079:0:6578:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9ca88d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3288:x1869752384378368:12345-0@lo:13: Request processed in 64us (339us total) trans 0 rc 0/0 00000100:00100000:2.0:1783134889.092085:0:6578:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1783134889.092092:0:3286:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fe9f5ca4e00 x1869752384378112/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783134905 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783134889.092097:0:6578:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1783134889.092103:0:3286:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9f5ca4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3286:1869752384378112:0@lo:400: 00000100:00100000:2.0:1783134889.092103:0:6578:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9cb33a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3289:x1869752384377472:12345-0@lo:13: 00002000:00000024:2.0:1783134889.092121:0:6578:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1783134889.092139:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1783134889.092141:0:5766:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1783134889.092147:0:5766:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1783134889.092151:0:5766:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1783134889.092161:0:6578:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9cb33a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3289:x1869752384377472:12345-0@lo:13: Request processed in 58us (610us total) trans 0 rc 0/0 00010000:00080000:3.0:1783134889.092166:0:3289:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fe9cb338000 x1869752384377472/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783134905 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783134889.092169:0:6578:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1783134889.092174:0:3289:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967298 gen 2 00010000:00080000:0.0:1783134889.092181:0:3287:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fe9f5ca6680 x1869752384377728/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783134905 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783134889.092196:0:3289:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9cb338000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1869752384377472:0@lo:13: 00000100:00100000:0.0:1783134889.092197:0:3287:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9f5ca6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3287:1869752384377728:0@lo:400: 00010000:00080000:2.0:1783134889.092213:0:3288:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fe9f5ca4700 x1869752384377856/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783134905 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00010000:00080000:0.0:1783134889.092222:0:3287:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fe9f5ca7480 x1869752384378240/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783134905 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783134889.092223:0:6577:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384377984 00000100:00100000:2.0:1783134889.092224:0:3288:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9f5ca4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3288:1869752384377856:0@lo:400: 00000100:00100000:3.0:1783134889.092227:0:6577:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384377984 00000100:00100000:0.0:1783134889.092237:0:3287:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967298 gen 2 00010000:00080000:2.0:1783134889.092244:0:3288:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fe9f6731f80 x1869752384378368/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783134905 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783134889.092253:0:3287:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9f5ca7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1869752384378240:0@lo:400: 00000100:00100000:3.0:1783134889.092257:0:6577:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1783134889.092259:0:3288:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9f6731f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1869752384378368:0@lo:13: 00000100:00100000:3.0:1783134889.092268:0:6577:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9cb33bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3289:x1869752384377984:12345-0@lo:400: 00000100:00100000:3.0:1783134889.092326:0:6577:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9cb33bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3289:x1869752384377984:12345-0@lo:400: Request processed in 60us (187us total) trans 0 rc 0/0 00000100:00100000:3.0:1783134889.092333:0:6577:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1783134889.092358:0:3289:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fe9f5ca7800 x1869752384377984/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783134905 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783134889.092366:0:3289:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9f5ca7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1869752384377984:0@lo:400: 00010000:00010000:2.0:1783134889.219438:0:6591:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783134889.425022:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:0.0:1783134889.425083:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:3.0:1783134889.425168:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373872768 00000100:00100000:1.0:1783134889.425169:0:5769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373872896 00000100:00100000:3.0:1783134889.425178:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373872768 00000100:00100000:1.0:1783134889.425178:0:5769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373872896 00000100:00080000:0.0:1783134889.425232:0:5766:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1783134889.425242:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 5 00000100:00100000:1.0:1783134889.425252:0:5769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 6 00000100:00100000:3.0:1783134889.425258:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9f5ca7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+7:0:x1869752373872768:12345-192.168.201.41@tcp:41: 00000100:00100000:1.0:1783134889.425269:0:5769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9f5ca6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+7:5561:x1869752373872896:12345-192.168.201.41@tcp:41: 00000004:00000024:3.0:1783134889.425332:0:5770:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000004:00000024:1.0:1783134889.425332:0:5769:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:3.0:1783134889.425407:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9f5ca7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+7:0:x1869752373872768:12345-192.168.201.41@tcp:41: Request processed in 154us (394us total) trans 0 rc 0/0 00000100:00100000:1.0:1783134889.425411:0:5769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9f5ca6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+7:5561:x1869752373872896:12345-192.168.201.41@tcp:41: Request processed in 145us (324us total) trans 0 rc 0/0 00000100:00100000:1.0:1783134889.425422:0:5769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 6 00000100:00100000:3.0:1783134889.425438:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 5 00000100:00100000:2.0:1783134889.427000:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:0.0:1783134889.427056:0:8031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373873024 00000100:00100000:0.0:1783134889.427064:0:8031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373873024 00000100:00100000:0.0:1783134889.427103:0:8031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 7 00000100:00100000:0.0:1783134889.427112:0:8031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9ca88c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+6:5561:x1869752373873024:12345-192.168.201.41@tcp:40: 00000100:00100000:0.0:1783134889.427196:0:8031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9ca88c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+6:5561:x1869752373873024:12345-192.168.201.41@tcp:40: Request processed in 86us (202us total) trans 0 rc 0/0 00000100:00100000:0.0:1783134889.427201:0:8031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 7 00000100:00100000:2.0:1783134889.432202:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:2.0:1783134889.432252:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:0.0:1783134889.432275:0:6574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373873152 00000100:00100000:0.0:1783134889.432314:0:6574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373873152 00000100:00100000:1.0:1783134889.432320:0:5763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373873408 00000100:00100000:1.0:1783134889.432327:0:5763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373873408 00000100:00100000:0.0:1783134889.432361:0:6574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 8 00000100:00100000:0.0:1783134889.432371:0:6574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9ca88ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2366:x1869752373873152:12345-192.168.201.41@tcp:8: 00000100:00100000:1.0:1783134889.432375:0:5763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 123 00000100:00100000:1.0:1783134889.432388:0:5763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9d286b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f39b22bc-4faf-4b59-bb00-2a11f91e37c0+10:2368:x1869752373873408:12345-192.168.201.41@tcp:400: 00010000:00080000:0.0:1783134889.432406:0:6574:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0000: connection from 28f4ba61-cfae-499e-ab3d-81cb8215f7bb@192.168.201.41@tcp t0 exp 0000000000000000 cur 171 last 0 00000020:00000080:0.0:1783134889.432445:0:6574:0:(genops.c:1406:class_connect()) connect: client 28f4ba61-cfae-499e-ab3d-81cb8215f7bb, cookie 0xd6c4b8f05867e58f 00000100:00100000:1.0:1783134889.432455:0:5763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9d286b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f39b22bc-4faf-4b59-bb00-2a11f91e37c0+10:2368:x1869752373873408:12345-192.168.201.41@tcp:400: Request processed in 68us (201us total) trans 0 rc 0/0 00002000:00100000:0.0:1783134889.432457:0:6574:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 28f4ba61-cfae-499e-ab3d-81cb8215f7bb/ffff9fea01d7c000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113653 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00000100:00100000:1.0:1783134889.432467:0:5763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 123 00002000:00100000:0.0:1783134889.432472:0:6574:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00000100:00100000:3.0:1783134889.432527:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:1.0:1783134889.432574:0:6577:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373873280 00000100:00100000:1.0:1783134889.432579:0:6577:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373873280 00000100:00100000:1.0:1783134889.432609:0:6577:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 9 00000100:00100000:1.0:1783134889.432620:0:6577:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9cb338000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2366:x1869752373873280:12345-192.168.201.41@tcp:8: 00010000:00080000:1.0:1783134889.432653:0:6577:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0001: connection from 28f4ba61-cfae-499e-ab3d-81cb8215f7bb@192.168.201.41@tcp t0 exp 0000000000000000 cur 171 last 0 00000020:00000080:1.0:1783134889.432672:0:6577:0:(genops.c:1406:class_connect()) connect: client 28f4ba61-cfae-499e-ab3d-81cb8215f7bb, cookie 0xd6c4b8f05867e596 00002000:00100000:1.0:1783134889.432679:0:6577:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 28f4ba61-cfae-499e-ab3d-81cb8215f7bb/ffff9fe8c5ffe000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113653 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1783134889.432686:0:6577:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1783134889.433007:0:6574:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1783134889.433040:0:6574:0:(import.c:65:import_set_state_nolock()) ffff9fea01d7c800 : changing import state from RECOVER to FULL 00002000:00080000:1.0:1783134889.433088:0:6577:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1783134889.433105:0:6577:0:(import.c:65:import_set_state_nolock()) ffff9fe8c5ffa000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1783134889.433486:0:6574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9ca88ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+6:2366:x1869752373873152:12345-192.168.201.41@tcp:8: Request processed in 1113us (1293us total) trans 0 rc 0/0 00000100:00100000:0.0:1783134889.433496:0:6574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 8 00000100:00100000:2.0:1783134889.433515:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:0.0:1783134889.433553:0:5772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373873536 00000100:00100000:0.0:1783134889.433558:0:5772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373873536 00000100:00100000:0.0:1783134889.433592:0:5772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 0 00000100:00100000:1.0:1783134889.433601:0:6577:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9cb338000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+6:2366:x1869752373873280:12345-192.168.201.41@tcp:8: Request processed in 977us (1072us total) trans 0 rc 0/0 00000100:00100000:0.0:1783134889.433603:0:5772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9ca88f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+6:5561:x1869752373873536:12345-192.168.201.41@tcp:33: 00000100:00100000:1.0:1783134889.433616:0:6577:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 9 00000004:00080000:1.0:1783134889.445835:0:5772:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 12109us 00000004:00200000:2.0:1783134889.457856:0:5772:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000100:00100000:2.0:1783134889.458047:0:5772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9ca88f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+6:5561:x1869752373873536:12345-192.168.201.41@tcp:33: Request processed in 24442us (24529us total) trans 0 rc 0/0 00000100:00100000:2.0:1783134889.458062:0:5772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 0 00000100:00100000:2.0:1783134889.652380:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:1.0:1783134889.653174:0:5769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373873664 00000100:00100000:1.0:1783134889.653183:0:5769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373873664 00000100:00100000:1.0:1783134889.653246:0:5769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 8 00000100:00100000:1.0:1783134889.653258:0:5769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9ca88ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+6:5603:x1869752373873664:12345-192.168.201.41@tcp:101: 00010000:00010000:1.0:1783134889.653321:0:5769:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783134889.653378:0:5769:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fea02167a00/0xd6c4b8f05867e59d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4428da03f5eb70c8 expref: -99 pid: 5769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134889.653435:0:5769:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fea02166600/0xd6c4b8f05867e5a4 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134889.653447:0:5769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fea02166600/0xd6c4b8f05867e5a4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134889.653460:0:5769:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fea02166600/0xd6c4b8f05867e5a4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783134889.653642:0:5769:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000004:00200000:1.0:1783134889.653646:0:5769:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:1.0:1783134889.653701:0:5769:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fea02166600/0xd6c4b8f05867e5a4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134889.653722:0:5769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fea02167a00/0xd6c4b8f05867e59d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb70c8 expref: 8 pid: 5769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134889.653734:0:5769:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fea02166600/0xd6c4b8f05867e5a4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb70c8 expref: 7 pid: 5769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134889.653741:0:5769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fe9e1c2b400) 00010000:00010000:1.0:1783134889.653743:0:5769:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1783134889.653745:0:5769:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fea02166600, rc 0) 00000100:00100000:1.0:1783134889.653793:0:5769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9ca88ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+7:5603:x1869752373873664:12345-192.168.201.41@tcp:101: Request processed in 538us (1423us total) trans 0 rc 0/0 00000100:00100000:1.0:1783134889.653800:0:5769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 8 00010000:00010000:2.0:1783134890.243481:0:5758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783134891.268456:0:5757:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783134891.326512:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:2.0:1783134891.326731:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373873792 00000100:00100000:2.0:1783134891.326750:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373873792 00000100:00100000:2.0:1783134891.326832:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 9 00000100:00100000:2.0:1783134891.326843:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9cb339180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+7:5655:x1869752373873792:12345-192.168.201.41@tcp:41: 00000004:00000024:2.0:1783134891.326889:0:5771:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:2.0:1783134891.326954:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9cb339180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+7:5655:x1869752373873792:12345-192.168.201.41@tcp:41: Request processed in 113us (450us total) trans 0 rc 0/0 00000100:00100000:2.0:1783134891.326962:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 9 00000100:00080000:0.0:1783134891.327223:0:5766:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1783134891.332454:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:0.0:1783134891.332553:0:6579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373873920 00000100:00100000:0.0:1783134891.332562:0:6579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373873920 00000100:00080000:2.0:1783134891.332674:0:5766:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1783134891.332712:0:6579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 5 00000100:00100000:0.0:1783134891.332722:0:6579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9ca88e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+6:5655:x1869752373873920:12345-192.168.201.41@tcp:13: 00002000:00000024:0.0:1783134891.332773:0:6579:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1783134891.332846:0:6579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9ca88e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+6:5655:x1869752373873920:12345-192.168.201.41@tcp:13: Request processed in 125us (400us total) trans 0 rc 0/0 00000100:00100000:0.0:1783134891.332854:0:6579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 5 00000100:00100000:3.0:1783134891.335355:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:2.0:1783134891.335431:0:6578:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373874048 00000100:00100000:2.0:1783134891.335439:0:6578:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373874048 00000100:00100000:2.0:1783134891.335495:0:6578:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 6 00000100:00100000:2.0:1783134891.335504:0:6578:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9cb33aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+6:5655:x1869752373874048:12345-192.168.201.41@tcp:13: 00002000:00000024:2.0:1783134891.335532:0:6578:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1783134891.335582:0:6578:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9cb33aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+6:5655:x1869752373874048:12345-192.168.201.41@tcp:13: Request processed in 79us (230us total) trans 0 rc 0/0 00000100:00100000:2.0:1783134891.335590:0:6578:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 6 00000100:00080000:0.0:1783134891.335917:0:5766:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1783134892.291423:0:6591:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1783134892.816252:0:8119:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:0.0:1783134893.315580:0:5758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1783134893.737465:0:5791:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 28f4ba61-cfae-499e-ab3d-81cb8215f7bb 00000001:00100000:1.0:1783134893.753428:0:7470:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 28f4ba61-cfae-499e-ab3d-81cb8215f7bb 00000100:00100000:2.0:1783134894.211431:0:3289:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9f6f73800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1869752384378496:0@lo:13: 00000100:00100000:2.0:1783134894.211521:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783134894.211611:0:6578:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384378496 00000100:00100000:2.0:1783134894.211619:0:6578:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384378496 00000100:00100000:2.0:1783134894.211691:0:6578:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1783134894.211699:0:6578:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9f6f70380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3289:x1869752384378496:12345-0@lo:13: 00002000:00000024:2.0:1783134894.211741:0:6578:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1783134894.211793:0:6578:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9f6f70380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3289:x1869752384378496:12345-0@lo:13: Request processed in 94us (273us total) trans 0 rc 0/0 00000100:00100000:2.0:1783134894.211802:0:6578:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:1.0:1783134894.211843:0:3289:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fe9f6f73800 x1869752384378496/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783134910 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783134894.211866:0:3289:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9f6f73800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1869752384378496:0@lo:13: 00000100:00100000:2.0:1783134894.212343:0:3286:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9f6f72d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1869752384378624:0@lo:13: 00000100:00100000:2.0:1783134894.212374:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783134894.212413:0:6579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384378624 00000100:00100000:2.0:1783134894.212417:0:6579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384378624 00000100:00100000:2.0:1783134894.212443:0:6579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1783134894.212459:0:6579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9f6f70a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1869752384378624:12345-0@lo:13: 00002000:00000024:2.0:1783134894.212483:0:6579:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1783134894.212516:0:6579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9f6f70a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1869752384378624:12345-0@lo:13: Request processed in 59us (142us total) trans 0 rc 0/0 00000100:00100000:2.0:1783134894.212522:0:6579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:2.0:1783134894.212546:0:3286:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fe9f6f72d80 x1869752384378624/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783134910 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783134894.212560:0:3286:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9f6f72d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1869752384378624:0@lo:13: 00000100:00080000:0.0:1783134894.212713:0:5766:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1783134894.212720:0:5766:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1783134894.212994:0:3287:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9cb339500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:88a2002e-2ea7-4f07-912a-8d001832cfc0:3287:1869752384378752:0@lo:400: 00000100:00100000:3.0:1783134894.213052:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783134894.213096:0:3287:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1783134894.213102:0:3287:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9cb33a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3287:1869752384379136:0@lo:400: 00000100:00100000:3.0:1783134894.213140:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783134894.213180:0:5765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384378752 00000100:00100000:3.0:1783134894.213184:0:5765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384378752 00000100:00100000:3.0:1783134894.213220:0:5765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:3.0:1783134894.213228:0:5765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9d2869850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88a2002e-2ea7-4f07-912a-8d001832cfc0+19:3287:x1869752384378752:12345-0@lo:400: 00000100:00100000:3.0:1783134894.213308:0:5765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9d2869850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88a2002e-2ea7-4f07-912a-8d001832cfc0+19:3287:x1869752384378752:12345-0@lo:400: Request processed in 80us (254us total) trans 0 rc 0/0 00000100:00100000:3.0:1783134894.213316:0:5765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:3.0:1783134894.213365:0:3287:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9cb339500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:88a2002e-2ea7-4f07-912a-8d001832cfc0:3287:1869752384378752:0@lo:400: 00000100:00100000:3.0:1783134894.213390:0:3288:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9cb339c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3288:1869752384378880:0@lo:400: 00000100:00100000:3.0:1783134894.213416:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783134894.213435:0:3288:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1783134894.213441:0:3288:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9cb339880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3288:1869752384379008:0@lo:400: 00000100:00100000:3.0:1783134894.213464:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783134894.213493:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384379136 00000100:00100000:3.0:1783134894.213497:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384379136 00000100:00100000:3.0:1783134894.213539:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384378880 00000100:00100000:3.0:1783134894.213543:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384378880 00000100:00100000:3.0:1783134894.213558:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384379008 00000100:00100000:3.0:1783134894.213559:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384379008 00000100:00100000:3.0:1783134894.213579:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1783134894.213586:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9cb339f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3287:x1869752384379136:12345-0@lo:400: 00000100:00100000:3.0:1783134894.213624:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9cb339f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3287:x1869752384379136:12345-0@lo:400: Request processed in 39us (483us total) trans 0 rc 0/0 00000100:00100000:3.0:1783134894.213630:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1783134894.213643:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1783134894.213649:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9cb339500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3288:x1869752384378880:12345-0@lo:400: 00000100:00100000:3.0:1783134894.213686:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9cb339500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3288:x1869752384378880:12345-0@lo:400: Request processed in 38us (269us total) trans 0 rc 0/0 00000100:00100000:3.0:1783134894.213693:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1783134894.213706:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1783134894.213712:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9cb33b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3288:x1869752384379008:12345-0@lo:400: 00000100:00100000:3.0:1783134894.213745:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9cb33b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3288:x1869752384379008:12345-0@lo:400: Request processed in 33us (279us total) trans 0 rc 0/0 00000100:00100000:3.0:1783134894.213751:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00080000:3.0:1783134894.213769:0:5766:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1783134894.213789:0:3287:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9cb33a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3287:1869752384379136:0@lo:400: 00000100:00100000:3.0:1783134894.213816:0:3288:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9cb339880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3288:1869752384379008:0@lo:400: 00000100:00100000:3.0:1783134894.213827:0:3288:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9cb339c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3288:1869752384378880:0@lo:400: 00000001:00100000:0.0:1783134894.241772:0:6602:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 28f4ba61-cfae-499e-ab3d-81cb8215f7bb 00010000:00010000:2.0:1783134894.339501:0:5757:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783134894.884772:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:3.0:1783134894.884820:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:3.0:1783134894.884860:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:3.0:1783134894.884890:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:2.0:1783134894.884932:0:6576:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373874560 00000100:00100000:2.0:1783134894.884945:0:6576:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373874560 00000100:00100000:2.0:1783134894.885015:0:6576:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373874432 00000100:00100000:2.0:1783134894.885019:0:6576:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373874432 00000100:00100000:2.0:1783134894.885061:0:6576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 3 00000100:00100000:2.0:1783134894.885073:0:6576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9cb339880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+5:2368:x1869752373874560:12345-192.168.201.41@tcp:400: 00000100:00100000:2.0:1783134894.885167:0:6576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9cb339880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+5:2368:x1869752373874560:12345-192.168.201.41@tcp:400: Request processed in 96us (346us total) trans 0 rc 0/0 00000100:00100000:2.0:1783134894.885175:0:6576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 3 00000100:00100000:2.0:1783134894.885194:0:6576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 4 00000100:00100000:2.0:1783134894.885201:0:6576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9cb33a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+5:2368:x1869752373874432:12345-192.168.201.41@tcp:400: 00000100:00100000:2.0:1783134894.885228:0:6576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9cb33a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+5:2368:x1869752373874432:12345-192.168.201.41@tcp:400: Request processed in 28us (338us total) trans 0 rc 0/0 00000100:00100000:2.0:1783134894.885234:0:6576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 4 00000100:00080000:2.0:1783134894.885254:0:5766:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1783134894.885259:0:5766:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1783134894.885458:0:5762:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373874176 00000100:00100000:3.0:1783134894.885463:0:5762:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373874176 00000100:00100000:3.0:1783134894.885499:0:5762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 125 00000100:00100000:3.0:1783134894.885507:0:5762:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9d286a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f39b22bc-4faf-4b59-bb00-2a11f91e37c0+10:2368:x1869752373874176:12345-192.168.201.41@tcp:400: 00000100:00100000:3.0:1783134894.885541:0:5762:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9d286a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f39b22bc-4faf-4b59-bb00-2a11f91e37c0+10:2368:x1869752373874176:12345-192.168.201.41@tcp:400: Request processed in 34us (679us total) trans 0 rc 0/0 00000100:00100000:3.0:1783134894.885548:0:5762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 125 00000100:00100000:0.0:1783134894.886326:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373874304 00000100:00100000:0.0:1783134894.886333:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373874304 00000100:00100000:0.0:1783134894.886396:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 16 00000100:00100000:0.0:1783134894.886406:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9cb339c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+6:2368:x1869752373874304:12345-192.168.201.41@tcp:400: 00000100:00100000:0.0:1783134894.886472:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9cb339c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+6:2368:x1869752373874304:12345-192.168.201.41@tcp:400: Request processed in 67us (1715us total) trans 0 rc 0/0 00000100:00080000:3.0:1783134894.886477:0:5766:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783134894.886482:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 16 00000020:00000080:1.0:1783134895.322222:0:8270:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffcb7c068d0 20000000:00000080:1.0:1783134895.322241:0:8270:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9fea00bec400 uarg=0000000000000000 20000000:01000000:1.0:1783134895.322403:0:8270:0:(mgs_llog.c:2004:mgs_parse_devname()) Device name lustre without fsname 20000000:01000000:1.0:1783134895.322406:0:8270:0:(mgs_llog.c:6054:mgs_set_conf_param()) lustre is seen as a file system name 20000000:01000000:1.0:1783134895.322409:0:8270:0:(mgs_llog.c:6085:mgs_set_conf_param()) set_conf_param fs='lustre' device='lustre' param='sys.jobid_var=procname_uid' 20000000:01000000:1.0:1783134895.322413:0:8270:0:(mgs_llog.c:4738:mgs_write_log_param()) next param 'sys.jobid_var=procname_uid' 20000000:01000000:1.0:1783134895.322418:0:8270:0:(mgs_llog.c:4172:mgs_write_log_sys()) global 'sys.jobid_var=procname_uid' val=procname_uid 20000000:01000000:1.0:1783134895.322432:0:8270:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:1.0:1783134895.322435:0:8270:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:1.0:1783134895.322612:0:8270:0:(mgs_llog.c:2541:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:1.0:1783134895.322615:0:8270:0:(mgs_llog.c:1106:mgs_modify()) modify lustre-OST0001/lustre/sys.jobid_var fl=4 00000040:00080000:3.0:1783134895.323708:0:8271:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 8 count 8 00000040:00080000:1.0:1783134895.324147:0:8270:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9632 00000040:00080000:1.0:1783134895.324211:0:8270:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 120 off9752 00000040:00080000:1.0:1783134895.324248:0:8270:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off9976 20000000:01000000:1.0:1783134895.324261:0:8270:0:(mgs_llog.c:2541:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:1.0:1783134895.324263:0:8270:0:(mgs_llog.c:1106:mgs_modify()) modify lustre-MDT0000/lustre/sys.jobid_var fl=4 00000040:00080000:3.0:1783134895.325052:0:8272:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000040:00080000:1.0:1783134895.325527:0:8270:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 224 off14144 00000040:00080000:1.0:1783134895.325573:0:8270:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 120 off14264 00000040:00080000:1.0:1783134895.325625:0:8270:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14488 20000000:01000000:1.0:1783134895.325639:0:8270:0:(mgs_llog.c:2541:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:1.0:1783134895.325641:0:8270:0:(mgs_llog.c:1106:mgs_modify()) modify lustre-OST0000/lustre/sys.jobid_var fl=4 00000040:00080000:3.0:1783134895.326212:0:8273:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000040:00080000:1.0:1783134895.326805:0:8270:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 224 off10160 00000040:00080000:1.0:1783134895.326863:0:8270:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 120 off10280 00000040:00080000:1.0:1783134895.326901:0:8270:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 224 off10504 20000000:01000000:1.0:1783134895.326912:0:8270:0:(mgs_llog.c:2541:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:1.0:1783134895.326914:0:8270:0:(mgs_llog.c:1106:mgs_modify()) modify lustre-client/lustre/sys.jobid_var fl=4 00000040:00080000:3.0:1783134895.327589:0:8274:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000040:00080000:1.0:1783134895.327929:0:8270:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].39, 224 off14880 00000040:00080000:1.0:1783134895.327972:0:8270:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].40, 120 off15000 00000040:00080000:1.0:1783134895.328005:0:8270:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].41, 224 off15224 10000000:01000000:1.0:1783134895.328028:0:8270:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:1.0:1783134895.328049:0:8270:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9fea02166200/0xd6c4b8f05867e5ab lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134895.328066:0:8270:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9fe9c0030200/0xd6c4b8f05867e4a8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd6c4b8f05867e4a1 expref: 18 pid: 5763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134895.328074:0:8270:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9fea02166c00/0xd6c4b8f05867e4d2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd6c4b8f05867e4cb expref: 18 pid: 5765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134895.328081:0:8270:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9fea02167800/0xd6c4b8f05867e4fc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd6c4b8f05867e4f5 expref: 18 pid: 5762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134895.328088:0:8270:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9fe9d2b74e00/0xd6c4b8f05867e50a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd6c4b8f05867e503 expref: 18 pid: 5763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134895.328094:0:8270:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9fe9c1523200/0xd6c4b8f05867e518 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd6c4b8f05867e511 expref: 18 pid: 5765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134895.328100:0:8270:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9fe9d2b74400/0xd6c4b8f05867e534 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd6c4b8f05867e52d expref: 18 pid: 5765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134895.328106:0:8270:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9fe9c1523a00/0xd6c4b8f05867e55e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd6c4b8f05867e557 expref: 18 pid: 5762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134895.328115:0:8270:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9fe9d2b75800/0xd6c4b8f05867e56c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb7066 expref: 9 pid: 5762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134895.328122:0:8270:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9fe9d2b75a00/0xd6c4b8f05867e573 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb706d expref: 9 pid: 5762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134895.328138:0:8270:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9fea02166200/0xd6c4b8f05867e5ab lrc: 12/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134895.328175:0:8270:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9fe9d2b75a00/0xd6c4b8f05867e573 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb706d expref: 9 pid: 5762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134895.328190:0:8270:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9fe9d2b75a00/0xd6c4b8f05867e573 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb706d expref: 9 pid: 5762 timeout: 277 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783134895.328205:0:8270:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9f6731500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8270:1869752384379264:192.168.201.41@tcp:104: 00010000:00010000:1.0:1783134895.328427:0:8270:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9fe9d2b75800/0xd6c4b8f05867e56c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb7066 expref: 9 pid: 5762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134895.328436:0:8270:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9fe9d2b75800/0xd6c4b8f05867e56c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb7066 expref: 9 pid: 5762 timeout: 277 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783134895.328445:0:8270:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9f6731f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8270:1869752384379392:192.168.201.41@tcp:104: 00010000:00010000:1.0:1783134895.328478:0:8270:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9fe9c1523a00/0xd6c4b8f05867e55e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd6c4b8f05867e557 expref: 18 pid: 5762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134895.328485:0:8270:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9fe9c1523a00/0xd6c4b8f05867e55e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd6c4b8f05867e557 expref: 18 pid: 5762 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783134895.328494:0:8270:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9f6731180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8270:1869752384379520:0@lo:104: 00000100:00100000:1.0:1783134895.328533:0:8270:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1783134895.328563:0:8270:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9fe9d2b74400/0xd6c4b8f05867e534 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd6c4b8f05867e52d expref: 18 pid: 5765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134895.328580:0:8270:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9fe9d2b74400/0xd6c4b8f05867e534 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd6c4b8f05867e52d expref: 18 pid: 5765 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783134895.328588:0:8270:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9f6731880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8270:1869752384379648:0@lo:104: 00000100:00100000:1.0:1783134895.328610:0:8270:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1783134895.328644:0:8270:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9fe9c1523200/0xd6c4b8f05867e518 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd6c4b8f05867e511 expref: 18 pid: 5765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134895.328651:0:8270:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9fe9c1523200/0xd6c4b8f05867e518 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd6c4b8f05867e511 expref: 18 pid: 5765 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783134895.328660:0:8270:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9f6733100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8270:1869752384379776:0@lo:104: 00010000:00010000:1.0:1783134895.328682:0:8270:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9fe9d2b74e00/0xd6c4b8f05867e50a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd6c4b8f05867e503 expref: 18 pid: 5763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134895.328689:0:8270:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9fe9d2b74e00/0xd6c4b8f05867e50a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd6c4b8f05867e503 expref: 18 pid: 5763 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783134895.328696:0:8270:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9f6732300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8270:1869752384379904:0@lo:104: 00010000:00010000:1.0:1783134895.328719:0:8270:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9fea02167800/0xd6c4b8f05867e4fc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd6c4b8f05867e4f5 expref: 18 pid: 5762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134895.328726:0:8270:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9fea02167800/0xd6c4b8f05867e4fc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd6c4b8f05867e4f5 expref: 18 pid: 5762 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783134895.328733:0:8270:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9f6733800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8270:1869752384380032:0@lo:104: 00010000:00010000:1.0:1783134895.328754:0:8270:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9fea02166c00/0xd6c4b8f05867e4d2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd6c4b8f05867e4cb expref: 18 pid: 5765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134895.328770:0:8270:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9fea02166c00/0xd6c4b8f05867e4d2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd6c4b8f05867e4cb expref: 18 pid: 5765 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783134895.328778:0:8270:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9f6733b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8270:1869752384380160:0@lo:104: 00010000:00010000:1.0:1783134895.328800:0:8270:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9fe9c0030200/0xd6c4b8f05867e4a8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd6c4b8f05867e4a1 expref: 18 pid: 5763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134895.328808:0:8270:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9fe9c0030200/0xd6c4b8f05867e4a8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd6c4b8f05867e4a1 expref: 18 pid: 5763 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783134895.328815:0:8270:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9f6730700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8270:1869752384380288:0@lo:104: 00000100:00100000:1.0:1783134895.328834:0:8270:0:(client.c:2701:ptlrpc_set_wait()) set ffff9fe9e9c699c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783134895.328906:0:5753:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1783134895.328923:0:5753:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783134895.328949:0:5753:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783134895.328958:0:5753:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783134895.328966:0:5753:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783134895.328973:0:5753:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783134895.328981:0:5753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384379520 00000100:00100000:0.0:1783134895.328987:0:5753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384379520 00000100:00100000:0.0:1783134895.329031:0:5753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384379648 00000100:00100000:0.0:1783134895.329034:0:5753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384379648 00000100:00100000:0.0:1783134895.329046:0:5753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384379776 00000100:00100000:0.0:1783134895.329048:0:5753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384379776 00000100:00100000:0.0:1783134895.329057:0:5753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384379904 00000100:00100000:0.0:1783134895.329064:0:5753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384379904 00000100:00100000:0.0:1783134895.329075:0:5753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384380032 00000100:00100000:0.0:1783134895.329077:0:5753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384380032 00000100:00100000:0.0:1783134895.329087:0:5753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384380160 00000100:00100000:0.0:1783134895.329089:0:5753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384380160 00000100:00100000:0.0:1783134895.329098:0:5753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384380288 00000100:00100000:0.0:1783134895.329100:0:5753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384380288 00000100:00100000:0.0:1783134895.329113:0:5753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1783134895.329121:0:5753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9f6732a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:88a2002e-2ea7-4f07-912a-8d001832cfc0+9:8270:x1869752384379520:12345-0@lo:104: 00010000:00010000:0.0:1783134895.329132:0:5753:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.141@tcp lock: ffff9fe9d2b74600/0xd6c4b8f05867e557 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xd6c4b8f05867e55e expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134895.329182:0:5753:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1783134895.329188:0:5753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9f6732a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:88a2002e-2ea7-4f07-912a-8d001832cfc0+9:8270:x1869752384379520:12345-0@lo:104: Request processed in 68us (656us total) trans 0 rc 0/0 00000100:00100000:0.0:1783134895.329195:0:5753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1783134895.329225:0:5753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1783134895.329231:0:5753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9f68ccc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:88a2002e-2ea7-4f07-912a-8d001832cfc0+8:8270:x1869752384379648:12345-0@lo:104: 00010000:00010000:0.0:1783134895.329238:0:5753:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.141@tcp lock: ffff9fe9d2b75000/0xd6c4b8f05867e52d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xd6c4b8f05867e534 expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134895.329268:0:5753:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1783134895.329273:0:5753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9f68ccc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:88a2002e-2ea7-4f07-912a-8d001832cfc0+8:8270:x1869752384379648:12345-0@lo:104: Request processed in 43us (663us total) trans 0 rc 0/0 00000100:00100000:0.0:1783134895.329301:0:5753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1783134895.329341:0:5753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1783134895.329346:0:5753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9f5ca6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:88a2002e-2ea7-4f07-912a-8d001832cfc0+7:8270:x1869752384379776:12345-0@lo:104: 00010000:00010000:0.0:1783134895.329353:0:5753:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.141@tcp lock: ffff9fe9d2b74200/0xd6c4b8f05867e511 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xd6c4b8f05867e518 expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134895.329390:0:5753:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1783134895.329395:0:5753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9f5ca6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:88a2002e-2ea7-4f07-912a-8d001832cfc0+7:8270:x1869752384379776:12345-0@lo:104: Request processed in 49us (471us total) trans 0 rc 0/0 00000100:00100000:0.0:1783134895.329401:0:5753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1783134895.329411:0:5753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1783134895.329416:0:5753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9f5ca6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:88a2002e-2ea7-4f07-912a-8d001832cfc0+6:8270:x1869752384379904:12345-0@lo:104: 00010000:00010000:0.0:1783134895.329423:0:5753:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.141@tcp lock: ffff9fe9c1523400/0xd6c4b8f05867e503 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xd6c4b8f05867e50a expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134895.329444:0:5753:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:0.0:1783134895.329448:0:5753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9f5ca6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:88a2002e-2ea7-4f07-912a-8d001832cfc0+6:8270:x1869752384379904:12345-0@lo:104: Request processed in 32us (499us total) trans 0 rc 0/0 00000100:00100000:0.0:1783134895.329453:0:5753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1783134895.329464:0:5753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1783134895.329468:0:5753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9f5ca5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:88a2002e-2ea7-4f07-912a-8d001832cfc0+5:8270:x1869752384380032:12345-0@lo:104: 00010000:00010000:0.0:1783134895.329475:0:5753:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.141@tcp lock: ffff9fe9d2b75c00/0xd6c4b8f05867e4f5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xd6c4b8f05867e4fc expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134895.329498:0:5753:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:0.0:1783134895.329502:0:5753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9f5ca5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:88a2002e-2ea7-4f07-912a-8d001832cfc0+5:8270:x1869752384380032:12345-0@lo:104: Request processed in 34us (543us total) trans 0 rc 0/0 00000100:00100000:0.0:1783134895.329507:0:5753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1783134895.329522:0:5753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1783134895.329527:0:5753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9f5ca5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:88a2002e-2ea7-4f07-912a-8d001832cfc0+4:8270:x1869752384380160:12345-0@lo:104: 00010000:00010000:0.0:1783134895.329534:0:5753:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.141@tcp lock: ffff9fe9c0031400/0xd6c4b8f05867e4cb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xd6c4b8f05867e4d2 expref: -99 pid: 7455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134895.329561:0:5753:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to priority blp list, 6 blwis in pool 00000100:00100000:0.0:1783134895.329565:0:5753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9f5ca5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:88a2002e-2ea7-4f07-912a-8d001832cfc0+4:8270:x1869752384380160:12345-0@lo:104: Request processed in 39us (599us total) trans 0 rc 0/0 00000100:00100000:0.0:1783134895.329571:0:5753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1783134895.329582:0:5753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1783134895.329588:0:5753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9f5ca5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:88a2002e-2ea7-4f07-912a-8d001832cfc0+3:8270:x1869752384380288:12345-0@lo:104: 00010000:00010000:0.0:1783134895.329594:0:5753:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.141@tcp lock: ffff9fe9d2b74c00/0xd6c4b8f05867e4a1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xd6c4b8f05867e4a8 expref: -99 pid: 7455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134895.329618:0:5753:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to priority blp list, 7 blwis in pool 00000100:00100000:0.0:1783134895.329622:0:5753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9f5ca5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:88a2002e-2ea7-4f07-912a-8d001832cfc0+3:8270:x1869752384380288:12345-0@lo:104: Request processed in 35us (648us total) trans 0 rc 0/0 00000100:00100000:0.0:1783134895.329627:0:5753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00010000:0.0:1783134895.329644:0:6591:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:0.0:1783134895.329650:0:6591:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.141@tcp lock: ffff9fe9d2b74600/0xd6c4b8f05867e557 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xd6c4b8f05867e55e expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134895.329656:0:6591:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe9d2b74600 already unused, calling callback (ffffffffc1b40c20) 10000000:00010000:0.0:1783134895.329660:0:6591:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.141@tcp lock: ffff9fe9d2b74600/0xd6c4b8f05867e557 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0xd6c4b8f05867e55e expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134895.329668:0:6591:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.141@tcp lock: ffff9fe9d2b74600/0xd6c4b8f05867e557 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0xd6c4b8f05867e55e expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1783134895.329676:0:6591:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.141@tcp lock: ffff9fe9d2b74600/0xd6c4b8f05867e557 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0xd6c4b8f05867e55e expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783134895.329681:0:6591:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1783134895.329713:0:6591:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.141@tcp lock: ffff9fe9d2b74600/0xd6c4b8f05867e557 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd6c4b8f05867e55e expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134895.329719:0:6591:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1783134895.329738:0:6591:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.141@tcp lock: ffff9fe9d2b74600/0xd6c4b8f05867e557 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd6c4b8f05867e55e expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134895.329744:0:6591:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.141@tcp lock: ffff9fe9d2b74600/0xd6c4b8f05867e557 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd6c4b8f05867e55e expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134895.329756:0:6591:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:0.0:1783134895.329759:0:6591:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.141@tcp lock: ffff9fe9d2b75000/0xd6c4b8f05867e52d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0xd6c4b8f05867e534 expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134895.329764:0:6591:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe9d2b75000 already unused, calling callback (ffffffffc1b40c20) 10000000:00010000:0.0:1783134895.329766:0:6591:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.141@tcp lock: ffff9fe9d2b75000/0xd6c4b8f05867e52d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0xd6c4b8f05867e534 expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134895.329773:0:6591:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.141@tcp lock: ffff9fe9d2b75000/0xd6c4b8f05867e52d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0xd6c4b8f05867e534 expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1783134895.329779:0:6591:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.141@tcp lock: ffff9fe9d2b75000/0xd6c4b8f05867e52d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0xd6c4b8f05867e534 expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783134895.329783:0:6591:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1783134895.329794:0:6591:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.141@tcp lock: ffff9fe9d2b75000/0xd6c4b8f05867e52d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd6c4b8f05867e534 expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134895.329800:0:6591:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1783134895.329814:0:6591:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.141@tcp lock: ffff9fe9d2b75000/0xd6c4b8f05867e52d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd6c4b8f05867e534 expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134895.329831:0:6591:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.141@tcp lock: ffff9fe9d2b75000/0xd6c4b8f05867e52d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd6c4b8f05867e534 expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134895.329840:0:6591:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:0.0:1783134895.329843:0:6591:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.141@tcp lock: ffff9fe9d2b74200/0xd6c4b8f05867e511 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xd6c4b8f05867e518 expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134895.329848:0:6591:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe9d2b74200 already unused, calling callback (ffffffffc1b40c20) 10000000:00010000:0.0:1783134895.329850:0:6591:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.141@tcp lock: ffff9fe9d2b74200/0xd6c4b8f05867e511 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0xd6c4b8f05867e518 expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134895.329856:0:6591:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.141@tcp lock: ffff9fe9d2b74200/0xd6c4b8f05867e511 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0xd6c4b8f05867e518 expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1783134895.329862:0:6591:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.141@tcp lock: ffff9fe9d2b74200/0xd6c4b8f05867e511 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0xd6c4b8f05867e518 expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783134895.329866:0:6591:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1783134895.329879:0:6591:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.141@tcp lock: ffff9fe9d2b74200/0xd6c4b8f05867e511 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd6c4b8f05867e518 expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134895.329884:0:6591:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1783134895.329889:0:6591:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.141@tcp lock: ffff9fe9d2b74200/0xd6c4b8f05867e511 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd6c4b8f05867e518 expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134895.329896:0:6591:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.141@tcp lock: ffff9fe9d2b74200/0xd6c4b8f05867e511 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd6c4b8f05867e518 expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134895.329904:0:6591:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1783134895.329912:0:6591:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.141@tcp lock: ffff9fe9c1523400/0xd6c4b8f05867e503 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xd6c4b8f05867e50a expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134895.329918:0:6591:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe9c1523400 already unused, calling callback (ffffffffc1b40c20) 10000000:00010000:0.0:1783134895.329920:0:6591:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.141@tcp lock: ffff9fe9c1523400/0xd6c4b8f05867e503 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xd6c4b8f05867e50a expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134895.329927:0:6591:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.141@tcp lock: ffff9fe9c1523400/0xd6c4b8f05867e503 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xd6c4b8f05867e50a expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1783134895.329933:0:6591:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.141@tcp lock: ffff9fe9c1523400/0xd6c4b8f05867e503 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xd6c4b8f05867e50a expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783134895.329938:0:6591:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1783134895.329951:0:6591:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.141@tcp lock: ffff9fe9c1523400/0xd6c4b8f05867e503 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd6c4b8f05867e50a expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134895.329957:0:6591:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1783134895.329962:0:6591:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.141@tcp lock: ffff9fe9c1523400/0xd6c4b8f05867e503 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd6c4b8f05867e50a expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134895.329968:0:6591:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.141@tcp lock: ffff9fe9c1523400/0xd6c4b8f05867e503 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd6c4b8f05867e50a expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134895.329976:0:6591:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1783134895.329979:0:6591:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.141@tcp lock: ffff9fe9d2b75c00/0xd6c4b8f05867e4f5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xd6c4b8f05867e4fc expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134895.329984:0:6591:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe9d2b75c00 already unused, calling callback (ffffffffc1b40c20) 10000000:00010000:0.0:1783134895.329986:0:6591:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.141@tcp lock: ffff9fe9d2b75c00/0xd6c4b8f05867e4f5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xd6c4b8f05867e4fc expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134895.330002:0:6591:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.141@tcp lock: ffff9fe9d2b75c00/0xd6c4b8f05867e4f5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xd6c4b8f05867e4fc expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1783134895.330007:0:6591:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.141@tcp lock: ffff9fe9d2b75c00/0xd6c4b8f05867e4f5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xd6c4b8f05867e4fc expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783134895.330012:0:6591:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1783134895.330044:0:6591:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.141@tcp lock: ffff9fe9d2b75c00/0xd6c4b8f05867e4f5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd6c4b8f05867e4fc expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134895.330050:0:6591:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1783134895.330053:0:6591:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.141@tcp lock: ffff9fe9d2b75c00/0xd6c4b8f05867e4f5 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd6c4b8f05867e4fc expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134895.330059:0:6591:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.141@tcp lock: ffff9fe9d2b75c00/0xd6c4b8f05867e4f5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd6c4b8f05867e4fc expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134895.330066:0:6591:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1783134895.330069:0:6591:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.141@tcp lock: ffff9fe9c0031400/0xd6c4b8f05867e4cb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xd6c4b8f05867e4d2 expref: -99 pid: 7455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134895.330074:0:6591:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe9c0031400 already unused, calling callback (ffffffffc1b40c20) 10000000:00010000:0.0:1783134895.330076:0:6591:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.141@tcp lock: ffff9fe9c0031400/0xd6c4b8f05867e4cb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xd6c4b8f05867e4d2 expref: -99 pid: 7455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134895.330082:0:6591:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.141@tcp lock: ffff9fe9c0031400/0xd6c4b8f05867e4cb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xd6c4b8f05867e4d2 expref: -99 pid: 7455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1783134895.330088:0:6591:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.141@tcp lock: ffff9fe9c0031400/0xd6c4b8f05867e4cb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xd6c4b8f05867e4d2 expref: -99 pid: 7455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783134895.330098:0:6591:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1783134895.330109:0:6591:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.141@tcp lock: ffff9fe9c0031400/0xd6c4b8f05867e4cb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd6c4b8f05867e4d2 expref: -99 pid: 7455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134895.330115:0:6591:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1783134895.330119:0:6591:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.141@tcp lock: ffff9fe9c0031400/0xd6c4b8f05867e4cb lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd6c4b8f05867e4d2 expref: -99 pid: 7455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134895.330125:0:6591:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.141@tcp lock: ffff9fe9c0031400/0xd6c4b8f05867e4cb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd6c4b8f05867e4d2 expref: -99 pid: 7455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134895.330135:0:6591:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783134895.330138:0:6591:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.141@tcp lock: ffff9fe9d2b74c00/0xd6c4b8f05867e4a1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xd6c4b8f05867e4a8 expref: -99 pid: 7455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134895.330144:0:6591:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe9d2b74c00 already unused, calling callback (ffffffffc1b40c20) 10000000:00010000:0.0:1783134895.330146:0:6591:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.141@tcp lock: ffff9fe9d2b74c00/0xd6c4b8f05867e4a1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xd6c4b8f05867e4a8 expref: -99 pid: 7455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134895.330152:0:6591:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.141@tcp lock: ffff9fe9d2b74c00/0xd6c4b8f05867e4a1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xd6c4b8f05867e4a8 expref: -99 pid: 7455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1783134895.330158:0:6591:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.141@tcp lock: ffff9fe9d2b74c00/0xd6c4b8f05867e4a1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xd6c4b8f05867e4a8 expref: -99 pid: 7455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783134895.330164:0:6591:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1783134895.330175:0:6591:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.141@tcp lock: ffff9fe9d2b74c00/0xd6c4b8f05867e4a1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd6c4b8f05867e4a8 expref: -99 pid: 7455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134895.330180:0:6591:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1783134895.330190:0:6591:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.141@tcp lock: ffff9fe9d2b74c00/0xd6c4b8f05867e4a1 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd6c4b8f05867e4a8 expref: -99 pid: 7455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134895.330196:0:6591:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.141@tcp lock: ffff9fe9d2b74c00/0xd6c4b8f05867e4a1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd6c4b8f05867e4a8 expref: -99 pid: 7455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134895.330208:0:6591:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783134895.330210:0:6591:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783134895.330211:0:6591:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783134895.330221:0:5758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783134895.330226:0:5757:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783134895.330236:0:3287:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9f5ca6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:88a2002e-2ea7-4f07-912a-8d001832cfc0:3287:1869752384380416:0@lo:103: 00000100:00100000:0.0:1783134895.330270:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783134895.330315:0:3287:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9f5ca4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:88a2002e-2ea7-4f07-912a-8d001832cfc0:3287:1869752384380928:0@lo:103: 00000100:00100000:0.0:1783134895.330332:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783134895.330349:0:3287:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1783134895.330354:0:3287:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9f5ca4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:88a2002e-2ea7-4f07-912a-8d001832cfc0:3287:1869752384380800:0@lo:103: 00000100:00100000:0.0:1783134895.330369:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783134895.330391:0:3288:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9f5ca7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:88a2002e-2ea7-4f07-912a-8d001832cfc0:3288:1869752384380544:0@lo:103: 00000100:00100000:0.0:1783134895.330412:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783134895.330426:0:3288:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9ca88e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:88a2002e-2ea7-4f07-912a-8d001832cfc0:3288:1869752384381056:0@lo:103: 00000100:00100000:0.0:1783134895.330442:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783134895.330452:0:3288:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1783134895.330456:0:3288:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9f5ca4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:88a2002e-2ea7-4f07-912a-8d001832cfc0:3288:1869752384380672:0@lo:103: 00000100:00100000:0.0:1783134895.330486:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783134895.330498:0:3288:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9ca88ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:88a2002e-2ea7-4f07-912a-8d001832cfc0:3288:1869752384381184:0@lo:103: 00000100:00100000:0.0:1783134895.330520:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783134895.330552:0:5754:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384380416 00000100:00100000:0.0:1783134895.330557:0:5754:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384380416 00010000:00010000:0.0:1783134895.330578:0:5754:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9fe9c1523a00/0xd6c4b8f05867e55e lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd6c4b8f05867e557 expref: 19 pid: 5762 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783134895.330593:0:5754:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384380928 00000100:00100000:0.0:1783134895.330596:0:5754:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384380928 00010000:00010000:0.0:1783134895.330609:0:5754:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9fea02167800/0xd6c4b8f05867e4fc lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd6c4b8f05867e4f5 expref: 20 pid: 5762 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783134895.330619:0:5754:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384380800 00000100:00100000:0.0:1783134895.330622:0:5754:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384380800 00010000:00010000:0.0:1783134895.330632:0:5754:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9fe9d2b74e00/0xd6c4b8f05867e50a lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd6c4b8f05867e503 expref: 21 pid: 5763 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783134895.330642:0:5754:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384380544 00000100:00100000:0.0:1783134895.330644:0:5754:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384380544 00010000:00010000:0.0:1783134895.330653:0:5754:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9fe9d2b74400/0xd6c4b8f05867e534 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd6c4b8f05867e52d expref: 22 pid: 5765 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783134895.330663:0:5754:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384381056 00000100:00100000:0.0:1783134895.330665:0:5754:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384381056 00010000:00010000:0.0:1783134895.330673:0:5754:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9fea02166c00/0xd6c4b8f05867e4d2 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd6c4b8f05867e4cb expref: 23 pid: 5765 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783134895.330682:0:5754:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384380672 00000100:00100000:0.0:1783134895.330684:0:5754:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384380672 00010000:00010000:0.0:1783134895.330693:0:5754:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9fe9c1523200/0xd6c4b8f05867e518 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd6c4b8f05867e511 expref: 24 pid: 5765 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783134895.330703:0:5754:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384381184 00000100:00100000:0.0:1783134895.330705:0:5754:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384381184 00010000:00010000:0.0:1783134895.330715:0:5754:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9fe9c0030200/0xd6c4b8f05867e4a8 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd6c4b8f05867e4a1 expref: 25 pid: 5763 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783134895.330737:0:5754:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1783134895.330743:0:5754:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9ca88d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:88a2002e-2ea7-4f07-912a-8d001832cfc0+25:3287:x1869752384380416:12345-0@lo:103: 00010000:00010000:0.0:1783134895.330754:0:5754:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783134895.330759:0:5754:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9fe9c1523a00/0xd6c4b8f05867e55e lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd6c4b8f05867e557 expref: 25 pid: 5762 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134895.330768:0:5754:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9fe9c1523a00/0xd6c4b8f05867e55e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd6c4b8f05867e557 expref: 25 pid: 5762 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134895.330783:0:5754:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783134895.330810:0:5754:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9ca88d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:88a2002e-2ea7-4f07-912a-8d001832cfc0+25:3287:x1869752384380416:12345-0@lo:103: Request processed in 68us (541us total) trans 0 rc 0/0 00000100:00100000:0.0:1783134895.330817:0:5754:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1783134895.330832:0:5754:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1783134895.330837:0:5754:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9ca88d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:88a2002e-2ea7-4f07-912a-8d001832cfc0+24:3287:x1869752384380928:12345-0@lo:103: 00010000:00010000:0.0:1783134895.330845:0:5754:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783134895.330849:0:5754:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9fea02167800/0xd6c4b8f05867e4fc lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd6c4b8f05867e4f5 expref: 24 pid: 5762 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134895.330857:0:5754:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9fea02167800/0xd6c4b8f05867e4fc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd6c4b8f05867e4f5 expref: 24 pid: 5762 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134895.330866:0:5754:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783134895.330886:0:5754:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9ca88d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:88a2002e-2ea7-4f07-912a-8d001832cfc0+24:3287:x1869752384380928:12345-0@lo:103: Request processed in 49us (553us total) trans 0 rc 0/0 00000100:00100000:0.0:1783134895.330892:0:5754:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1783134895.330903:0:5754:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1783134895.330915:0:5754:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9e0475180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:88a2002e-2ea7-4f07-912a-8d001832cfc0+23:3287:x1869752384380800:12345-0@lo:103: 00010000:00010000:0.0:1783134895.330923:0:5754:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783134895.330927:0:5754:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9fe9d2b74e00/0xd6c4b8f05867e50a lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd6c4b8f05867e503 expref: 23 pid: 5763 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134895.330935:0:5754:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9fe9d2b74e00/0xd6c4b8f05867e50a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd6c4b8f05867e503 expref: 23 pid: 5763 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134895.330944:0:5754:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783134895.330965:0:5754:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9e0475180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:88a2002e-2ea7-4f07-912a-8d001832cfc0+23:3287:x1869752384380800:12345-0@lo:103: Request processed in 50us (594us total) trans 0 rc 0/0 00000100:00100000:0.0:1783134895.330970:0:5754:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1783134895.330982:0:5754:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1783134895.330987:0:5754:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9e0474700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:88a2002e-2ea7-4f07-912a-8d001832cfc0+22:3288:x1869752384380544:12345-0@lo:103: 00010000:00010000:0.0:1783134895.330994:0:5754:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783134895.330998:0:5754:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9fe9d2b74400/0xd6c4b8f05867e534 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd6c4b8f05867e52d expref: 22 pid: 5765 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134895.331006:0:5754:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9fe9d2b74400/0xd6c4b8f05867e534 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd6c4b8f05867e52d expref: 22 pid: 5765 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134895.331024:0:5754:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783134895.331050:0:5754:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9e0474700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:88a2002e-2ea7-4f07-912a-8d001832cfc0+22:3288:x1869752384380544:12345-0@lo:103: Request processed in 63us (637us total) trans 0 rc 0/0 00000100:00100000:0.0:1783134895.331056:0:5754:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1783134895.331067:0:5754:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1783134895.331072:0:5754:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9e0474e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:88a2002e-2ea7-4f07-912a-8d001832cfc0+21:3288:x1869752384381056:12345-0@lo:103: 00010000:00010000:0.0:1783134895.331079:0:5754:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783134895.331089:0:5754:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9fea02166c00/0xd6c4b8f05867e4d2 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd6c4b8f05867e4cb expref: 21 pid: 5765 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134895.331097:0:5754:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9fea02166c00/0xd6c4b8f05867e4d2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd6c4b8f05867e4cb expref: 21 pid: 5765 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134895.331106:0:5754:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783134895.331127:0:5754:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9e0474e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:88a2002e-2ea7-4f07-912a-8d001832cfc0+21:3288:x1869752384381056:12345-0@lo:103: Request processed in 55us (684us total) trans 0 rc 0/0 00000100:00100000:0.0:1783134895.331133:0:5754:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1783134895.331145:0:5754:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1783134895.331150:0:5754:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9f5ce3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:88a2002e-2ea7-4f07-912a-8d001832cfc0+20:3288:x1869752384380672:12345-0@lo:103: 00010000:00010000:0.0:1783134895.331158:0:5754:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783134895.331161:0:5754:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9fe9c1523200/0xd6c4b8f05867e518 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd6c4b8f05867e511 expref: 20 pid: 5765 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134895.331169:0:5754:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9fe9c1523200/0xd6c4b8f05867e518 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd6c4b8f05867e511 expref: 20 pid: 5765 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134895.331177:0:5754:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783134895.331196:0:5754:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9f5ce3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:88a2002e-2ea7-4f07-912a-8d001832cfc0+20:3288:x1869752384380672:12345-0@lo:103: Request processed in 46us (710us total) trans 0 rc 0/0 00000100:00100000:0.0:1783134895.331201:0:5754:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1783134895.331213:0:5754:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1783134895.331218:0:5754:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9d1622850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:88a2002e-2ea7-4f07-912a-8d001832cfc0+19:3288:x1869752384381184:12345-0@lo:103: 00010000:00010000:0.0:1783134895.331225:0:5754:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783134895.331229:0:5754:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9fe9c0030200/0xd6c4b8f05867e4a8 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd6c4b8f05867e4a1 expref: 19 pid: 5763 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134895.331246:0:5754:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9fe9c0030200/0xd6c4b8f05867e4a8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd6c4b8f05867e4a1 expref: 19 pid: 5763 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134895.331256:0:5754:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783134895.331276:0:5754:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9d1622850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:88a2002e-2ea7-4f07-912a-8d001832cfc0+19:3288:x1869752384381184:12345-0@lo:103: Request processed in 58us (755us total) trans 0 rc 0/0 00000100:00100000:0.0:1783134895.331301:0:5754:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1783134895.331359:0:3287:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9f5ca4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:88a2002e-2ea7-4f07-912a-8d001832cfc0:3287:1869752384380800:0@lo:103: 00000100:00100000:0.0:1783134895.331370:0:3287:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9f5ca6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:88a2002e-2ea7-4f07-912a-8d001832cfc0:3287:1869752384380416:0@lo:103: 00000100:00100000:0.0:1783134895.331378:0:3287:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9f5ca4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:88a2002e-2ea7-4f07-912a-8d001832cfc0:3287:1869752384380928:0@lo:103: 00000100:00100000:0.0:1783134895.331407:0:3288:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9f5ca4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:88a2002e-2ea7-4f07-912a-8d001832cfc0:3288:1869752384380672:0@lo:103: 00000100:00100000:0.0:1783134895.331415:0:3288:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9ca88ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:88a2002e-2ea7-4f07-912a-8d001832cfc0:3288:1869752384381184:0@lo:103: 00000100:00100000:0.0:1783134895.331422:0:3288:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9f5ca7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:88a2002e-2ea7-4f07-912a-8d001832cfc0:3288:1869752384380544:0@lo:103: 00000100:00100000:0.0:1783134895.331428:0:3288:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9ca88e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:88a2002e-2ea7-4f07-912a-8d001832cfc0:3288:1869752384381056:0@lo:103: 00010000:00010000:1.0:1783134895.331790:0:8270:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fe9c1523a00/0xd6c4b8f05867e55e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd6c4b8f05867e557 expref: 18 pid: 5762 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783134895.331803:0:8270:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9f6731180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8270:1869752384379520:0@lo:104: 00010000:00010000:1.0:1783134895.331814:0:8270:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fe9d2b74400/0xd6c4b8f05867e534 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd6c4b8f05867e52d expref: 17 pid: 5765 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783134895.331822:0:8270:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9f6731880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8270:1869752384379648:0@lo:104: 00010000:00010000:1.0:1783134895.331832:0:8270:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fe9c1523200/0xd6c4b8f05867e518 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd6c4b8f05867e511 expref: 16 pid: 5765 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783134895.331840:0:8270:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9f6733100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8270:1869752384379776:0@lo:104: 00010000:00010000:1.0:1783134895.331850:0:8270:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fe9d2b74e00/0xd6c4b8f05867e50a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd6c4b8f05867e503 expref: 15 pid: 5763 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783134895.331858:0:8270:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9f6732300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8270:1869752384379904:0@lo:104: 00010000:00010000:1.0:1783134895.331877:0:8270:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fea02167800/0xd6c4b8f05867e4fc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd6c4b8f05867e4f5 expref: 14 pid: 5762 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783134895.331886:0:8270:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9f6733800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8270:1869752384380032:0@lo:104: 00010000:00010000:1.0:1783134895.331895:0:8270:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fea02166c00/0xd6c4b8f05867e4d2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd6c4b8f05867e4cb expref: 13 pid: 5765 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783134895.331904:0:8270:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9f6733b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8270:1869752384380160:0@lo:104: 00010000:00010000:1.0:1783134895.331913:0:8270:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fe9c0030200/0xd6c4b8f05867e4a8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd6c4b8f05867e4a1 expref: 12 pid: 5763 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783134895.331920:0:8270:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9f6730700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8270:1869752384380288:0@lo:104: 00000100:00100000:1.0:1783134895.335578:0:8270:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9f6731500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8270:1869752384379264:192.168.201.41@tcp:104: 00000100:00100000:1.0:1783134895.335595:0:8270:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9f6731f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8270:1869752384379392:192.168.201.41@tcp:104: 00010000:00010000:1.0:1783134895.335641:0:8270:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9fea02166200/0xd6c4b8f05867e5ab lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783134895.336136:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:0.0:1783134895.336173:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:2.0:1783134895.336244:0:5754:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373874688 00000100:00100000:2.0:1783134895.336263:0:5754:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373874688 00010000:00010000:2.0:1783134895.336327:0:5754:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9fe9d2b75a00/0xd6c4b8f05867e573 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb706d expref: 10 pid: 5762 timeout: 277 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783134895.336356:0:5754:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373874816 00000100:00100000:2.0:1783134895.336360:0:5754:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373874816 00010000:00010000:2.0:1783134895.336370:0:5754:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9fe9d2b75800/0xd6c4b8f05867e56c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb7066 expref: 11 pid: 5762 timeout: 277 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783134895.336393:0:5754:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 19 00000100:00100000:2.0:1783134895.336401:0:5754:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9f5ce3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f39b22bc-4faf-4b59-bb00-2a11f91e37c0+11:2369:x1869752373874688:12345-192.168.201.41@tcp:103: 00010000:00010000:2.0:1783134895.336415:0:5754:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783134895.336420:0:5754:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9fe9d2b75a00/0xd6c4b8f05867e573 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb706d expref: 11 pid: 5762 timeout: 277 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134895.336431:0:5754:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9fe9d2b75a00/0xd6c4b8f05867e573 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb706d expref: 11 pid: 5762 timeout: 277 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134895.336447:0:5754:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fe9d2b75a00/0xd6c4b8f05867e573 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb706d expref: 11 pid: 5762 timeout: 277 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134895.336463:0:5754:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783134895.336510:0:5754:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9f5ce3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f39b22bc-4faf-4b59-bb00-2a11f91e37c0+10:2369:x1869752373874688:12345-192.168.201.41@tcp:103: Request processed in 109us (375us total) trans 0 rc 0/0 00000100:00100000:2.0:1783134895.336518:0:5754:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 19 00000100:00100000:2.0:1783134895.336534:0:5754:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 20 00000100:00100000:2.0:1783134895.336540:0:5754:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9f5ce1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f39b22bc-4faf-4b59-bb00-2a11f91e37c0+9:2369:x1869752373874816:12345-192.168.201.41@tcp:103: 00010000:00010000:2.0:1783134895.336547:0:5754:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783134895.336551:0:5754:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9fe9d2b75800/0xd6c4b8f05867e56c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb7066 expref: 9 pid: 5762 timeout: 277 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134895.336566:0:5754:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9fe9d2b75800/0xd6c4b8f05867e56c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb7066 expref: 9 pid: 5762 timeout: 277 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134895.336576:0:5754:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fe9d2b75800/0xd6c4b8f05867e56c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb7066 expref: 9 pid: 5762 timeout: 277 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134895.336586:0:5754:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9fea02166200/0xd6c4b8f05867e5ab lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134895.336595:0:5754:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fea02166200/0xd6c4b8f05867e5ab lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134895.336608:0:5754:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9fea02166200/0xd6c4b8f05867e5ab lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134895.336615:0:5754:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9fea02166200/0xd6c4b8f05867e5ab lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134895.336622:0:5754:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9fea02166200/0xd6c4b8f05867e5ab lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134895.336629:0:5754:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9fea02166200/0xd6c4b8f05867e5ab lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134895.336636:0:5754:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fea02166200 already unused, calling callback (ffffffffc1527ce0) 00010000:00010000:2.0:1783134895.336639:0:5754:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9fea02166200/0xd6c4b8f05867e5ab lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134895.336647:0:5754:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9fea02166200/0xd6c4b8f05867e5ab lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134895.336669:0:5754:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9fea02166200/0xd6c4b8f05867e5ab lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134895.336677:0:5754:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783134895.336695:0:5754:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9f5ce1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f39b22bc-4faf-4b59-bb00-2a11f91e37c0+8:2369:x1869752373874816:12345-192.168.201.41@tcp:103: Request processed in 155us (522us total) trans 0 rc 0/0 00000100:00100000:2.0:1783134895.336702:0:5754:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 20 00010000:00010000:1.0:1783134895.337208:0:8270:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9fea02166200/0xd6c4b8f05867e5ab lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134895.337218:0:8270:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9fea02166200/0xd6c4b8f05867e5ab lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134895.337225:0:8270:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fea02166200/0xd6c4b8f05867e5ab lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134895.368906:0:6591:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783134896.390432:0:5758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1783134896.516699:0:5767:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1783134896.516707:0:5767:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff9fe8c47e1800 from 39 10000000:01000000:2.0:1783134896.516712:0:5767:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1783134896.516762:0:5767:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.141@tcp lock: ffff9fe9c1523c00/0xd6c4b8f05867e5b2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134896.516774:0:5767:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.141@tcp lock: ffff9fe9c1523c00/0xd6c4b8f05867e5b2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134896.516785:0:5767:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.141@tcp lock: ffff9fe9c1523c00/0xd6c4b8f05867e5b2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783134896.516809:0:5767:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9f6f72d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88a2002e-2ea7-4f07-912a-8d001832cfc0:5767:1869752384381312:0@lo:101: 00000100:00100000:2.0:1783134896.516880:0:5767:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783134896.516950:0:5767:0:(client.c:2701:ptlrpc_set_wait()) set ffff9fe9ca791780 going to sleep for 11 seconds 00000100:00100000:1.0:1783134896.517127:0:5763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384381312 00000100:00100000:1.0:1783134896.517135:0:5763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384381312 00000100:00100000:1.0:1783134896.517188:0:5763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:1.0:1783134896.517211:0:5763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9d286a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88a2002e-2ea7-4f07-912a-8d001832cfc0+12:5767:x1869752384381312:12345-0@lo:101: 00010000:00010000:1.0:1783134896.517225:0:5763:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783134896.517238:0:5763:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fea02166200/0xd6c4b8f05867e5b9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd6c4b8f05867e5b2 expref: -99 pid: 5763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134896.517262:0:5763:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fea02166200/0xd6c4b8f05867e5b9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd6c4b8f05867e5b2 expref: 13 pid: 5763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134896.517274:0:5763:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fea02166200/0xd6c4b8f05867e5b9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd6c4b8f05867e5b2 expref: 13 pid: 5763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134896.517311:0:5763:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fea02166200, rc 0) 00000100:00100000:1.0:1783134896.517357:0:5763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9d286a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88a2002e-2ea7-4f07-912a-8d001832cfc0+13:5767:x1869752384381312:12345-0@lo:101: Request processed in 148us (477us total) trans 0 rc 0/0 00000100:00100000:1.0:1783134896.517364:0:5763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:2.0:1783134896.517584:0:5767:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9f6f72d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88a2002e-2ea7-4f07-912a-8d001832cfc0:5767:1869752384381312:0@lo:101: 00010000:00010000:2.0:1783134896.517598:0:5767:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.141@tcp lock: ffff9fe9c1523c00/0xd6c4b8f05867e5b2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd6c4b8f05867e5b9 expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134896.517606:0:5767:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.141@tcp lock: ffff9fe9c1523c00/0xd6c4b8f05867e5b2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd6c4b8f05867e5b9 expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783134896.517669:0:5767:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9f6f72d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88a2002e-2ea7-4f07-912a-8d001832cfc0:5767:1869752384381440:0@lo:501: 00000100:00100000:2.0:1783134896.517696:0:5767:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783134896.517723:0:5767:0:(client.c:2701:ptlrpc_set_wait()) set ffff9fe9ca791780 going to sleep for 11 seconds 00000100:00100000:3.0:1783134896.517773:0:5765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384381440 00000100:00100000:3.0:1783134896.517778:0:5765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384381440 00000100:00100000:3.0:1783134896.517811:0:5765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:3.0:1783134896.517819:0:5765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9d2868450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88a2002e-2ea7-4f07-912a-8d001832cfc0+13:5767:x1869752384381440:12345-0@lo:501: 00000100:00100000:3.0:1783134896.518103:0:5765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9d2868450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88a2002e-2ea7-4f07-912a-8d001832cfc0+13:5767:x1869752384381440:12345-0@lo:501: Request processed in 285us (406us total) trans 0 rc 0/0 00000100:00100000:3.0:1783134896.518110:0:5765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:2.0:1783134896.518783:0:5767:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9f6f72d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88a2002e-2ea7-4f07-912a-8d001832cfc0:5767:1869752384381440:0@lo:501: 00000100:00100000:2.0:1783134896.518818:0:5767:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9f6f72d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88a2002e-2ea7-4f07-912a-8d001832cfc0:5767:1869752384381568:0@lo:503: 00000100:00100000:2.0:1783134896.518861:0:5767:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783134896.518895:0:5767:0:(client.c:2701:ptlrpc_set_wait()) set ffff9fe9ca791780 going to sleep for 11 seconds 00000100:00100000:3.0:1783134896.519062:0:5762:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384381568 00000100:00100000:3.0:1783134896.519068:0:5762:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384381568 00000100:00100000:3.0:1783134896.519108:0:5762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:3.0:1783134896.519115:0:5762:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9d0e61050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88a2002e-2ea7-4f07-912a-8d001832cfc0+13:5767:x1869752384381568:12345-0@lo:503: 00000100:00100000:3.0:1783134896.519303:0:5762:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9d0e61050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88a2002e-2ea7-4f07-912a-8d001832cfc0+13:5767:x1869752384381568:12345-0@lo:503: Request processed in 163us (416us total) trans 0 rc 0/0 00000100:00100000:3.0:1783134896.519311:0:5762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:2.0:1783134896.519472:0:5767:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9f6f72d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88a2002e-2ea7-4f07-912a-8d001832cfc0:5767:1869752384381568:0@lo:503: 00000100:00100000:2.0:1783134896.519828:0:8286:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9f6f72d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:88a2002e-2ea7-4f07-912a-8d001832cfc0:8286:1869752384381696:0@lo:502: 00000100:00100000:2.0:1783134896.519865:0:8286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783134896.519895:0:8286:0:(client.c:2701:ptlrpc_set_wait()) set ffff9fe9ca791e40 going to sleep for 11 seconds 00000100:00100000:3.0:1783134896.521090:0:5762:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384381696 00000100:00100000:3.0:1783134896.521099:0:5762:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384381696 00000100:00100000:3.0:1783134896.521149:0:5762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:3.0:1783134896.521158:0:5762:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9d0e63850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88a2002e-2ea7-4f07-912a-8d001832cfc0+13:8286:x1869752384381696:12345-0@lo:502: 00000100:00100000:3.0:1783134896.521422:0:5762:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9d0e63850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88a2002e-2ea7-4f07-912a-8d001832cfc0+13:8286:x1869752384381696:12345-0@lo:502: Request processed in 264us (1554us total) trans 0 rc 0/0 00000100:00100000:3.0:1783134896.521429:0:5762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:2.0:1783134896.521573:0:8286:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9f6f72d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:88a2002e-2ea7-4f07-912a-8d001832cfc0:8286:1869752384381696:0@lo:502: 00000100:00100000:2.0:1783134896.521622:0:8286:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9f6f72d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:88a2002e-2ea7-4f07-912a-8d001832cfc0:8286:1869752384381824:0@lo:502: 00000100:00100000:2.0:1783134896.521658:0:8286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783134896.521693:0:8286:0:(client.c:2701:ptlrpc_set_wait()) set ffff9fe9ca791e40 going to sleep for 11 seconds 00000100:00100000:1.0:1783134896.521752:0:5763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384381824 00000100:00100000:1.0:1783134896.521757:0:5763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384381824 00000100:00100000:1.0:1783134896.521788:0:5763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:1.0:1783134896.521796:0:5763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9d0e61850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88a2002e-2ea7-4f07-912a-8d001832cfc0+13:8286:x1869752384381824:12345-0@lo:502: 00000100:00100000:1.0:1783134896.521943:0:5763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9d0e61850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88a2002e-2ea7-4f07-912a-8d001832cfc0+13:8286:x1869752384381824:12345-0@lo:502: Request processed in 147us (284us total) trans 0 rc 0/0 00000100:00100000:1.0:1783134896.521949:0:5763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:2.0:1783134896.522083:0:8286:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9f6f72d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:88a2002e-2ea7-4f07-912a-8d001832cfc0:8286:1869752384381824:0@lo:502: 00000040:00080000:2.0:1783134896.522101:0:8286:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:1.0:1783134896.524961:0:5767:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:1.0:1783134896.525012:0:5767:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.201.141@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1783134896.525025:0:5767:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.141@tcp lock: ffff9fe9c1523c00/0xd6c4b8f05867e5b2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd6c4b8f05867e5b9 expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134896.525038:0:5767:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.141@tcp lock: ffff9fe9c1523c00/0xd6c4b8f05867e5b2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd6c4b8f05867e5b9 expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783134896.525068:0:5767:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:1.0:1783134896.525071:0:5767:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 8 10000000:01000000:1.0:1783134896.525073:0:5767:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:1.0:1783134896.525110:0:5767:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.141@tcp lock: ffff9fea02166c00/0xd6c4b8f05867e5c0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134896.525119:0:5767:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.141@tcp lock: ffff9fea02166c00/0xd6c4b8f05867e5c0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134896.525129:0:5767:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.141@tcp lock: ffff9fea02166c00/0xd6c4b8f05867e5c0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783134896.525150:0:5767:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9f6731f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88a2002e-2ea7-4f07-912a-8d001832cfc0:5767:1869752384381952:0@lo:101: 00000100:00100000:1.0:1783134896.525215:0:5767:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783134896.525265:0:5767:0:(client.c:2701:ptlrpc_set_wait()) set ffff9fe9e9c69780 going to sleep for 11 seconds 00000100:00100000:0.0:1783134896.525391:0:5765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384381952 00000100:00100000:0.0:1783134896.525399:0:5765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384381952 00000100:00100000:0.0:1783134896.525449:0:5765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:0.0:1783134896.525458:0:5765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9d0e62850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88a2002e-2ea7-4f07-912a-8d001832cfc0+13:5767:x1869752384381952:12345-0@lo:101: 00010000:00010000:0.0:1783134896.525471:0:5765:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783134896.525490:0:5765:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fe9c0030c00/0xd6c4b8f05867e5c7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xd6c4b8f05867e5c0 expref: -99 pid: 5765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134896.525513:0:5765:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fe9c0030c00/0xd6c4b8f05867e5c7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd6c4b8f05867e5c0 expref: 14 pid: 5765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134896.525523:0:5765:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fe9c0030c00/0xd6c4b8f05867e5c7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd6c4b8f05867e5c0 expref: 14 pid: 5765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134896.525532:0:5765:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fe9c0030c00, rc 0) 00000100:00100000:0.0:1783134896.525579:0:5765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9d0e62850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88a2002e-2ea7-4f07-912a-8d001832cfc0+14:5767:x1869752384381952:12345-0@lo:101: Request processed in 123us (364us total) trans 0 rc 0/0 00000100:00100000:0.0:1783134896.525586:0:5765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:2.0:1783134896.525666:0:5767:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9f6731f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88a2002e-2ea7-4f07-912a-8d001832cfc0:5767:1869752384381952:0@lo:101: 00010000:00010000:2.0:1783134896.525681:0:5767:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.141@tcp lock: ffff9fea02166c00/0xd6c4b8f05867e5c0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd6c4b8f05867e5c7 expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134896.525689:0:5767:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.141@tcp lock: ffff9fea02166c00/0xd6c4b8f05867e5c0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xd6c4b8f05867e5c7 expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783134896.525751:0:5767:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9f6f72d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88a2002e-2ea7-4f07-912a-8d001832cfc0:5767:1869752384382080:0@lo:501: 00000100:00100000:2.0:1783134896.525777:0:5767:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783134896.525805:0:5767:0:(client.c:2701:ptlrpc_set_wait()) set ffff9fe9ca791e40 going to sleep for 11 seconds 00000100:00100000:3.0:1783134896.525859:0:5762:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384382080 00000100:00100000:3.0:1783134896.525864:0:5762:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384382080 00000100:00100000:3.0:1783134896.525885:0:5762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:3.0:1783134896.525891:0:5762:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9d0e62050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88a2002e-2ea7-4f07-912a-8d001832cfc0+14:5767:x1869752384382080:12345-0@lo:501: 00000100:00100000:3.0:1783134896.526174:0:5762:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9d0e62050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88a2002e-2ea7-4f07-912a-8d001832cfc0+14:5767:x1869752384382080:12345-0@lo:501: Request processed in 282us (395us total) trans 0 rc 0/0 00000100:00100000:3.0:1783134896.526181:0:5762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:2.0:1783134896.530011:0:5767:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9f6f72d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88a2002e-2ea7-4f07-912a-8d001832cfc0:5767:1869752384382080:0@lo:501: 00000100:00100000:2.0:1783134896.530071:0:5767:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9f6f72d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88a2002e-2ea7-4f07-912a-8d001832cfc0:5767:1869752384382208:0@lo:503: 00000100:00100000:2.0:1783134896.530140:0:5767:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783134896.530170:0:5767:0:(client.c:2701:ptlrpc_set_wait()) set ffff9fe9ca791e40 going to sleep for 11 seconds 00000100:00100000:0.0:1783134896.530239:0:5765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384382208 00000100:00100000:0.0:1783134896.530245:0:5765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384382208 00000100:00100000:0.0:1783134896.530311:0:5765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:0.0:1783134896.530319:0:5765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9d0e60450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88a2002e-2ea7-4f07-912a-8d001832cfc0+14:5767:x1869752384382208:12345-0@lo:503: 00000100:00100000:0.0:1783134896.530488:0:5765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9d0e60450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88a2002e-2ea7-4f07-912a-8d001832cfc0+14:5767:x1869752384382208:12345-0@lo:503: Request processed in 169us (347us total) trans 0 rc 0/0 00000100:00100000:0.0:1783134896.530495:0:5765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:2.0:1783134896.530706:0:5767:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9f6f72d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88a2002e-2ea7-4f07-912a-8d001832cfc0:5767:1869752384382208:0@lo:503: 00000100:00100000:0.0:1783134896.531073:0:8287:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9f5ce2a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:88a2002e-2ea7-4f07-912a-8d001832cfc0:8287:1869752384382336:0@lo:502: 00000100:00100000:0.0:1783134896.531106:0:8287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783134896.531131:0:8287:0:(client.c:2701:ptlrpc_set_wait()) set ffff9fe9ca2f3b40 going to sleep for 11 seconds 00000100:00100000:3.0:1783134896.531173:0:5765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384382336 00000100:00100000:3.0:1783134896.531177:0:5765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384382336 00000100:00100000:3.0:1783134896.531205:0:5765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:3.0:1783134896.531211:0:5765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9d0e62450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88a2002e-2ea7-4f07-912a-8d001832cfc0+14:8287:x1869752384382336:12345-0@lo:502: 00000100:00100000:3.0:1783134896.531362:0:5765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9d0e62450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88a2002e-2ea7-4f07-912a-8d001832cfc0+14:8287:x1869752384382336:12345-0@lo:502: Request processed in 150us (255us total) trans 0 rc 0/0 00000100:00100000:3.0:1783134896.531369:0:5765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:0.0:1783134896.531463:0:8287:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9f5ce2a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:88a2002e-2ea7-4f07-912a-8d001832cfc0:8287:1869752384382336:0@lo:502: 00000020:01000000:0.0:1783134896.531481:0:8287:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1783134896.531489:0:8287:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783134896.531491:0:8287:0:(obd_config.c:1561:class_process_config()) marker 24 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1783134896.531497:0:8287:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:0.0:1783134896.531514:0:8287:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9f5ce2a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:88a2002e-2ea7-4f07-912a-8d001832cfc0:8287:1869752384382464:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783134896.531542:0:8287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783134896.531565:0:8287:0:(client.c:2701:ptlrpc_set_wait()) set ffff9fe9ca2f3b40 going to sleep for 11 seconds 00000100:00100000:3.0:1783134896.531634:0:5762:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384382464 00000100:00100000:3.0:1783134896.531637:0:5762:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384382464 00000100:00100000:3.0:1783134896.531662:0:5762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:3.0:1783134896.531668:0:5762:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9d0e61450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88a2002e-2ea7-4f07-912a-8d001832cfc0+14:8287:x1869752384382464:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783134896.531768:0:5762:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9d0e61450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88a2002e-2ea7-4f07-912a-8d001832cfc0+14:8287:x1869752384382464:12345-0@lo:502:llog_process_th.0 Request processed in 99us (224us total) trans 0 rc 0/0 00000100:00100000:3.0:1783134896.531774:0:5762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:1.0:1783134896.531837:0:8287:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9f5ce2a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:88a2002e-2ea7-4f07-912a-8d001832cfc0:8287:1869752384382464:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1783134896.531853:0:8287:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1783134896.531857:0:8287:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783134896.531858:0:8287:0:(obd_config.c:1561:class_process_config()) marker 24 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1783134896.531862:0:8287:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000020:01000000:2.0:1783134896.531988:0:5767:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 8-10 (rc=0) 10000000:01000000:2.0:1783134896.532015:0:5767:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.201.141@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:2.0:1783134896.532025:0:5767:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.141@tcp lock: ffff9fea02166c00/0xd6c4b8f05867e5c0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd6c4b8f05867e5c7 expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134896.532034:0:5767:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.141@tcp lock: ffff9fea02166c00/0xd6c4b8f05867e5c0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd6c4b8f05867e5c7 expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783134896.532044:0:5767:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1783134896.532047:0:5767:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff9fea01d1b000 from 39 10000000:01000000:2.0:1783134896.532049:0:5767:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1783134896.532071:0:5767:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.141@tcp lock: ffff9fe9c1522400/0xd6c4b8f05867e5ce lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134896.532079:0:5767:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.141@tcp lock: ffff9fe9c1522400/0xd6c4b8f05867e5ce lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134896.532087:0:5767:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.141@tcp lock: ffff9fe9c1522400/0xd6c4b8f05867e5ce lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783134896.532108:0:5767:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9f6f72d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88a2002e-2ea7-4f07-912a-8d001832cfc0:5767:1869752384382592:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1783134896.532132:0:5767:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783134896.532155:0:5767:0:(client.c:2701:ptlrpc_set_wait()) set ffff9fe9ca791e40 going to sleep for 11 seconds 00000100:00100000:0.0:1783134896.532199:0:5765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384382592 00000100:00100000:0.0:1783134896.532203:0:5765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384382592 00000100:00100000:0.0:1783134896.532230:0:5765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:0.0:1783134896.532237:0:5765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9d0e60c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88a2002e-2ea7-4f07-912a-8d001832cfc0+14:5767:x1869752384382592:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783134896.532245:0:5765:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783134896.532256:0:5765:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fe9c0030800/0xd6c4b8f05867e5d5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xd6c4b8f05867e5ce expref: -99 pid: 5765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134896.532275:0:5765:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fe9c0030800/0xd6c4b8f05867e5d5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd6c4b8f05867e5ce expref: 15 pid: 5765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134896.532315:0:5765:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fe9c0030800/0xd6c4b8f05867e5d5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd6c4b8f05867e5ce expref: 15 pid: 5765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134896.532324:0:5765:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fe9c0030800, rc 0) 00000100:00100000:0.0:1783134896.532355:0:5765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9d0e60c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88a2002e-2ea7-4f07-912a-8d001832cfc0+15:5767:x1869752384382592:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 119us (221us total) trans 0 rc 0/0 00000100:00100000:0.0:1783134896.532360:0:5765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:2.0:1783134896.532440:0:5767:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9f6f72d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88a2002e-2ea7-4f07-912a-8d001832cfc0:5767:1869752384382592:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783134896.532451:0:5767:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.141@tcp lock: ffff9fe9c1522400/0xd6c4b8f05867e5ce lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd6c4b8f05867e5d5 expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134896.532459:0:5767:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.141@tcp lock: ffff9fe9c1522400/0xd6c4b8f05867e5ce lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xd6c4b8f05867e5d5 expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783134896.532497:0:5767:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9f6f72d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88a2002e-2ea7-4f07-912a-8d001832cfc0:5767:1869752384382720:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783134896.532521:0:5767:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783134896.532536:0:5767:0:(client.c:2701:ptlrpc_set_wait()) set ffff9fe9ca791e40 going to sleep for 11 seconds 00000100:00100000:1.0:1783134896.532588:0:5763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384382720 00000100:00100000:1.0:1783134896.532592:0:5763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384382720 00000100:00100000:1.0:1783134896.532610:0:5763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1783134896.532617:0:5763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9d1657450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88a2002e-2ea7-4f07-912a-8d001832cfc0+15:5767:x1869752384382720:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783134896.532842:0:5763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9d1657450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88a2002e-2ea7-4f07-912a-8d001832cfc0+15:5767:x1869752384382720:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 225us (320us total) trans 0 rc 0/0 00000100:00100000:1.0:1783134896.532850:0:5763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:2.0:1783134896.532918:0:5767:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9f6f72d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88a2002e-2ea7-4f07-912a-8d001832cfc0:5767:1869752384382720:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783134896.532943:0:5767:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9f6f72d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88a2002e-2ea7-4f07-912a-8d001832cfc0:5767:1869752384382848:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783134896.532974:0:5767:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783134896.533003:0:5767:0:(client.c:2701:ptlrpc_set_wait()) set ffff9fe9ca791e40 going to sleep for 11 seconds 00000100:00100000:0.0:1783134896.533050:0:5765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384382848 00000100:00100000:0.0:1783134896.533054:0:5765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384382848 00000100:00100000:0.0:1783134896.533068:0:5765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:0.0:1783134896.533074:0:5765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9d1654050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88a2002e-2ea7-4f07-912a-8d001832cfc0+15:5767:x1869752384382848:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783134896.533206:0:5765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9d1654050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88a2002e-2ea7-4f07-912a-8d001832cfc0+15:5767:x1869752384382848:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 132us (231us total) trans 0 rc 0/0 00000100:00100000:0.0:1783134896.533212:0:5765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:2.0:1783134896.533307:0:5767:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9f6f72d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88a2002e-2ea7-4f07-912a-8d001832cfc0:5767:1869752384382848:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783134896.533604:0:8288:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9f6731500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:88a2002e-2ea7-4f07-912a-8d001832cfc0:8288:1869752384382976:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783134896.533637:0:8288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783134896.533664:0:8288:0:(client.c:2701:ptlrpc_set_wait()) set ffff9fe9e9c69180 going to sleep for 11 seconds 00000100:00100000:3.0:1783134896.533714:0:5762:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384382976 00000100:00100000:3.0:1783134896.533718:0:5762:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384382976 00000100:00100000:3.0:1783134896.533747:0:5762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:3.0:1783134896.533754:0:5762:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9d1655050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88a2002e-2ea7-4f07-912a-8d001832cfc0+15:8288:x1869752384382976:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783134896.533914:0:5762:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9d1655050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88a2002e-2ea7-4f07-912a-8d001832cfc0+15:8288:x1869752384382976:12345-0@lo:502:llog_process_th.0 Request processed in 160us (277us total) trans 0 rc 0/0 00000100:00100000:3.0:1783134896.533920:0:5762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:2.0:1783134896.534004:0:8288:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9f6731500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:88a2002e-2ea7-4f07-912a-8d001832cfc0:8288:1869752384382976:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783134896.534041:0:8288:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9f6f72d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:88a2002e-2ea7-4f07-912a-8d001832cfc0:8288:1869752384383104:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783134896.534072:0:8288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783134896.534093:0:8288:0:(client.c:2701:ptlrpc_set_wait()) set ffff9fe9ca791e40 going to sleep for 11 seconds 00000100:00100000:0.0:1783134896.534303:0:5765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384383104 00000100:00100000:0.0:1783134896.534314:0:5765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384383104 00000100:00100000:0.0:1783134896.534332:0:5765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1783134896.534337:0:5765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9d1657850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88a2002e-2ea7-4f07-912a-8d001832cfc0+15:8288:x1869752384383104:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783134896.534468:0:5765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9d1657850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88a2002e-2ea7-4f07-912a-8d001832cfc0+15:8288:x1869752384383104:12345-0@lo:502:llog_process_th.0 Request processed in 129us (394us total) trans 0 rc 0/0 00000100:00100000:0.0:1783134896.534474:0:5765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:2.0:1783134896.534564:0:8288:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9f6f72d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:88a2002e-2ea7-4f07-912a-8d001832cfc0:8288:1869752384383104:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1783134896.534587:0:8288:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:0.0:1783134896.534841:0:5767:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:0.0:1783134896.534857:0:5767:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.201.141@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1783134896.534865:0:5767:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.141@tcp lock: ffff9fe9c1522400/0xd6c4b8f05867e5ce lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd6c4b8f05867e5d5 expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134896.534875:0:5767:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.141@tcp lock: ffff9fe9c1522400/0xd6c4b8f05867e5ce lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd6c4b8f05867e5d5 expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783134896.534884:0:5767:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:0.0:1783134896.534887:0:5767:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 11 10000000:01000000:0.0:1783134896.534890:0:5767:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:0.0:1783134896.534911:0:5767:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.141@tcp lock: ffff9fe9c0030200/0xd6c4b8f05867e5dc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134896.534918:0:5767:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.141@tcp lock: ffff9fe9c0030200/0xd6c4b8f05867e5dc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134896.534926:0:5767:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.141@tcp lock: ffff9fe9c0030200/0xd6c4b8f05867e5dc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783134896.534939:0:5767:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9f5ce1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88a2002e-2ea7-4f07-912a-8d001832cfc0:5767:1869752384383232:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1783134896.534967:0:5767:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783134896.535007:0:5767:0:(client.c:2701:ptlrpc_set_wait()) set ffff9fe9ca2f3780 going to sleep for 11 seconds 00000100:00100000:3.0:1783134896.538872:0:5765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384383232 00000100:00100000:3.0:1783134896.538886:0:5765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384383232 00000100:00100000:3.0:1783134896.538967:0:5765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:3.0:1783134896.538977:0:5765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9d1655850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88a2002e-2ea7-4f07-912a-8d001832cfc0+15:5767:x1869752384383232:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783134896.539007:0:5765:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783134896.539024:0:5765:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fe9d2b74a00/0xd6c4b8f05867e5e3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xd6c4b8f05867e5dc expref: -99 pid: 5765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134896.539051:0:5765:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fe9d2b74a00/0xd6c4b8f05867e5e3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd6c4b8f05867e5dc expref: 16 pid: 5765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134896.539061:0:5765:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fe9d2b74a00/0xd6c4b8f05867e5e3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd6c4b8f05867e5dc expref: 16 pid: 5765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134896.539069:0:5765:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fe9d2b74a00, rc 0) 00000100:00100000:3.0:1783134896.539150:0:5765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9d1655850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88a2002e-2ea7-4f07-912a-8d001832cfc0+16:5767:x1869752384383232:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 175us (4181us total) trans 0 rc 0/0 00000100:00100000:3.0:1783134896.539157:0:5765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:1.0:1783134896.539301:0:5767:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9f5ce1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88a2002e-2ea7-4f07-912a-8d001832cfc0:5767:1869752384383232:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783134896.539319:0:5767:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.141@tcp lock: ffff9fe9c0030200/0xd6c4b8f05867e5dc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xd6c4b8f05867e5e3 expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134896.539328:0:5767:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.141@tcp lock: ffff9fe9c0030200/0xd6c4b8f05867e5dc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xd6c4b8f05867e5e3 expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783134896.539392:0:5767:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9f6730700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88a2002e-2ea7-4f07-912a-8d001832cfc0:5767:1869752384383360:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783134896.539425:0:5767:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783134896.539454:0:5767:0:(client.c:2701:ptlrpc_set_wait()) set ffff9fe9e9c69900 going to sleep for 11 seconds 00000100:00100000:3.0:1783134896.539610:0:5763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384383360 00000100:00100000:3.0:1783134896.539614:0:5763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384383360 00000100:00100000:3.0:1783134896.539647:0:5763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:3.0:1783134896.539654:0:5763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9d1656850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88a2002e-2ea7-4f07-912a-8d001832cfc0+16:5767:x1869752384383360:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783134896.539919:0:5763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9d1656850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88a2002e-2ea7-4f07-912a-8d001832cfc0+16:5767:x1869752384383360:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 264us (493us total) trans 0 rc 0/0 00000100:00100000:3.0:1783134896.539926:0:5763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:1.0:1783134896.540010:0:5767:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9f6730700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88a2002e-2ea7-4f07-912a-8d001832cfc0:5767:1869752384383360:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783134896.540039:0:5767:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9f6730700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88a2002e-2ea7-4f07-912a-8d001832cfc0:5767:1869752384383488:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783134896.540078:0:5767:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783134896.540104:0:5767:0:(client.c:2701:ptlrpc_set_wait()) set ffff9fe9e9c69900 going to sleep for 11 seconds 00000100:00100000:0.0:1783134896.540160:0:5762:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384383488 00000100:00100000:0.0:1783134896.540164:0:5762:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384383488 00000100:00100000:0.0:1783134896.540197:0:5762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:0.0:1783134896.540204:0:5762:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9d1656050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88a2002e-2ea7-4f07-912a-8d001832cfc0+16:5767:x1869752384383488:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783134896.540372:0:5762:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9d1656050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88a2002e-2ea7-4f07-912a-8d001832cfc0+16:5767:x1869752384383488:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 168us (293us total) trans 0 rc 0/0 00000100:00100000:0.0:1783134896.540378:0:5762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:0.0:1783134896.540408:0:5767:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9f6730700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88a2002e-2ea7-4f07-912a-8d001832cfc0:5767:1869752384383488:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783134896.540563:0:8289:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9f5ce1c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:88a2002e-2ea7-4f07-912a-8d001832cfc0:8289:1869752384383616:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783134896.540596:0:8289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783134896.540612:0:5762:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384383616 00000100:00100000:0.0:1783134896.540615:0:5762:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384383616 00000100:00100000:0.0:1783134896.540632:0:5762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:0.0:1783134896.540637:0:5762:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9d1654450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88a2002e-2ea7-4f07-912a-8d001832cfc0+16:8289:x1869752384383616:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783134896.540766:0:5762:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9d1654450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88a2002e-2ea7-4f07-912a-8d001832cfc0+16:8289:x1869752384383616:12345-0@lo:502:llog_process_th.0 Request processed in 126us (168us total) trans 0 rc 0/0 00000100:00100000:0.0:1783134896.540773:0:5762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:0.0:1783134896.540798:0:8289:0:(client.c:2701:ptlrpc_set_wait()) set ffff9fe9ca2f3780 going to sleep for 11 seconds 00000100:00100000:0.0:1783134896.540810:0:8289:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9f5ce1c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:88a2002e-2ea7-4f07-912a-8d001832cfc0:8289:1869752384383616:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1783134896.540830:0:8289:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1783134896.540838:0:8289:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783134896.540840:0:8289:0:(obd_config.c:1561:class_process_config()) marker 26 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1783134896.540845:0:8289:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:0.0:1783134896.540864:0:8289:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9f5ce1c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:88a2002e-2ea7-4f07-912a-8d001832cfc0:8289:1869752384383744:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783134896.540894:0:8289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783134896.540912:0:5762:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384383744 00000100:00100000:0.0:1783134896.540921:0:5762:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384383744 00000100:00100000:0.0:1783134896.540937:0:5762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1783134896.540943:0:5762:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9d1656450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88a2002e-2ea7-4f07-912a-8d001832cfc0+16:8289:x1869752384383744:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783134896.541051:0:5762:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9d1656450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88a2002e-2ea7-4f07-912a-8d001832cfc0+16:8289:x1869752384383744:12345-0@lo:502:llog_process_th.0 Request processed in 108us (156us total) trans 0 rc 0/0 00000100:00100000:0.0:1783134896.541058:0:5762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1783134896.541083:0:8289:0:(client.c:2701:ptlrpc_set_wait()) set ffff9fe9ca290a80 going to sleep for 11 seconds 00000100:00100000:0.0:1783134896.541094:0:8289:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9f5ce1c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:88a2002e-2ea7-4f07-912a-8d001832cfc0:8289:1869752384383744:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1783134896.541110:0:8289:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1783134896.541114:0:8289:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783134896.541115:0:8289:0:(obd_config.c:1561:class_process_config()) marker 26 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1783134896.541118:0:8289:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 14 count 14 00000020:01000000:0.0:1783134896.541161:0:5767:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 11-13 (rc=0) 10000000:01000000:0.0:1783134896.541176:0:5767:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.201.141@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:0.0:1783134896.541183:0:5767:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.141@tcp lock: ffff9fe9c0030200/0xd6c4b8f05867e5dc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xd6c4b8f05867e5e3 expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134896.541191:0:5767:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.141@tcp lock: ffff9fe9c0030200/0xd6c4b8f05867e5dc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xd6c4b8f05867e5e3 expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783134896.541200:0:5767:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1783134896.541203:0:5767:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff9fe9e0d14800 from 39 10000000:01000000:0.0:1783134896.541205:0:5767:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1783134896.541224:0:5767:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.141@tcp lock: ffff9fe9c0031400/0xd6c4b8f05867e5ea lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134896.541230:0:5767:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.141@tcp lock: ffff9fe9c0031400/0xd6c4b8f05867e5ea lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134896.541239:0:5767:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.141@tcp lock: ffff9fe9c0031400/0xd6c4b8f05867e5ea lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783134896.541257:0:5767:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9f5ce1c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88a2002e-2ea7-4f07-912a-8d001832cfc0:5767:1869752384383872:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1783134896.541300:0:5767:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783134896.541314:0:5767:0:(client.c:2701:ptlrpc_set_wait()) set ffff9fe9ca290a80 going to sleep for 11 seconds 00000100:00100000:0.0:1783134896.541325:0:5762:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384383872 00000100:00100000:0.0:1783134896.541328:0:5762:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384383872 00000100:00100000:0.0:1783134896.541344:0:5762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1783134896.541350:0:5762:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9d1655450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88a2002e-2ea7-4f07-912a-8d001832cfc0+16:5767:x1869752384383872:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783134896.541356:0:5762:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783134896.541366:0:5762:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fe9c0030a00/0xd6c4b8f05867e5f1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xd6c4b8f05867e5ea expref: -99 pid: 5762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134896.541383:0:5762:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fe9c0030a00/0xd6c4b8f05867e5f1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd6c4b8f05867e5ea expref: 17 pid: 5762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134896.541393:0:5762:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fe9c0030a00/0xd6c4b8f05867e5f1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd6c4b8f05867e5ea expref: 17 pid: 5762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134896.541400:0:5762:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fe9c0030a00, rc 0) 00000100:00100000:0.0:1783134896.541426:0:5762:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9d1655450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88a2002e-2ea7-4f07-912a-8d001832cfc0+17:5767:x1869752384383872:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 76us (125us total) trans 0 rc 0/0 00000100:00100000:0.0:1783134896.541431:0:5762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1783134896.541454:0:5767:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9f5ce1c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88a2002e-2ea7-4f07-912a-8d001832cfc0:5767:1869752384383872:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783134896.541464:0:5767:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.141@tcp lock: ffff9fe9c0031400/0xd6c4b8f05867e5ea lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xd6c4b8f05867e5f1 expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134896.541471:0:5767:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.141@tcp lock: ffff9fe9c0031400/0xd6c4b8f05867e5ea lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xd6c4b8f05867e5f1 expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783134896.541511:0:5767:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9f5ce1c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88a2002e-2ea7-4f07-912a-8d001832cfc0:5767:1869752384384000:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783134896.541534:0:5767:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783134896.541547:0:5767:0:(client.c:2701:ptlrpc_set_wait()) set ffff9fe9ca290a80 going to sleep for 11 seconds 00000100:00100000:0.0:1783134896.541556:0:5762:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384384000 00000100:00100000:0.0:1783134896.541559:0:5762:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384384000 00000100:00100000:0.0:1783134896.541575:0:5762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1783134896.541581:0:5762:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9d1654c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88a2002e-2ea7-4f07-912a-8d001832cfc0+17:5767:x1869752384384000:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783134896.541735:0:5762:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9d1654c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88a2002e-2ea7-4f07-912a-8d001832cfc0+17:5767:x1869752384384000:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 153us (199us total) trans 0 rc 0/0 00000100:00100000:0.0:1783134896.541741:0:5762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1783134896.541767:0:5767:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9f5ce1c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88a2002e-2ea7-4f07-912a-8d001832cfc0:5767:1869752384384000:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783134896.541786:0:5767:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9f5ce1c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88a2002e-2ea7-4f07-912a-8d001832cfc0:5767:1869752384384128:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783134896.541813:0:5767:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783134896.541823:0:5767:0:(client.c:2701:ptlrpc_set_wait()) set ffff9fe9fe46c480 going to sleep for 11 seconds 00000100:00100000:0.0:1783134896.541832:0:5762:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384384128 00000100:00100000:0.0:1783134896.541835:0:5762:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384384128 00000100:00100000:0.0:1783134896.541848:0:5762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:0.0:1783134896.541852:0:5762:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9d1654850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88a2002e-2ea7-4f07-912a-8d001832cfc0+17:5767:x1869752384384128:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783134896.541959:0:5762:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9d1654850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88a2002e-2ea7-4f07-912a-8d001832cfc0+17:5767:x1869752384384128:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 105us (144us total) trans 0 rc 0/0 00000100:00100000:0.0:1783134896.541965:0:5762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:0.0:1783134896.542011:0:5767:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9f5ce1c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88a2002e-2ea7-4f07-912a-8d001832cfc0:5767:1869752384384128:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783134896.542237:0:8290:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9f5ce1c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:88a2002e-2ea7-4f07-912a-8d001832cfc0:8290:1869752384384256:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783134896.542270:0:8290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783134896.542378:0:5765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384384256 00000100:00100000:1.0:1783134896.542381:0:5765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384384256 00000100:00100000:1.0:1783134896.542399:0:5765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1783134896.542405:0:5765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9d1657050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88a2002e-2ea7-4f07-912a-8d001832cfc0+17:8290:x1869752384384256:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783134896.542972:0:5765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9d1657050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88a2002e-2ea7-4f07-912a-8d001832cfc0+17:8290:x1869752384384256:12345-0@lo:502:llog_process_th.0 Request processed in 565us (700us total) trans 0 rc 0/0 00000100:00100000:1.0:1783134896.543033:0:5765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1783134896.543101:0:8290:0:(client.c:2701:ptlrpc_set_wait()) set ffff9fe9f615c840 going to sleep for 11 seconds 00000100:00100000:0.0:1783134896.543115:0:8290:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9f5ce1c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:88a2002e-2ea7-4f07-912a-8d001832cfc0:8290:1869752384384256:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783134896.543153:0:8290:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9f5ce1c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:88a2002e-2ea7-4f07-912a-8d001832cfc0:8290:1869752384384384:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783134896.543183:0:8290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783134896.543241:0:8290:0:(client.c:2701:ptlrpc_set_wait()) set ffff9fe9f615c840 going to sleep for 11 seconds 00000100:00100000:3.0:1783134896.544131:0:5763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384384384 00000100:00100000:3.0:1783134896.544139:0:5763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384384384 00000100:00100000:3.0:1783134896.544182:0:5763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1783134896.544191:0:5763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9d1657c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88a2002e-2ea7-4f07-912a-8d001832cfc0+17:8290:x1869752384384384:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783134896.544555:0:5763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9d1657c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88a2002e-2ea7-4f07-912a-8d001832cfc0+17:8290:x1869752384384384:12345-0@lo:502:llog_process_th.0 Request processed in 364us (1370us total) trans 0 rc 0/0 00000100:00100000:3.0:1783134896.544569:0:5763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:0.0:1783134896.549452:0:8290:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9f5ce1c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:88a2002e-2ea7-4f07-912a-8d001832cfc0:8290:1869752384384384:0@lo:502:llog_process_th.0 00000040:00080000:0.0:1783134896.549506:0:8290:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:1.0:1783134896.551648:0:5767:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:1.0:1783134896.551681:0:5767:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.201.141@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1783134896.551708:0:5767:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.141@tcp lock: ffff9fe9c0031400/0xd6c4b8f05867e5ea lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xd6c4b8f05867e5f1 expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134896.551720:0:5767:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.141@tcp lock: ffff9fe9c0031400/0xd6c4b8f05867e5ea lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xd6c4b8f05867e5f1 expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783134896.551731:0:5767:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:1.0:1783134896.551733:0:5767:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 34 10000000:01000000:1.0:1783134896.551736:0:5767:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1783134896.551771:0:5767:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.141@tcp lock: ffff9fea02167800/0xd6c4b8f05867e5f8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134896.551780:0:5767:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.141@tcp lock: ffff9fea02167800/0xd6c4b8f05867e5f8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134896.551790:0:5767:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.141@tcp lock: ffff9fea02167800/0xd6c4b8f05867e5f8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783134896.551815:0:5767:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9f6733b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88a2002e-2ea7-4f07-912a-8d001832cfc0:5767:1869752384384512:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1783134896.551884:0:5767:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783134896.551933:0:5767:0:(client.c:2701:ptlrpc_set_wait()) set ffff9fe9e9c69840 going to sleep for 11 seconds 00000100:00100000:2.0:1783134896.552042:0:5762:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384384512 00000100:00100000:2.0:1783134896.552049:0:5762:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384384512 00000100:00100000:2.0:1783134896.552096:0:5762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:2.0:1783134896.552105:0:5762:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9d1655c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88a2002e-2ea7-4f07-912a-8d001832cfc0+17:5767:x1869752384384512:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783134896.552118:0:5762:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783134896.552132:0:5762:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fe9c1522000/0xd6c4b8f05867e5ff lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xd6c4b8f05867e5f8 expref: -99 pid: 5762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134896.552155:0:5762:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fe9c1522000/0xd6c4b8f05867e5ff lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd6c4b8f05867e5f8 expref: 18 pid: 5762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134896.552166:0:5762:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fe9c1522000/0xd6c4b8f05867e5ff lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd6c4b8f05867e5f8 expref: 18 pid: 5762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134896.552175:0:5762:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fe9c1522000, rc 0) 00000100:00100000:2.0:1783134896.552212:0:5762:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9d1655c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88a2002e-2ea7-4f07-912a-8d001832cfc0+18:5767:x1869752384384512:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 108us (327us total) trans 0 rc 0/0 00000100:00100000:2.0:1783134896.552217:0:5762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1783134896.552329:0:5767:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9f6733b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88a2002e-2ea7-4f07-912a-8d001832cfc0:5767:1869752384384512:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783134896.552343:0:5767:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.141@tcp lock: ffff9fea02167800/0xd6c4b8f05867e5f8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xd6c4b8f05867e5ff expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134896.552352:0:5767:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.141@tcp lock: ffff9fea02167800/0xd6c4b8f05867e5f8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xd6c4b8f05867e5ff expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783134896.552400:0:5767:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9cb33b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88a2002e-2ea7-4f07-912a-8d001832cfc0:5767:1869752384384640:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783134896.552426:0:5767:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783134896.552447:0:5767:0:(client.c:2701:ptlrpc_set_wait()) set ffff9fe8c55ea6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783134896.552458:0:5763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384384640 00000100:00100000:3.0:1783134896.552461:0:5763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384384640 00000100:00100000:3.0:1783134896.552476:0:5763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1783134896.552480:0:5763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9d1656c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88a2002e-2ea7-4f07-912a-8d001832cfc0+18:5767:x1869752384384640:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783134896.552699:0:5763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9d1656c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88a2002e-2ea7-4f07-912a-8d001832cfc0+18:5767:x1869752384384640:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 218us (272us total) trans 0 rc 0/0 00000100:00100000:3.0:1783134896.552704:0:5763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1783134896.552724:0:5767:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9cb33b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88a2002e-2ea7-4f07-912a-8d001832cfc0:5767:1869752384384640:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783134896.552743:0:5767:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9cb33b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88a2002e-2ea7-4f07-912a-8d001832cfc0:5767:1869752384384768:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783134896.552769:0:5767:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783134896.552778:0:5767:0:(client.c:2701:ptlrpc_set_wait()) set ffff9fe8c55ea6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783134896.552785:0:5763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384384768 00000100:00100000:3.0:1783134896.552787:0:5763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384384768 00000100:00100000:3.0:1783134896.552798:0:5763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1783134896.552806:0:5763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9ea689c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88a2002e-2ea7-4f07-912a-8d001832cfc0+18:5767:x1869752384384768:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783134896.552901:0:5763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9ea689c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88a2002e-2ea7-4f07-912a-8d001832cfc0+18:5767:x1869752384384768:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 94us (130us total) trans 0 rc 0/0 00000100:00100000:3.0:1783134896.552905:0:5763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1783134896.552928:0:5767:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9cb33b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88a2002e-2ea7-4f07-912a-8d001832cfc0:5767:1869752384384768:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783134896.553852:0:8291:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9cb33b100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:88a2002e-2ea7-4f07-912a-8d001832cfc0:8291:1869752384384896:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783134896.553884:0:8291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783134896.553903:0:8291:0:(client.c:2701:ptlrpc_set_wait()) set ffff9fe8c55eae40 going to sleep for 11 seconds 00000100:00100000:1.0:1783134896.553934:0:5763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384384896 00000100:00100000:1.0:1783134896.553938:0:5763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384384896 00000100:00100000:1.0:1783134896.553961:0:5763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:1.0:1783134896.553966:0:5763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9ea68ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88a2002e-2ea7-4f07-912a-8d001832cfc0+18:8291:x1869752384384896:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783134896.554113:0:5763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9ea68ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88a2002e-2ea7-4f07-912a-8d001832cfc0+18:8291:x1869752384384896:12345-0@lo:502:llog_process_th.0 Request processed in 147us (227us total) trans 0 rc 0/0 00000100:00100000:1.0:1783134896.554118:0:5763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1783134896.554199:0:8291:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9cb33b100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:88a2002e-2ea7-4f07-912a-8d001832cfc0:8291:1869752384384896:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1783134896.554214:0:8291:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1783134896.554221:0:8291:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783134896.554222:0:8291:0:(obd_config.c:1561:class_process_config()) marker 25 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1783134896.554226:0:8291:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:3.0:1783134896.554239:0:8291:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9cb33b100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:88a2002e-2ea7-4f07-912a-8d001832cfc0:8291:1869752384385024:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783134896.554260:0:8291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783134896.554276:0:8291:0:(client.c:2701:ptlrpc_set_wait()) set ffff9fe8c55eae40 going to sleep for 11 seconds 00000100:00100000:2.0:1783134896.554604:0:5762:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384385024 00000100:00100000:2.0:1783134896.554609:0:5762:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384385024 00000100:00100000:2.0:1783134896.554639:0:5762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1783134896.554646:0:5762:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9d1651450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88a2002e-2ea7-4f07-912a-8d001832cfc0+18:8291:x1869752384385024:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783134896.554751:0:5762:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9d1651450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88a2002e-2ea7-4f07-912a-8d001832cfc0+18:8291:x1869752384385024:12345-0@lo:502:llog_process_th.0 Request processed in 105us (489us total) trans 0 rc 0/0 00000100:00100000:2.0:1783134896.554755:0:5762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1783134896.555023:0:8291:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9cb33b100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:88a2002e-2ea7-4f07-912a-8d001832cfc0:8291:1869752384385024:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1783134896.555041:0:8291:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1783134896.555046:0:8291:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783134896.555048:0:8291:0:(obd_config.c:1561:class_process_config()) marker 25 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1783134896.555052:0:8291:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:1.0:1783134896.555171:0:5767:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 34-36 (rc=0) 10000000:01000000:1.0:1783134896.555190:0:5767:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.201.141@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1783134896.555197:0:5767:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.141@tcp lock: ffff9fea02167800/0xd6c4b8f05867e5f8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xd6c4b8f05867e5ff expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134896.555203:0:5767:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.141@tcp lock: ffff9fea02167800/0xd6c4b8f05867e5f8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xd6c4b8f05867e5ff expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783134896.555209:0:5767:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:1.0:1783134896.555211:0:5767:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-sptlrpc-ffff9fe9d13819c0 from 1 10000000:01000000:1.0:1783134896.555213:0:5767:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1783134896.555230:0:5767:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.141@tcp lock: ffff9fea02166400/0xd6c4b8f05867e606 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134896.555235:0:5767:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.141@tcp lock: ffff9fea02166400/0xd6c4b8f05867e606 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134896.555240:0:5767:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.141@tcp lock: ffff9fea02166400/0xd6c4b8f05867e606 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783134896.555249:0:5767:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9f6733800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88a2002e-2ea7-4f07-912a-8d001832cfc0:5767:1869752384385152:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1783134896.555268:0:5767:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783134896.555322:0:5767:0:(client.c:2701:ptlrpc_set_wait()) set ffff9fe9e9c69cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1783134896.555468:0:5762:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384385152 00000100:00100000:2.0:1783134896.555472:0:5762:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384385152 00000100:00100000:2.0:1783134896.555497:0:5762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1783134896.555501:0:5762:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9d1650c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88a2002e-2ea7-4f07-912a-8d001832cfc0+18:5767:x1869752384385152:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783134896.555507:0:5762:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783134896.555524:0:5762:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fe9c1523200/0xd6c4b8f05867e60d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xd6c4b8f05867e606 expref: -99 pid: 5762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134896.555544:0:5762:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fe9c1523200/0xd6c4b8f05867e60d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd6c4b8f05867e606 expref: 19 pid: 5762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134896.555554:0:5762:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fe9c1523200/0xd6c4b8f05867e60d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd6c4b8f05867e606 expref: 19 pid: 5762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134896.555562:0:5762:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fe9c1523200, rc 0) 00000100:00100000:2.0:1783134896.555589:0:5762:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9d1650c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88a2002e-2ea7-4f07-912a-8d001832cfc0+19:5767:x1869752384385152:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 87us (319us total) trans 0 rc 0/0 00000100:00100000:2.0:1783134896.555595:0:5762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1783134896.555660:0:5767:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9f6733800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88a2002e-2ea7-4f07-912a-8d001832cfc0:5767:1869752384385152:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783134896.555672:0:5767:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.141@tcp lock: ffff9fea02166400/0xd6c4b8f05867e606 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xd6c4b8f05867e60d expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134896.555679:0:5767:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.141@tcp lock: ffff9fea02166400/0xd6c4b8f05867e606 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xd6c4b8f05867e60d expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783134896.555716:0:5767:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9cb338e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88a2002e-2ea7-4f07-912a-8d001832cfc0:5767:1869752384385280:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783134896.555738:0:5767:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783134896.555773:0:5767:0:(client.c:2701:ptlrpc_set_wait()) set ffff9fe8c55ea000 going to sleep for 11 seconds 00000100:00100000:0.0:1783134896.555810:0:5765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384385280 00000100:00100000:0.0:1783134896.555813:0:5765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384385280 00000100:00100000:0.0:1783134896.555836:0:5765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1783134896.555840:0:5765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9d1650850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88a2002e-2ea7-4f07-912a-8d001832cfc0+19:5767:x1869752384385280:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783134896.556035:0:5765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9d1650850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88a2002e-2ea7-4f07-912a-8d001832cfc0+19:5767:x1869752384385280:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 193us (295us total) trans 0 rc -2/-2 00000100:00100000:0.0:1783134896.556041:0:5765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1783134896.556110:0:5767:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9cb338e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88a2002e-2ea7-4f07-912a-8d001832cfc0:5767:1869752384385280:0@lo:501:ll_cfg_requeue.0 10000000:01000000:3.0:1783134896.556127:0:5767:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.201.141@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1783134896.556132:0:5767:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.141@tcp lock: ffff9fea02166400/0xd6c4b8f05867e606 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xd6c4b8f05867e60d expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134896.556139:0:5767:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.141@tcp lock: ffff9fea02166400/0xd6c4b8f05867e606 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xd6c4b8f05867e60d expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783134897.000371:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:0.0:1783134897.000410:0:5765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373874944 00000100:00100000:0.0:1783134897.000419:0:5765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373874944 00000100:00100000:0.0:1783134897.000476:0:5765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 158 00000100:00100000:0.0:1783134897.000487:0:5765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9d1653050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f39b22bc-4faf-4b59-bb00-2a11f91e37c0+8:5575:x1869752373874944:12345-192.168.201.41@tcp:101: 00010000:00010000:0.0:1783134897.000514:0:5765:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783134897.000544:0:5765:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fe9c148b800/0xd6c4b8f05867e614 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x4428da03f5eb70cf expref: -99 pid: 5765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134897.000572:0:5765:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fe9c148b800/0xd6c4b8f05867e614 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb70cf expref: 9 pid: 5765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134897.000585:0:5765:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fe9c148b800/0xd6c4b8f05867e614 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb70cf expref: 9 pid: 5765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134897.000594:0:5765:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fe9c148b800, rc 0) 00000100:00100000:0.0:1783134897.000662:0:5765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9d1653050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f39b22bc-4faf-4b59-bb00-2a11f91e37c0+9:5575:x1869752373874944:12345-192.168.201.41@tcp:101: Request processed in 176us (299us total) trans 0 rc 0/0 00000100:00100000:0.0:1783134897.000669:0:5765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 158 00000100:00100000:2.0:1783134897.002267:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:0.0:1783134897.004529:0:5762:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373875072 00000100:00100000:0.0:1783134897.004541:0:5762:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373875072 00000100:00100000:0.0:1783134897.004610:0:5762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 159 00000100:00100000:0.0:1783134897.004621:0:5762:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9d1653c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f39b22bc-4faf-4b59-bb00-2a11f91e37c0+9:5575:x1869752373875072:12345-192.168.201.41@tcp:501: 00000100:00100000:0.0:1783134897.004925:0:5762:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9d1653c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f39b22bc-4faf-4b59-bb00-2a11f91e37c0+9:5575:x1869752373875072:12345-192.168.201.41@tcp:501: Request processed in 305us (2661us total) trans 0 rc 0/0 00000100:00100000:0.0:1783134897.004933:0:5762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 159 00000100:00100000:2.0:1783134897.014247:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:0.0:1783134897.014354:0:5765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373875200 00000100:00100000:0.0:1783134897.014364:0:5765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373875200 00000100:00100000:0.0:1783134897.014417:0:5765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 160 00000100:00100000:0.0:1783134897.014425:0:5765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9d1651c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f39b22bc-4faf-4b59-bb00-2a11f91e37c0+9:5575:x1869752373875200:12345-192.168.201.41@tcp:503: 00000100:00100000:0.0:1783134897.014640:0:5765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9d1651c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f39b22bc-4faf-4b59-bb00-2a11f91e37c0+9:5575:x1869752373875200:12345-192.168.201.41@tcp:503: Request processed in 215us (403us total) trans 0 rc 0/0 00000100:00100000:0.0:1783134897.014645:0:5765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 160 00000100:00100000:3.0:1783134897.019751:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:1.0:1783134897.020077:0:5763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373875328 00000100:00100000:1.0:1783134897.020099:0:5763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373875328 00000100:00100000:1.0:1783134897.020223:0:5763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 161 00000100:00100000:1.0:1783134897.020242:0:5763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9d1652c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f39b22bc-4faf-4b59-bb00-2a11f91e37c0+9:6049:x1869752373875328:12345-192.168.201.41@tcp:502: 00000100:00100000:1.0:1783134897.020549:0:5763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9d1652c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f39b22bc-4faf-4b59-bb00-2a11f91e37c0+9:6049:x1869752373875328:12345-192.168.201.41@tcp:502: Request processed in 309us (806us total) trans 0 rc 0/0 00000100:00100000:1.0:1783134897.020557:0:5763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 161 00000100:00100000:3.0:1783134897.022515:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:2.0:1783134897.022607:0:5762:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373875456 00000100:00100000:2.0:1783134897.022615:0:5762:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373875456 00000100:00100000:2.0:1783134897.022693:0:5762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 162 00000100:00100000:2.0:1783134897.022703:0:5762:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9d1653450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f39b22bc-4faf-4b59-bb00-2a11f91e37c0+9:6049:x1869752373875456:12345-192.168.201.41@tcp:502:llog_process_th.0 00000100:00100000:2.0:1783134897.022932:0:5762:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9d1653450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f39b22bc-4faf-4b59-bb00-2a11f91e37c0+9:6049:x1869752373875456:12345-192.168.201.41@tcp:502:llog_process_th.0 Request processed in 229us (421us total) trans 0 rc 0/0 00000100:00100000:2.0:1783134897.022939:0:5762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 162 00000100:00100000:2.0:1783134897.025901:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:1.0:1783134897.026198:0:5763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373875584 00000100:00100000:1.0:1783134897.026206:0:5763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373875584 00000100:00100000:1.0:1783134897.026255:0:5763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 163 00000100:00100000:1.0:1783134897.026263:0:5763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9d1650050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f39b22bc-4faf-4b59-bb00-2a11f91e37c0+9:5575:x1869752373875584:12345-192.168.201.41@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783134897.026306:0:5763:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783134897.026425:0:5763:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fea02166800/0xd6c4b8f05867e61b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x4428da03f5eb70d6 expref: -99 pid: 5763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134897.026451:0:5763:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fea02166800/0xd6c4b8f05867e61b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb70d6 expref: 10 pid: 5763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134897.026463:0:5763:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fea02166800/0xd6c4b8f05867e61b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb70d6 expref: 10 pid: 5763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134897.026472:0:5763:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fea02166800, rc 0) 00000100:00100000:1.0:1783134897.026600:0:5763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9d1650050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f39b22bc-4faf-4b59-bb00-2a11f91e37c0+10:5575:x1869752373875584:12345-192.168.201.41@tcp:101:ll_cfg_requeue.0 Request processed in 337us (705us total) trans 0 rc 0/0 00000100:00100000:1.0:1783134897.026607:0:5763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 163 00000100:00100000:3.0:1783134897.028793:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:2.0:1783134897.028935:0:5762:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373875712 00000100:00100000:2.0:1783134897.028943:0:5762:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373875712 00000100:00100000:2.0:1783134897.029014:0:5762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 164 00000100:00100000:2.0:1783134897.029022:0:5762:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9d1651050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f39b22bc-4faf-4b59-bb00-2a11f91e37c0+10:5575:x1869752373875712:12345-192.168.201.41@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783134897.029277:0:5762:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9d1651050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f39b22bc-4faf-4b59-bb00-2a11f91e37c0+10:5575:x1869752373875712:12345-192.168.201.41@tcp:501:ll_cfg_requeue.0 Request processed in 248us (481us total) trans 0 rc -2/-2 00000100:00100000:2.0:1783134897.029882:0:5762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 164 00010000:00010000:0.0:1783134897.411470:0:5757:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1783134898.033844:0:8328:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe5e69c0d0 20000000:00000080:1.0:1783134898.033923:0:8328:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9fe9f6ff2000 uarg=0000000000000000 20000000:01000000:1.0:1783134898.033959:0:8328:0:(mgs_llog.c:6177:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:1.0:1783134898.033965:0:8328:0:(mgs_llog.c:4638:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:1.0:1783134898.033981:0:8328:0:(mgs_llog.c:1376:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:2.0:1783134898.037736:0:8329:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 20000000:02000000:1.0:1783134898.037890:0:8328:0:(mgs_llog.c:4111:mgs_wlp_lcfg()) Setting parameter general.lod.*.mdt_hash=crush in log params 00000040:00080000:1.0:1783134898.041709:0:8328:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8976 00000040:00080000:1.0:1783134898.041759:0:8328:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 112 off9088 00000040:00080000:1.0:1783134898.041804:0:8328:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 224 off9312 10000000:01000000:1.0:1783134898.041820:0:8328:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1783134898.041838:0:8328:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9fea02167600/0xd6c4b8f05867e622 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134898.042048:0:8328:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9fea02166e00/0xd6c4b8f05867e397 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd6c4b8f05867e390 expref: 18 pid: 5765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134898.042059:0:8328:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9fe9d2b74800/0xd6c4b8f05867e3f9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd6c4b8f05867e3f2 expref: 18 pid: 5763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134898.042067:0:8328:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9fe9c0030000/0xd6c4b8f05867e4c4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd6c4b8f05867e4bd expref: 18 pid: 5762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134898.042076:0:8328:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9fea02167c00/0xd6c4b8f05867e581 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb709e expref: 9 pid: 5763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134898.042084:0:8328:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9fea02167600/0xd6c4b8f05867e622 lrc: 7/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134898.042120:0:8328:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9fea02167c00/0xd6c4b8f05867e581 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb709e expref: 9 pid: 5763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134898.042135:0:8328:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9fea02167c00/0xd6c4b8f05867e581 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb709e expref: 9 pid: 5763 timeout: 280 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783134898.042150:0:8328:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9f6732300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8328:1869752384385408:192.168.201.41@tcp:104: 00010000:00010000:1.0:1783134898.042251:0:8328:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9fe9c0030000/0xd6c4b8f05867e4c4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd6c4b8f05867e4bd expref: 18 pid: 5762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134898.042259:0:8328:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9fe9c0030000/0xd6c4b8f05867e4c4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd6c4b8f05867e4bd expref: 18 pid: 5762 timeout: 330 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783134898.042268:0:8328:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9f6733100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8328:1869752384385536:0@lo:104: 00000100:00100000:1.0:1783134898.042339:0:8328:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1783134898.042365:0:8328:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9fe9d2b74800/0xd6c4b8f05867e3f9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd6c4b8f05867e3f2 expref: 18 pid: 5763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134898.042372:0:8328:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9fe9d2b74800/0xd6c4b8f05867e3f9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd6c4b8f05867e3f2 expref: 18 pid: 5763 timeout: 330 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783134898.042381:0:8328:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9f6731180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8328:1869752384385664:0@lo:104: 00000100:00100000:1.0:1783134898.042398:0:8328:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783134898.042436:0:6590:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1783134898.042447:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384385536 00000100:00100000:1.0:1783134898.042452:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384385536 00000100:00100000:1.0:1783134898.042487:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384385664 00000100:00100000:1.0:1783134898.042489:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384385664 00000100:00100000:1.0:1783134898.042500:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1783134898.042508:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9f6731880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:88a2002e-2ea7-4f07-912a-8d001832cfc0+4:8328:x1869752384385536:12345-0@lo:104: 00010000:00010000:1.0:1783134898.042519:0:6590:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.141@tcp lock: ffff9fe9d2b74000/0xd6c4b8f05867e4bd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xd6c4b8f05867e4c4 expref: -99 pid: 7455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134898.042556:0:6590:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1783134898.042561:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9f6731880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:88a2002e-2ea7-4f07-912a-8d001832cfc0+4:8328:x1869752384385536:12345-0@lo:104: Request processed in 54us (223us total) trans 0 rc 0/0 00000100:00100000:1.0:1783134898.042568:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1783134898.042581:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1783134898.042586:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fe46ac50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:88a2002e-2ea7-4f07-912a-8d001832cfc0+3:8328:x1869752384385664:12345-0@lo:104: 00010000:00010000:1.0:1783134898.042592:0:6590:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.141@tcp lock: ffff9fe9c0031600/0xd6c4b8f05867e3f2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xd6c4b8f05867e3f9 expref: -99 pid: 6572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134898.042614:0:6590:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1783134898.042624:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fe46ac50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:88a2002e-2ea7-4f07-912a-8d001832cfc0+3:8328:x1869752384385664:12345-0@lo:104: Request processed in 38us (224us total) trans 0 rc 0/0 00000100:00100000:1.0:1783134898.042629:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00010000:1.0:1783134898.042676:0:8328:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9fea02166e00/0xd6c4b8f05867e397 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd6c4b8f05867e390 expref: 18 pid: 5765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134898.042685:0:8328:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9fea02166e00/0xd6c4b8f05867e397 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd6c4b8f05867e390 expref: 18 pid: 5765 timeout: 330 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783134898.042693:0:8328:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9f6731880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8328:1869752384385792:0@lo:104: 00000100:00100000:1.0:1783134898.042718:0:8328:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783134898.042733:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384385792 00000100:00100000:1.0:1783134898.042736:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384385792 00000100:00100000:1.0:1783134898.042749:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1783134898.042754:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9f6732680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:88a2002e-2ea7-4f07-912a-8d001832cfc0+3:8328:x1869752384385792:12345-0@lo:104: 00010000:00010000:1.0:1783134898.042761:0:6590:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.141@tcp lock: ffff9fe9c0030400/0xd6c4b8f05867e390 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xd6c4b8f05867e397 expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134898.042784:0:6590:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1783134898.042789:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9f6732680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:88a2002e-2ea7-4f07-912a-8d001832cfc0+3:8328:x1869752384385792:12345-0@lo:104: Request processed in 35us (71us total) trans 0 rc 0/0 00000100:00100000:1.0:1783134898.042794:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1783134898.042809:0:8328:0:(client.c:2701:ptlrpc_set_wait()) set ffff9fe9e9c69180 going to sleep for 11 seconds 00000100:00100000:1.0:1783134898.042828:0:8328:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9f6733100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8328:1869752384385536:0@lo:104: 00000100:00100000:1.0:1783134898.042835:0:8328:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9f6731180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8328:1869752384385664:0@lo:104: 00000100:00100000:1.0:1783134898.042841:0:8328:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9f6731880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8328:1869752384385792:0@lo:104: 00010000:00010000:0.0:1783134898.044448:0:6591:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1783134898.044457:0:6591:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.141@tcp lock: ffff9fe9d2b74000/0xd6c4b8f05867e4bd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xd6c4b8f05867e4c4 expref: -99 pid: 7455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134898.044467:0:6591:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe9d2b74000 already unused, calling callback (ffffffffc1b40c20) 10000000:00010000:0.0:1783134898.044471:0:6591:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.141@tcp lock: ffff9fe9d2b74000/0xd6c4b8f05867e4bd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xd6c4b8f05867e4c4 expref: -99 pid: 7455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134898.044481:0:6591:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.141@tcp lock: ffff9fe9d2b74000/0xd6c4b8f05867e4bd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xd6c4b8f05867e4c4 expref: -99 pid: 7455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1783134898.044489:0:6591:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.141@tcp lock: ffff9fe9d2b74000/0xd6c4b8f05867e4bd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xd6c4b8f05867e4c4 expref: -99 pid: 7455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783134898.044495:0:6591:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1783134898.044531:0:6591:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.141@tcp lock: ffff9fe9d2b74000/0xd6c4b8f05867e4bd lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd6c4b8f05867e4c4 expref: -99 pid: 7455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134898.044537:0:6591:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1783134898.044556:0:6591:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.141@tcp lock: ffff9fe9d2b74000/0xd6c4b8f05867e4bd lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd6c4b8f05867e4c4 expref: -99 pid: 7455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134898.044564:0:6591:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.141@tcp lock: ffff9fe9d2b74000/0xd6c4b8f05867e4bd lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd6c4b8f05867e4c4 expref: -99 pid: 7455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134898.044574:0:6591:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1783134898.044577:0:6591:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.141@tcp lock: ffff9fe9c0031600/0xd6c4b8f05867e3f2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xd6c4b8f05867e3f9 expref: -99 pid: 6572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134898.044582:0:6591:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe9c0031600 already unused, calling callback (ffffffffc1b40c20) 10000000:00010000:0.0:1783134898.044585:0:6591:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.141@tcp lock: ffff9fe9c0031600/0xd6c4b8f05867e3f2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xd6c4b8f05867e3f9 expref: -99 pid: 6572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134898.044598:0:6591:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.141@tcp lock: ffff9fe9c0031600/0xd6c4b8f05867e3f2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xd6c4b8f05867e3f9 expref: -99 pid: 6572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1783134898.044604:0:6591:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.141@tcp lock: ffff9fe9c0031600/0xd6c4b8f05867e3f2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xd6c4b8f05867e3f9 expref: -99 pid: 6572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783134898.044610:0:6591:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1783134898.044622:0:6591:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.141@tcp lock: ffff9fe9c0031600/0xd6c4b8f05867e3f2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd6c4b8f05867e3f9 expref: -99 pid: 6572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134898.044627:0:6591:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1783134898.044633:0:6591:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.141@tcp lock: ffff9fe9c0031600/0xd6c4b8f05867e3f2 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd6c4b8f05867e3f9 expref: -99 pid: 6572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134898.044639:0:6591:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.141@tcp lock: ffff9fe9c0031600/0xd6c4b8f05867e3f2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd6c4b8f05867e3f9 expref: -99 pid: 6572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134898.044647:0:6591:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783134898.044651:0:6591:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.141@tcp lock: ffff9fe9c0030400/0xd6c4b8f05867e390 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xd6c4b8f05867e397 expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134898.044656:0:6591:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe9c0030400 already unused, calling callback (ffffffffc1b40c20) 10000000:00010000:0.0:1783134898.044659:0:6591:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.141@tcp lock: ffff9fe9c0030400/0xd6c4b8f05867e390 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xd6c4b8f05867e397 expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134898.044666:0:6591:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.141@tcp lock: ffff9fe9c0030400/0xd6c4b8f05867e390 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xd6c4b8f05867e397 expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1783134898.044673:0:6591:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.141@tcp lock: ffff9fe9c0030400/0xd6c4b8f05867e390 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xd6c4b8f05867e397 expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783134898.044682:0:6591:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1783134898.044692:0:6591:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.141@tcp lock: ffff9fe9c0030400/0xd6c4b8f05867e390 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd6c4b8f05867e397 expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134898.044697:0:6591:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1783134898.044709:0:6591:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.141@tcp lock: ffff9fe9c0030400/0xd6c4b8f05867e390 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd6c4b8f05867e397 expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134898.044715:0:6591:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.141@tcp lock: ffff9fe9c0030400/0xd6c4b8f05867e390 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd6c4b8f05867e397 expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134898.044727:0:6591:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783134898.044728:0:6591:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783134898.044730:0:6591:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783134898.044735:0:5758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783134898.044740:0:5757:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783134898.044750:0:3286:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9f5ce1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:88a2002e-2ea7-4f07-912a-8d001832cfc0:3286:1869752384385920:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1783134898.044795:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783134898.044830:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1783134898.044836:0:3286:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9f5ce1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:88a2002e-2ea7-4f07-912a-8d001832cfc0:3286:1869752384386048:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1783134898.044856:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783134898.044882:0:3288:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9f5ce2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:88a2002e-2ea7-4f07-912a-8d001832cfc0:3288:1869752384386176:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1783134898.044900:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783134898.044925:0:5754:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384385920 00000100:00100000:0.0:1783134898.044930:0:5754:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384385920 00010000:00010000:0.0:1783134898.044951:0:5754:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9fe9c0030000/0xd6c4b8f05867e4c4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd6c4b8f05867e4bd expref: 19 pid: 5762 timeout: 330 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783134898.044990:0:5754:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384386048 00000100:00100000:0.0:1783134898.044993:0:5754:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384386048 00010000:00010000:0.0:1783134898.045003:0:5754:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9fe9d2b74800/0xd6c4b8f05867e3f9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd6c4b8f05867e3f2 expref: 20 pid: 5763 timeout: 330 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783134898.045012:0:5754:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384386176 00000100:00100000:0.0:1783134898.045014:0:5754:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384386176 00010000:00010000:0.0:1783134898.045021:0:5754:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9fea02166e00/0xd6c4b8f05867e397 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd6c4b8f05867e390 expref: 21 pid: 5765 timeout: 330 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783134898.045032:0:5754:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1783134898.045039:0:5754:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9f5ce1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:88a2002e-2ea7-4f07-912a-8d001832cfc0+21:3286:x1869752384385920:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1783134898.045050:0:5754:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783134898.045054:0:5754:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9fe9c0030000/0xd6c4b8f05867e4c4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd6c4b8f05867e4bd expref: 21 pid: 5762 timeout: 330 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134898.045063:0:5754:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9fe9c0030000/0xd6c4b8f05867e4c4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd6c4b8f05867e4bd expref: 21 pid: 5762 timeout: 330 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134898.045076:0:5754:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fe9c0030000/0xd6c4b8f05867e4c4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd6c4b8f05867e4bd expref: 21 pid: 5762 timeout: 330 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134898.045086:0:5754:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783134898.045113:0:5754:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9f5ce1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:88a2002e-2ea7-4f07-912a-8d001832cfc0+20:3286:x1869752384385920:12345-0@lo:103:ldlm_bl.0 Request processed in 74us (317us total) trans 0 rc 0/0 00000100:00100000:0.0:1783134898.045119:0:5754:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1783134898.045131:0:5754:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1783134898.045135:0:5754:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9f5ce3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:88a2002e-2ea7-4f07-912a-8d001832cfc0+19:3286:x1869752384386048:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1783134898.045149:0:5754:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783134898.045153:0:5754:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9fe9d2b74800/0xd6c4b8f05867e3f9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd6c4b8f05867e3f2 expref: 19 pid: 5763 timeout: 330 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134898.045161:0:5754:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9fe9d2b74800/0xd6c4b8f05867e3f9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd6c4b8f05867e3f2 expref: 19 pid: 5763 timeout: 330 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134898.045171:0:5754:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fe9d2b74800/0xd6c4b8f05867e3f9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd6c4b8f05867e3f2 expref: 19 pid: 5763 timeout: 330 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134898.045178:0:5754:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783134898.045195:0:5754:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9f5ce3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:88a2002e-2ea7-4f07-912a-8d001832cfc0+18:3286:x1869752384386048:12345-0@lo:103:ldlm_bl.0 Request processed in 60us (339us total) trans 0 rc 0/0 00000100:00100000:0.0:1783134898.045201:0:5754:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1783134898.045210:0:5754:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1783134898.045215:0:5754:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9f5ce3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:88a2002e-2ea7-4f07-912a-8d001832cfc0+17:3288:x1869752384386176:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1783134898.045221:0:5754:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783134898.045225:0:5754:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9fea02166e00/0xd6c4b8f05867e397 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd6c4b8f05867e390 expref: 17 pid: 5765 timeout: 330 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134898.045232:0:5754:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9fea02166e00/0xd6c4b8f05867e397 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd6c4b8f05867e390 expref: 17 pid: 5765 timeout: 330 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134898.045241:0:5754:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fea02166e00/0xd6c4b8f05867e397 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd6c4b8f05867e390 expref: 17 pid: 5765 timeout: 330 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134898.045249:0:5754:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783134898.045267:0:5754:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9f5ce3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:88a2002e-2ea7-4f07-912a-8d001832cfc0+16:3288:x1869752384386176:12345-0@lo:103:ldlm_bl.0 Request processed in 52us (367us total) trans 0 rc 0/0 00000100:00100000:0.0:1783134898.045311:0:5754:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1783134898.045342:0:3288:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9f5ce2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:88a2002e-2ea7-4f07-912a-8d001832cfc0:3288:1869752384386176:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1783134898.045361:0:3286:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9f5ce1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:88a2002e-2ea7-4f07-912a-8d001832cfc0:3286:1869752384386048:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1783134898.045369:0:3286:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9f5ce1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:88a2002e-2ea7-4f07-912a-8d001832cfc0:3286:1869752384385920:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1783134898.049834:0:8328:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9f6732300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8328:1869752384385408:192.168.201.41@tcp:104: 00010000:00010000:1.0:1783134898.049885:0:8328:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9fea02167600/0xd6c4b8f05867e622 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783134898.050568:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:0.0:1783134898.050640:0:5754:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373875840 00000100:00100000:0.0:1783134898.050646:0:5754:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373875840 00010000:00010000:0.0:1783134898.050677:0:5754:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9fea02167c00/0xd6c4b8f05867e581 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb709e expref: 10 pid: 5763 timeout: 280 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783134898.050707:0:5754:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 24 00000100:00100000:0.0:1783134898.050716:0:5754:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9cb338e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f39b22bc-4faf-4b59-bb00-2a11f91e37c0+10:2370:x1869752373875840:12345-192.168.201.41@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783134898.050729:0:5754:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783134898.050734:0:5754:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9fea02167c00/0xd6c4b8f05867e581 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb709e expref: 10 pid: 5763 timeout: 280 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134898.050744:0:5754:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9fea02167c00/0xd6c4b8f05867e581 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb709e expref: 10 pid: 5763 timeout: 280 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134898.050759:0:5754:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fea02167c00/0xd6c4b8f05867e581 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb709e expref: 10 pid: 5763 timeout: 280 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134898.050776:0:5754:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9fea02167600/0xd6c4b8f05867e622 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134898.050785:0:5754:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fea02167600/0xd6c4b8f05867e622 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134898.050811:0:5754:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9fea02167600/0xd6c4b8f05867e622 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134898.050818:0:5754:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9fea02167600/0xd6c4b8f05867e622 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134898.050825:0:5754:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9fea02167600/0xd6c4b8f05867e622 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134898.050832:0:5754:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9fea02167600/0xd6c4b8f05867e622 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134898.050838:0:5754:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fea02167600 already unused, calling callback (ffffffffc1527ce0) 00010000:00010000:0.0:1783134898.050842:0:5754:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9fea02167600/0xd6c4b8f05867e622 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134898.050850:0:5754:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9fea02167600/0xd6c4b8f05867e622 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134898.050874:0:5754:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9fea02167600/0xd6c4b8f05867e622 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134898.050883:0:5754:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783134898.050928:0:5754:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9cb338e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f39b22bc-4faf-4b59-bb00-2a11f91e37c0+9:2370:x1869752373875840:12345-192.168.201.41@tcp:103:ldlm_bl.0 Request processed in 213us (362us total) trans 0 rc 0/0 00000100:00100000:0.0:1783134898.050936:0:5754:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 24 00010000:00010000:3.0:1783134898.051082:0:8328:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9fea02167600/0xd6c4b8f05867e622 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134898.051090:0:8328:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9fea02167600/0xd6c4b8f05867e622 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134898.051097:0:8328:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fea02167600/0xd6c4b8f05867e622 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8328 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783134898.340317:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:1.0:1783134898.340377:0:5763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373875968 00000100:00100000:1.0:1783134898.340387:0:5763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373875968 00000100:00100000:1.0:1783134898.340481:0:5763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 165 00000100:00100000:1.0:1783134898.340490:0:5763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9d1653850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f39b22bc-4faf-4b59-bb00-2a11f91e37c0+9:5575:x1869752373875968:12345-192.168.201.41@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783134898.340506:0:5763:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783134898.340524:0:5763:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fea02167a00/0xd6c4b8f05867e629 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x4428da03f5eb70dd expref: -99 pid: 5763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134898.340560:0:5763:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fea02167a00/0xd6c4b8f05867e629 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb70dd expref: 10 pid: 5763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134898.340571:0:5763:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fea02167a00/0xd6c4b8f05867e629 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb70dd expref: 10 pid: 5763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134898.340581:0:5763:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fea02167a00, rc 0) 00000100:00100000:1.0:1783134898.340632:0:5763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9d1653850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f39b22bc-4faf-4b59-bb00-2a11f91e37c0+10:5575:x1869752373875968:12345-192.168.201.41@tcp:101:ll_cfg_requeue.0 Request processed in 143us (355us total) trans 0 rc 0/0 00000100:00100000:1.0:1783134898.340639:0:5763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 165 00000100:00100000:2.0:1783134898.343629:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:0.0:1783134898.343706:0:5765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373876096 00000100:00100000:0.0:1783134898.343714:0:5765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373876096 00000100:00100000:0.0:1783134898.343791:0:5765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 166 00000100:00100000:0.0:1783134898.343800:0:5765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9d1651850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f39b22bc-4faf-4b59-bb00-2a11f91e37c0+10:5575:x1869752373876096:12345-192.168.201.41@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783134898.344092:0:5765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9d1651850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f39b22bc-4faf-4b59-bb00-2a11f91e37c0+10:5575:x1869752373876096:12345-192.168.201.41@tcp:501:ll_cfg_requeue.0 Request processed in 292us (469us total) trans 0 rc 0/0 00000100:00100000:0.0:1783134898.344099:0:5765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 166 00000100:00100000:3.0:1783134898.347862:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:1.0:1783134898.348016:0:5763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373876224 00000100:00100000:1.0:1783134898.348025:0:5763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373876224 00000100:00100000:1.0:1783134898.348116:0:5763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 167 00000100:00100000:1.0:1783134898.348125:0:5763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9d1652850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f39b22bc-4faf-4b59-bb00-2a11f91e37c0+10:5575:x1869752373876224:12345-192.168.201.41@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783134898.348346:0:5763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9d1652850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f39b22bc-4faf-4b59-bb00-2a11f91e37c0+10:5575:x1869752373876224:12345-192.168.201.41@tcp:503:ll_cfg_requeue.0 Request processed in 222us (490us total) trans 0 rc 0/0 00000100:00100000:1.0:1783134898.348353:0:5763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 167 00000100:00100000:2.0:1783134898.351525:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:0.0:1783134898.352202:0:5765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373876352 00000100:00100000:0.0:1783134898.352211:0:5765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373876352 00000100:00100000:0.0:1783134898.352304:0:5765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 168 00000100:00100000:0.0:1783134898.352314:0:5765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9d1652050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f39b22bc-4faf-4b59-bb00-2a11f91e37c0+10:6106:x1869752373876352:12345-192.168.201.41@tcp:502:llog_process_th.0 00000100:00100000:0.0:1783134898.352522:0:5765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9d1652050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f39b22bc-4faf-4b59-bb00-2a11f91e37c0+10:6106:x1869752373876352:12345-192.168.201.41@tcp:502:llog_process_th.0 Request processed in 206us (1001us total) trans 0 rc 0/0 00000100:00100000:0.0:1783134898.352531:0:5765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 168 00000100:00100000:3.0:1783134898.358913:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:0.0:1783134898.360756:0:5765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373876480 00000100:00100000:0.0:1783134898.360768:0:5765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373876480 00000100:00100000:0.0:1783134898.360824:0:5765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 169 00000100:00100000:0.0:1783134898.360834:0:5765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9d1650450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f39b22bc-4faf-4b59-bb00-2a11f91e37c0+10:6106:x1869752373876480:12345-192.168.201.41@tcp:502:llog_process_th.0 00000100:00100000:0.0:1783134898.361085:0:5765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9d1650450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f39b22bc-4faf-4b59-bb00-2a11f91e37c0+10:6106:x1869752373876480:12345-192.168.201.41@tcp:502:llog_process_th.0 Request processed in 251us (2180us total) trans 0 rc 0/0 00000100:00100000:0.0:1783134898.361093:0:5765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 169 00010000:00010000:1.0:1783134898.435406:0:6591:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1783134899.204358:0:5767:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1783134899.204367:0:5767:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff9fe8c47e1800 from 4 10000000:01000000:1.0:1783134899.204372:0:5767:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1783134899.204415:0:5767:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.141@tcp lock: ffff9fea02166e00/0xd6c4b8f05867e630 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134899.204427:0:5767:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.141@tcp lock: ffff9fea02166e00/0xd6c4b8f05867e630 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134899.204438:0:5767:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.141@tcp lock: ffff9fea02166e00/0xd6c4b8f05867e630 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783134899.204463:0:5767:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9f6732300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88a2002e-2ea7-4f07-912a-8d001832cfc0:5767:1869752384386304:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1783134899.204531:0:5767:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783134899.204612:0:5767:0:(client.c:2701:ptlrpc_set_wait()) set ffff9fe9e9c69300 going to sleep for 11 seconds 00000100:00100000:2.0:1783134899.207932:0:5762:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384386304 00000100:00100000:2.0:1783134899.207946:0:5762:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384386304 00000100:00100000:2.0:1783134899.208062:0:5762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:2.0:1783134899.208073:0:5762:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9d1652450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88a2002e-2ea7-4f07-912a-8d001832cfc0+16:5767:x1869752384386304:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783134899.208088:0:5762:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783134899.208104:0:5762:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fe9c1523400/0xd6c4b8f05867e637 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xd6c4b8f05867e630 expref: -99 pid: 5762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134899.208129:0:5762:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fe9c1523400/0xd6c4b8f05867e637 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd6c4b8f05867e630 expref: 17 pid: 5762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134899.208140:0:5762:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fe9c1523400/0xd6c4b8f05867e637 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd6c4b8f05867e630 expref: 17 pid: 5762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134899.208150:0:5762:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fe9c1523400, rc 0) 00000100:00100000:2.0:1783134899.208243:0:5762:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9d1652450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88a2002e-2ea7-4f07-912a-8d001832cfc0+17:5767:x1869752384386304:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 172us (3711us total) trans 0 rc 0/0 00000100:00100000:2.0:1783134899.208250:0:5762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:0.0:1783134899.208382:0:5767:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9f6732300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88a2002e-2ea7-4f07-912a-8d001832cfc0:5767:1869752384386304:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783134899.208398:0:5767:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.141@tcp lock: ffff9fea02166e00/0xd6c4b8f05867e630 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd6c4b8f05867e637 expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134899.208407:0:5767:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.141@tcp lock: ffff9fea02166e00/0xd6c4b8f05867e630 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd6c4b8f05867e637 expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783134899.208467:0:5767:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9f5ce1c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88a2002e-2ea7-4f07-912a-8d001832cfc0:5767:1869752384386432:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783134899.208503:0:5767:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783134899.211172:0:5767:0:(client.c:2701:ptlrpc_set_wait()) set ffff9fe9d1552cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1783134899.211252:0:5763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384386432 00000100:00100000:1.0:1783134899.211260:0:5763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384386432 00000100:00100000:1.0:1783134899.211328:0:5763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:1.0:1783134899.211339:0:5763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9d17a7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88a2002e-2ea7-4f07-912a-8d001832cfc0+17:5767:x1869752384386432:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783134899.212960:0:5763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9d17a7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88a2002e-2ea7-4f07-912a-8d001832cfc0+17:5767:x1869752384386432:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 1612us (4444us total) trans 0 rc 0/0 00000100:00100000:1.0:1783134899.212971:0:5763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:0.0:1783134899.220616:0:5767:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9f5ce1c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88a2002e-2ea7-4f07-912a-8d001832cfc0:5767:1869752384386432:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783134899.220772:0:5767:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9f6f72d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88a2002e-2ea7-4f07-912a-8d001832cfc0:5767:1869752384386560:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783134899.220864:0:5767:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783134899.220905:0:5767:0:(client.c:2701:ptlrpc_set_wait()) set ffff9fe9fe99e900 going to sleep for 11 seconds 00000100:00100000:0.0:1783134899.221009:0:5765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384386560 00000100:00100000:0.0:1783134899.221016:0:5765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384386560 00000100:00100000:0.0:1783134899.221063:0:5765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:0.0:1783134899.221071:0:5765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9d17a7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88a2002e-2ea7-4f07-912a-8d001832cfc0+17:5767:x1869752384386560:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783134899.221268:0:5765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9d17a7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88a2002e-2ea7-4f07-912a-8d001832cfc0+17:5767:x1869752384386560:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 197us (404us total) trans 0 rc 0/0 00000100:00100000:0.0:1783134899.221300:0:5765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:0.0:1783134899.221344:0:5767:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9f6f72d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88a2002e-2ea7-4f07-912a-8d001832cfc0:5767:1869752384386560:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783134899.221528:0:8398:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9f5ce1880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:88a2002e-2ea7-4f07-912a-8d001832cfc0:8398:1869752384386688:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783134899.221563:0:8398:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783134899.221580:0:8398:0:(client.c:2701:ptlrpc_set_wait()) set ffff9fe9d1552180 going to sleep for 11 seconds 00000100:00100000:2.0:1783134899.221683:0:5762:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384386688 00000100:00100000:2.0:1783134899.221687:0:5762:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384386688 00000100:00100000:2.0:1783134899.221717:0:5762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:2.0:1783134899.221724:0:5762:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9d17a5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88a2002e-2ea7-4f07-912a-8d001832cfc0+17:8398:x1869752384386688:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783134899.221857:0:5762:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9d17a5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88a2002e-2ea7-4f07-912a-8d001832cfc0+17:8398:x1869752384386688:12345-0@lo:502:llog_process_th.0 Request processed in 134us (293us total) trans 0 rc 0/0 00000100:00100000:2.0:1783134899.221864:0:5762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:0.0:1783134899.222127:0:8398:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9f5ce1880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:88a2002e-2ea7-4f07-912a-8d001832cfc0:8398:1869752384386688:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1783134899.222148:0:8398:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1783134899.222156:0:8398:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783134899.222158:0:8398:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1783134899.222164:0:8398:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9fe8c47e1800 00000020:00000080:0.0:1783134899.222167:0:8398:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1783134899.222314:0:8398:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9f5ce1880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:88a2002e-2ea7-4f07-912a-8d001832cfc0:8398:1869752384386816:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783134899.222347:0:8398:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783134899.222367:0:8398:0:(client.c:2701:ptlrpc_set_wait()) set ffff9fe9d1552180 going to sleep for 11 seconds 00000100:00100000:0.0:1783134899.224935:0:5763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384386816 00000100:00100000:0.0:1783134899.224945:0:5763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384386816 00000100:00100000:0.0:1783134899.225010:0:5763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:0.0:1783134899.225019:0:5763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9d17a6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88a2002e-2ea7-4f07-912a-8d001832cfc0+17:8398:x1869752384386816:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783134899.225966:0:5763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9d17a6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88a2002e-2ea7-4f07-912a-8d001832cfc0+17:8398:x1869752384386816:12345-0@lo:502:llog_process_th.0 Request processed in 946us (3616us total) trans 0 rc 0/0 00000100:00100000:0.0:1783134899.225975:0:5763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:0.0:1783134899.226040:0:8398:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9f5ce1880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:88a2002e-2ea7-4f07-912a-8d001832cfc0:8398:1869752384386816:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1783134899.226073:0:8398:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1783134899.226080:0:8398:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783134899.226083:0:8398:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:0.0:1783134899.226088:0:8398:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:0.0:1783134899.226143:0:5767:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:0.0:1783134899.226159:0:5767:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.201.141@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1783134899.226168:0:5767:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.141@tcp lock: ffff9fea02166e00/0xd6c4b8f05867e630 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd6c4b8f05867e637 expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134899.226179:0:5767:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.141@tcp lock: ffff9fea02166e00/0xd6c4b8f05867e630 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd6c4b8f05867e637 expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783134899.226252:0:5767:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1783134899.226255:0:5767:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff9fea01d1b000 from 4 10000000:01000000:0.0:1783134899.226258:0:5767:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1783134899.226303:0:5767:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.141@tcp lock: ffff9fe9c148b400/0xd6c4b8f05867e63e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134899.226312:0:5767:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.141@tcp lock: ffff9fe9c148b400/0xd6c4b8f05867e63e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134899.226321:0:5767:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.141@tcp lock: ffff9fe9c148b400/0xd6c4b8f05867e63e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783134899.226352:0:5767:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9f5ce1880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88a2002e-2ea7-4f07-912a-8d001832cfc0:5767:1869752384386944:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1783134899.226387:0:5767:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783134899.226413:0:5767:0:(client.c:2701:ptlrpc_set_wait()) set ffff9fe9d1552180 going to sleep for 11 seconds 00000100:00100000:0.0:1783134899.226426:0:5763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384386944 00000100:00100000:0.0:1783134899.226430:0:5763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384386944 00000100:00100000:0.0:1783134899.226453:0:5763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:0.0:1783134899.226460:0:5763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9d17a7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88a2002e-2ea7-4f07-912a-8d001832cfc0+17:5767:x1869752384386944:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783134899.226469:0:5763:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783134899.226480:0:5763:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fe9c148ba00/0xd6c4b8f05867e645 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xd6c4b8f05867e63e expref: -99 pid: 5763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134899.226501:0:5763:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fe9c148ba00/0xd6c4b8f05867e645 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd6c4b8f05867e63e expref: 18 pid: 5763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134899.226512:0:5763:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fe9c148ba00/0xd6c4b8f05867e645 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd6c4b8f05867e63e expref: 18 pid: 5763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134899.226521:0:5763:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fe9c148ba00, rc 0) 00000100:00100000:0.0:1783134899.226548:0:5763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9d17a7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88a2002e-2ea7-4f07-912a-8d001832cfc0+18:5767:x1869752384386944:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 88us (160us total) trans 0 rc 0/0 00000100:00100000:0.0:1783134899.226553:0:5763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:0.0:1783134899.226579:0:5767:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9f5ce1880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88a2002e-2ea7-4f07-912a-8d001832cfc0:5767:1869752384386944:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783134899.226590:0:5767:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.141@tcp lock: ffff9fe9c148b400/0xd6c4b8f05867e63e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd6c4b8f05867e645 expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134899.226599:0:5767:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.141@tcp lock: ffff9fe9c148b400/0xd6c4b8f05867e63e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xd6c4b8f05867e645 expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783134899.226644:0:5767:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9f5ce1880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88a2002e-2ea7-4f07-912a-8d001832cfc0:5767:1869752384387072:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783134899.226668:0:5767:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783134899.226680:0:5767:0:(client.c:2701:ptlrpc_set_wait()) set ffff9fe9d1552180 going to sleep for 11 seconds 00000100:00100000:0.0:1783134899.226691:0:5763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384387072 00000100:00100000:0.0:1783134899.226694:0:5763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384387072 00000100:00100000:0.0:1783134899.226715:0:5763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:0.0:1783134899.226720:0:5763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9d17a4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88a2002e-2ea7-4f07-912a-8d001832cfc0+18:5767:x1869752384387072:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783134899.229086:0:5763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9d17a4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88a2002e-2ea7-4f07-912a-8d001832cfc0+18:5767:x1869752384387072:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 2358us (2410us total) trans 0 rc 0/0 00000100:00100000:0.0:1783134899.229098:0:5763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:1.0:1783134899.229317:0:5767:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9f5ce1880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88a2002e-2ea7-4f07-912a-8d001832cfc0:5767:1869752384387072:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783134899.229360:0:5767:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9f6731880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88a2002e-2ea7-4f07-912a-8d001832cfc0:5767:1869752384387200:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783134899.229406:0:5767:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783134899.229437:0:5767:0:(client.c:2701:ptlrpc_set_wait()) set ffff9fe9e9c690c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783134899.229450:0:5763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384387200 00000100:00100000:1.0:1783134899.229455:0:5763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384387200 00000100:00100000:1.0:1783134899.229493:0:5763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:1.0:1783134899.229500:0:5763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9d17a5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88a2002e-2ea7-4f07-912a-8d001832cfc0+18:5767:x1869752384387200:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783134899.229711:0:5763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9d17a5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88a2002e-2ea7-4f07-912a-8d001832cfc0+18:5767:x1869752384387200:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 211us (304us total) trans 0 rc 0/0 00000100:00100000:1.0:1783134899.229719:0:5763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:1.0:1783134899.229754:0:5767:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9f6731880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88a2002e-2ea7-4f07-912a-8d001832cfc0:5767:1869752384387200:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783134899.229918:0:8400:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9f6731880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:88a2002e-2ea7-4f07-912a-8d001832cfc0:8400:1869752384387328:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783134899.229958:0:8400:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783134899.229977:0:5763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384387328 00000100:00100000:1.0:1783134899.229981:0:5763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384387328 00000100:00100000:1.0:1783134899.230003:0:5763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:1.0:1783134899.230009:0:5763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9d17a7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88a2002e-2ea7-4f07-912a-8d001832cfc0+18:8400:x1869752384387328:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783134899.230117:0:5763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9d17a7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88a2002e-2ea7-4f07-912a-8d001832cfc0+18:8400:x1869752384387328:12345-0@lo:502:llog_process_th.0 Request processed in 107us (166us total) trans 0 rc 0/0 00000100:00100000:1.0:1783134899.230123:0:5763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:1.0:1783134899.230149:0:8400:0:(client.c:2701:ptlrpc_set_wait()) set ffff9fe9e9c69300 going to sleep for 11 seconds 00000100:00100000:1.0:1783134899.230161:0:8400:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9f6731880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:88a2002e-2ea7-4f07-912a-8d001832cfc0:8400:1869752384387328:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1783134899.230180:0:8400:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1783134899.232275:0:8400:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783134899.232296:0:8400:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1783134899.232309:0:8400:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9fea01d1b000 00000020:00000080:1.0:1783134899.232313:0:8400:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1783134899.233982:0:8400:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9f6731880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:88a2002e-2ea7-4f07-912a-8d001832cfc0:8400:1869752384387456:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783134899.234055:0:8400:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783134899.234664:0:8400:0:(client.c:2701:ptlrpc_set_wait()) set ffff9fe9e9c69300 going to sleep for 11 seconds 00000100:00100000:0.0:1783134899.243828:0:5763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384387456 00000100:00100000:0.0:1783134899.243842:0:5763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384387456 00000100:00100000:0.0:1783134899.243898:0:5763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:0.0:1783134899.243907:0:5763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9d17a5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88a2002e-2ea7-4f07-912a-8d001832cfc0+18:8400:x1869752384387456:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783134899.244169:0:5763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9d17a5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88a2002e-2ea7-4f07-912a-8d001832cfc0+18:8400:x1869752384387456:12345-0@lo:502:llog_process_th.0 Request processed in 262us (10114us total) trans 0 rc 0/0 00000100:00100000:0.0:1783134899.244177:0:5763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:3.0:1783134899.244341:0:8400:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9f6731880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:88a2002e-2ea7-4f07-912a-8d001832cfc0:8400:1869752384387456:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1783134899.244378:0:8400:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1783134899.244387:0:8400:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783134899.244393:0:8400:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:3.0:1783134899.244399:0:8400:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:1.0:1783134899.244915:0:5767:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:1.0:1783134899.244938:0:5767:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.201.141@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1783134899.244957:0:5767:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.141@tcp lock: ffff9fe9c148b400/0xd6c4b8f05867e63e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd6c4b8f05867e645 expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134899.244969:0:5767:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.141@tcp lock: ffff9fe9c148b400/0xd6c4b8f05867e63e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd6c4b8f05867e645 expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783134899.244979:0:5767:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1783134899.244982:0:5767:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff9fe9e0d14800 from 4 10000000:01000000:1.0:1783134899.244985:0:5767:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1783134899.245014:0:5767:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.141@tcp lock: ffff9fea02167c00/0xd6c4b8f05867e64c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134899.245023:0:5767:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.141@tcp lock: ffff9fea02167c00/0xd6c4b8f05867e64c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134899.245032:0:5767:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.141@tcp lock: ffff9fea02167c00/0xd6c4b8f05867e64c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783134899.245051:0:5767:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9f6731180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88a2002e-2ea7-4f07-912a-8d001832cfc0:5767:1869752384387584:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1783134899.245086:0:5767:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783134899.245152:0:5767:0:(client.c:2701:ptlrpc_set_wait()) set ffff9fe9e9c69900 going to sleep for 11 seconds 00000100:00100000:0.0:1783134899.250909:0:5762:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384387584 00000100:00100000:0.0:1783134899.250925:0:5762:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384387584 00000100:00100000:0.0:1783134899.250982:0:5762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:0.0:1783134899.250992:0:5762:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9d17a6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88a2002e-2ea7-4f07-912a-8d001832cfc0+18:5767:x1869752384387584:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783134899.251009:0:5762:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783134899.251028:0:5762:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fe9c148ac00/0xd6c4b8f05867e653 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xd6c4b8f05867e64c expref: -99 pid: 5762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134899.251067:0:5762:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fe9c148ac00/0xd6c4b8f05867e653 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd6c4b8f05867e64c expref: 19 pid: 5762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134899.251078:0:5762:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fe9c148ac00/0xd6c4b8f05867e653 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd6c4b8f05867e64c expref: 19 pid: 5762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134899.251087:0:5762:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fe9c148ac00, rc 0) 00000100:00100000:0.0:1783134899.251159:0:5762:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9d17a6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88a2002e-2ea7-4f07-912a-8d001832cfc0+19:5767:x1869752384387584:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 168us (6072us total) trans 0 rc 0/0 00000100:00100000:0.0:1783134899.251166:0:5762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:0.0:1783134899.251408:0:5767:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9f6731180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88a2002e-2ea7-4f07-912a-8d001832cfc0:5767:1869752384387584:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783134899.251426:0:5767:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.141@tcp lock: ffff9fea02167c00/0xd6c4b8f05867e64c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd6c4b8f05867e653 expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134899.251435:0:5767:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.141@tcp lock: ffff9fea02167c00/0xd6c4b8f05867e64c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xd6c4b8f05867e653 expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783134899.251500:0:5767:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9f5ce2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88a2002e-2ea7-4f07-912a-8d001832cfc0:5767:1869752384387712:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783134899.251596:0:5767:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783134899.251666:0:5767:0:(client.c:2701:ptlrpc_set_wait()) set ffff9fe9d1552480 going to sleep for 11 seconds 00000100:00100000:2.0:1783134899.251717:0:5765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384387712 00000100:00100000:2.0:1783134899.251722:0:5765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384387712 00000100:00100000:2.0:1783134899.251777:0:5765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:2.0:1783134899.251785:0:5765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9d17a6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88a2002e-2ea7-4f07-912a-8d001832cfc0+19:5767:x1869752384387712:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783134899.252035:0:5765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9d17a6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88a2002e-2ea7-4f07-912a-8d001832cfc0+19:5767:x1869752384387712:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 251us (439us total) trans 0 rc 0/0 00000100:00100000:2.0:1783134899.252042:0:5765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:1.0:1783134899.252569:0:5767:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9f5ce2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88a2002e-2ea7-4f07-912a-8d001832cfc0:5767:1869752384387712:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783134899.252603:0:5767:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9f6733100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88a2002e-2ea7-4f07-912a-8d001832cfc0:5767:1869752384387840:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783134899.252644:0:5767:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783134899.255855:0:5767:0:(client.c:2701:ptlrpc_set_wait()) set ffff9fe9e9c69900 going to sleep for 11 seconds 00000100:00100000:0.0:1783134899.256365:0:5762:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384387840 00000100:00100000:0.0:1783134899.256373:0:5762:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384387840 00000100:00100000:0.0:1783134899.256416:0:5762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:0.0:1783134899.256425:0:5762:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9d17a4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88a2002e-2ea7-4f07-912a-8d001832cfc0+19:5767:x1869752384387840:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783134899.258739:0:5762:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9d17a4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88a2002e-2ea7-4f07-912a-8d001832cfc0+19:5767:x1869752384387840:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 2311us (6090us total) trans 0 rc 0/0 00000100:00100000:0.0:1783134899.258761:0:5762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:0.0:1783134899.258877:0:5767:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9f6733100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88a2002e-2ea7-4f07-912a-8d001832cfc0:5767:1869752384387840:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783134899.259091:0:8403:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9f5ce0e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:88a2002e-2ea7-4f07-912a-8d001832cfc0:8403:1869752384387968:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783134899.259133:0:8403:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783134899.259154:0:5762:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384387968 00000100:00100000:0.0:1783134899.259158:0:5762:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384387968 00000100:00100000:0.0:1783134899.259181:0:5762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:0.0:1783134899.259578:0:5762:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9d17a6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88a2002e-2ea7-4f07-912a-8d001832cfc0+19:8403:x1869752384387968:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783134899.259726:0:5762:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9d17a6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88a2002e-2ea7-4f07-912a-8d001832cfc0+19:8403:x1869752384387968:12345-0@lo:502:llog_process_th.0 Request processed in 537us (592us total) trans 0 rc 0/0 00000100:00100000:0.0:1783134899.259733:0:5762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:0.0:1783134899.259772:0:8403:0:(client.c:2701:ptlrpc_set_wait()) set ffff9fe9d15523c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783134899.259785:0:8403:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9f5ce0e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:88a2002e-2ea7-4f07-912a-8d001832cfc0:8403:1869752384387968:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1783134899.259806:0:8403:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1783134899.260256:0:8403:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783134899.260259:0:8403:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1783134899.260268:0:8403:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9fe9e0d14800 00000020:00000080:0.0:1783134899.260271:0:8403:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1783134899.260957:0:8403:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9f5ce0e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:88a2002e-2ea7-4f07-912a-8d001832cfc0:8403:1869752384388096:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783134899.261003:0:8403:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783134899.261026:0:5762:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384388096 00000100:00100000:0.0:1783134899.261030:0:5762:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384388096 00000100:00100000:0.0:1783134899.261065:0:5762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:0.0:1783134899.261072:0:5762:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9d17a5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88a2002e-2ea7-4f07-912a-8d001832cfc0+19:8403:x1869752384388096:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783134899.261209:0:5762:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9d17a5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88a2002e-2ea7-4f07-912a-8d001832cfc0+19:8403:x1869752384388096:12345-0@lo:502:llog_process_th.0 Request processed in 137us (206us total) trans 0 rc 0/0 00000100:00100000:0.0:1783134899.261222:0:5762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:0.0:1783134899.261254:0:8403:0:(client.c:2701:ptlrpc_set_wait()) set ffff9fe9d1552d80 going to sleep for 11 seconds 00000100:00100000:0.0:1783134899.261268:0:8403:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9f5ce0e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:88a2002e-2ea7-4f07-912a-8d001832cfc0:8403:1869752384388096:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1783134899.261307:0:8403:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1783134899.261312:0:8403:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783134899.261314:0:8403:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:0.0:1783134899.261317:0:8403:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:0.0:1783134899.261362:0:5767:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:0.0:1783134899.261376:0:5767:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.201.141@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1783134899.261385:0:5767:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.141@tcp lock: ffff9fea02167c00/0xd6c4b8f05867e64c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd6c4b8f05867e653 expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134899.261396:0:5767:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.141@tcp lock: ffff9fea02167c00/0xd6c4b8f05867e64c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd6c4b8f05867e653 expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783134899.331839:0:3288:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1783134899.331860:0:3288:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9f5ce0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1869752384388224:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1783134899.331920:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783134899.331984:0:6578:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384388224 00000100:00100000:0.0:1783134899.331992:0:6578:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384388224 00000100:00100000:0.0:1783134899.332041:0:6578:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1783134899.332049:0:6578:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9f5ce3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3288:x1869752384388224:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1783134899.332081:0:6578:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1783134899.332120:0:6578:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9f5ce3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3288:x1869752384388224:12345-0@lo:13:osp-pre-0-0.0 Request processed in 71us (199us total) trans 0 rc 0/0 00000100:00100000:0.0:1783134899.332128:0:6578:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00080000:0.0:1783134899.332146:0:5766:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1783134899.332180:0:3288:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fe9f5ce0e00 x1869752384388224/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783134915 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783134899.332198:0:3288:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9f5ce0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1869752384388224:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1783134899.332451:0:3286:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9f6f70000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1869752384388352:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1783134899.332481:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783134899.334207:0:6578:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384388352 00000100:00100000:2.0:1783134899.334216:0:6578:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384388352 00000100:00100000:2.0:1783134899.334303:0:6578:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1783134899.334313:0:6578:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9f6730000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1869752384388352:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1783134899.334340:0:6578:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1783134899.334393:0:6578:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9f6730000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1869752384388352:12345-0@lo:13:osp-pre-1-0.0 Request processed in 82us (1910us total) trans 0 rc 0/0 00000100:00100000:2.0:1783134899.334399:0:6578:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00080000:1.0:1783134899.334470:0:3286:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fe9f6f70000 x1869752384388352/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783134915 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783134899.334486:0:3286:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9f6f70000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1869752384388352:0@lo:13:osp-pre-1-0.0 00000100:00080000:0.0:1783134899.334554:0:5766:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1783134899.335874:0:3289:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9f6f73b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3289:1869752384388736:0@lo:400:kworker.0 00000100:00100000:2.0:1783134899.335919:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783134899.339091:0:3289:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1783134899.339110:0:3289:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9f6f70700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3289:1869752384388608:0@lo:400:kworker.0 00000100:00100000:2.0:1783134899.339173:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783134899.339218:0:5769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384388736 00000100:00100000:2.0:1783134899.339225:0:5769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384388736 00000100:00100000:2.0:1783134899.339271:0:5769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384388608 00000100:00100000:2.0:1783134899.339274:0:5769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384388608 00000100:00100000:2.0:1783134899.339312:0:5769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1783134899.339320:0:5769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9f6f71180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3289:x1869752384388736:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783134899.339374:0:5769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9f6f71180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3289:x1869752384388736:12345-0@lo:400:kworker.0 Request processed in 54us (3454us total) trans 0 rc 0/0 00000100:00100000:2.0:1783134899.339381:0:5769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1783134899.339397:0:5769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1783134899.339403:0:5769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9f6f72a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3289:x1869752384388608:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783134899.339429:0:5769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9f6f72a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3289:x1869752384388608:12345-0@lo:400:kworker.0 Request processed in 27us (256us total) trans 0 rc 0/0 00000100:00100000:2.0:1783134899.339436:0:5769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1783134899.339552:0:3289:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9f6f70700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3289:1869752384388608:0@lo:400:kworker.0 00000100:00100000:2.0:1783134899.339565:0:3289:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9f6f73b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3289:1869752384388736:0@lo:400:kworker.0 00000100:00100000:1.0:1783134899.339764:0:3287:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9f6f72680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3287:1869752384388480:0@lo:400:kworker.0 00000100:00100000:1.0:1783134899.339795:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1783134899.339837:0:5766:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783134899.339884:0:5769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384388480 00000100:00100000:0.0:1783134899.339888:0:5769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384388480 00000100:00100000:0.0:1783134899.339920:0:5769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1783134899.339927:0:5769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9f6730a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3287:x1869752384388480:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783134899.339981:0:5769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9f6730a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3287:x1869752384388480:12345-0@lo:400:kworker.0 Request processed in 55us (184us total) trans 0 rc 0/0 00000100:00100000:0.0:1783134899.339987:0:5769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1783134899.341599:0:3287:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9f6f72680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3287:1869752384388480:0@lo:400:kworker.0 00010000:00010000:0.0:1783134899.459517:0:5758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783134900.013348:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:3.0:1783134900.013387:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:0.0:1783134900.013408:0:5763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373876608 00000100:00100000:0.0:1783134900.013417:0:5763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373876608 00000100:00100000:3.0:1783134900.013419:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:3.0:1783134900.013463:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:0.0:1783134900.013464:0:5763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 185 00000100:00100000:0.0:1783134900.013474:0:5763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9d17a4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f39b22bc-4faf-4b59-bb00-2a11f91e37c0+10:2370:x1869752373876608:12345-192.168.201.41@tcp:400:kworker.0 00000100:00100000:3.0:1783134900.013483:0:7676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373876864 00000100:00100000:3.0:1783134900.013487:0:7676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373876864 00000100:00100000:3.0:1783134900.013519:0:7676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373876992 00000100:00100000:3.0:1783134900.013522:0:7676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373876992 00000100:00100000:3.0:1783134900.013538:0:7676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 5 00000100:00100000:0.0:1783134900.013539:0:5763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9d17a4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f39b22bc-4faf-4b59-bb00-2a11f91e37c0+10:2370:x1869752373876608:12345-192.168.201.41@tcp:400:kworker.0 Request processed in 67us (200us total) trans 0 rc 0/0 00000100:00100000:3.0:1783134900.013546:0:7676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9cb33b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+5:2370:x1869752373876864:12345-192.168.201.41@tcp:400:kworker.0 00000100:00100000:0.0:1783134900.013546:0:5763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 185 00000100:00100000:3.0:1783134900.013573:0:7676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9cb33b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+5:2370:x1869752373876864:12345-192.168.201.41@tcp:400:kworker.0 Request processed in 29us (186us total) trans 0 rc 0/0 00000100:00100000:3.0:1783134900.013579:0:7676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 5 00000100:00100000:3.0:1783134900.013591:0:7676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 6 00000100:00100000:3.0:1783134900.013597:0:7676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9cb33ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+5:2370:x1869752373876992:12345-192.168.201.41@tcp:400:kworker.0 00000100:00100000:3.0:1783134900.013632:0:7676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9cb33ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+5:2370:x1869752373876992:12345-192.168.201.41@tcp:400:kworker.0 Request processed in 23us (158us total) trans 0 rc 0/0 00000100:00100000:1.0:1783134900.013647:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373876736 00000100:00100000:1.0:1783134900.013657:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373876736 00000100:00100000:1.0:1783134900.013697:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 20 00000100:00100000:1.0:1783134900.013707:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9cb338380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+6:2370:x1869752373876736:12345-192.168.201.41@tcp:400:kworker.0 00000100:00100000:1.0:1783134900.013743:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9cb338380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+6:2370:x1869752373876736:12345-192.168.201.41@tcp:400:kworker.0 Request processed in 40us (323us total) trans 0 rc 0/0 00000100:00100000:1.0:1783134900.013751:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 20 00000100:00080000:1.0:1783134900.013772:0:5766:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1783134900.013777:0:5766:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1783134900.013780:0:5766:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1783134900.014094:0:7676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 6 00010000:00010000:0.0:1783134900.488322:0:5757:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783134901.507589:0:6591:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1783134902.218830:0:8628:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg141-server.virtnet: executing check_logdir /tmp/testlogs/ 00010000:00010000:0.0:1783134902.531455:0:5758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783134903.556982:0:5757:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783134904.451464:0:3286:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9f5ce0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1869752384388864:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1783134904.451535:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783134904.451653:0:6578:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384388864 00000100:00100000:2.0:1783134904.451661:0:6578:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384388864 00000100:00100000:2.0:1783134904.451718:0:6578:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1783134904.451728:0:6578:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9f5ce0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1869752384388864:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1783134904.451765:0:6578:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1783134904.451812:0:6578:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9f5ce0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1869752384388864:12345-0@lo:13:osp-pre-0-0.0 Request processed in 85us (276us total) trans 0 rc 0/0 00000100:00100000:2.0:1783134904.451827:0:6578:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00080000:2.0:1783134904.451891:0:3286:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fe9f5ce0e00 x1869752384388864/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783134920 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783134904.451909:0:3286:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9f5ce0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1869752384388864:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1783134904.451961:0:5766:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1783134904.454652:0:3287:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9f6f73b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:88a2002e-2ea7-4f07-912a-8d001832cfc0:3287:1869752384388992:0@lo:400:kworker.0 00000100:00100000:2.0:1783134904.454716:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783134904.455786:0:3289:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9f6f71500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3289:1869752384389248:0@lo:400:kworker.0 00000100:00100000:3.0:1783134904.455829:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783134904.455876:0:3289:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1783134904.455883:0:3289:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9f6f70700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3289:1869752384389120:0@lo:400:kworker.0 00000100:00100000:3.0:1783134904.455916:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783134904.455949:0:3286:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9f6f71c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3286:1869752384389376:0@lo:400:kworker.0 00000100:00100000:3.0:1783134904.455981:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783134904.456033:0:3288:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe8c67b8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1869752384389632:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1783134904.456058:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783134904.456099:0:6578:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384389632 00000100:00100000:3.0:1783134904.456105:0:6578:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384389632 00000100:00100000:3.0:1783134904.456154:0:6578:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1783134904.456162:0:6578:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe8c67bbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3288:x1869752384389632:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1783134904.456195:0:6578:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1783134904.456234:0:6578:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe8c67bbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3288:x1869752384389632:12345-0@lo:13:osp-pre-1-0.0 Request processed in 73us (174us total) trans 0 rc 0/0 00000100:00100000:3.0:1783134904.456241:0:6578:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:3.0:1783134904.456299:0:3288:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fe8c67b8700 x1869752384389632/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783134920 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783134904.456318:0:3288:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe8c67b8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1869752384389632:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1783134904.457938:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384389248 00000100:00100000:1.0:1783134904.457948:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384389248 00000100:00100000:1.0:1783134904.457986:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384389120 00000100:00100000:1.0:1783134904.457990:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384389120 00000100:00100000:1.0:1783134904.458002:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384389376 00000100:00100000:1.0:1783134904.458005:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384389376 00000100:00100000:1.0:1783134904.458021:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1783134904.458029:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9cb33b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3289:x1869752384389248:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783134904.458095:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9cb33b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3289:x1869752384389248:12345-0@lo:400:kworker.0 Request processed in 66us (2265us total) trans 0 rc 0/0 00000100:00100000:1.0:1783134904.458107:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1783134904.458122:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1783134904.458128:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe8c67b8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3289:x1869752384389120:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783134904.458157:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe8c67b8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3289:x1869752384389120:12345-0@lo:400:kworker.0 Request processed in 29us (2240us total) trans 0 rc 0/0 00000100:00100000:1.0:1783134904.458163:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1783134904.458174:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1783134904.458180:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe8c67ba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3286:x1869752384389376:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783134904.458210:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe8c67ba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3286:x1869752384389376:12345-0@lo:400:kworker.0 Request processed in 30us (2228us total) trans 0 rc 0/0 00000100:00100000:1.0:1783134904.458215:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1783134904.458253:0:3289:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9f6f70700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3289:1869752384389120:0@lo:400:kworker.0 00000100:00100000:1.0:1783134904.458266:0:3289:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9f6f71500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3289:1869752384389248:0@lo:400:kworker.0 00000100:00100000:1.0:1783134904.458315:0:3286:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9f6f71c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3286:1869752384389376:0@lo:400:kworker.0 00000100:00080000:1.0:1783134904.458348:0:5766:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1783134904.458353:0:5766:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1783134904.458537:0:3287:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9f6f71880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1869752384389504:0@lo:400:kworker.0 00000100:00100000:2.0:1783134904.458568:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783134904.460608:0:5765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384388992 00000100:00100000:0.0:1783134904.460631:0:5765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384388992 00000100:00100000:0.0:1783134904.460685:0:5763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:0.0:1783134904.460694:0:5763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9d17a4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88a2002e-2ea7-4f07-912a-8d001832cfc0+19:3287:x1869752384388992:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783134904.460764:0:5763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9d17a4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88a2002e-2ea7-4f07-912a-8d001832cfc0+19:3287:x1869752384388992:12345-0@lo:400:kworker.0 Request processed in 72us (6048us total) trans 0 rc 0/0 00000100:00100000:0.0:1783134904.460771:0:5763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00100000:2.0:1783134904.460978:0:3287:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9f6f73b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:88a2002e-2ea7-4f07-912a-8d001832cfc0:3287:1869752384388992:0@lo:400:kworker.0 00000100:00100000:1.0:1783134904.461114:0:6576:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384389504 00000100:00100000:1.0:1783134904.461119:0:6576:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384389504 00000100:00100000:1.0:1783134904.461196:0:6576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1783134904.461204:0:6576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9f6f72300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3287:x1869752384389504:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783134904.461246:0:6576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9f6f72300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3287:x1869752384389504:12345-0@lo:400:kworker.0 Request processed in 44us (2677us total) trans 0 rc 0/0 00000100:00100000:1.0:1783134904.461252:0:6576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:3.0:1783134904.468567:0:3287:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fe9f6f71880 x1869752384389504/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783134920 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783134904.468589:0:3287:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9f6f71880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1869752384389504:0@lo:400:kworker.0 00010000:00010000:1.0:1783134904.584064:0:6591:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783134905.124442:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:0.0:1783134905.124482:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:0.0:1783134905.124509:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:0.0:1783134905.124535:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:0.0:1783134905.124562:0:6574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373877376 00000100:00100000:0.0:1783134905.124570:0:6574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373877376 00000100:00100000:0.0:1783134905.124625:0:6574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373877504 00000100:00100000:0.0:1783134905.124628:0:6574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373877504 00000100:00100000:0.0:1783134905.124653:0:6574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 8 00000100:00100000:0.0:1783134905.124663:0:6574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9f5ce2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+5:2367:x1869752373877376:12345-192.168.201.41@tcp:400:kworker.0 00000100:00100000:0.0:1783134905.124728:0:6574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9f5ce2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+5:2367:x1869752373877376:12345-192.168.201.41@tcp:400:kworker.0 Request processed in 67us (245us total) trans 0 rc 0/0 00000100:00100000:0.0:1783134905.124736:0:6574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 8 00000100:00100000:0.0:1783134905.124754:0:6574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 9 00000100:00100000:0.0:1783134905.124760:0:6574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9f5ce0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+5:2367:x1869752373877504:12345-192.168.201.41@tcp:400:kworker.0 00000100:00100000:0.0:1783134905.124784:0:6574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9f5ce0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+5:2367:x1869752373877504:12345-192.168.201.41@tcp:400:kworker.0 Request processed in 24us (248us total) trans 0 rc 0/0 00000100:00100000:0.0:1783134905.124790:0:6574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 9 00000100:00100000:0.0:1783134905.124809:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373877248 00000100:00100000:0.0:1783134905.124812:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373877248 00000100:00100000:0.0:1783134905.124860:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 24 00000100:00100000:0.0:1783134905.124867:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9f5ce0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+6:2367:x1869752373877248:12345-192.168.201.41@tcp:400:kworker.0 00000100:00100000:0.0:1783134905.124896:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9f5ce0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+6:2367:x1869752373877248:12345-192.168.201.41@tcp:400:kworker.0 Request processed in 30us (386us total) trans 0 rc 0/0 00000100:00100000:0.0:1783134905.124902:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 24 00000100:00080000:0.0:1783134905.124922:0:5766:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1783134905.124926:0:5766:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1783134905.124928:0:5766:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1783134905.125090:0:5762:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373877120 00000100:00100000:3.0:1783134905.125094:0:5762:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373877120 00000100:00100000:3.0:1783134905.125172:0:5762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 187 00000100:00100000:3.0:1783134905.125179:0:5762:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9d286b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f39b22bc-4faf-4b59-bb00-2a11f91e37c0+10:2367:x1869752373877120:12345-192.168.201.41@tcp:400:kworker.0 00000100:00100000:3.0:1783134905.125212:0:5762:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9d286b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f39b22bc-4faf-4b59-bb00-2a11f91e37c0+10:2367:x1869752373877120:12345-192.168.201.41@tcp:400:kworker.0 Request processed in 34us (780us total) trans 0 rc 0/0 00000100:00100000:3.0:1783134905.125218:0:5762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 187 00010000:00010000:0.0:1783134905.603486:0:5758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1783134906.006925:0:8872:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg141-server.virtnet: executing yml_node 00010000:00010000:3.0:1783134906.627400:0:5757:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783134907.651645:0:6591:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783134908.675628:0:5758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1783134909.491560:0:9065:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: Client: 2.17.54.83 00000100:00100000:3.0:1783134909.572860:0:3288:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe8c67b9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1869752384390144:0@lo:400:kworker.0 00000100:00100000:3.0:1783134909.572931:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783134909.572981:0:3288:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1783134909.572988:0:3288:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe8c67b8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:88a2002e-2ea7-4f07-912a-8d001832cfc0:3288:1869752384389760:0@lo:400:kworker.0 00000100:00100000:3.0:1783134909.573014:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783134909.573035:0:3288:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe8c67b9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3288:1869752384390272:0@lo:400:kworker.0 00000100:00100000:3.0:1783134909.573058:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783134909.573096:0:3287:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe8c67baa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3287:1869752384390016:0@lo:400:kworker.0 00000100:00100000:3.0:1783134909.573119:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783134909.573135:0:3287:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1783134909.573140:0:3287:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe8c67b9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3287:1869752384389888:0@lo:400:kworker.0 00000100:00100000:3.0:1783134909.573161:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783134909.573175:0:3287:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe8c67b9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1869752384390400:0@lo:400:kworker.0 00000100:00100000:3.0:1783134909.573194:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783134909.573461:0:3287:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe8c67bb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1869752384390528:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1783134909.573486:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783134909.573517:0:6578:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384390528 00000100:00100000:3.0:1783134909.573524:0:6578:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384390528 00000100:00100000:3.0:1783134909.573576:0:6578:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1783134909.573584:0:6578:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe8c67b8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3287:x1869752384390528:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1783134909.573620:0:6578:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1783134909.573662:0:6578:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe8c67b8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3287:x1869752384390528:12345-0@lo:13:osp-pre-1-0.0 Request processed in 77us (173us total) trans 0 rc 0/0 00000100:00100000:3.0:1783134909.573669:0:6578:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:3.0:1783134909.573709:0:3287:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fe8c67bb800 x1869752384390528/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783134925 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783134909.573737:0:3287:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe8c67bb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1869752384390528:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1783134909.573857:0:6574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384390144 00000100:00100000:0.0:1783134909.573861:0:6574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384390144 00000100:00100000:0.0:1783134909.573888:0:6574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384390400 00000100:00100000:0.0:1783134909.573891:0:6574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384390400 00000100:00100000:0.0:1783134909.573911:0:6574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1783134909.573919:0:6574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe8c67ba300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3288:x1869752384390144:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783134909.573955:0:6574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe8c67ba300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3288:x1869752384390144:12345-0@lo:400:kworker.0 Request processed in 37us (1024us total) trans 0 rc 0/0 00000100:00100000:0.0:1783134909.573961:0:6574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1783134909.573975:0:6574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1783134909.573981:0:6574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe8c67b8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3287:x1869752384390400:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783134909.574013:0:6574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe8c67b8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3287:x1869752384390400:12345-0@lo:400:kworker.0 Request processed in 32us (818us total) trans 0 rc 0/0 00000100:00100000:0.0:1783134909.574019:0:6574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1783134909.574036:0:5765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384389760 00000100:00100000:0.0:1783134909.574040:0:5765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384389760 00000100:00100000:0.0:1783134909.574178:0:5765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00100000:0.0:1783134909.574186:0:5765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9d2869850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88a2002e-2ea7-4f07-912a-8d001832cfc0+19:3288:x1869752384389760:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783134909.574224:0:5765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9d2869850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88a2002e-2ea7-4f07-912a-8d001832cfc0+19:3288:x1869752384389760:12345-0@lo:400:kworker.0 Request processed in 39us (1208us total) trans 0 rc 0/0 00000100:00100000:0.0:1783134909.574231:0:5765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00100000:0.0:1783134909.574259:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384390272 00000100:00100000:0.0:1783134909.574263:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384390272 00000100:00100000:0.0:1783134909.574318:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384390016 00000100:00100000:0.0:1783134909.574322:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384390016 00000100:00100000:0.0:1783134909.574336:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384389888 00000100:00100000:0.0:1783134909.574339:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384389888 00000100:00100000:0.0:1783134909.574353:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1783134909.574358:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe8c67b9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3288:x1869752384390272:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783134909.574385:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe8c67b9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3288:x1869752384390272:12345-0@lo:400:kworker.0 Request processed in 27us (1326us total) trans 0 rc 0/0 00000100:00100000:0.0:1783134909.574390:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1783134909.574400:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1783134909.574405:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe8c67bb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3287:x1869752384390016:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783134909.574428:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe8c67bb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3287:x1869752384390016:12345-0@lo:400:kworker.0 Request processed in 23us (1309us total) trans 0 rc 0/0 00000100:00100000:0.0:1783134909.574434:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1783134909.574444:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1783134909.574449:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe8c67bb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3287:x1869752384389888:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783134909.574472:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe8c67bb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3287:x1869752384389888:12345-0@lo:400:kworker.0 Request processed in 23us (1310us total) trans 0 rc 0/0 00000100:00100000:0.0:1783134909.574477:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00080000:0.0:1783134909.574495:0:5766:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1783134909.574498:0:5766:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1783134909.574500:0:5766:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1783134909.574537:0:3287:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe8c67b9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3287:1869752384389888:0@lo:400:kworker.0 00010000:00080000:0.0:1783134909.574548:0:3287:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fe8c67b9880 x1869752384390400/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783134925 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783134909.574557:0:3287:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe8c67b9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1869752384390400:0@lo:400:kworker.0 00000100:00100000:0.0:1783134909.574566:0:3287:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe8c67baa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3287:1869752384390016:0@lo:400:kworker.0 00000100:00100000:0.0:1783134909.574589:0:3288:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9f5ce2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1869752384390656:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1783134909.574614:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783134909.574637:0:3288:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe8c67b8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:88a2002e-2ea7-4f07-912a-8d001832cfc0:3288:1869752384389760:0@lo:400:kworker.0 00000100:00100000:0.0:1783134909.574648:0:3288:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe8c67b9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3288:1869752384390272:0@lo:400:kworker.0 00010000:00080000:0.0:1783134909.574657:0:3288:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fe8c67b9500 x1869752384390144/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783134925 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783134909.574665:0:3288:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe8c67b9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1869752384390144:0@lo:400:kworker.0 00000100:00100000:0.0:1783134909.574686:0:6578:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384390656 00000100:00100000:0.0:1783134909.574689:0:6578:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384390656 00000100:00100000:0.0:1783134909.574709:0:6578:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1783134909.574715:0:6578:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9f5ce0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3288:x1869752384390656:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1783134909.574737:0:6578:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1783134909.574779:0:6578:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9f5ce0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3288:x1869752384390656:12345-0@lo:13:osp-pre-0-0.0 Request processed in 54us (154us total) trans 0 rc 0/0 00000100:00100000:0.0:1783134909.574959:0:6578:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00080000:0.0:1783134909.575044:0:3288:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fe9f5ce2680 x1869752384390656/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783134925 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783134909.575057:0:3288:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9f5ce2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1869752384390656:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1783134909.699523:0:5757:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783134910.244657:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:0.0:1783134910.244701:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:0.0:1783134910.244746:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:0.0:1783134910.244795:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:0.0:1783134910.244823:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373877760 00000100:00100000:0.0:1783134910.244832:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373877760 00000100:00100000:0.0:1783134910.244888:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 28 00000100:00100000:0.0:1783134910.244898:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9f5ce0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+6:2367:x1869752373877760:12345-192.168.201.41@tcp:400:kworker.0 00000100:00100000:0.0:1783134910.244968:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9f5ce0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+6:2367:x1869752373877760:12345-192.168.201.41@tcp:400:kworker.0 Request processed in 71us (221us total) trans 0 rc 0/0 00000100:00100000:0.0:1783134910.244975:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 28 00000100:00100000:0.0:1783134910.244997:0:7676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373877888 00000100:00100000:0.0:1783134910.245001:0:7676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373877888 00000100:00100000:0.0:1783134910.245024:0:7676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373878016 00000100:00100000:0.0:1783134910.245026:0:7676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373878016 00000100:00100000:0.0:1783134910.245046:0:7676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 12 00000100:00100000:0.0:1783134910.245052:0:7676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9f5ce2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+5:2367:x1869752373877888:12345-192.168.201.41@tcp:400:kworker.0 00000100:00100000:0.0:1783134910.245078:0:7676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9f5ce2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+5:2367:x1869752373877888:12345-192.168.201.41@tcp:400:kworker.0 Request processed in 26us (376us total) trans 0 rc 0/0 00000100:00100000:0.0:1783134910.245084:0:7676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 12 00000100:00100000:0.0:1783134910.245095:0:7676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 13 00000100:00100000:0.0:1783134910.245100:0:7676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9f5ce2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+5:2367:x1869752373878016:12345-192.168.201.41@tcp:400:kworker.0 00000100:00100000:0.0:1783134910.245125:0:7676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9f5ce2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+5:2367:x1869752373878016:12345-192.168.201.41@tcp:400:kworker.0 Request processed in 24us (329us total) trans 0 rc 0/0 00000100:00100000:0.0:1783134910.245130:0:7676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 13 00000100:00080000:0.0:1783134910.245156:0:5766:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1783134910.245160:0:5766:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1783134910.245162:0:5766:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1783134910.245317:0:5763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373877632 00000100:00100000:1.0:1783134910.245321:0:5763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373877632 00000100:00100000:1.0:1783134910.245349:0:5763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 189 00000100:00100000:1.0:1783134910.245355:0:5763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9d286a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f39b22bc-4faf-4b59-bb00-2a11f91e37c0+10:2367:x1869752373877632:12345-192.168.201.41@tcp:400:kworker.0 00000100:00100000:1.0:1783134910.245387:0:5763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9d286a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f39b22bc-4faf-4b59-bb00-2a11f91e37c0+10:2367:x1869752373877632:12345-192.168.201.41@tcp:400:kworker.0 Request processed in 32us (740us total) trans 0 rc 0/0 00000100:00100000:1.0:1783134910.245393:0:5763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 189 00010000:00010000:1.0:1783134910.724078:0:6591:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1783134911.576595:0:9162:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: MDS: 2.17.54.83 00010000:00010000:0.0:1783134911.747848:0:5758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783134912.771499:0:5757:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1783134913.202110:0:9259:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: OSS: 2.17.54.83 00010000:00010000:1.0:1783134913.796323:0:6591:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1783134914.104766:0:9308:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: -----============= acceptance-small: sanity-pcc ============----- Fri Jul 3 23:15:13 EDT 2026 00000100:00100000:2.0:1783134914.691901:0:3289:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9f5ce1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1869752384390784:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1783134914.691972:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783134914.692101:0:6578:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384390784 00000100:00100000:0.0:1783134914.692163:0:6578:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384390784 00000100:00100000:0.0:1783134914.692261:0:6578:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1783134914.692269:0:6578:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9f6f73b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3289:x1869752384390784:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1783134914.692315:0:6578:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1783134914.692362:0:6578:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9f6f73b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3289:x1869752384390784:12345-0@lo:13:osp-pre-0-0.0 Request processed in 93us (389us total) trans 0 rc 0/0 00000100:00100000:0.0:1783134914.692369:0:6578:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1783134914.693098:0:3286:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe8c67bb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1869752384390912:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1783134914.693137:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783134914.693162:0:3286:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9f5ca6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3286:1869752384391424:0@lo:400:kworker.0 00000100:00100000:0.0:1783134914.693183:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783134914.693208:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1783134914.693213:0:3286:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9f5ce1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:88a2002e-2ea7-4f07-912a-8d001832cfc0:3286:1869752384391040:0@lo:400:kworker.0 00000100:00100000:0.0:1783134914.693236:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783134914.693252:0:3286:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9f5ca6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1869752384391552:0@lo:400:kworker.0 00000100:00100000:0.0:1783134914.693267:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783134914.693307:0:8031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384391424 00000100:00100000:0.0:1783134914.693311:0:8031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384391424 00000100:00100000:3.0:1783134914.693573:0:3288:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9f5ce1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3288:1869752384391168:0@lo:400:kworker.0 00000100:00100000:3.0:1783134914.693600:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783134914.693615:0:3288:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1783134914.693620:0:3288:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9f5ce2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3288:1869752384391296:0@lo:400:kworker.0 00000100:00100000:3.0:1783134914.693637:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783134914.693658:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384391168 00000100:00100000:3.0:1783134914.693661:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384391168 00000100:00100000:3.0:1783134914.693704:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384391296 00000100:00100000:3.0:1783134914.693707:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384391296 00000100:00100000:1.0:1783134914.693917:0:5769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1783134914.693927:0:5769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe8c67bad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3288:x1869752384391168:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783134914.693972:0:5769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe8c67bad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3288:x1869752384391168:12345-0@lo:400:kworker.0 Request processed in 48us (371us total) trans 0 rc 0/0 00000100:00100000:1.0:1783134914.693979:0:5769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1783134914.694016:0:3288:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9f5ce1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3288:1869752384391168:0@lo:400:kworker.0 00010000:00080000:1.0:1783134914.694047:0:3289:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fe9f5ce1880 x1869752384390784/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783134930 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783134914.694063:0:3289:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9f5ce1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1869752384390784:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1783134914.694094:0:6578:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384390912 00000100:00100000:1.0:1783134914.694097:0:6578:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384390912 00000100:00080000:2.0:1783134914.697238:0:5766:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1783134914.697249:0:5766:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1783134914.697252:0:5766:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1783134914.697323:0:7676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384391552 00000100:00100000:2.0:1783134914.697332:0:7676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384391552 00000100:00100000:2.0:1783134914.697396:0:7676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1783134914.697407:0:7676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9f5ca5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3286:x1869752384391552:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783134914.697514:0:7676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9f5ca5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3286:x1869752384391552:12345-0@lo:400:kworker.0 Request processed in 101us (4236us total) trans 0 rc 0/0 00000100:00100000:2.0:1783134914.697522:0:7676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1783134914.697544:0:5762:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384391040 00000100:00100000:2.0:1783134914.697548:0:5762:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384391040 00000100:00100000:2.0:1783134914.697577:0:5762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 190 00000100:00100000:2.0:1783134914.697597:0:5762:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9d286a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88a2002e-2ea7-4f07-912a-8d001832cfc0+19:3286:x1869752384391040:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783134914.697630:0:5762:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9d286a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88a2002e-2ea7-4f07-912a-8d001832cfc0+19:3286:x1869752384391040:12345-0@lo:400:kworker.0 Request processed in 34us (4393us total) trans 0 rc 0/0 00000100:00100000:2.0:1783134914.697637:0:5762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 190 00000100:00100000:2.0:1783134914.697709:0:3286:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9f5ce1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:88a2002e-2ea7-4f07-912a-8d001832cfc0:3286:1869752384391040:0@lo:400:kworker.0 00010000:00080000:2.0:1783134914.697725:0:3286:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fe9f5ca6300 x1869752384391552/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783134930 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783134914.697738:0:3286:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9f5ca6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1869752384391552:0@lo:400:kworker.0 00000100:00100000:0.0:1783134914.698354:0:5769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1783134914.698366:0:5769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9f5ca5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3286:x1869752384391424:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783134914.698415:0:5769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9f5ca5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3286:x1869752384391424:12345-0@lo:400:kworker.0 Request processed in 53us (5231us total) trans 0 rc 0/0 00000100:00100000:0.0:1783134914.698432:0:5769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1783134914.698465:0:3286:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9f5ca6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3286:1869752384391424:0@lo:400:kworker.0 00000100:00100000:3.0:1783134914.699421:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1783134914.699431:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe8c67b8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3288:x1869752384391296:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783134914.699484:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe8c67b8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3288:x1869752384391296:12345-0@lo:400:kworker.0 Request processed in 56us (5845us total) trans 0 rc 0/0 00000100:00100000:3.0:1783134914.699489:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1783134914.699533:0:3288:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9f5ce2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3288:1869752384391296:0@lo:400:kworker.0 00000100:00100000:1.0:1783134914.714804:0:6578:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1783134914.714818:0:6578:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9f5ca5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1869752384390912:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1783134914.714871:0:6578:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1783134914.714950:0:6578:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9f5ca5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1869752384390912:12345-0@lo:13:osp-pre-1-0.0 Request processed in 135us (21811us total) trans 0 rc 0/0 00000100:00100000:1.0:1783134914.714957:0:6578:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00080000:1.0:1783134914.715010:0:3286:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fe8c67bb800 x1869752384390912/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783134930 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783134914.715028:0:3286:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe8c67bb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1869752384390912:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1783134914.819788:0:5758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783134915.364480:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:0.0:1783134915.364565:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:2.0:1783134915.364619:0:5765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373878144 00000100:00100000:3.0:1783134915.364624:0:5769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373878272 00000100:00100000:3.0:1783134915.364628:0:5769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373878272 00000100:00100000:2.0:1783134915.364628:0:5765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373878144 00000100:00100000:3.0:1783134915.364690:0:5769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 32 00000100:00080000:0.0:1783134915.364694:0:5766:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1783134915.364701:0:5769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9f5ca6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+6:2367:x1869752373878272:12345-192.168.201.41@tcp:400:kworker.0 00000100:00100000:3.0:1783134915.364790:0:5769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9f5ca6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+6:2367:x1869752373878272:12345-192.168.201.41@tcp:400:kworker.0 Request processed in 83us (216us total) trans 0 rc 0/0 00000100:00100000:2.0:1783134915.364790:0:5765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 191 00000100:00100000:2.0:1783134915.364798:0:5765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9d2868450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f39b22bc-4faf-4b59-bb00-2a11f91e37c0+10:2367:x1869752373878144:12345-192.168.201.41@tcp:400:kworker.0 00000100:00100000:3.0:1783134915.364803:0:5769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 32 00000100:00100000:2.0:1783134915.364823:0:5765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9d2868450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f39b22bc-4faf-4b59-bb00-2a11f91e37c0+10:2367:x1869752373878144:12345-192.168.201.41@tcp:400:kworker.0 Request processed in 27us (351us total) trans 0 rc 0/0 00000100:00100000:2.0:1783134915.364829:0:5765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 191 00000100:00100000:1.0:1783134915.370698:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:0.0:1783134915.370857:0:6576:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373878400 00000100:00100000:0.0:1783134915.370866:0:6576:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373878400 00000100:00100000:0.0:1783134915.370934:0:6576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 10 00000100:00100000:0.0:1783134915.370946:0:6576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9f6733100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+5:2366:x1869752373878400:12345-192.168.201.41@tcp:9:kworker.0 00000020:00000080:0.0:1783134915.370981:0:6576:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xd6c4b8f05867e58f 00000100:00080000:0.0:1783134915.370991:0:6576:0:(import.c:65:import_set_state_nolock()) ffff9fea01d7c800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1783134915.371076:0:6576:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:0.0:1783134915.371440:0:6576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9f6733100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+2:2366:x1869752373878400:12345-192.168.201.41@tcp:9:kworker.0 Request processed in 496us (749us total) trans 0 rc 0/0 00000100:00100000:0.0:1783134915.371448:0:6576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 10 00000100:00080000:1.0:1783134915.371694:0:5766:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1783134915.372020:0:5757:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783134915.372080:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:1.0:1783134915.372155:0:7676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373878528 00000100:00100000:1.0:1783134915.372161:0:7676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373878528 00000100:00100000:1.0:1783134915.372232:0:7676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 11 00000100:00100000:1.0:1783134915.372240:0:7676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9f5ca7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+5:2366:x1869752373878528:12345-192.168.201.41@tcp:9:kworker.0 00000020:00000080:1.0:1783134915.372261:0:7676:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xd6c4b8f05867e596 00000100:00080000:1.0:1783134915.372267:0:7676:0:(import.c:65:import_set_state_nolock()) ffff9fe8c5ffa000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1783134915.372307:0:7676:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:1.0:1783134915.372524:0:7676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9f5ca7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+2:2366:x1869752373878528:12345-192.168.201.41@tcp:9:kworker.0 Request processed in 284us (445us total) trans 0 rc 0/0 00000100:00100000:1.0:1783134915.372543:0:7676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 11 00010000:00010000:1.0:1783134915.372584:0:6591:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1783134915.372857:0:5766:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1783134915.845803:0:5758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783134916.868465:0:5757:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783134917.891443:0:6591:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783134918.915446:0:5758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1783134919.320233:0:7470:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 28f4ba61-cfae-499e-ab3d-81cb8215f7bb 00000020:00000080:2.0:1783134919.320242:0:7470:0:(genops.c:906:class_export_put()) final put ffff9fe8c5ffe000/28f4ba61-cfae-499e-ab3d-81cb8215f7bb 00000020:00000080:3.0:1783134919.320277:0:483:0:(genops.c:865:class_export_destroy()) destroying export ffff9fe8c5ffe000/28f4ba61-cfae-499e-ab3d-81cb8215f7bb for lustre-OST0001 00000020:00000080:3.0:1783134919.320337:0:483:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9fe8c5ffa000 for lustre-OST0001 00000100:00100000:0.0:1783134919.811509:0:3288:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9f5ca4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:88a2002e-2ea7-4f07-912a-8d001832cfc0:3288:1869752384391680:0@lo:400:kworker.0 00000100:00100000:2.0:1783134919.811510:0:3289:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9f5ca4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3289:1869752384391808:0@lo:400:kworker.0 00000100:00100000:2.0:1783134919.811613:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783134919.811741:0:3289:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9ca88e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1869752384392320:0@lo:400:kworker.0 00000100:00100000:0.0:1783134919.811745:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783134919.811780:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783134919.811787:0:3288:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9f5ca6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3288:1869752384392192:0@lo:400:kworker.0 00000100:00100000:0.0:1783134919.811827:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783134919.811840:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384391808 00000100:00100000:2.0:1783134919.811848:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384391808 00000100:00100000:0.0:1783134919.811866:0:3287:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9f5ca4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1869752384392064:0@lo:400:kworker.0 00000100:00100000:2.0:1783134919.811901:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384392192 00000100:00100000:2.0:1783134919.811910:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384392192 00000100:00100000:2.0:1783134919.811943:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1783134919.811953:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9f6f71f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3289:x1869752384391808:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783134919.811970:0:3286:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9f5ca6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3286:1869752384391936:0@lo:400:kworker.0 00000100:00100000:0.0:1783134919.811973:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783134919.812019:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783134919.812026:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384391936 00000100:00100000:0.0:1783134919.812031:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384391936 00000100:00100000:2.0:1783134919.812032:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9f6f71f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3289:x1869752384391808:12345-0@lo:400:kworker.0 Request processed in 79us (422us total) trans 0 rc 0/0 00000100:00100000:2.0:1783134919.812043:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1783134919.812065:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1783134919.812073:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1783134919.812078:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9ca88ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3288:x1869752384392192:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783134919.812084:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9f6731180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3286:x1869752384391936:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783134919.812128:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9f6731180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3286:x1869752384391936:12345-0@lo:400:kworker.0 Request processed in 48us (111us total) trans 0 rc 0/0 00000100:00100000:2.0:1783134919.812136:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1783134919.812149:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9ca88ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3288:x1869752384392192:12345-0@lo:400:kworker.0 Request processed in 73us (319us total) trans 0 rc 0/0 00000100:00100000:0.0:1783134919.812158:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1783134919.812161:0:5763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384391680 00000100:00100000:2.0:1783134919.812166:0:5763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384391680 00000100:00100000:0.0:1783134919.812186:0:6576:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384392320 00000100:00100000:0.0:1783134919.812191:0:6576:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384392320 00000100:00100000:2.0:1783134919.812200:0:5763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 192 00000100:00100000:2.0:1783134919.812210:0:5763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9d0e61050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88a2002e-2ea7-4f07-912a-8d001832cfc0+19:3288:x1869752384391680:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783134919.812227:0:6576:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384392064 00000100:00100000:0.0:1783134919.812232:0:6576:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384392064 00000100:00100000:2.0:1783134919.812259:0:5763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9d0e61050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88a2002e-2ea7-4f07-912a-8d001832cfc0+19:3288:x1869752384391680:12345-0@lo:400:kworker.0 Request processed in 50us (650us total) trans 0 rc 0/0 00000100:00100000:0.0:1783134919.812261:0:6576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1783134919.812268:0:5763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 192 00000100:00100000:2.0:1783134919.812525:0:6574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00080000:2.0:1783134919.812561:0:5766:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1783134919.812566:0:5766:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1783134919.812567:0:6576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9f6f73480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3289:x1869752384392320:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1783134919.812569:0:5766:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1783134919.812608:0:6574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9ca88d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3287:x1869752384392064:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783134919.812692:0:3287:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9f6732300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1869752384392576:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1783134919.814932:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783134919.814933:0:6576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9f6f73480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3289:x1869752384392320:12345-0@lo:400:kworker.0 Request processed in 2400us (3148us total) trans 0 rc 0/0 00000100:00100000:2.0:1783134919.814935:0:6574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9ca88d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3287:x1869752384392064:12345-0@lo:400:kworker.0 Request processed in 2399us (2961us total) trans 0 rc 0/0 00000100:00100000:0.0:1783134919.814951:0:6576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1783134919.814959:0:6574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00080000:1.0:1783134919.814997:0:3287:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fe9f5ca4e00 x1869752384392064/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783134935 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783134919.815014:0:3287:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9f5ca4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1869752384392064:0@lo:400:kworker.0 00000100:00100000:0.0:1783134919.815021:0:3288:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9f5ca4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:88a2002e-2ea7-4f07-912a-8d001832cfc0:3288:1869752384391680:0@lo:400:kworker.0 00000100:00100000:1.0:1783134919.815039:0:3287:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1783134919.815039:0:3288:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9f5ca6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3288:1869752384392192:0@lo:400:kworker.0 00000100:00100000:1.0:1783134919.815052:0:3287:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9f6731880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1869752384392448:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1783134919.815100:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783134919.815140:0:6578:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384392576 00000100:00100000:1.0:1783134919.815146:0:6578:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384392576 00000100:00100000:1.0:1783134919.815180:0:6578:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384392448 00000100:00100000:1.0:1783134919.815184:0:6578:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384392448 00000100:00100000:1.0:1783134919.815208:0:6578:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1783134919.815216:0:6578:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9f6733800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3287:x1869752384392576:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1783134919.815251:0:6578:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1783134919.815313:0:6578:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9f6733800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3287:x1869752384392576:12345-0@lo:13:osp-pre-0-0.0 Request processed in 97us (387us total) trans 0 rc 0/0 00000100:00100000:1.0:1783134919.815320:0:6578:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1783134919.815335:0:6578:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1783134919.815342:0:6578:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9f6733b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3287:x1869752384392448:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1783134919.815364:0:6578:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1783134919.815392:0:6578:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9f6733b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3287:x1869752384392448:12345-0@lo:13:osp-pre-1-0.0 Request processed in 52us (293us total) trans 0 rc 0/0 00000100:00100000:1.0:1783134919.815399:0:6578:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1783134919.815434:0:3286:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9f5ca6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3286:1869752384391936:0@lo:400:kworker.0 00010000:00080000:1.0:1783134919.815460:0:3287:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fe9f6731880 x1869752384392448/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783134935 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783134919.815474:0:3287:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9f6731880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1869752384392448:0@lo:13:osp-pre-1-0.0 00010000:00080000:1.0:1783134919.815496:0:3287:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fe9f6732300 x1869752384392576/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783134935 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783134919.815509:0:3287:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9f6732300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1869752384392576:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1783134919.815880:0:3289:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9f5ca4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3289:1869752384391808:0@lo:400:kworker.0 00010000:00080000:1.0:1783134919.815909:0:3289:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fe9ca88e680 x1869752384392320/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783134935 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783134919.815921:0:3289:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9ca88e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1869752384392320:0@lo:400:kworker.0 00000001:00100000:0.0:1783134919.854635:0:6602:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 28f4ba61-cfae-499e-ab3d-81cb8215f7bb 00000020:00000080:0.0:1783134919.854645:0:6602:0:(genops.c:906:class_export_put()) final put ffff9fea01d7c000/28f4ba61-cfae-499e-ab3d-81cb8215f7bb 00000020:00000080:1.0:1783134919.854755:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9fea01d7c000/28f4ba61-cfae-499e-ab3d-81cb8215f7bb for lustre-OST0000 00000020:00000080:1.0:1783134919.854899:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9fea01d7c800 for lustre-OST0000 00010000:00010000:0.0:1783134919.942499:0:5757:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783134920.485848:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:0.0:1783134920.485883:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:2.0:1783134920.485908:0:5765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373878656 00000100:00100000:2.0:1783134920.485929:0:5765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373878656 00000100:00100000:3.0:1783134920.485968:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373878784 00000100:00100000:3.0:1783134920.485973:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373878784 00000100:00100000:2.0:1783134920.485990:0:5765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 193 00000100:00100000:2.0:1783134920.486001:0:5765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9d0e63850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f39b22bc-4faf-4b59-bb00-2a11f91e37c0+10:2367:x1869752373878656:12345-192.168.201.41@tcp:400:kworker.0 00000100:00100000:3.0:1783134920.486030:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 36 00000100:00100000:3.0:1783134920.486038:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9ca88d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+6:2367:x1869752373878784:12345-192.168.201.41@tcp:400:kworker.0 00000100:00080000:1.0:1783134920.486076:0:5766:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1783134920.486081:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9ca88d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+6:2367:x1869752373878784:12345-192.168.201.41@tcp:400:kworker.0 Request processed in 43us (196us total) trans 0 rc 0/0 00000100:00100000:2.0:1783134920.486083:0:5765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9d0e63850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f39b22bc-4faf-4b59-bb00-2a11f91e37c0+10:2367:x1869752373878656:12345-192.168.201.41@tcp:400:kworker.0 Request processed in 82us (240us total) trans 0 rc 0/0 00000100:00100000:3.0:1783134920.486091:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 36 00000100:00100000:2.0:1783134920.486098:0:5765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 193 00010000:00010000:1.0:1783134920.963487:0:6591:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1783134921.720160:0:9939:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: start setup 23:15:20 (1783134920) === 00010000:00010000:0.0:1783134921.988101:0:5758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783134922.055964:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:0.0:1783134922.056132:0:5762:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373878912 00000100:00100000:0.0:1783134922.056145:0:5762:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373878912 00000100:00100000:0.0:1783134922.056210:0:5762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 194 00000100:00100000:0.0:1783134922.056221:0:5762:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9d0e61850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f39b22bc-4faf-4b59-bb00-2a11f91e37c0+10:8104:x1869752373878912:12345-192.168.201.41@tcp:101:mount.lustre.0 00010000:00010000:0.0:1783134922.056244:0:5762:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783134922.056268:0:5762:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fe9c148b200/0xd6c4b8f05867e65a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x4428da03f5eb70e4 expref: -99 pid: 5762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134922.056346:0:5762:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fe9c148b200/0xd6c4b8f05867e65a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb70e4 expref: 11 pid: 5762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134922.056360:0:5762:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fe9c148b200/0xd6c4b8f05867e65a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb70e4 expref: 11 pid: 5762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134922.056372:0:5762:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fe9c148b200, rc 0) 00000100:00100000:0.0:1783134922.056438:0:5762:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9d0e61850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f39b22bc-4faf-4b59-bb00-2a11f91e37c0+11:8104:x1869752373878912:12345-192.168.201.41@tcp:101:mount.lustre.0 Request processed in 219us (488us total) trans 0 rc 0/0 00000100:00100000:0.0:1783134922.056446:0:5762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 194 00000100:00100000:0.0:1783134922.058530:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:2.0:1783134922.058610:0:5765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373879040 00000100:00100000:2.0:1783134922.058621:0:5765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373879040 00000100:00100000:2.0:1783134922.058736:0:5765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 195 00000100:00100000:2.0:1783134922.058746:0:5765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9d0e62850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f39b22bc-4faf-4b59-bb00-2a11f91e37c0+11:8104:x1869752373879040:12345-192.168.201.41@tcp:501:mount.lustre.0 00000100:00100000:2.0:1783134922.059098:0:5765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9d0e62850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f39b22bc-4faf-4b59-bb00-2a11f91e37c0+11:8104:x1869752373879040:12345-192.168.201.41@tcp:501:mount.lustre.0 Request processed in 352us (579us total) trans 0 rc 0/0 00000100:00100000:2.0:1783134922.059105:0:5765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 195 00000100:00100000:1.0:1783134922.068146:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:2.0:1783134922.072713:0:5763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373879168 00000100:00100000:2.0:1783134922.072730:0:5763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373879168 00000100:00100000:2.0:1783134922.072816:0:5763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 196 00000100:00100000:2.0:1783134922.072827:0:5763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9d0e62050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f39b22bc-4faf-4b59-bb00-2a11f91e37c0+11:8104:x1869752373879168:12345-192.168.201.41@tcp:503:mount.lustre.0 00000100:00100000:2.0:1783134922.073096:0:5763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9d0e62050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f39b22bc-4faf-4b59-bb00-2a11f91e37c0+11:8104:x1869752373879168:12345-192.168.201.41@tcp:503:mount.lustre.0 Request processed in 271us (4966us total) trans 0 rc 0/0 00000100:00100000:2.0:1783134922.073103:0:5763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 196 00000100:00100000:1.0:1783134922.078314:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:2.0:1783134922.078478:0:5765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373879296 00000100:00100000:2.0:1783134922.078489:0:5765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373879296 00000100:00100000:2.0:1783134922.078548:0:5765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 197 00000100:00100000:2.0:1783134922.078569:0:5765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9d0e60450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f39b22bc-4faf-4b59-bb00-2a11f91e37c0+11:8108:x1869752373879296:12345-192.168.201.41@tcp:502:llog_process_th.0 00000100:00100000:2.0:1783134922.079022:0:5765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9d0e60450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f39b22bc-4faf-4b59-bb00-2a11f91e37c0+11:8108:x1869752373879296:12345-192.168.201.41@tcp:502:llog_process_th.0 Request processed in 455us (757us total) trans 0 rc 0/0 00000100:00100000:2.0:1783134922.079030:0:5765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 197 00000100:00100000:0.0:1783134922.096178:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:3.0:1783134922.098081:0:5762:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373879424 00000100:00100000:3.0:1783134922.098099:0:5762:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373879424 00000100:00100000:2.0:1783134922.098377:0:5762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 198 00000100:00100000:2.0:1783134922.098391:0:5762:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9d0e62450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f39b22bc-4faf-4b59-bb00-2a11f91e37c0+11:8108:x1869752373879424:12345-192.168.201.41@tcp:502:llog_process_th.0 00000100:00100000:2.0:1783134922.098791:0:5762:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9d0e62450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f39b22bc-4faf-4b59-bb00-2a11f91e37c0+11:8108:x1869752373879424:12345-192.168.201.41@tcp:502:llog_process_th.0 Request processed in 401us (2627us total) trans 0 rc 0/0 00000100:00100000:2.0:1783134922.098800:0:5762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 198 00000100:00100000:1.0:1783134922.113993:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:2.0:1783134922.114412:0:5765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373879552 00000100:00100000:2.0:1783134922.114426:0:5765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373879552 00000100:00100000:2.0:1783134922.114506:0:5765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 199 00000100:00100000:2.0:1783134922.114519:0:5765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9d0e61450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f39b22bc-4faf-4b59-bb00-2a11f91e37c0+11:8104:x1869752373879552:12345-192.168.201.41@tcp:101:mount.lustre.0 00010000:00010000:2.0:1783134922.114542:0:5765:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783134922.114583:0:5765:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fe9c1523e00/0xd6c4b8f05867e661 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x4428da03f5eb710e expref: -99 pid: 5765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134922.114620:0:5765:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fe9c1523e00/0xd6c4b8f05867e661 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb710e expref: 12 pid: 5765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134922.114632:0:5765:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fe9c1523e00/0xd6c4b8f05867e661 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb710e expref: 12 pid: 5765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134922.114642:0:5765:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fe9c1523e00, rc 0) 00000100:00100000:2.0:1783134922.115959:0:5765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9d0e61450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f39b22bc-4faf-4b59-bb00-2a11f91e37c0+12:8104:x1869752373879552:12345-192.168.201.41@tcp:101:mount.lustre.0 Request processed in 1431us (1969us total) trans 0 rc 0/0 00000100:00100000:2.0:1783134922.115972:0:5765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 199 00000100:00100000:1.0:1783134922.119816:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:2.0:1783134922.120070:0:5762:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373879680 00000100:00100000:2.0:1783134922.120081:0:5762:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373879680 00000100:00100000:2.0:1783134922.120169:0:5762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 200 00000100:00100000:2.0:1783134922.120182:0:5762:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9d0e60c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f39b22bc-4faf-4b59-bb00-2a11f91e37c0+12:8104:x1869752373879680:12345-192.168.201.41@tcp:256:mount.lustre.0 20000000:01000000:2.0:1783134922.120222:0:5762:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:2.0:1783134922.120254:0:5762:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1783134922.120259:0:5762:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1783134922.120263:0:5762:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1783134922.120265:0:5762:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:2.0:1783134922.122885:0:5762:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9d0e60c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f39b22bc-4faf-4b59-bb00-2a11f91e37c0+12:8104:x1869752373879680:12345-192.168.201.41@tcp:256:mount.lustre.0 Request processed in 2690us (3068us total) trans 0 rc 0/0 00000100:00100000:2.0:1783134922.122902:0:5762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 200 00000100:00100000:1.0:1783134922.133521:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:2.0:1783134922.133680:0:5765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373879808 00000100:00100000:2.0:1783134922.133693:0:5765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373879808 00000100:00100000:2.0:1783134922.133775:0:5765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 201 00000100:00100000:2.0:1783134922.133787:0:5765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9d1657450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f39b22bc-4faf-4b59-bb00-2a11f91e37c0+12:8104:x1869752373879808:12345-192.168.201.41@tcp:101:mount.lustre.0 00010000:00010000:2.0:1783134922.133811:0:5765:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783134922.133836:0:5765:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fe9c1523a00/0xd6c4b8f05867e668 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x4428da03f5eb7115 expref: -99 pid: 5765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134922.133874:0:5765:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fe9c1523a00/0xd6c4b8f05867e668 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb7115 expref: 13 pid: 5765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134922.133888:0:5765:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fe9c1523a00/0xd6c4b8f05867e668 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb7115 expref: 13 pid: 5765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134922.133899:0:5765:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fe9c1523a00, rc 0) 00000100:00100000:2.0:1783134922.133972:0:5765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9d1657450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f39b22bc-4faf-4b59-bb00-2a11f91e37c0+13:8104:x1869752373879808:12345-192.168.201.41@tcp:101:mount.lustre.0 Request processed in 186us (465us total) trans 0 rc 0/0 00000100:00100000:2.0:1783134922.133995:0:5765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 201 00000100:00100000:1.0:1783134922.136810:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:2.0:1783134922.136914:0:5762:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373879936 00000100:00100000:2.0:1783134922.136925:0:5762:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373879936 00000100:00100000:2.0:1783134922.136991:0:5762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 202 00000100:00100000:2.0:1783134922.137003:0:5762:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9d1654050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f39b22bc-4faf-4b59-bb00-2a11f91e37c0+13:8104:x1869752373879936:12345-192.168.201.41@tcp:501:mount.lustre.0 00000100:00100000:2.0:1783134922.137433:0:5762:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9d1654050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f39b22bc-4faf-4b59-bb00-2a11f91e37c0+13:8104:x1869752373879936:12345-192.168.201.41@tcp:501:mount.lustre.0 Request processed in 431us (634us total) trans 0 rc 0/0 00000100:00100000:2.0:1783134922.137442:0:5762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 202 00000100:00100000:3.0:1783134922.145702:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:0.0:1783134922.145822:0:5763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373880064 00000100:00100000:0.0:1783134922.145835:0:5763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373880064 00000100:00100000:0.0:1783134922.145905:0:5763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 203 00000100:00100000:0.0:1783134922.145915:0:5763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9d1655050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f39b22bc-4faf-4b59-bb00-2a11f91e37c0+13:8104:x1869752373880064:12345-192.168.201.41@tcp:503:mount.lustre.0 00000100:00100000:0.0:1783134922.146173:0:5763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9d1655050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f39b22bc-4faf-4b59-bb00-2a11f91e37c0+13:8104:x1869752373880064:12345-192.168.201.41@tcp:503:mount.lustre.0 Request processed in 258us (488us total) trans 0 rc 0/0 00000100:00100000:0.0:1783134922.146179:0:5763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 203 00000100:00100000:1.0:1783134922.152374:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:0.0:1783134922.152587:0:5765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373880192 00000100:00100000:0.0:1783134922.152599:0:5765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373880192 00000100:00100000:0.0:1783134922.152736:0:5765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 204 00000100:00100000:0.0:1783134922.152749:0:5765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9d1657850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f39b22bc-4faf-4b59-bb00-2a11f91e37c0+13:8113:x1869752373880192:12345-192.168.201.41@tcp:502:llog_process_th.0 00000100:00100000:0.0:1783134922.153096:0:5765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9d1657850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f39b22bc-4faf-4b59-bb00-2a11f91e37c0+13:8113:x1869752373880192:12345-192.168.201.41@tcp:502:llog_process_th.0 Request processed in 347us (732us total) trans 0 rc 0/0 00000100:00100000:0.0:1783134922.153106:0:5765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 204 00000100:00100000:1.0:1783134922.157625:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:2.0:1783134922.157711:0:5762:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373880320 00000100:00100000:2.0:1783134922.158026:0:5762:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373880320 00000100:00100000:2.0:1783134922.158093:0:5762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 205 00000100:00100000:2.0:1783134922.158103:0:5762:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9d1655850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f39b22bc-4faf-4b59-bb00-2a11f91e37c0+13:8113:x1869752373880320:12345-192.168.201.41@tcp:502:llog_process_th.0 00000100:00100000:2.0:1783134922.158449:0:5762:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9d1655850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f39b22bc-4faf-4b59-bb00-2a11f91e37c0+13:8113:x1869752373880320:12345-192.168.201.41@tcp:502:llog_process_th.0 Request processed in 346us (835us total) trans 0 rc 0/0 00000100:00100000:2.0:1783134922.158458:0:5762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 205 00000100:00100000:3.0:1783134922.161246:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:2.0:1783134922.161318:0:8031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373880448 00000100:00100000:3.0:1783134922.161322:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:2.0:1783134922.161330:0:8031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373880448 00000100:00100000:2.0:1783134922.161371:0:8031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373880832 00000100:00100000:2.0:1783134922.161374:0:8031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373880832 00000100:00100000:3.0:1783134922.161385:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 10 00000100:00100000:3.0:1783134922.161395:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe8c67bb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2366:x1869752373880448:12345-192.168.201.41@tcp:38:mount.lustre.0 00010000:00080000:3.0:1783134922.161433:0:5771:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from c936801d-68e8-41a4-8fbc-6becd5e1be74@192.168.201.41@tcp t0 exp 0000000000000000 cur 204 last 0 00000100:00100000:2.0:1783134922.161433:0:8031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 37 00000100:00100000:2.0:1783134922.161442:0:8031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe8c67b9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+6:2370:x1869752373880832:12345-192.168.201.41@tcp:400:kworker.0 00000020:00000080:3.0:1783134922.161482:0:5771:0:(genops.c:1406:class_connect()) connect: client c936801d-68e8-41a4-8fbc-6becd5e1be74, cookie 0xd6c4b8f05867e66f 00000004:00100000:3.0:1783134922.161521:0:5771:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00100000:2.0:1783134922.161531:0:8031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe8c67b9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+6:2370:x1869752373880832:12345-192.168.201.41@tcp:400:kworker.0 Request processed in 91us (207us total) trans 0 rc 0/0 00000100:00100000:2.0:1783134922.161539:0:8031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 37 00000100:00080000:1.0:1783134922.161739:0:5766:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1783134922.162382:0:5771:0:(import.c:65:import_set_state_nolock()) ffff9fe8c57d9000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1783134922.162820:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe8c67bb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c936801d-68e8-41a4-8fbc-6becd5e1be74+6:2366:x1869752373880448:12345-192.168.201.41@tcp:38:mount.lustre.0 Request processed in 1049us (1210us total) trans 0 rc 0/0 00000100:00100000:2.0:1783134922.162831:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 10 00000100:00100000:3.0:1783134922.167546:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:3.0:1783134922.167626:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:2.0:1783134922.167651:0:8031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373880704 00000100:00100000:2.0:1783134922.167663:0:8031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373880704 00000100:00100000:0.0:1783134922.167727:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373880576 00000100:00100000:0.0:1783134922.167731:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373880576 00000100:00100000:0.0:1783134922.167788:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 11 00000100:00100000:0.0:1783134922.167799:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe8c67b8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c936801d-68e8-41a4-8fbc-6becd5e1be74+7:0:x1869752373880576:12345-192.168.201.41@tcp:41:mount.lustre.0 00000004:00000024:0.0:1783134922.167860:0:5770:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1783134922.167941:0:8031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 12 00000100:00100000:2.0:1783134922.167960:0:8031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe8c67b9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c936801d-68e8-41a4-8fbc-6becd5e1be74+7:8104:x1869752373880704:12345-192.168.201.41@tcp:41:mount.lustre.0 00000100:00100000:0.0:1783134922.167969:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe8c67b8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c936801d-68e8-41a4-8fbc-6becd5e1be74+7:0:x1869752373880576:12345-192.168.201.41@tcp:41:mount.lustre.0 Request processed in 172us (342us total) trans 0 rc 0/0 00000004:00000024:2.0:1783134922.167974:0:8031:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1783134922.167977:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 11 00000100:00100000:2.0:1783134922.168000:0:8031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe8c67b9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c936801d-68e8-41a4-8fbc-6becd5e1be74+6:8104:x1869752373880704:12345-192.168.201.41@tcp:41:mount.lustre.0 Request processed in 53us (467us total) trans 0 rc 0/0 00000100:00100000:2.0:1783134922.168007:0:8031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 12 00000100:00080000:1.0:1783134922.168114:0:5766:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1783134922.169243:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:0.0:1783134922.169309:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373880960 00000100:00100000:0.0:1783134922.169317:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373880960 00000100:00100000:0.0:1783134922.169353:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 13 00000100:00100000:0.0:1783134922.169361:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9f6732300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c936801d-68e8-41a4-8fbc-6becd5e1be74+6:8104:x1869752373880960:12345-192.168.201.41@tcp:40:mount.lustre.0 00000100:00100000:0.0:1783134922.169428:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9f6732300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c936801d-68e8-41a4-8fbc-6becd5e1be74+6:8104:x1869752373880960:12345-192.168.201.41@tcp:40:mount.lustre.0 Request processed in 68us (189us total) trans 0 rc 0/0 00000100:00100000:0.0:1783134922.169434:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 13 00000100:00100000:1.0:1783134922.172374:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:1.0:1783134922.172402:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:1.0:1783134922.172434:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:2.0:1783134922.172476:0:7676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373881088 00000100:00100000:2.0:1783134922.172487:0:7676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373881088 00000100:00100000:0.0:1783134922.172515:0:6577:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373881216 00000100:00100000:0.0:1783134922.172520:0:6577:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373881216 00000100:00100000:2.0:1783134922.172538:0:7676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 12 00000100:00100000:2.0:1783134922.172547:0:7676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9f6731880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2366:x1869752373881088:12345-192.168.201.41@tcp:8:mount.lustre.0 00010000:00080000:2.0:1783134922.172604:0:7676:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0000: connection from c936801d-68e8-41a4-8fbc-6becd5e1be74@192.168.201.41@tcp t0 exp 0000000000000000 cur 204 last 0 00000100:00100000:3.0:1783134922.172613:0:5772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373881344 00000100:00100000:3.0:1783134922.172634:0:5772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373881344 00000020:00000080:2.0:1783134922.172663:0:7676:0:(genops.c:1406:class_connect()) connect: client c936801d-68e8-41a4-8fbc-6becd5e1be74, cookie 0xd6c4b8f05867e676 00000100:00100000:3.0:1783134922.172675:0:5772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 1 00002000:00100000:2.0:1783134922.172680:0:7676:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli c936801d-68e8-41a4-8fbc-6becd5e1be74/ffff9fe8c57df800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113653 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00000100:00100000:3.0:1783134922.172682:0:5772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9f6731500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c936801d-68e8-41a4-8fbc-6becd5e1be74+6:8104:x1869752373881344:12345-192.168.201.41@tcp:33:mount.lustre.0 00002000:00100000:2.0:1783134922.172720:0:7676:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00000004:00200000:3.0:1783134922.172899:0:5772:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00002000:00080000:2.0:1783134922.173015:0:7676:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00100000:3.0:1783134922.173042:0:5772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9f6731500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c936801d-68e8-41a4-8fbc-6becd5e1be74+6:8104:x1869752373881344:12345-192.168.201.41@tcp:33:mount.lustre.0 Request processed in 360us (606us total) trans 0 rc 0/0 00000100:00080000:2.0:1783134922.173048:0:7676:0:(import.c:65:import_set_state_nolock()) ffff9fe8c57de000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1783134922.173049:0:5772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 1 00000100:00100000:2.0:1783134922.173078:0:7676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9f6731880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c936801d-68e8-41a4-8fbc-6becd5e1be74+6:2366:x1869752373881088:12345-192.168.201.41@tcp:8:mount.lustre.0 Request processed in 532us (715us total) trans 0 rc 0/0 00000100:00100000:0.0:1783134922.173130:0:6577:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 13 00000100:00100000:0.0:1783134922.173137:0:6577:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9f6730700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2366:x1869752373881216:12345-192.168.201.41@tcp:8:mount.lustre.0 00010000:00080000:0.0:1783134922.173163:0:6577:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0001: connection from c936801d-68e8-41a4-8fbc-6becd5e1be74@192.168.201.41@tcp t0 exp 0000000000000000 cur 204 last 0 00000020:00000080:0.0:1783134922.173181:0:6577:0:(genops.c:1406:class_connect()) connect: client c936801d-68e8-41a4-8fbc-6becd5e1be74, cookie 0xd6c4b8f05867e67d 00002000:00100000:0.0:1783134922.173187:0:6577:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli c936801d-68e8-41a4-8fbc-6becd5e1be74/ffff9fe9fe497800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113653 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1783134922.173203:0:6577:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1783134922.173395:0:6577:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1783134922.173428:0:6577:0:(import.c:65:import_set_state_nolock()) ffff9fe9fe493000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1783134922.173451:0:6577:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9f6730700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c936801d-68e8-41a4-8fbc-6becd5e1be74+6:2366:x1869752373881216:12345-192.168.201.41@tcp:8:mount.lustre.0 Request processed in 314us (1047us total) trans 0 rc 0/0 00000100:00100000:0.0:1783134922.173458:0:6577:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 13 00000100:00100000:2.0:1783134922.173858:0:7676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 12 00010000:00010000:0.0:1783134923.011710:0:5757:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783134924.036233:0:6591:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1783134924.440687:0:5791:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of c936801d-68e8-41a4-8fbc-6becd5e1be74 00000001:00100000:2.0:1783134924.448913:0:7470:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of c936801d-68e8-41a4-8fbc-6becd5e1be74 00000100:00100000:3.0:1783134924.934618:0:3289:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1783134924.934640:0:3289:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe8c67baa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1869752384392704:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1783134924.934710:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783134924.934766:0:6578:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384392704 00000100:00100000:3.0:1783134924.934774:0:6578:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384392704 00000100:00100000:3.0:1783134924.934826:0:6578:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1783134924.934835:0:6578:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe8c67b9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3289:x1869752384392704:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1783134924.934868:0:6578:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1783134924.934911:0:6578:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe8c67b9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3289:x1869752384392704:12345-0@lo:13:osp-pre-1-0.0 Request processed in 77us (200us total) trans 0 rc 0/0 00000100:00100000:3.0:1783134924.934919:0:6578:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00080000:3.0:1783134924.934938:0:5766:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1783134924.934969:0:3289:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fe8c67baa00 x1869752384392704/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783134940 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783134924.934987:0:3289:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe8c67baa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1869752384392704:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1783134924.937110:0:3286:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe8c67baa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:88a2002e-2ea7-4f07-912a-8d001832cfc0:3286:1869752384392960:0@lo:400:kworker.0 00000100:00100000:3.0:1783134924.937164:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783134924.937176:0:3288:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fea00bcf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3288:1869752384393216:0@lo:400:kworker.0 00000100:00100000:3.0:1783134924.937198:0:3286:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fea00bcf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3286:1869752384393472:0@lo:400:kworker.0 00000100:00100000:0.0:1783134924.937204:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783134924.937226:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783134924.937242:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1783134924.937250:0:3286:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe8c67b9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3286:1869752384393088:0@lo:400:kworker.0 00000100:00100000:3.0:1783134924.937273:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783134924.937331:0:5769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384393216 00000100:00100000:3.0:1783134924.937339:0:5769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384393216 00000100:00100000:3.0:1783134924.937382:0:5769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384393472 00000100:00100000:3.0:1783134924.937384:0:5769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384393472 00000100:00100000:2.0:1783134924.937398:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384393088 00000100:00100000:2.0:1783134924.937404:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384393088 00000100:00100000:3.0:1783134924.937406:0:5769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1783134924.937417:0:5769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9e0475180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3288:x1869752384393216:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783134924.937437:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1783134924.937448:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fea00bcc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3286:x1869752384393472:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783134924.937465:0:5769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9e0475180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3288:x1869752384393216:12345-0@lo:400:kworker.0 Request processed in 48us (257us total) trans 0 rc 0/0 00000100:00100000:3.0:1783134924.937472:0:5769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1783134924.937489:0:5769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1783134924.937496:0:5769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fea00bced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3286:x1869752384393088:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783134924.937532:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fea00bcc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3286:x1869752384393472:12345-0@lo:400:kworker.0 Request processed in 85us (303us total) trans 0 rc 0/0 00000100:00100000:2.0:1783134924.937539:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1783134924.937572:0:3289:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9ca88e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1869752384392832:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1783134924.937588:0:3286:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fea00bcf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3286:1869752384393472:0@lo:400:kworker.0 00000100:00100000:1.0:1783134924.937605:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783134924.937610:0:5769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fea00bced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3286:x1869752384393088:12345-0@lo:400:kworker.0 Request processed in 115us (336us total) trans 0 rc 0/0 00000100:00100000:2.0:1783134924.937617:0:3286:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe8c67b9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3286:1869752384393088:0@lo:400:kworker.0 00000100:00100000:3.0:1783134924.937622:0:5769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1783134924.937627:0:3289:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fea00bcce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1869752384393344:0@lo:400:kworker.0 00000100:00080000:3.0:1783134924.937646:0:5766:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1783134924.937650:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783134924.937661:0:6578:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384392832 00000100:00100000:2.0:1783134924.937666:0:6578:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384392832 00000100:00100000:2.0:1783134924.937707:0:6578:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1783134924.937717:0:6578:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9f6731f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3289:x1869752384392832:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1783134924.937718:0:5765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384392960 00000100:00100000:1.0:1783134924.937724:0:5765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384392960 00002000:00000024:2.0:1783134924.937747:0:6578:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1783134924.937756:0:5765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 206 00000100:00100000:1.0:1783134924.937764:0:5765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9d1656850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88a2002e-2ea7-4f07-912a-8d001832cfc0+19:3286:x1869752384392960:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783134924.937793:0:6578:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9f6731f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3289:x1869752384392832:12345-0@lo:13:osp-pre-0-0.0 Request processed in 77us (187us total) trans 0 rc 0/0 00000100:00100000:2.0:1783134924.937801:0:6578:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1783134924.937813:0:5765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9d1656850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88a2002e-2ea7-4f07-912a-8d001832cfc0+19:3286:x1869752384392960:12345-0@lo:400:kworker.0 Request processed in 48us (646us total) trans 0 rc 0/0 00000100:00100000:1.0:1783134924.937821:0:5765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 206 00010000:00080000:2.0:1783134924.937840:0:3289:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fe9ca88e680 x1869752384392832/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783134940 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783134924.937858:0:3289:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9ca88e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1869752384392832:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1783134924.937863:0:6577:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384393344 00000100:00100000:1.0:1783134924.937868:0:6577:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384393344 00000100:00080000:2.0:1783134924.937883:0:5766:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1783134924.937901:0:3286:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe8c67baa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:88a2002e-2ea7-4f07-912a-8d001832cfc0:3286:1869752384392960:0@lo:400:kworker.0 00000100:00100000:1.0:1783134924.937903:0:6577:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1783134924.937925:0:6577:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9f6732a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3289:x1869752384393344:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783134924.937970:0:6577:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9f6732a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3289:x1869752384393344:12345-0@lo:400:kworker.0 Request processed in 56us (317us total) trans 0 rc 0/0 00000100:00100000:1.0:1783134924.937977:0:6577:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00080000:2.0:1783134924.937987:0:3289:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fea00bcce00 x1869752384393344/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783134940 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783134924.937998:0:3289:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fea00bcce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1869752384393344:0@lo:400:kworker.0 00000100:00100000:0.0:1783134924.938062:0:3288:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fea00bcf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3288:1869752384393216:0@lo:400:kworker.0 00000001:00100000:0.0:1783134924.953578:0:6602:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of c936801d-68e8-41a4-8fbc-6becd5e1be74 00010000:00010000:0.0:1783134925.059397:0:5758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1783134925.121424:0:10134:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg141-client.virtnet: executing check_config_client /mnt/lustre 00010000:00010000:0.0:1783134926.083453:0:5757:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783134927.114174:0:6591:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783134927.655825:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:0.0:1783134927.655870:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:0.0:1783134927.655896:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:0.0:1783134927.655987:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:0.0:1783134927.656022:0:6574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373881984 00000100:00100000:0.0:1783134927.656034:0:6574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373881984 00000100:00100000:0.0:1783134927.656093:0:6574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 18 00000100:00100000:0.0:1783134927.656102:0:6574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9e0474e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c936801d-68e8-41a4-8fbc-6becd5e1be74+5:2370:x1869752373881984:12345-192.168.201.41@tcp:400:kworker.0 00000100:00100000:0.0:1783134927.656184:0:6574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9e0474e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c936801d-68e8-41a4-8fbc-6becd5e1be74+5:2370:x1869752373881984:12345-192.168.201.41@tcp:400:kworker.0 Request processed in 83us (286us total) trans 0 rc 0/0 00000100:00100000:0.0:1783134927.656190:0:6574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 18 00000100:00100000:2.0:1783134927.658584:0:5762:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373881472 00000100:00100000:2.0:1783134927.658614:0:5762:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373881472 00000100:00100000:2.0:1783134927.658692:0:5762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 207 00000100:00100000:2.0:1783134927.658704:0:5762:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9d1656050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f39b22bc-4faf-4b59-bb00-2a11f91e37c0+13:2370:x1869752373881472:12345-192.168.201.41@tcp:400:kworker.0 00000100:00100000:2.0:1783134927.658800:0:5762:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9d1656050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f39b22bc-4faf-4b59-bb00-2a11f91e37c0+13:2370:x1869752373881472:12345-192.168.201.41@tcp:400:kworker.0 Request processed in 99us (3042us total) trans 0 rc 0/0 00000100:00100000:2.0:1783134927.658821:0:5762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 207 00000100:00100000:2.0:1783134927.658865:0:8031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373881728 00000100:00100000:2.0:1783134927.658869:0:8031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373881728 00000100:00100000:2.0:1783134927.658900:0:8031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373881600 00000100:00100000:2.0:1783134927.658904:0:8031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373881600 00000100:00100000:2.0:1783134927.658929:0:8031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 41 00000100:00100000:2.0:1783134927.658935:0:8031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9e0474700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c936801d-68e8-41a4-8fbc-6becd5e1be74+5:2370:x1869752373881728:12345-192.168.201.41@tcp:400:kworker.0 00000100:00100000:2.0:1783134927.658969:0:8031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9e0474700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c936801d-68e8-41a4-8fbc-6becd5e1be74+5:2370:x1869752373881728:12345-192.168.201.41@tcp:400:kworker.0 Request processed in 34us (3099us total) trans 0 rc 0/0 00000100:00100000:2.0:1783134927.658975:0:8031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 41 00000100:00100000:2.0:1783134927.658987:0:8031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 42 00000100:00100000:2.0:1783134927.658993:0:8031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fe438000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+6:2370:x1869752373881600:12345-192.168.201.41@tcp:400:kworker.0 00000100:00100000:2.0:1783134927.659017:0:8031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fe438000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+6:2370:x1869752373881600:12345-192.168.201.41@tcp:400:kworker.0 Request processed in 24us (3031us total) trans 0 rc 0/0 00000100:00100000:2.0:1783134927.659023:0:8031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 42 00000100:00080000:2.0:1783134927.659040:0:5766:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1783134927.659046:0:5766:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1783134927.662151:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:2.0:1783134927.662969:0:7676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373881856 00000100:00100000:2.0:1783134927.662983:0:7676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373881856 00000100:00100000:2.0:1783134927.663115:0:7676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 19 00000100:00100000:2.0:1783134927.663128:0:7676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fe43a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c936801d-68e8-41a4-8fbc-6becd5e1be74+5:2370:x1869752373881856:12345-192.168.201.41@tcp:400:kworker.0 00000100:00100000:2.0:1783134927.663237:0:7676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fe43a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c936801d-68e8-41a4-8fbc-6becd5e1be74+5:2370:x1869752373881856:12345-192.168.201.41@tcp:400:kworker.0 Request processed in 111us (1097us total) trans 0 rc 0/0 00000100:00100000:2.0:1783134927.663245:0:7676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 19 00000100:00080000:0.0:1783134927.664535:0:5766:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1783134928.131677:0:5758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783134929.161802:0:5757:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783134930.051551:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1783134930.051575:0:3286:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9f6f73100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1869752384393600:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1783134930.051645:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783134930.051706:0:6578:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384393600 00000100:00100000:2.0:1783134930.051713:0:6578:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384393600 00000100:00100000:2.0:1783134930.051770:0:6578:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1783134930.051779:0:6578:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9f6f70e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1869752384393600:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1783134930.051814:0:6578:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1783134930.051858:0:6578:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9f6f70e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1869752384393600:12345-0@lo:13:osp-pre-0-0.0 Request processed in 79us (211us total) trans 0 rc 0/0 00000100:00100000:2.0:1783134930.051866:0:6578:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00080000:2.0:1783134930.051888:0:5766:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1783134930.051918:0:3286:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fe9f6f73100 x1869752384393600/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783134946 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783134930.051937:0:3286:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9f6f73100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1869752384393600:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1783134930.056495:0:3288:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fea00bcca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1869752384393728:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1783134930.056565:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783134930.056625:0:6578:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384393728 00000100:00100000:3.0:1783134930.056633:0:6578:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384393728 00000100:00100000:3.0:1783134930.056687:0:6578:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1783134930.056696:0:6578:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fea00bcc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3288:x1869752384393728:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1783134930.056735:0:6578:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1783134930.056780:0:6578:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fea00bcc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3288:x1869752384393728:12345-0@lo:13:osp-pre-1-0.0 Request processed in 84us (215us total) trans 0 rc 0/0 00000100:00100000:3.0:1783134930.056797:0:6578:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00080000:3.0:1783134930.056821:0:5766:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1783134930.056849:0:3288:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fea00bcca80 x1869752384393728/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783134946 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783134930.056868:0:3288:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fea00bcca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1869752384393728:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1783134930.057022:0:3288:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9f5ca4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3288:1869752384394240:0@lo:400:kworker.0 00000100:00100000:1.0:1783134930.057052:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783134930.057074:0:3288:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1783134930.057080:0:3288:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9f5ca4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:88a2002e-2ea7-4f07-912a-8d001832cfc0:3288:1869752384393856:0@lo:400:kworker.0 00000100:00100000:1.0:1783134930.057106:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783134930.057133:0:3286:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9f5ca6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3286:1869752384393984:0@lo:400:kworker.0 00000100:00100000:1.0:1783134930.057167:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783134930.057187:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1783134930.057193:0:3286:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9f5ca6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3286:1869752384394112:0@lo:400:kworker.0 00000100:00100000:1.0:1783134930.057214:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783134930.057252:0:8031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384394240 00000100:00100000:1.0:1783134930.057257:0:8031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384394240 00000100:00100000:1.0:1783134930.057332:0:8031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384393984 00000100:00100000:1.0:1783134930.057335:0:8031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384393984 00000100:00100000:1.0:1783134930.057349:0:8031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384394112 00000100:00100000:1.0:1783134930.057351:0:8031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384394112 00000100:00100000:1.0:1783134930.057365:0:8031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1783134930.057371:0:8031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9f5ca4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3288:x1869752384394240:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783134930.057407:0:8031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9f5ca4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3288:x1869752384394240:12345-0@lo:400:kworker.0 Request processed in 35us (353us total) trans 0 rc 0/0 00000100:00100000:1.0:1783134930.057421:0:8031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1783134930.057434:0:8031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1783134930.057441:0:8031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9f5ce2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3286:x1869752384393984:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783134930.057472:0:8031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9f5ce2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3286:x1869752384393984:12345-0@lo:400:kworker.0 Request processed in 32us (304us total) trans 0 rc 0/0 00000100:00100000:1.0:1783134930.057479:0:8031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1783134930.057489:0:8031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1783134930.057495:0:8031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9f5ce1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3286:x1869752384394112:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783134930.057520:0:8031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9f5ce1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3286:x1869752384394112:12345-0@lo:400:kworker.0 Request processed in 25us (305us total) trans 0 rc 0/0 00000100:00100000:1.0:1783134930.057526:0:8031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1783134930.057542:0:5763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384393856 00000100:00100000:1.0:1783134930.057545:0:5763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384393856 00000100:00100000:1.0:1783134930.057577:0:5763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 208 00000100:00100000:1.0:1783134930.057584:0:5763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9d1654450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88a2002e-2ea7-4f07-912a-8d001832cfc0+19:3288:x1869752384393856:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783134930.057614:0:5763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9d1654450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88a2002e-2ea7-4f07-912a-8d001832cfc0+19:3288:x1869752384393856:12345-0@lo:400:kworker.0 Request processed in 31us (507us total) trans 0 rc 0/0 00000100:00100000:1.0:1783134930.057620:0:5763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 208 00000100:00080000:1.0:1783134930.057649:0:5766:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1783134930.057676:0:3286:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9f5ca6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3286:1869752384394112:0@lo:400:kworker.0 00000100:00100000:1.0:1783134930.057688:0:3286:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9f5ca6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3286:1869752384393984:0@lo:400:kworker.0 00000100:00100000:1.0:1783134930.057711:0:3288:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9f5ca4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:88a2002e-2ea7-4f07-912a-8d001832cfc0:3288:1869752384393856:0@lo:400:kworker.0 00000100:00100000:1.0:1783134930.057721:0:3288:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9f5ca4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3288:1869752384394240:0@lo:400:kworker.0 00010000:00010000:1.0:1783134930.179797:0:6591:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783134931.208975:0:5758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783134932.227634:0:5757:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783134932.774968:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:2.0:1783134932.775013:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:2.0:1783134932.775042:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:1.0:1783134932.775422:0:8031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373882240 00000100:00100000:1.0:1783134932.775437:0:8031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373882240 00000100:00100000:1.0:1783134932.775515:0:8031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 46 00000100:00100000:1.0:1783134932.775529:0:8031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9f6f73100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+6:2370:x1869752373882240:12345-192.168.201.41@tcp:400:kworker.0 00000100:00100000:1.0:1783134932.775637:0:8031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9f6f73100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+6:2370:x1869752373882240:12345-192.168.201.41@tcp:400:kworker.0 Request processed in 111us (682us total) trans 0 rc 0/0 00000100:00100000:1.0:1783134932.775646:0:8031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 46 00000100:00080000:1.0:1783134932.775674:0:5766:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1783134932.778059:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:2.0:1783134932.778094:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:2.0:1783134932.778134:0:5765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373882112 00000100:00100000:2.0:1783134932.778151:0:5765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373882112 00000100:00100000:2.0:1783134932.778210:0:5765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 209 00000100:00100000:2.0:1783134932.778222:0:5765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9d1656450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f39b22bc-4faf-4b59-bb00-2a11f91e37c0+13:2369:x1869752373882112:12345-192.168.201.41@tcp:400:kworker.0 00000100:00100000:2.0:1783134932.778331:0:5765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9d1656450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f39b22bc-4faf-4b59-bb00-2a11f91e37c0+13:2369:x1869752373882112:12345-192.168.201.41@tcp:400:kworker.0 Request processed in 111us (3315us total) trans 0 rc 0/0 00000100:00100000:2.0:1783134932.778341:0:5765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 209 00000100:00100000:2.0:1783134932.778432:0:6574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373882496 00000100:00100000:2.0:1783134932.778437:0:6574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373882496 00000100:00100000:2.0:1783134932.778479:0:6574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373882624 00000100:00100000:2.0:1783134932.778482:0:6574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373882624 00000100:00100000:2.0:1783134932.778513:0:6574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 20 00000100:00100000:2.0:1783134932.778521:0:6574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9f6f71880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c936801d-68e8-41a4-8fbc-6becd5e1be74+5:2370:x1869752373882496:12345-192.168.201.41@tcp:400:kworker.0 00000100:00100000:1.0:1783134932.778532:0:5769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373882368 00000100:00100000:1.0:1783134932.778539:0:5769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373882368 00000100:00100000:2.0:1783134932.778560:0:6574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9f6f71880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c936801d-68e8-41a4-8fbc-6becd5e1be74+5:2370:x1869752373882496:12345-192.168.201.41@tcp:400:kworker.0 Request processed in 38us (3514us total) trans 0 rc 0/0 00000100:00100000:2.0:1783134932.778568:0:6574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 20 00000100:00100000:2.0:1783134932.778585:0:6574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 21 00000100:00100000:1.0:1783134932.778591:0:5769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 47 00000100:00100000:2.0:1783134932.778596:0:6574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9f6f71500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c936801d-68e8-41a4-8fbc-6becd5e1be74+5:2369:x1869752373882624:12345-192.168.201.41@tcp:400:kworker.0 00000100:00100000:1.0:1783134932.778605:0:5769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9f6f71c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c936801d-68e8-41a4-8fbc-6becd5e1be74+5:2369:x1869752373882368:12345-192.168.201.41@tcp:400:kworker.0 00000100:00100000:2.0:1783134932.778624:0:6574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9f6f71500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c936801d-68e8-41a4-8fbc-6becd5e1be74+5:2369:x1869752373882624:12345-192.168.201.41@tcp:400:kworker.0 Request processed in 31us (529us total) trans 0 rc 0/0 00000100:00100000:2.0:1783134932.778630:0:6574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 21 00000100:00100000:1.0:1783134932.778648:0:5769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9f6f71c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c936801d-68e8-41a4-8fbc-6becd5e1be74+5:2369:x1869752373882368:12345-192.168.201.41@tcp:400:kworker.0 Request processed in 46us (608us total) trans 0 rc 0/0 00000100:00100000:1.0:1783134932.778663:0:5769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 47 00000100:00080000:2.0:1783134932.778830:0:5766:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1783134932.778836:0:5766:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1783134932.778838:0:5766:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1783134933.256627:0:6591:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783134934.276430:0:5758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783134935.171432:0:3289:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9fe438700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1869752384394368:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1783134935.171466:0:3286:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9f6f70700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:88a2002e-2ea7-4f07-912a-8d001832cfc0:3286:1869752384394496:0@lo:400:kworker.0 00000100:00100000:3.0:1783134935.171506:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783134935.171514:0:3288:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9f6f70000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3288:1869752384394752:0@lo:400:kworker.0 00000100:00100000:0.0:1783134935.171515:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783134935.171549:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783134935.171570:0:3286:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9f6f73800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3286:1869752384395008:0@lo:400:kworker.0 00000100:00100000:3.0:1783134935.171573:0:3289:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9f6f72d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1869752384394880:0@lo:400:kworker.0 00000100:00100000:1.0:1783134935.171584:0:5762:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384394496 00000100:00100000:0.0:1783134935.171602:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783134935.171604:0:5762:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384394496 00000100:00100000:3.0:1783134935.171616:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783134935.171627:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1783134935.171636:0:3286:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9f6f72680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3286:1869752384394624:0@lo:400:kworker.0 00000100:00100000:1.0:1783134935.171655:0:5762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 210 00000100:00100000:0.0:1783134935.171662:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783134935.171665:0:5762:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9d1655450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88a2002e-2ea7-4f07-912a-8d001832cfc0+19:3286:x1869752384394496:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783134935.171684:0:3286:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9ca88e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1869752384395136:0@lo:400:kworker.0 00000100:00100000:0.0:1783134935.171705:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783134935.171712:0:5762:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9d1655450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88a2002e-2ea7-4f07-912a-8d001832cfc0+19:3286:x1869752384394496:12345-0@lo:400:kworker.0 Request processed in 50us (198us total) trans 0 rc 0/0 00000100:00100000:2.0:1783134935.171716:0:6574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384394880 00000100:00100000:2.0:1783134935.171723:0:6574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384394880 00000100:00100000:1.0:1783134935.171732:0:5762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 210 00000100:00100000:0.0:1783134935.171733:0:3286:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9f6f70700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:88a2002e-2ea7-4f07-912a-8d001832cfc0:3286:1869752384394496:0@lo:400:kworker.0 00000100:00100000:1.0:1783134935.171770:0:8031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384394752 00000100:00100000:2.0:1783134935.171773:0:6574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384395136 00000100:00100000:1.0:1783134935.171775:0:8031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384394752 00000100:00100000:2.0:1783134935.171779:0:6574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384395136 00000100:00100000:3.0:1783134935.171792:0:6578:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384394368 00000100:00100000:3.0:1783134935.171798:0:6578:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384394368 00000100:00100000:1.0:1783134935.171815:0:8031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384395008 00000100:00100000:1.0:1783134935.171821:0:8031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384395008 00000100:00100000:2.0:1783134935.171826:0:6574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1783134935.171837:0:6574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fea00bce680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3289:x1869752384394880:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783134935.171841:0:6578:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1783134935.171848:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384394624 00000100:00100000:0.0:1783134935.171853:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384394624 00000100:00100000:0.0:1783134935.171879:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1783134935.171886:0:6574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fea00bce680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3289:x1869752384394880:12345-0@lo:400:kworker.0 Request processed in 52us (271us total) trans 0 rc 0/0 00000100:00100000:2.0:1783134935.171894:0:6574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1783134935.171899:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9f5ce1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3288:x1869752384394752:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783134935.171910:0:6574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1783134935.171937:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9f5ce1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3288:x1869752384394752:12345-0@lo:400:kworker.0 Request processed in 41us (387us total) trans 0 rc 0/0 00000100:00100000:0.0:1783134935.171954:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1783134935.171962:0:6578:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fea00bcca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3289:x1869752384394368:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1783134935.171971:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1783134935.171980:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fe439180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3286:x1869752384394624:12345-0@lo:400:kworker.0 00002000:00000024:3.0:1783134935.171992:0:6578:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1783134935.172026:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fe439180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3286:x1869752384394624:12345-0@lo:400:kworker.0 Request processed in 47us (363us total) trans 0 rc 0/0 00000100:00100000:0.0:1783134935.172033:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1783134935.172066:0:3286:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9f6f72680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3286:1869752384394624:0@lo:400:kworker.0 00000100:00100000:3.0:1783134935.172067:0:6578:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fea00bcca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3289:x1869752384394368:12345-0@lo:13:osp-pre-1-0.0 Request processed in 107us (561us total) trans 0 rc 0/0 00000100:00100000:2.0:1783134935.172079:0:6574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fe43aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3286:x1869752384395136:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783134935.172080:0:6578:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1783134935.172133:0:6574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fe43aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3286:x1869752384395136:12345-0@lo:400:kworker.0 Request processed in 60us (428us total) trans 0 rc 0/0 00000100:00100000:2.0:1783134935.172140:0:6574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00080000:2.0:1783134935.172167:0:5766:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1783134935.172172:0:5766:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1783134935.172174:0:5766:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1783134935.172241:0:3286:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fe9ca88e680 x1869752384395136/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783134951 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783134935.172254:0:3286:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9ca88e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1869752384395136:0@lo:400:kworker.0 00000100:00100000:3.0:1783134935.172272:0:3288:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe8c67baa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1869752384395264:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1783134935.172549:0:8031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1783134935.172559:0:8031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fe43bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3286:x1869752384395008:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783134935.172604:0:3286:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9f6f73800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3286:1869752384395008:0@lo:400:kworker.0 00000100:00100000:1.0:1783134935.172654:0:8031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fe43bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3286:x1869752384395008:12345-0@lo:400:kworker.0 Request processed in 97us (1051us total) trans 0 rc 0/0 00000100:00100000:1.0:1783134935.172659:0:8031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00010000:00080000:2.0:1783134935.172677:0:3289:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fe9f6f72d80 x1869752384394880/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783134951 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783134935.172690:0:3289:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9f6f72d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1869752384394880:0@lo:400:kworker.0 00010000:00080000:2.0:1783134935.172710:0:3289:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fe9fe438700 x1869752384394368/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783134951 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783134935.172723:0:3289:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9fe438700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1869752384394368:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1783134935.172882:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783134935.172922:0:3288:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9f6f70000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3288:1869752384394752:0@lo:400:kworker.0 00000100:00100000:1.0:1783134935.172922:0:6578:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384395264 00000100:00100000:1.0:1783134935.172929:0:6578:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384395264 00000100:00100000:1.0:1783134935.172964:0:6578:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1783134935.172972:0:6579:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 2 min 2 max 16 00000100:00100000:1.0:1783134935.172973:0:6578:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fea00bcc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3288:x1869752384395264:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1783134935.172984:0:6579:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_002' 00002000:00000024:1.0:1783134935.172998:0:6578:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1783134935.173033:0:6578:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fea00bcc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3288:x1869752384395264:12345-0@lo:13:osp-pre-0-0.0 Request processed in 62us (152us total) trans 0 rc 0/0 00000100:00100000:1.0:1783134935.173049:0:6578:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00080000:3.0:1783134935.173176:0:3288:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fe8c67baa00 x1869752384395264/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783134951 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783134935.173204:0:3288:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe8c67baa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1869752384395264:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1783134935.301443:0:5757:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1783134936.271568:0:10838:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:0.0:1783134936.328898:0:6591:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783134937.353121:0:5758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783134937.892457:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:3.0:1783134937.892697:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:2.0:1783134937.892724:0:5763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373882752 00000100:00100000:3.0:1783134937.892736:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:2.0:1783134937.892737:0:5763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373882752 00000100:00100000:3.0:1783134937.892772:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:2.0:1783134937.892804:0:5763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 211 00000100:00100000:2.0:1783134937.892817:0:5763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9d1654c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f39b22bc-4faf-4b59-bb00-2a11f91e37c0+13:2370:x1869752373882752:12345-192.168.201.41@tcp:400:kworker.0 00000100:00100000:3.0:1783134937.892856:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:3.0:1783134937.892884:0:8031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373883008 00000100:00100000:3.0:1783134937.892901:0:8031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373883008 00000100:00100000:2.0:1783134937.892915:0:5763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9d1654c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f39b22bc-4faf-4b59-bb00-2a11f91e37c0+13:2370:x1869752373882752:12345-192.168.201.41@tcp:400:kworker.0 Request processed in 99us (468us total) trans 0 rc 0/0 00000100:00100000:2.0:1783134937.892945:0:5763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 211 00000100:00100000:3.0:1783134937.892987:0:8031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373882880 00000100:00100000:3.0:1783134937.892990:0:8031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373882880 00000100:00100000:3.0:1783134937.893014:0:8031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 51 00000100:00100000:3.0:1783134937.893020:0:8031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fea00bcfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c936801d-68e8-41a4-8fbc-6becd5e1be74+5:2370:x1869752373883008:12345-192.168.201.41@tcp:400:kworker.0 00000100:00100000:3.0:1783134937.893049:0:8031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fea00bcfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c936801d-68e8-41a4-8fbc-6becd5e1be74+5:2370:x1869752373883008:12345-192.168.201.41@tcp:400:kworker.0 Request processed in 30us (356us total) trans 0 rc 0/0 00000100:00100000:3.0:1783134937.893054:0:8031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 51 00000100:00100000:3.0:1783134937.893064:0:8031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 52 00000100:00100000:3.0:1783134937.893069:0:8031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fea00bcea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+6:2370:x1869752373882880:12345-192.168.201.41@tcp:400:kworker.0 00000100:00100000:1.0:1783134937.893149:0:6574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373883264 00000100:00100000:1.0:1783134937.893152:0:6574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373883264 00000100:00100000:1.0:1783134937.893184:0:6574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373883136 00000100:00100000:1.0:1783134937.893185:0:6574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373883136 00000100:00100000:1.0:1783134937.893204:0:6574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 24 00000100:00100000:1.0:1783134937.893212:0:6574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fea00bcd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c936801d-68e8-41a4-8fbc-6becd5e1be74+5:2370:x1869752373883264:12345-192.168.201.41@tcp:400:kworker.0 00000100:00100000:0.0:1783134937.893223:0:6577:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 25 00000100:00100000:1.0:1783134937.893240:0:6574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fea00bcd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c936801d-68e8-41a4-8fbc-6becd5e1be74+5:2370:x1869752373883264:12345-192.168.201.41@tcp:400:kworker.0 Request processed in 27us (500us total) trans 0 rc 0/0 00000100:00100000:0.0:1783134937.893240:0:6577:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fea00bcd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c936801d-68e8-41a4-8fbc-6becd5e1be74+5:2370:x1869752373883136:12345-192.168.201.41@tcp:400:kworker.0 00000100:00100000:1.0:1783134937.893252:0:6574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 24 00000100:00100000:0.0:1783134937.893307:0:6577:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fea00bcd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c936801d-68e8-41a4-8fbc-6becd5e1be74+5:2370:x1869752373883136:12345-192.168.201.41@tcp:400:kworker.0 Request processed in 75us (451us total) trans 0 rc 0/0 00000100:00100000:0.0:1783134937.893315:0:6577:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 25 00000100:00100000:3.0:1783134937.893569:0:8031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fea00bcea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+6:2370:x1869752373882880:12345-192.168.201.41@tcp:400:kworker.0 Request processed in 498us (797us total) trans 0 rc 0/0 00000100:00100000:3.0:1783134937.893575:0:8031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 52 00000100:00080000:3.0:1783134937.893685:0:5766:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1783134937.893689:0:5766:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1783134937.893691:0:5766:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1783134938.371680:0:5757:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1783134938.828614:0:10985:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe2ce54f50 20000000:00000080:2.0:1783134938.828631:0:10985:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9fe8c4583000 uarg=0000000000000000 20000000:01000000:2.0:1783134938.828665:0:10985:0:(mgs_llog.c:6177:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:2.0:1783134938.828671:0:10985:0:(mgs_llog.c:4638:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:2.0:1783134938.828675:0:10985:0:(mgs_llog.c:1376:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:2.0:1783134938.829716:0:10986:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 7 20000000:00000400:1.0:1783134938.829962:0:10985:0:(mgs_llog.c:1447:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:1.0:1783134938.834654:0:10985:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1783134938.834680:0:10985:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9fe9fe43fa00/0xd6c4b8f05867e684 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134938.834697:0:10985:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9fea02167a00/0xd6c4b8f05867e629 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb70dd expref: 12 pid: 5763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134938.834704:0:10985:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9fe9c1523400/0xd6c4b8f05867e637 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd6c4b8f05867e630 expref: 18 pid: 5762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134938.834708:0:10985:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9fe9c148ba00/0xd6c4b8f05867e645 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd6c4b8f05867e63e expref: 18 pid: 5763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134938.834712:0:10985:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9fe9c148ac00/0xd6c4b8f05867e653 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd6c4b8f05867e64c expref: 18 pid: 5762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134938.834731:0:10985:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9fe9c1523a00/0xd6c4b8f05867e668 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb7115 expref: 12 pid: 5765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134938.834736:0:10985:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9fe9fe43fa00/0xd6c4b8f05867e684 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 10985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134938.834770:0:10985:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9fe9c1523a00/0xd6c4b8f05867e668 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb7115 expref: 12 pid: 5765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134938.834784:0:10985:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9fe9c1523a00/0xd6c4b8f05867e668 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb7115 expref: 12 pid: 5765 timeout: 321 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783134938.834798:0:10985:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9f5ce1500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10985:1869752384395392:192.168.201.41@tcp:104: 00010000:00010000:1.0:1783134938.834896:0:10985:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9fe9c148ac00/0xd6c4b8f05867e653 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd6c4b8f05867e64c expref: 18 pid: 5762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134938.834902:0:10985:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9fe9c148ac00/0xd6c4b8f05867e653 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd6c4b8f05867e64c expref: 18 pid: 5762 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783134938.834910:0:10985:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9f5ca4700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10985:1869752384395520:0@lo:104: 00000100:00100000:1.0:1783134938.834941:0:10985:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1783134938.834977:0:10985:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9fe9c148ba00/0xd6c4b8f05867e645 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd6c4b8f05867e63e expref: 18 pid: 5763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134938.834995:0:10985:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9fe9c148ba00/0xd6c4b8f05867e645 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd6c4b8f05867e63e expref: 18 pid: 5763 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783134938.835003:0:10985:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9f5ca6a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10985:1869752384395648:0@lo:104: 00000100:00100000:1.0:1783134938.835030:0:10985:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1783134938.835067:0:10985:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9fe9c1523400/0xd6c4b8f05867e637 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd6c4b8f05867e630 expref: 18 pid: 5762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134938.835072:0:10985:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9fe9c1523400/0xd6c4b8f05867e637 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd6c4b8f05867e630 expref: 18 pid: 5762 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783134938.835078:0:10985:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9fe9fa300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10985:1869752384395776:0@lo:104: 00000100:00100000:1.0:1783134938.835100:0:10985:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783134938.835131:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384395520 00000100:00100000:1.0:1783134938.835138:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384395520 00000100:00100000:0.0:1783134938.835156:0:5753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384395648 00000100:00100000:0.0:1783134938.835162:0:5753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384395648 00000100:00100000:1.0:1783134938.835179:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384395776 00000100:00100000:1.0:1783134938.835183:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384395776 00000100:00100000:0.0:1783134938.835193:0:5753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1783134938.835204:0:5753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9f5ca4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:88a2002e-2ea7-4f07-912a-8d001832cfc0+5:10985:x1869752384395520:12345-0@lo:104: 00010000:00010000:0.0:1783134938.835216:0:5753:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.141@tcp lock: ffff9fea02167c00/0xd6c4b8f05867e64c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xd6c4b8f05867e653 expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783134938.835304:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1783134938.835313:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9f5ca6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:88a2002e-2ea7-4f07-912a-8d001832cfc0+5:10985:x1869752384395648:12345-0@lo:104: 00010000:00010000:1.0:1783134938.835321:0:6590:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.141@tcp lock: ffff9fe9c148b400/0xd6c4b8f05867e63e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xd6c4b8f05867e645 expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134938.835467:0:5753:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1783134938.835475:0:5753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9f5ca4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:88a2002e-2ea7-4f07-912a-8d001832cfc0+5:10985:x1869752384395520:12345-0@lo:104: Request processed in 273us (533us total) trans 0 rc 0/0 00000100:00100000:0.0:1783134938.835484:0:5753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00010000:00010000:1.0:1783134938.835504:0:6590:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1783134938.835506:0:5753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1783134938.835517:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9f5ca6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:88a2002e-2ea7-4f07-912a-8d001832cfc0+4:10985:x1869752384395648:12345-0@lo:104: Request processed in 201us (481us total) trans 0 rc 0/0 00000100:00100000:0.0:1783134938.835518:0:5753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fe9f9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:88a2002e-2ea7-4f07-912a-8d001832cfc0+4:10985:x1869752384395776:12345-0@lo:104: 00010000:00010000:0.0:1783134938.835531:0:5753:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.141@tcp lock: ffff9fea02166e00/0xd6c4b8f05867e630 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xd6c4b8f05867e637 expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783134938.835537:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00010000:1.0:1783134938.835577:0:10985:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9fea02167a00/0xd6c4b8f05867e629 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb70dd expref: 12 pid: 5763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134938.835586:0:10985:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9fea02167a00/0xd6c4b8f05867e629 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb70dd expref: 12 pid: 5763 timeout: 321 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783134938.835646:0:10985:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9fe9fb480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10985:1869752384395904:192.168.201.41@tcp:104: 00000100:00100000:1.0:1783134938.835682:0:10985:0:(client.c:2701:ptlrpc_set_wait()) set ffff9fe9fe46c900 going to sleep for 11 seconds 00000100:00100000:1.0:1783134938.835700:0:10985:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9f5ca4700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10985:1869752384395520:0@lo:104: 00000100:00100000:1.0:1783134938.835706:0:10985:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9f5ca6a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10985:1869752384395648:0@lo:104: 00000100:00100000:1.0:1783134938.835711:0:10985:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9fe9fa300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10985:1869752384395776:0@lo:104: 00010000:00010000:2.0:1783134938.836195:0:5758:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1783134938.836203:0:5758:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.141@tcp lock: ffff9fea02167c00/0xd6c4b8f05867e64c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xd6c4b8f05867e653 expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134938.836210:0:5758:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fea02167c00 already unused, calling callback (ffffffffc1b40c20) 10000000:00010000:2.0:1783134938.836214:0:5758:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.141@tcp lock: ffff9fea02167c00/0xd6c4b8f05867e64c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xd6c4b8f05867e653 expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134938.836222:0:5758:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.141@tcp lock: ffff9fea02167c00/0xd6c4b8f05867e64c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xd6c4b8f05867e653 expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783134938.836230:0:5758:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.141@tcp lock: ffff9fea02167c00/0xd6c4b8f05867e64c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xd6c4b8f05867e653 expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783134938.836237:0:5758:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1783134938.836340:0:5753:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00010000:00010000:3.0:1783134938.836349:0:6591:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00000100:00100000:0.0:1783134938.836349:0:5753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fe9f9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:88a2002e-2ea7-4f07-912a-8d001832cfc0+3:10985:x1869752384395776:12345-0@lo:104: Request processed in 832us (1246us total) trans 0 rc 0/0 00010000:00010000:3.0:1783134938.836357:0:6591:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.141@tcp lock: ffff9fe9c148b400/0xd6c4b8f05867e63e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xd6c4b8f05867e645 expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783134938.836360:0:5753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00010000:3.0:1783134938.836371:0:6591:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe9c148b400 already unused, calling callback (ffffffffc1b40c20) 10000000:00010000:3.0:1783134938.836374:0:6591:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.141@tcp lock: ffff9fe9c148b400/0xd6c4b8f05867e63e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xd6c4b8f05867e645 expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134938.836381:0:6591:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.141@tcp lock: ffff9fe9c148b400/0xd6c4b8f05867e63e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xd6c4b8f05867e645 expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134938.836382:0:5757:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 10000000:00010000:3.0:1783134938.836391:0:6591:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.141@tcp lock: ffff9fe9c148b400/0xd6c4b8f05867e63e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xd6c4b8f05867e645 expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783134938.836396:0:6591:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1783134938.836477:0:5758:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.141@tcp lock: ffff9fea02167c00/0xd6c4b8f05867e64c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd6c4b8f05867e653 expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134938.836485:0:5758:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1783134938.836502:0:5758:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.141@tcp lock: ffff9fea02167c00/0xd6c4b8f05867e64c lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd6c4b8f05867e653 expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134938.836509:0:5758:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.141@tcp lock: ffff9fea02167c00/0xd6c4b8f05867e64c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd6c4b8f05867e653 expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134938.836509:0:10987:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783134938.836516:0:5757:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.141@tcp lock: ffff9fea02166e00/0xd6c4b8f05867e630 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xd6c4b8f05867e637 expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134938.836527:0:5757:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fea02166e00 already unused, calling callback (ffffffffc1b40c20) 10000000:00010000:0.0:1783134938.836531:0:5757:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.141@tcp lock: ffff9fea02166e00/0xd6c4b8f05867e630 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xd6c4b8f05867e637 expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134938.836537:0:5758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783134938.836539:0:5757:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.141@tcp lock: ffff9fea02166e00/0xd6c4b8f05867e630 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xd6c4b8f05867e637 expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134938.836540:0:5758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783134938.836544:0:5758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:00010000:0.0:1783134938.836550:0:5757:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.141@tcp lock: ffff9fea02166e00/0xd6c4b8f05867e630 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xd6c4b8f05867e637 expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783134938.836567:0:5757:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00000100:00100000:2.0:1783134938.837348:0:3289:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe8c67b9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:88a2002e-2ea7-4f07-912a-8d001832cfc0:3289:1869752384396032:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1783134938.837391:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783134938.837582:0:5756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384396032 00000100:00100000:2.0:1783134938.837589:0:5756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384396032 00010000:00010000:2.0:1783134938.837611:0:5756:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9fe9c148ac00/0xd6c4b8f05867e653 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd6c4b8f05867e64c expref: 19 pid: 5762 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783134938.837635:0:5756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1783134938.837643:0:5756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9d1622050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:88a2002e-2ea7-4f07-912a-8d001832cfc0+19:3289:x1869752384396032:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1783134938.837653:0:5756:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783134938.837657:0:5756:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9fe9c148ac00/0xd6c4b8f05867e653 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd6c4b8f05867e64c expref: 19 pid: 5762 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134938.837664:0:5756:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9fe9c148ac00/0xd6c4b8f05867e653 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd6c4b8f05867e64c expref: 19 pid: 5762 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134938.837675:0:5756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fe9c148ac00/0xd6c4b8f05867e653 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd6c4b8f05867e64c expref: 19 pid: 5762 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134938.837684:0:5756:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783134938.837706:0:5756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9d1622050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:88a2002e-2ea7-4f07-912a-8d001832cfc0+18:3289:x1869752384396032:12345-0@lo:103:ldlm_bl.0 Request processed in 65us (315us total) trans 0 rc 0/0 00000100:00100000:2.0:1783134938.837711:0:5756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1783134938.837753:0:3289:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe8c67b9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:88a2002e-2ea7-4f07-912a-8d001832cfc0:3289:1869752384396032:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1783134938.837911:0:10987:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783134938.837914:0:10987:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783134938.837952:0:5757:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.141@tcp lock: ffff9fea02166e00/0xd6c4b8f05867e630 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd6c4b8f05867e637 expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134938.837961:0:5757:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1783134938.837990:0:5757:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.141@tcp lock: ffff9fea02166e00/0xd6c4b8f05867e630 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd6c4b8f05867e637 expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134938.837998:0:5757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.141@tcp lock: ffff9fea02166e00/0xd6c4b8f05867e630 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd6c4b8f05867e637 expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134938.838008:0:5757:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783134938.838010:0:5757:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783134938.838012:0:5757:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783134938.838019:0:3287:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1783134938.838029:0:3287:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9fe439500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:88a2002e-2ea7-4f07-912a-8d001832cfc0:3287:1869752384396160:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1783134938.838061:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1783134938.838089:0:6591:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.141@tcp lock: ffff9fe9c148b400/0xd6c4b8f05867e63e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd6c4b8f05867e645 expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134938.838098:0:6591:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1783134938.838105:0:6591:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.141@tcp lock: ffff9fe9c148b400/0xd6c4b8f05867e63e lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd6c4b8f05867e645 expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783134938.838106:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00010000:00010000:3.0:1783134938.838112:0:6591:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.141@tcp lock: ffff9fe9c148b400/0xd6c4b8f05867e63e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd6c4b8f05867e645 expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783134938.838115:0:3286:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fea00bcdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:88a2002e-2ea7-4f07-912a-8d001832cfc0:3286:1869752384396288:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1783134938.838124:0:6591:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783134938.838126:0:6591:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783134938.838128:0:6591:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783134938.838231:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:2.0:1783134938.838370:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384396160 00000100:00100000:2.0:1783134938.838374:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384396160 00000100:00100000:0.0:1783134938.838390:0:10985:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9f5ce1500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10985:1869752384395392:192.168.201.41@tcp:104: 00010000:00010000:2.0:1783134938.838392:0:6592:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9fe9c1523400/0xd6c4b8f05867e637 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd6c4b8f05867e630 expref: 18 pid: 5762 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783134938.838414:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373883392 00000100:00100000:2.0:1783134938.838417:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373883392 00010000:00010000:2.0:1783134938.838428:0:6592:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9fe9c1523a00/0xd6c4b8f05867e668 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb7115 expref: 13 pid: 5765 timeout: 321 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783134938.838449:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1783134938.838457:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fe439c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:88a2002e-2ea7-4f07-912a-8d001832cfc0+18:3287:x1869752384396160:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1783134938.838465:0:6592:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783134938.838469:0:6592:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9fe9c1523400/0xd6c4b8f05867e637 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd6c4b8f05867e630 expref: 18 pid: 5762 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783134938.838474:0:5754:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 27 00010000:00010000:2.0:1783134938.838484:0:6592:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9fe9c1523400/0xd6c4b8f05867e637 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd6c4b8f05867e630 expref: 18 pid: 5762 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783134938.838490:0:5754:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe8c67b9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f39b22bc-4faf-4b59-bb00-2a11f91e37c0+13:2369:x1869752373883392:12345-192.168.201.41@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783134938.838503:0:6592:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fe9c1523400/0xd6c4b8f05867e637 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd6c4b8f05867e630 expref: 18 pid: 5762 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134938.838504:0:5754:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783134938.838514:0:5754:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9fe9c1523a00/0xd6c4b8f05867e668 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb7115 expref: 13 pid: 5765 timeout: 321 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134938.838515:0:6592:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1783134938.838528:0:5754:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9fe9c1523a00/0xd6c4b8f05867e668 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb7115 expref: 13 pid: 5765 timeout: 321 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134938.838539:0:5754:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fe9c1523a00/0xd6c4b8f05867e668 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb7115 expref: 13 pid: 5765 timeout: 321 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134938.838555:0:5754:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783134938.838622:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783134938.838638:0:5754:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe8c67b9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f39b22bc-4faf-4b59-bb00-2a11f91e37c0+12:2369:x1869752373883392:12345-192.168.201.41@tcp:103:ldlm_bl.0 Request processed in 152us (406us total) trans 0 rc 0/0 00000100:00100000:0.0:1783134938.838646:0:5754:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 27 00000100:00100000:0.0:1783134938.838662:0:5754:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384396288 00000100:00100000:0.0:1783134938.838665:0:5754:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384396288 00010000:00010000:0.0:1783134938.838681:0:5754:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9fe9c148ba00/0xd6c4b8f05867e645 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd6c4b8f05867e63e expref: 18 pid: 5763 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783134938.838698:0:5754:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1783134938.838704:0:5754:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fe9fb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:88a2002e-2ea7-4f07-912a-8d001832cfc0+18:3286:x1869752384396288:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1783134938.838713:0:5754:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1783134938.838715:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fe439c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:88a2002e-2ea7-4f07-912a-8d001832cfc0+18:3287:x1869752384396160:12345-0@lo:103:ldlm_bl.0 Request processed in 259us (654us total) trans 0 rc 0/0 00010000:00010000:0.0:1783134938.838720:0:5754:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9fe9c148ba00/0xd6c4b8f05867e645 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd6c4b8f05867e63e expref: 18 pid: 5763 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783134938.838723:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00010000:0.0:1783134938.838738:0:5754:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9fe9c148ba00/0xd6c4b8f05867e645 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd6c4b8f05867e63e expref: 17 pid: 5763 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134938.838751:0:5754:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fe9c148ba00/0xd6c4b8f05867e645 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd6c4b8f05867e63e expref: 17 pid: 5763 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783134938.838789:0:3287:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9fe439500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:88a2002e-2ea7-4f07-912a-8d001832cfc0:3287:1869752384396160:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1783134938.839104:0:5754:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783134938.839225:0:3286:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fea00bcdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:88a2002e-2ea7-4f07-912a-8d001832cfc0:3286:1869752384396288:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1783134938.839228:0:5754:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fe9fb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:88a2002e-2ea7-4f07-912a-8d001832cfc0+16:3286:x1869752384396288:12345-0@lo:103:ldlm_bl.0 Request processed in 522us (605us total) trans 0 rc 0/0 00000100:00100000:0.0:1783134938.839237:0:5754:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1783134938.841861:0:10985:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9fe9fb480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10985:1869752384395904:192.168.201.41@tcp:104: 00010000:00010000:0.0:1783134938.841900:0:10985:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9fe9fe43fa00/0xd6c4b8f05867e684 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 10985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783134938.842016:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:2.0:1783134938.842065:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373883520 00000100:00100000:2.0:1783134938.842072:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373883520 00010000:00010000:2.0:1783134938.842105:0:6592:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9fea02167a00/0xd6c4b8f05867e629 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb70dd expref: 12 pid: 5763 timeout: 321 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783134938.842148:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 29 00000100:00100000:2.0:1783134938.842157:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fea00bcd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f39b22bc-4faf-4b59-bb00-2a11f91e37c0+12:2370:x1869752373883520:12345-192.168.201.41@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783134938.842170:0:6592:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783134938.842175:0:6592:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9fea02167a00/0xd6c4b8f05867e629 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb70dd expref: 12 pid: 5763 timeout: 321 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134938.842186:0:6592:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9fea02167a00/0xd6c4b8f05867e629 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb70dd expref: 12 pid: 5763 timeout: 321 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134938.842202:0:6592:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fea02167a00/0xd6c4b8f05867e629 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb70dd expref: 12 pid: 5763 timeout: 321 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134938.842218:0:6592:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9fe9fe43fa00/0xd6c4b8f05867e684 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 10985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134938.842227:0:6592:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fe9fe43fa00/0xd6c4b8f05867e684 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 10985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134938.842241:0:6592:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9fe9fe43fa00/0xd6c4b8f05867e684 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 10985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134938.842248:0:6592:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9fe9fe43fa00/0xd6c4b8f05867e684 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 10985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134938.842255:0:6592:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9fe9fe43fa00/0xd6c4b8f05867e684 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 10985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134938.842273:0:6592:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9fe9fe43fa00/0xd6c4b8f05867e684 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 10985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134938.842347:0:6592:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe9fe43fa00 already unused, calling callback (ffffffffc1527ce0) 00010000:00010000:2.0:1783134938.842352:0:6592:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9fe9fe43fa00/0xd6c4b8f05867e684 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 10985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134938.842361:0:6592:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9fe9fe43fa00/0xd6c4b8f05867e684 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 10985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134938.842377:0:6592:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9fe9fe43fa00/0xd6c4b8f05867e684 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134938.842384:0:10985:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9fe9fe43fa00/0xd6c4b8f05867e684 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134938.842387:0:6592:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1783134938.842394:0:10985:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9fe9fe43fa00/0xd6c4b8f05867e684 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134938.842399:0:10985:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fe9fe43fa00/0xd6c4b8f05867e684 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783134938.842446:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fea00bcd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f39b22bc-4faf-4b59-bb00-2a11f91e37c0+11:2370:x1869752373883520:12345-192.168.201.41@tcp:103:ldlm_bl.0 Request processed in 289us (430us total) trans 0 rc 0/0 00000100:00100000:2.0:1783134938.842453:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 29 00010000:00010000:2.0:1783134939.395488:0:5758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783134940.298509:0:3288:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fea00bce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:88a2002e-2ea7-4f07-912a-8d001832cfc0:3288:1869752384396416:0@lo:400:kworker.0 00000100:00100000:3.0:1783134940.298580:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783134940.298626:0:3288:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fea00bcf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3288:1869752384396928:0@lo:400:kworker.0 00000100:00100000:3.0:1783134940.298722:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783134940.298748:0:3288:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1783134940.298754:0:3288:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fea00bcdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3288:1869752384396544:0@lo:400:kworker.0 00000100:00100000:3.0:1783134940.298775:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783134940.298788:0:3288:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fea00bcce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1869752384397056:0@lo:400:kworker.0 00000100:00100000:3.0:1783134940.298809:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783134940.298834:0:3286:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fea00bcf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3286:1869752384396672:0@lo:400:kworker.0 00000100:00100000:3.0:1783134940.298854:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783134940.298871:0:3286:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fea00bcf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1869752384397184:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1783134940.298893:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783134940.298910:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1783134940.298915:0:3286:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fea00bcdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1869752384396800:0@lo:400:kworker.0 00000100:00100000:3.0:1783134940.298934:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783134940.298961:0:5765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384396416 00000100:00100000:3.0:1783134940.298968:0:5765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384396416 00000100:00100000:3.0:1783134940.299007:0:5765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 212 00000100:00100000:3.0:1783134940.299016:0:5765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9d1654850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88a2002e-2ea7-4f07-912a-8d001832cfc0+16:3288:x1869752384396416:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783134940.299061:0:5765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9d1654850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88a2002e-2ea7-4f07-912a-8d001832cfc0+16:3288:x1869752384396416:12345-0@lo:400:kworker.0 Request processed in 46us (481us total) trans 0 rc 0/0 00000100:00100000:3.0:1783134940.299068:0:5765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 212 00000100:00100000:3.0:1783134940.299099:0:8031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384396928 00000100:00100000:3.0:1783134940.299102:0:8031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384396928 00000100:00100000:3.0:1783134940.299130:0:8031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384396544 00000100:00100000:3.0:1783134940.299133:0:8031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384396544 00000100:00100000:3.0:1783134940.299147:0:8031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384396672 00000100:00100000:3.0:1783134940.299149:0:8031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384396672 00000100:00100000:3.0:1783134940.299165:0:8031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1783134940.299177:0:8031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe8c6df5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3288:x1869752384396928:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783134940.299209:0:8031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe8c6df5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3288:x1869752384396928:12345-0@lo:400:kworker.0 Request processed in 32us (486us total) trans 0 rc 0/0 00000100:00100000:3.0:1783134940.299215:0:8031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1783134940.299227:0:8031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1783134940.299246:0:8031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe8c6df5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3288:x1869752384396544:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783134940.300154:0:8031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe8c6df5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3288:x1869752384396544:12345-0@lo:400:kworker.0 Request processed in 918us (1375us total) trans 0 rc 0/0 00000100:00100000:3.0:1783134940.300161:0:8031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1783134940.300178:0:8031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1783134940.300185:0:8031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe8c6df6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3286:x1869752384396672:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783134940.300225:0:8031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe8c6df6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3286:x1869752384396672:12345-0@lo:400:kworker.0 Request processed in 41us (1369us total) trans 0 rc 0/0 00000100:00100000:3.0:1783134940.300231:0:8031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1783134940.300434:0:3287:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9fe439880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1869752384397312:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1783134940.300468:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783134940.300503:0:6579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384397184 00000100:00100000:0.0:1783134940.300507:0:6579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384397184 00000100:00100000:0.0:1783134940.300536:0:6579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384397312 00000100:00100000:0.0:1783134940.300539:0:6579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384397312 00000100:00100000:0.0:1783134940.300553:0:6579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1783134940.300558:0:6579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe8c6df5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1869752384397184:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1783134940.300585:0:6579:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1783134940.300617:0:6579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe8c6df5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1869752384397184:12345-0@lo:13:osp-pre-0-0.0 Request processed in 59us (1723us total) trans 0 rc 0/0 00000100:00100000:0.0:1783134940.300623:0:6579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1783134940.300634:0:6579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1783134940.300640:0:6579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fe43a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3287:x1869752384397312:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1783134940.300659:0:6579:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1783134940.300688:0:6579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fe43a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3287:x1869752384397312:12345-0@lo:13:osp-pre-1-0.0 Request processed in 49us (221us total) trans 0 rc 0/0 00000100:00100000:0.0:1783134940.300694:0:6579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00080000:0.0:1783134940.300733:0:3287:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fe9fe439880 x1869752384397312/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783134956 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783134940.300750:0:3287:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9fe439880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1869752384397312:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1783134940.300824:0:6574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384397056 00000100:00100000:3.0:1783134940.300828:0:6574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384397056 00000100:00100000:2.0:1783134940.303508:0:3286:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fea00bcf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3286:1869752384396672:0@lo:400:kworker.0 00010000:00080000:2.0:1783134940.303528:0:3286:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fea00bcf800 x1869752384397184/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783134956 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783134940.303547:0:3286:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fea00bcf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1869752384397184:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1783134940.303815:0:6574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384396800 00000100:00100000:3.0:1783134940.303822:0:6574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384396800 00000100:00100000:0.0:1783134940.303925:0:7676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1783134940.303938:0:7676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe8c6df5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3288:x1869752384397056:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783134940.304012:0:7676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe8c6df5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3288:x1869752384397056:12345-0@lo:400:kworker.0 Request processed in 78us (5201us total) trans 0 rc 0/0 00000100:00100000:0.0:1783134940.304018:0:7676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1783134940.304035:0:7676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1783134940.304041:0:7676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe8c6df7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3286:x1869752384396800:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783134940.304080:0:7676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe8c6df7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3286:x1869752384396800:12345-0@lo:400:kworker.0 Request processed in 39us (5145us total) trans 0 rc 0/0 00000100:00100000:0.0:1783134940.304085:0:7676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00080000:2.0:1783134940.304101:0:3286:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fea00bcdc00 x1869752384396800/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783134956 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783134940.304110:0:3286:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fea00bcdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1869752384396800:0@lo:400:kworker.0 00000100:00080000:1.0:1783134940.304152:0:5766:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1783134940.304156:0:5766:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1783134940.304158:0:5766:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1783134940.304250:0:3288:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fea00bcdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3288:1869752384396544:0@lo:400:kworker.0 00010000:00080000:3.0:1783134940.304264:0:3288:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fea00bcce00 x1869752384397056/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783134956 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783134940.304273:0:3288:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fea00bcce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1869752384397056:0@lo:400:kworker.0 00000100:00100000:3.0:1783134940.304391:0:3288:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fea00bce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:88a2002e-2ea7-4f07-912a-8d001832cfc0:3288:1869752384396416:0@lo:400:kworker.0 00000100:00100000:3.0:1783134940.304404:0:3288:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fea00bcf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3288:1869752384396928:0@lo:400:kworker.0 00010000:00010000:1.0:1783134940.420566:0:10987:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1783134940.739389:0:5767:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1783134940.739398:0:5767:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff9fe8c47e1800 from 7 10000000:01000000:1.0:1783134940.739404:0:5767:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1783134940.739454:0:5767:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.141@tcp lock: ffff9fe9fe43f600/0xd6c4b8f05867e68b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134940.739468:0:5767:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.141@tcp lock: ffff9fe9fe43f600/0xd6c4b8f05867e68b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134940.739479:0:5767:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.141@tcp lock: ffff9fe9fe43f600/0xd6c4b8f05867e68b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783134940.739506:0:5767:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9fe9f8e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88a2002e-2ea7-4f07-912a-8d001832cfc0:5767:1869752384397440:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1783134940.739587:0:5767:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783134940.739650:0:5767:0:(client.c:2701:ptlrpc_set_wait()) set ffff9fe9f8980cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1783134940.739766:0:5762:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384397440 00000100:00100000:2.0:1783134940.739774:0:5762:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384397440 00000100:00100000:2.0:1783134940.739825:0:5762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 213 00000100:00100000:2.0:1783134940.739834:0:5762:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9d1657050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88a2002e-2ea7-4f07-912a-8d001832cfc0+16:5767:x1869752384397440:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783134940.739856:0:5762:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783134940.739869:0:5762:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fe9c7828200/0xd6c4b8f05867e692 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd6c4b8f05867e68b expref: -99 pid: 5762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134940.739893:0:5762:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fe9c7828200/0xd6c4b8f05867e692 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd6c4b8f05867e68b expref: 17 pid: 5762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134940.739904:0:5762:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fe9c7828200/0xd6c4b8f05867e692 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd6c4b8f05867e68b expref: 17 pid: 5762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134940.739913:0:5762:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fe9c7828200, rc 0) 00000100:00100000:2.0:1783134940.739961:0:5762:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9d1657050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88a2002e-2ea7-4f07-912a-8d001832cfc0+17:5767:x1869752384397440:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 128us (374us total) trans 0 rc 0/0 00000100:00100000:2.0:1783134940.739968:0:5762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 213 00000100:00100000:1.0:1783134940.740269:0:5767:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9fe9f8e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88a2002e-2ea7-4f07-912a-8d001832cfc0:5767:1869752384397440:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783134940.740318:0:5767:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.141@tcp lock: ffff9fe9fe43f600/0xd6c4b8f05867e68b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd6c4b8f05867e692 expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134940.740328:0:5767:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.141@tcp lock: ffff9fe9fe43f600/0xd6c4b8f05867e68b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd6c4b8f05867e692 expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783134940.740388:0:5767:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9fe9f8e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88a2002e-2ea7-4f07-912a-8d001832cfc0:5767:1869752384397568:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783134940.740419:0:5767:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783134940.740438:0:5767:0:(client.c:2701:ptlrpc_set_wait()) set ffff9fe9f8980cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1783134940.740890:0:5763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384397568 00000100:00100000:2.0:1783134940.740895:0:5763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384397568 00000100:00100000:2.0:1783134940.740928:0:5763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 214 00000100:00100000:2.0:1783134940.740936:0:5763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9d1657c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88a2002e-2ea7-4f07-912a-8d001832cfc0+17:5767:x1869752384397568:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783134940.741267:0:5763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9d1657c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88a2002e-2ea7-4f07-912a-8d001832cfc0+17:5767:x1869752384397568:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 331us (846us total) trans 0 rc 0/0 00000100:00100000:2.0:1783134940.741275:0:5763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 214 00000100:00100000:2.0:1783134940.741332:0:5767:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9fe9f8e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88a2002e-2ea7-4f07-912a-8d001832cfc0:5767:1869752384397568:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783134940.741365:0:5767:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe8c67baa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88a2002e-2ea7-4f07-912a-8d001832cfc0:5767:1869752384397696:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783134940.741403:0:5767:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783134940.741417:0:5767:0:(client.c:2701:ptlrpc_set_wait()) set ffff9fe9fe962780 going to sleep for 11 seconds 00000100:00100000:0.0:1783134940.741547:0:5765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384397696 00000100:00100000:0.0:1783134940.741552:0:5765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384397696 00000100:00100000:0.0:1783134940.741575:0:5765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 215 00000100:00100000:0.0:1783134940.741581:0:5765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9d1655c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88a2002e-2ea7-4f07-912a-8d001832cfc0+17:5767:x1869752384397696:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783134940.741729:0:5765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9d1655c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88a2002e-2ea7-4f07-912a-8d001832cfc0+17:5767:x1869752384397696:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 147us (324us total) trans 0 rc 0/0 00000100:00100000:0.0:1783134940.741736:0:5765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 215 00000100:00100000:2.0:1783134940.742165:0:5767:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe8c67baa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88a2002e-2ea7-4f07-912a-8d001832cfc0:5767:1869752384397696:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1783134940.743433:0:11121:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:2.0:1783134940.744767:0:5767:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:2.0:1783134940.744795:0:5767:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.201.141@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1783134940.744805:0:5767:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.141@tcp lock: ffff9fe9fe43f600/0xd6c4b8f05867e68b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd6c4b8f05867e692 expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134940.744817:0:5767:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.141@tcp lock: ffff9fe9fe43f600/0xd6c4b8f05867e68b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd6c4b8f05867e692 expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783134940.744826:0:5767:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1783134940.744829:0:5767:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff9fea01d1b000 from 7 10000000:01000000:2.0:1783134940.744832:0:5767:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1783134940.744874:0:5767:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.141@tcp lock: ffff9fe9c7829600/0xd6c4b8f05867e699 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134940.744883:0:5767:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.141@tcp lock: ffff9fe9c7829600/0xd6c4b8f05867e699 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134940.744893:0:5767:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.141@tcp lock: ffff9fe9c7829600/0xd6c4b8f05867e699 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783134940.744916:0:5767:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe8c67baa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88a2002e-2ea7-4f07-912a-8d001832cfc0:5767:1869752384397824:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1783134940.744975:0:5767:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783134940.745014:0:5767:0:(client.c:2701:ptlrpc_set_wait()) set ffff9fe9fe962780 going to sleep for 11 seconds 00000100:00100000:0.0:1783134940.745175:0:5765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384397824 00000100:00100000:0.0:1783134940.745182:0:5765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384397824 00000100:00100000:0.0:1783134940.745239:0:5765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 216 00000100:00100000:0.0:1783134940.745248:0:5765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9d1656c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88a2002e-2ea7-4f07-912a-8d001832cfc0+17:5767:x1869752384397824:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783134940.745261:0:5765:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783134940.745294:0:5765:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fe9c0030400/0xd6c4b8f05867e6a0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xd6c4b8f05867e699 expref: -99 pid: 5765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134940.745317:0:5765:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fe9c0030400/0xd6c4b8f05867e6a0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd6c4b8f05867e699 expref: 18 pid: 5765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134940.745327:0:5765:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fe9c0030400/0xd6c4b8f05867e6a0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd6c4b8f05867e699 expref: 18 pid: 5765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134940.745335:0:5765:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fe9c0030400, rc 0) 00000100:00100000:0.0:1783134940.745374:0:5765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9d1656c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88a2002e-2ea7-4f07-912a-8d001832cfc0+18:5767:x1869752384397824:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 126us (398us total) trans 0 rc 0/0 00000100:00100000:0.0:1783134940.745381:0:5765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 216 00000100:00100000:2.0:1783134940.745479:0:5767:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe8c67baa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88a2002e-2ea7-4f07-912a-8d001832cfc0:5767:1869752384397824:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783134940.745493:0:5767:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.141@tcp lock: ffff9fe9c7829600/0xd6c4b8f05867e699 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd6c4b8f05867e6a0 expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134940.745501:0:5767:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.141@tcp lock: ffff9fe9c7829600/0xd6c4b8f05867e699 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xd6c4b8f05867e6a0 expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783134940.745555:0:5767:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe8c67baa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88a2002e-2ea7-4f07-912a-8d001832cfc0:5767:1869752384397952:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783134940.745578:0:5767:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783134940.745617:0:5767:0:(client.c:2701:ptlrpc_set_wait()) set ffff9fe9fe962780 going to sleep for 11 seconds 00000100:00100000:0.0:1783134940.745723:0:5763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384397952 00000100:00100000:0.0:1783134940.745727:0:5763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384397952 00000100:00100000:0.0:1783134940.745760:0:5763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 217 00000100:00100000:0.0:1783134940.745768:0:5763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9ea689c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88a2002e-2ea7-4f07-912a-8d001832cfc0+18:5767:x1869752384397952:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783134940.746005:0:5763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9ea689c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88a2002e-2ea7-4f07-912a-8d001832cfc0+18:5767:x1869752384397952:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 238us (424us total) trans 0 rc 0/0 00000100:00100000:0.0:1783134940.746012:0:5763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 217 00000100:00100000:2.0:1783134940.746199:0:5767:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe8c67baa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88a2002e-2ea7-4f07-912a-8d001832cfc0:5767:1869752384397952:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783134940.746259:0:5767:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe8c67baa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88a2002e-2ea7-4f07-912a-8d001832cfc0:5767:1869752384398080:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783134940.746328:0:5767:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783134940.746342:0:5767:0:(client.c:2701:ptlrpc_set_wait()) set ffff9fe9fe962780 going to sleep for 11 seconds 00000100:00100000:2.0:1783134940.746355:0:5762:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384398080 00000100:00100000:2.0:1783134940.746358:0:5762:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384398080 00000100:00100000:2.0:1783134940.746379:0:5762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 218 00000100:00100000:2.0:1783134940.746385:0:5762:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9ea68ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88a2002e-2ea7-4f07-912a-8d001832cfc0+18:5767:x1869752384398080:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783134940.746524:0:5762:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9ea68ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88a2002e-2ea7-4f07-912a-8d001832cfc0+18:5767:x1869752384398080:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 138us (194us total) trans 0 rc 0/0 00000100:00100000:2.0:1783134940.746531:0:5762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 218 00000100:00100000:2.0:1783134940.746565:0:5767:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe8c67baa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88a2002e-2ea7-4f07-912a-8d001832cfc0:5767:1869752384398080:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1783134940.750376:0:11122:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:2.0:1783134940.750686:0:5767:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:2.0:1783134940.750706:0:5767:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.201.141@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1783134940.750718:0:5767:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.141@tcp lock: ffff9fe9c7829600/0xd6c4b8f05867e699 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd6c4b8f05867e6a0 expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134940.750729:0:5767:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.141@tcp lock: ffff9fe9c7829600/0xd6c4b8f05867e699 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd6c4b8f05867e6a0 expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783134940.750740:0:5767:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1783134940.750749:0:5767:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff9fe9e0d14800 from 7 10000000:01000000:2.0:1783134940.750752:0:5767:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1783134940.750784:0:5767:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.141@tcp lock: ffff9fe9c7828e00/0xd6c4b8f05867e6a7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134940.750790:0:5767:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.141@tcp lock: ffff9fe9c7828e00/0xd6c4b8f05867e6a7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134940.750798:0:5767:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.141@tcp lock: ffff9fe9c7828e00/0xd6c4b8f05867e6a7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783134940.750816:0:5767:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe8c67baa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88a2002e-2ea7-4f07-912a-8d001832cfc0:5767:1869752384398208:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1783134940.750870:0:5767:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783134940.750916:0:5767:0:(client.c:2701:ptlrpc_set_wait()) set ffff9fe9fe962780 going to sleep for 11 seconds 00000100:00100000:0.0:1783134940.750933:0:5765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384398208 00000100:00100000:0.0:1783134940.750940:0:5765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384398208 00000100:00100000:0.0:1783134940.750986:0:5765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 219 00000100:00100000:0.0:1783134940.750995:0:5765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9d1651450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88a2002e-2ea7-4f07-912a-8d001832cfc0+18:5767:x1869752384398208:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783134940.751008:0:5765:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783134940.751020:0:5765:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fe9c0030000/0xd6c4b8f05867e6ae lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xd6c4b8f05867e6a7 expref: -99 pid: 5765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134940.751161:0:5765:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fe9c0030000/0xd6c4b8f05867e6ae lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd6c4b8f05867e6a7 expref: 19 pid: 5765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134940.751240:0:5765:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fe9c0030000/0xd6c4b8f05867e6ae lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd6c4b8f05867e6a7 expref: 19 pid: 5765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134940.751249:0:5765:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fe9c0030000, rc 0) 00000100:00100000:0.0:1783134940.751310:0:5765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9d1651450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88a2002e-2ea7-4f07-912a-8d001832cfc0+19:5767:x1869752384398208:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 316us (439us total) trans 0 rc 0/0 00000100:00100000:0.0:1783134940.751317:0:5765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 219 00000100:00100000:2.0:1783134940.751333:0:5767:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe8c67baa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88a2002e-2ea7-4f07-912a-8d001832cfc0:5767:1869752384398208:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783134940.751346:0:5767:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.141@tcp lock: ffff9fe9c7828e00/0xd6c4b8f05867e6a7 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd6c4b8f05867e6ae expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134940.751355:0:5767:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.141@tcp lock: ffff9fe9c7828e00/0xd6c4b8f05867e6a7 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xd6c4b8f05867e6ae expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783134940.751391:0:5767:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe8c67baa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88a2002e-2ea7-4f07-912a-8d001832cfc0:5767:1869752384398336:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783134940.751409:0:5767:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783134940.751429:0:5767:0:(client.c:2701:ptlrpc_set_wait()) set ffff9fe9fe962780 going to sleep for 11 seconds 00000100:00100000:0.0:1783134940.751439:0:5763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384398336 00000100:00100000:0.0:1783134940.751443:0:5763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384398336 00000100:00100000:0.0:1783134940.751470:0:5763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 220 00000100:00100000:0.0:1783134940.751477:0:5763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9d1650c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88a2002e-2ea7-4f07-912a-8d001832cfc0+19:5767:x1869752384398336:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783134940.751763:0:5763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9d1650c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88a2002e-2ea7-4f07-912a-8d001832cfc0+19:5767:x1869752384398336:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 286us (351us total) trans 0 rc 0/0 00000100:00100000:0.0:1783134940.751770:0:5763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 220 00000100:00100000:2.0:1783134940.753906:0:5767:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe8c67baa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88a2002e-2ea7-4f07-912a-8d001832cfc0:5767:1869752384398336:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783134940.753959:0:5767:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe8c67baa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88a2002e-2ea7-4f07-912a-8d001832cfc0:5767:1869752384398464:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783134940.754024:0:5767:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783134940.754065:0:5767:0:(client.c:2701:ptlrpc_set_wait()) set ffff9fe9fe962780 going to sleep for 11 seconds 00000100:00100000:0.0:1783134940.754090:0:5765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384398464 00000100:00100000:0.0:1783134940.754095:0:5765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384398464 00000100:00100000:0.0:1783134940.754149:0:5765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 221 00000100:00100000:0.0:1783134940.754157:0:5765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9d1650850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88a2002e-2ea7-4f07-912a-8d001832cfc0+19:5767:x1869752384398464:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783134940.754359:0:5765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9d1650850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88a2002e-2ea7-4f07-912a-8d001832cfc0+19:5767:x1869752384398464:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 202us (334us total) trans 0 rc 0/0 00000100:00100000:0.0:1783134940.754366:0:5765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 221 00000100:00100000:0.0:1783134940.754405:0:5767:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe8c67baa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88a2002e-2ea7-4f07-912a-8d001832cfc0:5767:1869752384398464:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1783134940.755084:0:11123:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:0.0:1783134940.755129:0:5767:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:0.0:1783134940.755147:0:5767:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.201.141@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1783134940.755156:0:5767:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.141@tcp lock: ffff9fe9c7828e00/0xd6c4b8f05867e6a7 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd6c4b8f05867e6ae expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134940.755166:0:5767:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.141@tcp lock: ffff9fe9c7828e00/0xd6c4b8f05867e6a7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd6c4b8f05867e6ae expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783134940.836580:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:1.0:1783134940.836670:0:5763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373883648 00000100:00100000:1.0:1783134940.836682:0:5763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373883648 00000100:00100000:1.0:1783134940.836782:0:5763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 222 00000100:00100000:1.0:1783134940.836794:0:5763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9d1653050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f39b22bc-4faf-4b59-bb00-2a11f91e37c0+11:5575:x1869752373883648:12345-192.168.201.41@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783134940.836809:0:5763:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783134940.836824:0:5763:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fe9fe43e200/0xd6c4b8f05867e6b5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x4428da03f5eb713f expref: -99 pid: 5763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134940.836846:0:5763:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fe9fe43e200/0xd6c4b8f05867e6b5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb713f expref: 12 pid: 5763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134940.836857:0:5763:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fe9fe43e200/0xd6c4b8f05867e6b5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb713f expref: 12 pid: 5763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134940.836866:0:5763:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fe9fe43e200, rc 0) 00000100:00100000:1.0:1783134940.836926:0:5763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9d1653050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f39b22bc-4faf-4b59-bb00-2a11f91e37c0+12:5575:x1869752373883648:12345-192.168.201.41@tcp:101:ll_cfg_requeue.0 Request processed in 135us (357us total) trans 0 rc 0/0 00000100:00100000:1.0:1783134940.836931:0:5763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 222 00000100:00100000:1.0:1783134940.840349:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:3.0:1783134940.840568:0:5762:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373883776 00000100:00100000:3.0:1783134940.840577:0:5762:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373883776 00000100:00100000:3.0:1783134940.840633:0:5762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 223 00000100:00100000:3.0:1783134940.840643:0:5762:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9d1653c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f39b22bc-4faf-4b59-bb00-2a11f91e37c0+12:5575:x1869752373883776:12345-192.168.201.41@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783134940.840913:0:5762:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9d1653c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f39b22bc-4faf-4b59-bb00-2a11f91e37c0+12:5575:x1869752373883776:12345-192.168.201.41@tcp:501:ll_cfg_requeue.0 Request processed in 270us (572us total) trans 0 rc 0/0 00000100:00100000:3.0:1783134940.840921:0:5762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 223 00000100:00100000:3.0:1783134940.843759:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:2.0:1783134940.844275:0:5763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373883904 00000100:00100000:2.0:1783134940.844304:0:5763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373883904 00000100:00100000:2.0:1783134940.844352:0:5763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 224 00000100:00100000:2.0:1783134940.844360:0:5763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9d1651c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f39b22bc-4faf-4b59-bb00-2a11f91e37c0+12:5575:x1869752373883904:12345-192.168.201.41@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783134940.844535:0:5763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9d1651c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f39b22bc-4faf-4b59-bb00-2a11f91e37c0+12:5575:x1869752373883904:12345-192.168.201.41@tcp:503:ll_cfg_requeue.0 Request processed in 175us (782us total) trans 0 rc 0/0 00000100:00100000:2.0:1783134940.844540:0:5763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 224 00000100:00100000:3.0:1783134940.848413:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:2.0:1783134940.848465:0:5765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373884032 00000100:00100000:2.0:1783134940.848475:0:5765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373884032 00000100:00100000:2.0:1783134940.848593:0:5765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 225 00000100:00100000:2.0:1783134940.848605:0:5765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9d1652c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f39b22bc-4faf-4b59-bb00-2a11f91e37c0+12:5575:x1869752373884032:12345-192.168.201.41@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783134940.848623:0:5765:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783134940.848641:0:5765:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fe9c7828600/0xd6c4b8f05867e6bc lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x4428da03f5eb7146 expref: -99 pid: 5765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134940.848668:0:5765:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fe9c7828600/0xd6c4b8f05867e6bc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb7146 expref: 13 pid: 5765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134940.848678:0:5765:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fe9c7828600/0xd6c4b8f05867e6bc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb7146 expref: 13 pid: 5765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134940.848686:0:5765:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fe9c7828600, rc 0) 00000100:00100000:2.0:1783134940.849018:0:5765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9d1652c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f39b22bc-4faf-4b59-bb00-2a11f91e37c0+13:5575:x1869752373884032:12345-192.168.201.41@tcp:101:ll_cfg_requeue.0 Request processed in 414us (611us total) trans 0 rc 0/0 00000100:00100000:2.0:1783134940.849025:0:5765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 225 00000100:00100000:2.0:1783134940.850330:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:2.0:1783134940.850356:0:5762:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373884160 00000100:00100000:2.0:1783134940.850367:0:5762:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373884160 00000100:00100000:2.0:1783134940.850399:0:5762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 226 00000100:00100000:2.0:1783134940.850407:0:5762:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9d1653450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f39b22bc-4faf-4b59-bb00-2a11f91e37c0+13:5575:x1869752373884160:12345-192.168.201.41@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783134940.850948:0:5762:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9d1653450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f39b22bc-4faf-4b59-bb00-2a11f91e37c0+13:5575:x1869752373884160:12345-192.168.201.41@tcp:501:ll_cfg_requeue.0 Request processed in 540us (618us total) trans 0 rc 0/0 00000100:00100000:2.0:1783134940.850956:0:5762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 226 00000100:00100000:3.0:1783134940.857581:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:1.0:1783134940.858131:0:5765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373884288 00000100:00100000:1.0:1783134940.858142:0:5765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373884288 00000100:00100000:1.0:1783134940.858198:0:5765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 227 00000100:00100000:1.0:1783134940.858208:0:5765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9d1650050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f39b22bc-4faf-4b59-bb00-2a11f91e37c0+13:5575:x1869752373884288:12345-192.168.201.41@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783134940.859797:0:5765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9d1650050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f39b22bc-4faf-4b59-bb00-2a11f91e37c0+13:5575:x1869752373884288:12345-192.168.201.41@tcp:503:ll_cfg_requeue.0 Request processed in 1583us (2219us total) trans 0 rc 0/0 00000100:00100000:1.0:1783134940.859808:0:5765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 227 00000001:02000400:3.0:1783134941.273371:0:11183:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg141-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1783134941.443855:0:5757:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783134942.468443:0:6591:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783134943.015410:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:3.0:1783134943.015466:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:3.0:1783134943.015510:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:0.0:1783134943.015792:0:8031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373884672 00000100:00100000:0.0:1783134943.015805:0:8031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373884672 00000100:00100000:0.0:1783134943.015879:0:8031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373884544 00000100:00100000:0.0:1783134943.015883:0:8031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373884544 00000100:00100000:0.0:1783134943.015911:0:8031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 56 00000100:00100000:0.0:1783134943.015923:0:8031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe8c6df7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c936801d-68e8-41a4-8fbc-6becd5e1be74+5:2367:x1869752373884672:12345-192.168.201.41@tcp:400:kworker.0 00000100:00100000:0.0:1783134943.016026:0:8031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe8c6df7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c936801d-68e8-41a4-8fbc-6becd5e1be74+5:2367:x1869752373884672:12345-192.168.201.41@tcp:400:kworker.0 Request processed in 105us (558us total) trans 0 rc 0/0 00000100:00100000:0.0:1783134943.016123:0:8031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 56 00000100:00100000:0.0:1783134943.016144:0:8031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 57 00000100:00100000:0.0:1783134943.016152:0:8031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe8c6df4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+6:2367:x1869752373884544:12345-192.168.201.41@tcp:400:kworker.0 00000100:00100000:0.0:1783134943.016181:0:8031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe8c6df4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+6:2367:x1869752373884544:12345-192.168.201.41@tcp:400:kworker.0 Request processed in 30us (670us total) trans 0 rc 0/0 00000100:00100000:0.0:1783134943.016468:0:8031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 57 00000100:00100000:2.0:1783134943.016691:0:5762:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373884416 00000100:00100000:2.0:1783134943.016699:0:5762:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373884416 00000100:00100000:2.0:1783134943.016746:0:5762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 228 00000100:00100000:2.0:1783134943.016754:0:5762:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9d1651050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f39b22bc-4faf-4b59-bb00-2a11f91e37c0+13:2367:x1869752373884416:12345-192.168.201.41@tcp:400:kworker.0 00000100:00100000:2.0:1783134943.017052:0:5762:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9d1651050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f39b22bc-4faf-4b59-bb00-2a11f91e37c0+13:2367:x1869752373884416:12345-192.168.201.41@tcp:400:kworker.0 Request processed in 52us (1412us total) trans 0 rc 0/0 00000100:00100000:2.0:1783134943.017061:0:5762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 228 00000100:00080000:3.0:1783134943.020150:0:5766:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1783134943.031339:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:3.0:1783134943.031379:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:0.0:1783134943.031593:0:7676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373884800 00000100:00100000:0.0:1783134943.031606:0:7676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373884800 00000100:00100000:1.0:1783134943.031670:0:6576:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373884928 00000100:00100000:1.0:1783134943.031677:0:6576:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373884928 00000100:00100000:0.0:1783134943.031713:0:7676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 14 00000100:00080000:3.0:1783134943.031771:0:5766:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1783134943.031777:0:5766:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1783134943.031827:0:7676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe8c6df7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c936801d-68e8-41a4-8fbc-6becd5e1be74+5:2366:x1869752373884800:12345-192.168.201.41@tcp:9:kworker.0 00000020:00000080:0.0:1783134943.031873:0:7676:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xd6c4b8f05867e676 00000100:00080000:0.0:1783134943.031884:0:7676:0:(import.c:65:import_set_state_nolock()) ffff9fe8c57de000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1783134943.031962:0:7676:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:0.0:1783134943.032452:0:7676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe8c6df7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c936801d-68e8-41a4-8fbc-6becd5e1be74+2:2366:x1869752373884800:12345-192.168.201.41@tcp:9:kworker.0 Request processed in 629us (1177us total) trans 0 rc 0/0 00000100:00100000:1.0:1783134943.033170:0:6576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 15 00000100:00100000:1.0:1783134943.033199:0:6576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe8c6df4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c936801d-68e8-41a4-8fbc-6becd5e1be74+5:2366:x1869752373884928:12345-192.168.201.41@tcp:9:kworker.0 00000020:00000080:1.0:1783134943.033226:0:6576:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xd6c4b8f05867e67d 00000100:00080000:1.0:1783134943.033236:0:6576:0:(import.c:65:import_set_state_nolock()) ffff9fe9fe493000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1783134943.033273:0:6576:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967298 00010000:00010000:3.0:1783134943.033297:0:5758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783134943.033315:0:10987:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783134943.034482:0:6576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe8c6df4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c936801d-68e8-41a4-8fbc-6becd5e1be74+2:2366:x1869752373884928:12345-192.168.201.41@tcp:9:kworker.0 Request processed in 1295us (3094us total) trans 0 rc 0/0 00000100:00100000:1.0:1783134943.034495:0:6576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 15 00000100:00100000:0.0:1783134943.039551:0:7676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 14 00010000:00010000:3.0:1783134943.491503:0:5757:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1783134943.821013:0:11283:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: finish setup 23:15:42 (1783134942) === 00000100:00100000:3.0:1783134943.972426:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:2.0:1783134943.972486:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373885056 00000100:00100000:2.0:1783134943.972496:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373885056 00000100:00100000:2.0:1783134943.972584:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 0 00000100:00100000:2.0:1783134943.972595:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe8c6df6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+6:9655:x1869752373885056:12345-192.168.201.41@tcp:700:mkdir.0 00000100:00100000:2.0:1783134943.972683:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe8c6df6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+6:9655:x1869752373885056:12345-192.168.201.41@tcp:700:mkdir.0 Request processed in 91us (266us total) trans 0 rc 0/0 00000100:00100000:2.0:1783134943.972691:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 0 00000100:00100000:2.0:1783134943.974250:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:1.0:1783134943.974394:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373885312 00000100:00100000:1.0:1783134943.974403:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373885312 00000100:00100000:1.0:1783134943.974442:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 14 00000100:00100000:1.0:1783134943.974450:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe8c67baa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+6:9655:x1869752373885312:12345-192.168.201.41@tcp:36:mkdir.0 00010000:00010000:1.0:1783134943.974499:0:5771:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783134943.974572:0:5771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fea02166600/0xd6c4b8f05867e5a4 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb70c8 expref: 6 pid: 5769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134943.974591:0:5771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fe9e1c2b400) 00010000:00010000:1.0:1783134943.974602:0:5771:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1783134943.974914:0:5771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43e000/0xd6c4b8f05867e6c3 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134943.974928:0:5771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43e000/0xd6c4b8f05867e6c3 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134943.974937:0:5771:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43e000/0xd6c4b8f05867e6c3 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134943.974966:0:5771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43ea00/0xd6c4b8f05867e6ca lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134943.974974:0:5771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43ea00/0xd6c4b8f05867e6ca lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134943.974981:0:5771:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43ea00/0xd6c4b8f05867e6ca lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783134943.976217:0:5771:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 512 00010000:00010000:1.0:1783134943.976231:0:5771:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43e000/0xd6c4b8f05867e6c3 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134943.976240:0:5771:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43e000/0xd6c4b8f05867e6c3 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134943.976248:0:5771:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43e000/0xd6c4b8f05867e6c3 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134943.976264:0:5771:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe9fe43e000 already unused, calling callback (ffffffffc1f634f0) 00010000:00010000:1.0:1783134943.976268:0:5771:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43e000/0xd6c4b8f05867e6c3 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134943.976276:0:5771:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43e000/0xd6c4b8f05867e6c3 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134943.976328:0:5771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fe9e1c2bd00) 00010000:00010000:1.0:1783134943.976331:0:5771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783134943.976335:0:5771:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43e000/0xd6c4b8f05867e6c3 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134943.976341:0:5771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43e000/0xd6c4b8f05867e6c3 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1783134943.976359:0:5771:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000005f707d9f reply state 00000000311e9cbe transno 4294967297 ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43ea00/0xd6c4b8f05867e6ca lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783134943.976367:0:5771:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1783134943.976460:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe8c67baa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+7:9655:x1869752373885312:12345-192.168.201.41@tcp:36:mkdir.0 Request processed in 2008us (2211us total) trans 4294967297 rc 0/0 00000100:00100000:1.0:1783134943.976470:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 14 00010000:00010000:3.0:1783134943.978442:0:3272:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43ea00/0xd6c4b8f05867e6ca lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134943.978464:0:3272:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43ea00/0xd6c4b8f05867e6ca lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134943.978473:0:3272:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43ea00/0xd6c4b8f05867e6ca lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134943.978480:0:3272:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe9fe43ea00 already unused, calling callback (ffffffffc1f634f0) 00010000:00010000:3.0:1783134943.978485:0:3272:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43ea00/0xd6c4b8f05867e6ca lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134943.978495:0:3272:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43ea00/0xd6c4b8f05867e6ca lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134943.978514:0:3272:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9fe9e1c2bf00) 00010000:00010000:3.0:1783134943.978517:0:3272:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783134943.978522:0:3272:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43ea00/0xd6c4b8f05867e6ca lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134943.978529:0:3272:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43ea00/0xd6c4b8f05867e6ca lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783134943.984203:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:1.0:1783134943.984571:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373885440 00000100:00100000:1.0:1783134943.984582:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373885440 00000100:00100000:1.0:1783134943.984644:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 15 00000100:00100000:1.0:1783134943.984654:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fea00bcf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+6:9656:x1869752373885440:12345-192.168.201.41@tcp:101:chmod.0 00010000:00010000:1.0:1783134943.984675:0:5770:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783134943.984698:0:5770:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43e000/0xd6c4b8f05867e6d1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4428da03f5eb714d expref: -99 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134943.984783:0:5770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43fe00/0xd6c4b8f05867e6d8 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134943.984797:0:5770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43fe00/0xd6c4b8f05867e6d8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134943.984808:0:5770:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43fe00/0xd6c4b8f05867e6d8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783134943.984878:0:5770:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000004:00200000:1.0:1783134943.984882:0:5770:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:1.0:1783134943.984920:0:5770:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43fe00/0xd6c4b8f05867e6d8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134943.984944:0:5770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43e000/0xd6c4b8f05867e6d1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb714d expref: 8 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134943.984961:0:5770:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43fe00/0xd6c4b8f05867e6d8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb714d expref: 7 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134943.984970:0:5770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fe9e1c2bd00) 00010000:00010000:1.0:1783134943.984973:0:5770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1783134943.984976:0:5770:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fe9fe43fe00, rc 0) 00000100:00100000:1.0:1783134943.985044:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fea00bcf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+7:9656:x1869752373885440:12345-192.168.201.41@tcp:101:chmod.0 Request processed in 382us (846us total) trans 0 rc 0/0 00000100:00100000:1.0:1783134943.985051:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 15 00000100:00100000:2.0:1783134943.993997:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:1.0:1783134943.999602:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373885696 00000100:00100000:1.0:1783134943.999632:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373885696 00000100:00100000:1.0:1783134943.999725:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 16 00000100:00100000:1.0:1783134943.999737:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fea00bce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+7:9656:x1869752373885696:12345-192.168.201.41@tcp:36:chmod.0 00010000:00010000:1.0:1783134943.999791:0:5771:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783134943.999817:0:5771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43fe00/0xd6c4b8f05867e6d8 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb714d expref: 7 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134943.999849:0:5771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fe9e1c2bd00) 00010000:00010000:1.0:1783134943.999861:0:5771:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1783134943.999886:0:5771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43e000/0xd6c4b8f05867e6df lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134943.999899:0:5771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43e000/0xd6c4b8f05867e6df lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134943.999908:0:5771:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43e000/0xd6c4b8f05867e6df lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1783134944.000190:0:5771:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000c46cc531 reply state 000000005413ffb0 transno 4294967298 ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43e000/0xd6c4b8f05867e6df lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783134944.000197:0:5771:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1783134944.000208:0:5771:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000100:00100000:1.0:1783134944.000304:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fea00bce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+8:9656:x1869752373885696:12345-192.168.201.41@tcp:36:chmod.0 Request processed in 570us (6317us total) trans 4294967298 rc 0/0 00000100:00100000:1.0:1783134944.000310:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 16 00010000:00010000:1.0:1783134944.002383:0:3273:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43e000/0xd6c4b8f05867e6df lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134944.002398:0:3273:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43e000/0xd6c4b8f05867e6df lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134944.002420:0:3273:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43e000/0xd6c4b8f05867e6df lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134944.002426:0:3273:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe9fe43e000 already unused, calling callback (ffffffffc1f634f0) 00010000:00010000:1.0:1783134944.002429:0:3273:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43e000/0xd6c4b8f05867e6df lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134944.002449:0:3273:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43e000/0xd6c4b8f05867e6df lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134944.002465:0:3273:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fe9e1c2b400) 00010000:00010000:1.0:1783134944.002469:0:3273:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1783134944.002473:0:3273:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43e000/0xd6c4b8f05867e6df lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134944.002479:0:3273:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43e000/0xd6c4b8f05867e6df lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783134944.021706:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:0.0:1783134944.021799:0:8031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373885824 00000100:00100000:0.0:1783134944.021809:0:8031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373885824 00000100:00100000:0.0:1783134944.021873:0:8031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 17 00000100:00100000:0.0:1783134944.021883:0:8031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fea00bcce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+7:9657:x1869752373885824:12345-192.168.201.41@tcp:101:chown.0 00010000:00010000:0.0:1783134944.021905:0:8031:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783134944.021929:0:8031:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ade00/0xd6c4b8f05867e6e6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4428da03f5eb7154 expref: -99 pid: 8031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134944.021992:0:8031:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ad000/0xd6c4b8f05867e6ed lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134944.022005:0:8031:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ad000/0xd6c4b8f05867e6ed lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134944.022018:0:8031:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ad000/0xd6c4b8f05867e6ed lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783134944.022073:0:8031:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000004:00200000:0.0:1783134944.022077:0:8031:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:0.0:1783134944.022109:0:8031:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ad000/0xd6c4b8f05867e6ed lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134944.022150:0:8031:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ade00/0xd6c4b8f05867e6e6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb7154 expref: 9 pid: 8031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134944.022168:0:8031:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ad000/0xd6c4b8f05867e6ed lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb7154 expref: 8 pid: 8031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134944.022187:0:8031:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fe9c8301500) 00010000:00010000:0.0:1783134944.022190:0:8031:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1783134944.022194:0:8031:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fe9f68ad000, rc 0) 00000100:00100000:0.0:1783134944.022250:0:8031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fea00bcce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+8:9657:x1869752373885824:12345-192.168.201.41@tcp:101:chown.0 Request processed in 370us (555us total) trans 0 rc 0/0 00000100:00100000:0.0:1783134944.022258:0:8031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 17 00000100:00100000:3.0:1783134944.024908:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:2.0:1783134944.025428:0:5769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373885952 00000100:00100000:2.0:1783134944.025450:0:5769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373885952 00000100:00100000:2.0:1783134944.025524:0:5769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 18 00000100:00100000:2.0:1783134944.025536:0:5769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe8c6df4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+8:9657:x1869752373885952:12345-192.168.201.41@tcp:101:chown.0 00010000:00010000:2.0:1783134944.025554:0:5769:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783134944.025576:0:5769:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828c00/0xd6c4b8f05867e6f4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4428da03f5eb715b expref: -99 pid: 5769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134944.025634:0:5769:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829400/0xd6c4b8f05867e6fb lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134944.025648:0:5769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829400/0xd6c4b8f05867e6fb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134944.025658:0:5769:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829400/0xd6c4b8f05867e6fb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134944.025672:0:5769:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829200/0xd6c4b8f05867e702 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134944.025678:0:5769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829200/0xd6c4b8f05867e702 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134944.025684:0:5769:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829200/0xd6c4b8f05867e702 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134944.025772:0:5769:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829a00/0xd6c4b8f05867e709 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134944.025780:0:5769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829a00/0xd6c4b8f05867e709 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134944.025786:0:5769:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829a00/0xd6c4b8f05867e709 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783134944.025832:0:5769:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 512 00000004:00200000:2.0:1783134944.025835:0:5769:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1783134944.025859:0:5769:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829a00/0xd6c4b8f05867e709 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134944.025870:0:5769:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829400/0xd6c4b8f05867e6fb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134944.025876:0:5769:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829400/0xd6c4b8f05867e6fb lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134944.025882:0:5769:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829400/0xd6c4b8f05867e6fb lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134944.025888:0:5769:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe9c7829400 already unused, calling callback (ffffffffc1f634f0) 00010000:00010000:2.0:1783134944.025892:0:5769:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829400/0xd6c4b8f05867e6fb lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134944.025899:0:5769:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829400/0xd6c4b8f05867e6fb lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134944.025910:0:5769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fe9c8301500) 00010000:00010000:2.0:1783134944.025913:0:5769:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783134944.025918:0:5769:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829400/0xd6c4b8f05867e6fb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134944.025923:0:5769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829400/0xd6c4b8f05867e6fb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134944.025936:0:5769:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829200/0xd6c4b8f05867e702 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134944.025951:0:5769:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829200/0xd6c4b8f05867e702 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134944.025957:0:5769:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829200/0xd6c4b8f05867e702 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134944.025962:0:5769:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe9c7829200 already unused, calling callback (ffffffffc1f634f0) 00010000:00010000:2.0:1783134944.025966:0:5769:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829200/0xd6c4b8f05867e702 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134944.025972:0:5769:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829200/0xd6c4b8f05867e702 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134944.025981:0:5769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9fe9cc3c1f00) 00010000:00010000:2.0:1783134944.025983:0:5769:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783134944.025986:0:5769:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829200/0xd6c4b8f05867e702 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134944.025992:0:5769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829200/0xd6c4b8f05867e702 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134944.026022:0:5769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828c00/0xd6c4b8f05867e6f4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb715b expref: 10 pid: 5769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134944.026036:0:5769:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829a00/0xd6c4b8f05867e709 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb715b expref: 9 pid: 5769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134944.026043:0:5769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9fe9cc3c1800) 00010000:00010000:2.0:1783134944.026045:0:5769:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1783134944.026053:0:5769:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fe9c7829a00, rc 0) 00000100:00100000:2.0:1783134944.027386:0:5769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe8c6df4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+9:9657:x1869752373885952:12345-192.168.201.41@tcp:101:chown.0 Request processed in 1846us (2478us total) trans 0 rc 0/0 00000100:00100000:2.0:1783134944.027396:0:5769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 18 00000100:00100000:2.0:1783134944.030942:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:0.0:1783134944.031026:0:8031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373886208 00000100:00100000:0.0:1783134944.031036:0:8031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373886208 00000100:00100000:0.0:1783134944.031104:0:8031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 19 00000100:00100000:0.0:1783134944.031113:0:8031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fea00bcdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+9:9657:x1869752373886208:12345-192.168.201.41@tcp:36:chown.0 00010000:00010000:0.0:1783134944.031163:0:8031:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783134944.031205:0:8031:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829a00/0xd6c4b8f05867e709 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb715b expref: 9 pid: 5769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134944.031225:0:8031:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9fe9cc3c1800) 00010000:00010000:0.0:1783134944.031235:0:8031:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1783134944.031257:0:8031:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ade00/0xd6c4b8f05867e710 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134944.031270:0:8031:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ade00/0xd6c4b8f05867e710 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134944.031326:0:8031:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ade00/0xd6c4b8f05867e710 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1783134944.062400:0:8031:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000242bfe07 reply state 0000000077f76ba1 transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ade00/0xd6c4b8f05867e710 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783134944.062420:0:8031:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1783134944.062560:0:8031:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00000100:00100000:3.0:1783134944.062658:0:8031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fea00bcdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+10:9657:x1869752373886208:12345-192.168.201.41@tcp:36:chown.0 Request processed in 31542us (31720us total) trans 4294967299 rc 0/0 00000100:00100000:3.0:1783134944.062667:0:8031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 19 00000001:00080000:3.0:1783134944.062714:0:5791:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967299 is committed 00010000:00010000:3.0:1783134944.062840:0:3272:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ade00/0xd6c4b8f05867e710 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134944.062849:0:3272:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ade00/0xd6c4b8f05867e710 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134944.062856:0:3272:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ade00/0xd6c4b8f05867e710 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134944.062862:0:3272:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe9f68ade00 already unused, calling callback (ffffffffc1f634f0) 00010000:00010000:3.0:1783134944.062866:0:3272:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ade00/0xd6c4b8f05867e710 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134944.062874:0:3272:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ade00/0xd6c4b8f05867e710 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134944.062890:0:3272:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9fe9c8301100) 00010000:00010000:3.0:1783134944.062893:0:3272:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1783134944.062899:0:3272:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ade00/0xd6c4b8f05867e710 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134944.062905:0:3272:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ade00/0xd6c4b8f05867e710 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783134944.081253:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:1.0:1783134944.081719:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373886336 00000100:00100000:1.0:1783134944.081729:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373886336 00000100:00100000:1.0:1783134944.081794:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 20 00000100:00100000:1.0:1783134944.081806:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fea00bcdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+6:9658:x1869752373886336:12345-192.168.201.41@tcp:101:touch.500 00010000:00010000:1.0:1783134944.081829:0:5771:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783134944.081849:0:5771:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43e000/0xd6c4b8f05867e717 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4428da03f5eb7162 expref: -99 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1783134944.083075:0:5771:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 500, time 1177us 00010000:00010000:2.0:1783134944.096271:0:5771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828c00/0xd6c4b8f05867e71e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134944.096324:0:5771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828c00/0xd6c4b8f05867e71e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134944.096337:0:5771:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828c00/0xd6c4b8f05867e71e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134944.096351:0:5771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829200/0xd6c4b8f05867e725 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134944.096359:0:5771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829200/0xd6c4b8f05867e725 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134944.096366:0:5771:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829200/0xd6c4b8f05867e725 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134944.096843:0:5771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829400/0xd6c4b8f05867e72c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134944.096852:0:5771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829400/0xd6c4b8f05867e72c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134944.096859:0:5771:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829400/0xd6c4b8f05867e72c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783134944.096949:0:5771:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00000004:00200000:2.0:1783134944.096954:0:5771:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1783134944.097045:0:5771:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829400/0xd6c4b8f05867e72c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134944.097059:0:5771:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828c00/0xd6c4b8f05867e71e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134944.097066:0:5771:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828c00/0xd6c4b8f05867e71e lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134944.097239:0:5771:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828c00/0xd6c4b8f05867e71e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134944.097246:0:5771:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe9c7828c00 already unused, calling callback (ffffffffc1f634f0) 00010000:00010000:2.0:1783134944.097251:0:5771:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828c00/0xd6c4b8f05867e71e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134944.097259:0:5771:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828c00/0xd6c4b8f05867e71e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134944.097272:0:5771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fe9c8301500) 00010000:00010000:2.0:1783134944.097275:0:5771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783134944.097309:0:5771:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828c00/0xd6c4b8f05867e71e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134944.097316:0:5771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828c00/0xd6c4b8f05867e71e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134944.097328:0:5771:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829200/0xd6c4b8f05867e725 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134944.097343:0:5771:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829200/0xd6c4b8f05867e725 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134944.097349:0:5771:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829200/0xd6c4b8f05867e725 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134944.097354:0:5771:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe9c7829200 already unused, calling callback (ffffffffc1f634f0) 00010000:00010000:2.0:1783134944.097357:0:5771:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829200/0xd6c4b8f05867e725 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134944.097363:0:5771:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829200/0xd6c4b8f05867e725 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134944.097371:0:5771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9fe9cc3c1f00) 00010000:00010000:2.0:1783134944.097374:0:5771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783134944.097377:0:5771:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829200/0xd6c4b8f05867e725 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134944.097383:0:5771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829200/0xd6c4b8f05867e725 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134944.097418:0:5771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43e000/0xd6c4b8f05867e717 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb7162 expref: 8 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134944.097433:0:5771:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829400/0xd6c4b8f05867e72c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb7162 expref: 7 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134944.097440:0:5771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9fe9cc3c1b00) 00010000:00010000:2.0:1783134944.097443:0:5771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1783134944.097451:0:5771:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fe9c7829400, rc 0) 00000100:00100000:3.0:1783134944.097776:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fea00bcdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+7:9658:x1869752373886336:12345-192.168.201.41@tcp:101:touch.500 Request processed in 15969us (16530us total) trans 0 rc 0/0 00000100:00100000:3.0:1783134944.097787:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 20 00000100:00100000:3.0:1783134944.101089:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:1.0:1783134944.101154:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373886592 00000100:00100000:1.0:1783134944.101162:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373886592 00000100:00100000:1.0:1783134944.101233:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 21 00000100:00100000:1.0:1783134944.101254:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe8c6df4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+7:9658:x1869752373886592:12345-192.168.201.41@tcp:101:touch.500 00010000:00010000:1.0:1783134944.101274:0:5770:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783134944.101501:0:5770:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43fe00/0xd6c4b8f05867e733 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4428da03f5eb7169 expref: -99 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134944.101818:0:5770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43f000/0xd6c4b8f05867e73a lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134944.101834:0:5770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43f000/0xd6c4b8f05867e73a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134944.101843:0:5770:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43f000/0xd6c4b8f05867e73a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134944.101905:0:5770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43e400/0xd6c4b8f05867e741 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x22bab6ae bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134944.101914:0:5770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43e400/0xd6c4b8f05867e741 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x22bab6ae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134944.101921:0:5770:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43e400/0xd6c4b8f05867e741 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x22bab6ae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1783134944.102690:0:5770:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x2:0x0], index 1: 0 00010000:00010000:1.0:1783134944.102918:0:5770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43fc00/0xd6c4b8f05867e748 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134944.102930:0:5770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43fc00/0xd6c4b8f05867e748 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134944.102935:0:5770:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43fc00/0xd6c4b8f05867e748 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134944.102968:0:5770:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43f000/0xd6c4b8f05867e73a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134944.102973:0:5770:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43f000/0xd6c4b8f05867e73a lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134944.102977:0:5770:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43f000/0xd6c4b8f05867e73a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134944.102981:0:5770:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe9fe43f000 already unused, calling callback (ffffffffc1f634f0) 00010000:00010000:1.0:1783134944.102984:0:5770:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43f000/0xd6c4b8f05867e73a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134944.102989:0:5770:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43f000/0xd6c4b8f05867e73a lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134944.102998:0:5770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9fe9cc3c1b00) 00010000:00010000:1.0:1783134944.103000:0:5770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783134944.103002:0:5770:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43f000/0xd6c4b8f05867e73a lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134944.103006:0:5770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43f000/0xd6c4b8f05867e73a lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1783134944.103015:0:5770:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000b5e0556c reply state 000000006e343d23 transno 4294967300 ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43e400/0xd6c4b8f05867e741 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x22bab6ae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783134944.103022:0:5770:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1783134944.103051:0:5770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43fe00/0xd6c4b8f05867e733 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb7169 expref: 10 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134944.103077:0:5770:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43fc00/0xd6c4b8f05867e748 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb7169 expref: 9 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134944.103084:0:5770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9fe9e1c2bd00) 00010000:00010000:1.0:1783134944.103086:0:5770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1783134944.103088:0:5770:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fe9fe43fc00, rc 0) 00000100:00100000:1.0:1783134944.103163:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe8c6df4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+10:9658:x1869752373886592:12345-192.168.201.41@tcp:101:touch.500 Request processed in 1910us (2080us total) trans 4294967300 rc 0/0 00000100:00100000:1.0:1783134944.103183:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 21 00010000:00010000:1.0:1783134944.106191:0:3273:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43e400/0xd6c4b8f05867e741 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x22bab6ae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134944.106208:0:3273:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43e400/0xd6c4b8f05867e741 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x22bab6ae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134944.106215:0:3273:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43e400/0xd6c4b8f05867e741 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x22bab6ae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134944.106229:0:3273:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe9fe43e400 already unused, calling callback (ffffffffc1f634f0) 00010000:00010000:1.0:1783134944.106234:0:3273:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43e400/0xd6c4b8f05867e741 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x22bab6ae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134944.106241:0:3273:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43e400/0xd6c4b8f05867e741 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x22bab6ae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134944.106258:0:3273:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x22bab6ae (ffff9fe9e1c2b400) 00010000:00010000:1.0:1783134944.106261:0:3273:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783134944.106266:0:3273:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43e400/0xd6c4b8f05867e741 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x22bab6ae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134944.106342:0:3273:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43e400/0xd6c4b8f05867e741 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x22bab6ae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783134944.109431:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:2.0:1783134944.109673:0:5769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373886848 00000100:00100000:2.0:1783134944.109683:0:5769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373886848 00000100:00100000:2.0:1783134944.109735:0:5769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 22 00000100:00100000:2.0:1783134944.109745:0:5769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe8c6df6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+9:9658:x1869752373886848:12345-192.168.201.41@tcp:36:touch.500 00010000:00010000:2.0:1783134944.109804:0:5769:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783134944.109830:0:5769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43fc00/0xd6c4b8f05867e748 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb7169 expref: 9 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134944.109850:0:5769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9fe9e1c2bd00) 00010000:00010000:2.0:1783134944.109861:0:5769:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1783134944.109905:0:5769:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829200/0xd6c4b8f05867e756 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134944.109919:0:5769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829200/0xd6c4b8f05867e756 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134944.109928:0:5769:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829200/0xd6c4b8f05867e756 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1783134944.110069:0:5769:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000d15712d3 reply state 00000000c7517112 transno 4294967301 ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829200/0xd6c4b8f05867e756 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783134944.110078:0:5769:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1783134944.110179:0:5769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe8c6df6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+10:9658:x1869752373886848:12345-192.168.201.41@tcp:36:touch.500 Request processed in 425us (746us total) trans 4294967301 rc 0/0 00000100:00100000:2.0:1783134944.110187:0:5769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 22 00010000:00010000:3.0:1783134944.111675:0:3272:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829200/0xd6c4b8f05867e756 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134944.111700:0:3272:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829200/0xd6c4b8f05867e756 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134944.111708:0:3272:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829200/0xd6c4b8f05867e756 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134944.111714:0:3272:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe9c7829200 already unused, calling callback (ffffffffc1f634f0) 00010000:00010000:3.0:1783134944.111719:0:3272:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829200/0xd6c4b8f05867e756 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134944.111726:0:3272:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829200/0xd6c4b8f05867e756 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134944.111740:0:3272:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9fe9cc3c1f00) 00010000:00010000:3.0:1783134944.111743:0:3272:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783134944.111748:0:3272:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829200/0xd6c4b8f05867e756 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134944.111754:0:3272:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829200/0xd6c4b8f05867e756 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783134944.114488:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:0.0:1783134944.114592:0:8031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373886976 00000100:00100000:0.0:1783134944.114602:0:8031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373886976 00000100:00100000:0.0:1783134944.114658:0:8031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 23 00000100:00100000:0.0:1783134944.114668:0:8031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe8c6df4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+9:9658:x1869752373886976:12345-192.168.201.41@tcp:101:touch.500 00010000:00010000:0.0:1783134944.114693:0:8031:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783134944.114712:0:8031:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ac600/0xd6c4b8f05867e75d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4428da03f5eb7170 expref: -99 pid: 8031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134944.114768:0:8031:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ac600/0xd6c4b8f05867e75d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb7170 expref: 10 pid: 8031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134944.114782:0:8031:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ac600/0xd6c4b8f05867e75d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb7170 expref: 10 pid: 8031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134944.114798:0:8031:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9fe9c8301a00) 00010000:00010000:0.0:1783134944.114801:0:8031:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1783134944.114804:0:8031:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fe9f68ac600, rc 0) 00000100:00100000:0.0:1783134944.114858:0:8031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe8c6df4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+10:9658:x1869752373886976:12345-192.168.201.41@tcp:101:touch.500 Request processed in 192us (378us total) trans 0 rc 0/0 00000100:00100000:0.0:1783134944.114865:0:8031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 23 00000100:00100000:0.0:1783134944.117621:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:3.0:1783134944.117681:0:6574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373887104 00000100:00100000:3.0:1783134944.117690:0:6574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373887104 00000100:00100000:3.0:1783134944.117781:0:6574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 16 00000100:00100000:3.0:1783134944.117789:0:6574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fe439880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2366:x1869752373887104:12345-192.168.201.41@tcp:8:touch.500 00010000:00080000:3.0:1783134944.117820:0:6574:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0001: connection from 28f4ba61-cfae-499e-ab3d-81cb8215f7bb@192.168.201.41@tcp t0 exp 0000000000000000 cur 226 last 0 00000020:00000080:3.0:1783134944.117848:0:6574:0:(genops.c:1406:class_connect()) connect: client 28f4ba61-cfae-499e-ab3d-81cb8215f7bb, cookie 0xd6c4b8f05867e764 00002000:00100000:3.0:1783134944.117859:0:6574:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 28f4ba61-cfae-499e-ab3d-81cb8215f7bb/ffff9fe9f8a59000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113653 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1783134944.117894:0:6574:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:3.0:1783134944.118003:0:6574:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1783134944.118032:0:6574:0:(import.c:65:import_set_state_nolock()) ffff9fe9f8a58800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1783134944.118102:0:6574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fe439880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+6:2366:x1869752373887104:12345-192.168.201.41@tcp:8:touch.500 Request processed in 312us (488us total) trans 0 rc 0/0 00000100:00100000:3.0:1783134944.118110:0:6574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 16 00000100:00100000:2.0:1783134944.120179:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:1.0:1783134944.120355:0:6576:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373887232 00000100:00100000:1.0:1783134944.120365:0:6576:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373887232 00000100:00080000:3.0:1783134944.120573:0:5766:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1783134944.120620:0:6576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 17 00000100:00100000:1.0:1783134944.120633:0:6576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fea00bcf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+6:0:x1869752373887232:12345-192.168.201.41@tcp:2:touch.500 00000001:00080000:2.0:1783134944.139066:0:7470:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967299 is committed 00000001:00100000:2.0:1783134944.139082:0:7470:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of c936801d-68e8-41a4-8fbc-6becd5e1be74 00000020:00000080:2.0:1783134944.139096:0:7470:0:(genops.c:906:class_export_put()) final put ffff9fe9fe497800/c936801d-68e8-41a4-8fbc-6becd5e1be74 00000001:00100000:2.0:1783134944.139122:0:7470:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 28f4ba61-cfae-499e-ab3d-81cb8215f7bb 00000020:00000080:2.0:1783134944.139139:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9fe9fe497800/c936801d-68e8-41a4-8fbc-6becd5e1be74 for lustre-OST0001 00000020:00000080:2.0:1783134944.139190:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9fe9fe493000 for lustre-OST0001 00000100:00100000:1.0:1783134944.139195:0:6576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fea00bcf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+5:0:x1869752373887232:12345-192.168.201.41@tcp:2:touch.500 Request processed in 18554us (19018us total) trans 4294967299 rc 0/0 00000100:00100000:1.0:1783134944.139206:0:6576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 17 00000100:00100000:0.0:1783134944.141303:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:3.0:1783134944.141398:0:5773:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373887488 00000100:00100000:3.0:1783134944.141408:0:5773:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373887488 00000100:00100000:3.0:1783134944.141476:0:5773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 2 00000100:00100000:3.0:1783134944.141487:0:5773:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fe439f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+10:9658:x1869752373887488:12345-192.168.201.41@tcp:35:touch.500 00000100:00100000:3.0:1783134944.141830:0:5773:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fe439f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+11:9658:x1869752373887488:12345-192.168.201.41@tcp:35:touch.500 Request processed in 344us (550us total) trans 4294967302 rc 0/0 00000100:00100000:3.0:1783134944.141839:0:5773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 2 00000100:00100000:0.0:1783134944.153557:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:2.0:1783134944.153625:0:5769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373887616 00000100:00100000:2.0:1783134944.153636:0:5769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373887616 00000100:00100000:2.0:1783134944.153700:0:5769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 24 00000100:00100000:2.0:1783134944.153710:0:5769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fe43b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+11:9659:x1869752373887616:12345-192.168.201.41@tcp:101:rm.0 00010000:00010000:2.0:1783134944.153731:0:5769:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783134944.153749:0:5769:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829e00/0xd6c4b8f05867e76b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4428da03f5eb7177 expref: -99 pid: 5769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134944.153813:0:5769:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829000/0xd6c4b8f05867e772 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134944.153826:0:5769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829000/0xd6c4b8f05867e772 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134944.153836:0:5769:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829000/0xd6c4b8f05867e772 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783134944.153892:0:5769:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00000004:00200000:2.0:1783134944.153895:0:5769:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:2.0:1783134944.153931:0:5769:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829000/0xd6c4b8f05867e772 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134944.153957:0:5769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829e00/0xd6c4b8f05867e76b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb7177 expref: 13 pid: 5769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134944.153976:0:5769:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829000/0xd6c4b8f05867e772 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb7177 expref: 12 pid: 5769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134944.153999:0:5769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9fe9cc3c1b00) 00010000:00010000:2.0:1783134944.154003:0:5769:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1783134944.154007:0:5769:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fe9c7829000, rc 0) 00000100:00100000:2.0:1783134944.154178:0:5769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fe43b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+12:9659:x1869752373887616:12345-192.168.201.41@tcp:101:rm.0 Request processed in 457us (618us total) trans 0 rc 0/0 00000100:00100000:2.0:1783134944.154195:0:5769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 24 00000100:00100000:2.0:1783134944.157503:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:0.0:1783134944.158732:0:8031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373887872 00000100:00100000:0.0:1783134944.158743:0:8031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373887872 00000100:00100000:0.0:1783134944.158804:0:8031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 25 00000100:00100000:0.0:1783134944.158816:0:8031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fea00bcf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+12:9659:x1869752373887872:12345-192.168.201.41@tcp:101:rm.0 00010000:00010000:0.0:1783134944.158836:0:8031:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783134944.158857:0:8031:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ace00/0xd6c4b8f05867e779 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4428da03f5eb717e expref: -99 pid: 8031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783134944.158965:0:8031:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00010000:0.0:1783134944.159115:0:8031:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ace00/0xd6c4b8f05867e779 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb717e expref: 14 pid: 8031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134944.159129:0:8031:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fe9c8301500) 00010000:00010000:0.0:1783134944.159133:0:8031:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1783134944.159138:0:8031:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ace00/0xd6c4b8f05867e779 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb717e expref: 14 pid: 8031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134944.159152:0:8031:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fe9f68ace00, rc 0) 00000100:00100000:0.0:1783134944.159663:0:8031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fea00bcf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+13:9659:x1869752373887872:12345-192.168.201.41@tcp:101:rm.0 Request processed in 848us (2167us total) trans 4294967303 rc 301/301 00000100:00100000:0.0:1783134944.159671:0:8031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 25 00000100:00100000:0.0:1783134944.171622:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:2.0:1783134944.171715:0:5772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373888000 00000100:00100000:2.0:1783134944.171725:0:5772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373888000 00000100:00100000:2.0:1783134944.171777:0:5772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 3 00000100:00100000:2.0:1783134944.171788:0:5772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fe43b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+13:9659:x1869752373888000:12345-192.168.201.41@tcp:37:rm.0 00000100:00100000:2.0:1783134944.177076:0:5772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fe43b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+13:9659:x1869752373888000:12345-192.168.201.41@tcp:37:rm.0 Request processed in 5280us (5455us total) trans 0 rc 0/0 00000100:00100000:2.0:1783134944.177090:0:5772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 3 00000100:00100000:0.0:1783134944.181322:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:3.0:1783134944.181376:0:5773:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373888256 00000100:00100000:3.0:1783134944.181386:0:5773:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373888256 00000100:00100000:3.0:1783134944.181440:0:5773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 4 00000100:00100000:3.0:1783134944.181559:0:5773:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9cb43bc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+13:9659:x1869752373888256:12345-192.168.201.41@tcp:35:rm.0 00000100:00100000:3.0:1783134944.181914:0:5773:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9cb43bc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+14:9659:x1869752373888256:12345-192.168.201.41@tcp:35:rm.0 Request processed in 465us (639us total) trans 4294967304 rc 0/0 00000100:00100000:3.0:1783134944.181922:0:5773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 4 00000100:00100000:0.0:1783134944.188559:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:3.0:1783134944.188794:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373888512 00000100:00100000:3.0:1783134944.188803:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373888512 00000100:00100000:3.0:1783134944.188866:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 26 00000100:00100000:3.0:1783134944.188876:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fe438e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+14:9659:x1869752373888512:12345-192.168.201.41@tcp:101:rm.0 00010000:00010000:3.0:1783134944.188898:0:5771:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783134944.188930:0:5771:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b74800/0xd6c4b8f05867e787 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4428da03f5eb7185 expref: -99 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134944.189043:0:5771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b74000/0xd6c4b8f05867e78e lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134944.189056:0:5771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b74000/0xd6c4b8f05867e78e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134944.189068:0:5771:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b74000/0xd6c4b8f05867e78e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783134944.189078:0:5771:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00010000:3.0:1783134944.189205:0:5771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b74800/0xd6c4b8f05867e787 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb7185 expref: 17 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134944.189224:0:5771:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b74000/0xd6c4b8f05867e78e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb7185 expref: 16 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134944.189233:0:5771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9fe9cc3c1b00) 00010000:00010000:3.0:1783134944.189236:0:5771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1783134944.189239:0:5771:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fe9d2b74000, rc 0) 00000100:00100000:3.0:1783134944.189339:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fe438e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+16:9659:x1869752373888512:12345-192.168.201.41@tcp:101:rm.0 Request processed in 464us (790us total) trans 4294967305 rc 0/0 00000100:00100000:3.0:1783134944.189347:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 26 00000100:00100000:1.0:1783134944.198498:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:2.0:1783134944.198614:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373888640 00000100:00100000:2.0:1783134944.198624:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373888640 00000100:00100000:2.0:1783134944.198781:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 27 00000100:00100000:2.0:1783134944.198792:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fe9fb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+16:9659:x1869752373888640:12345-192.168.201.41@tcp:41:rm.0 00000004:00000024:2.0:1783134944.198852:0:5770:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 7719616512 avail 7715422208 00000100:00100000:2.0:1783134944.198926:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fe9fb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+16:9659:x1869752373888640:12345-192.168.201.41@tcp:41:rm.0 Request processed in 136us (439us total) trans 0 rc 0/0 00000100:00100000:2.0:1783134944.198934:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 27 00000100:00100000:1.0:1783134944.201372:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:3.0:1783134944.201441:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373888768 00000100:00100000:3.0:1783134944.201449:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373888768 00000100:00100000:3.0:1783134944.201504:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 28 00000100:00100000:3.0:1783134944.201512:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fe9f8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+16:9659:x1869752373888768:12345-192.168.201.41@tcp:101:rm.0 00010000:00010000:3.0:1783134944.201541:0:5771:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783134944.201558:0:5771:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b74800/0xd6c4b8f05867e79c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4428da03f5eb718c expref: -99 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134944.201614:0:5771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b75400/0xd6c4b8f05867e7a3 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134944.201627:0:5771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b75400/0xd6c4b8f05867e7a3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134944.201636:0:5771:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b75400/0xd6c4b8f05867e7a3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134944.201650:0:5771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b75600/0xd6c4b8f05867e7aa lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x22bab6ae bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134944.201657:0:5771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b75600/0xd6c4b8f05867e7aa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x22bab6ae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134944.201674:0:5771:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b75600/0xd6c4b8f05867e7aa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x22bab6ae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134944.201788:0:5771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b75800/0xd6c4b8f05867e7b1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134944.201798:0:5771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b75800/0xd6c4b8f05867e7b1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134944.201804:0:5771:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b75800/0xd6c4b8f05867e7b1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783134944.201831:0:5771:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x2:0x0]: returning size 0 00000004:00200000:3.0:1783134944.201840:0:5771:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1783134944.201861:0:5771:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b75800/0xd6c4b8f05867e7b1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134944.201872:0:5771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b75800/0xd6c4b8f05867e7b1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134944.201879:0:5771:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b75400/0xd6c4b8f05867e7a3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134944.201885:0:5771:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b75400/0xd6c4b8f05867e7a3 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134944.201892:0:5771:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b75400/0xd6c4b8f05867e7a3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134944.201898:0:5771:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe9d2b75400 already unused, calling callback (ffffffffc1f634f0) 00010000:00010000:3.0:1783134944.201902:0:5771:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b75400/0xd6c4b8f05867e7a3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134944.201909:0:5771:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b75400/0xd6c4b8f05867e7a3 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134944.201921:0:5771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9fe9cc3c1b00) 00010000:00010000:3.0:1783134944.201924:0:5771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783134944.201929:0:5771:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b75400/0xd6c4b8f05867e7a3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134944.201936:0:5771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b75400/0xd6c4b8f05867e7a3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134944.201950:0:5771:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b75600/0xd6c4b8f05867e7aa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x22bab6ae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134944.201965:0:5771:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b75600/0xd6c4b8f05867e7aa lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x22bab6ae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134944.201971:0:5771:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b75600/0xd6c4b8f05867e7aa lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x22bab6ae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134944.201976:0:5771:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe9d2b75600 already unused, calling callback (ffffffffc1f634f0) 00010000:00010000:3.0:1783134944.201979:0:5771:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b75600/0xd6c4b8f05867e7aa lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x22bab6ae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134944.201985:0:5771:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b75600/0xd6c4b8f05867e7aa lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x22bab6ae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134944.201992:0:5771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x22bab6ae (ffff9fe9cb8f4c00) 00010000:00010000:3.0:1783134944.201994:0:5771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783134944.201996:0:5771:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b75600/0xd6c4b8f05867e7aa lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x22bab6ae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134944.202001:0:5771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b75600/0xd6c4b8f05867e7aa lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x22bab6ae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134944.202027:0:5771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b74800/0xd6c4b8f05867e79c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb718c expref: 18 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134944.202038:0:5771:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b75800/0xd6c4b8f05867e7b1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb718c expref: 17 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134944.202045:0:5771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9fe9c8301a00) 00010000:00010000:3.0:1783134944.202047:0:5771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1783134944.202054:0:5771:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fe9d2b75800, rc 0) 00000100:00100000:3.0:1783134944.202110:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fe9f8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+17:9659:x1869752373888768:12345-192.168.201.41@tcp:101:rm.0 Request processed in 597us (744us total) trans 0 rc 0/0 00000100:00100000:3.0:1783134944.202117:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 28 00000100:00100000:3.0:1783134944.209109:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:0.0:1783134944.209248:0:8031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373889024 00000100:00100000:0.0:1783134944.209258:0:8031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373889024 00000100:00100000:0.0:1783134944.209401:0:8031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 29 00000100:00100000:0.0:1783134944.209422:0:8031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe8c6df7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+17:9659:x1869752373889024:12345-192.168.201.41@tcp:36:rm.0 00010000:00010000:0.0:1783134944.209479:0:8031:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1783134944.209507:0:8031:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b75800/0xd6c4b8f05867e7b1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb718c expref: 17 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134944.209529:0:8031:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ac600/0xd6c4b8f05867e75d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb7170 expref: 16 pid: 8031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134944.209540:0:8031:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9fe9c8301a00) 00010000:00010000:0.0:1783134944.209557:0:8031:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829000/0xd6c4b8f05867e772 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb7177 expref: 15 pid: 5769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134944.209567:0:8031:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9fe9cc3c1b00) 00010000:00010000:0.0:1783134944.209570:0:8031:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1783134944.209589:0:8031:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ad800/0xd6c4b8f05867e7b8 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134944.209603:0:8031:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ad800/0xd6c4b8f05867e7b8 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134944.209613:0:8031:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ad800/0xd6c4b8f05867e7b8 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134944.209626:0:8031:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ace00/0xd6c4b8f05867e7bf lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x22bab6ae bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134944.209633:0:8031:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ace00/0xd6c4b8f05867e7bf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x22bab6ae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134944.209639:0:8031:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ace00/0xd6c4b8f05867e7bf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x22bab6ae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134944.209780:0:8031:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ad600/0xd6c4b8f05867e7c6 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134944.209789:0:8031:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ad600/0xd6c4b8f05867e7c6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134944.209796:0:8031:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ad600/0xd6c4b8f05867e7c6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1783134944.210805:0:8031:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].2, 64 off8320 00000004:00080000:0.0:1783134944.210816:0:8031:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 226606535865ns, next at 227606533798ns, rc = 0 00010000:00010000:0.0:1783134944.210874:0:8031:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ac200/0xd6c4b8f05867e7cd lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134944.210886:0:8031:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ac200/0xd6c4b8f05867e7cd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134944.210895:0:8031:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ac200/0xd6c4b8f05867e7cd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134944.210902:0:8031:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ac200/0xd6c4b8f05867e7cd lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134944.210908:0:8031:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ac200/0xd6c4b8f05867e7cd lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134944.210915:0:8031:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ac200/0xd6c4b8f05867e7cd lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134944.210972:0:8031:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1783134944.210992:0:8031:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ad600/0xd6c4b8f05867e7c6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134944.211007:0:8031:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ad600/0xd6c4b8f05867e7c6 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134944.211014:0:8031:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ad600/0xd6c4b8f05867e7c6 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134944.211020:0:8031:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe9f68ad600 already unused, calling callback (ffffffffc1f634f0) 00010000:00010000:0.0:1783134944.211024:0:8031:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ad600/0xd6c4b8f05867e7c6 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134944.211032:0:8031:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ad600/0xd6c4b8f05867e7c6 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134944.211042:0:8031:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9fe9c8301900) 00010000:00010000:0.0:1783134944.211045:0:8031:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1783134944.211049:0:8031:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ad600/0xd6c4b8f05867e7c6 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134944.211055:0:8031:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ad600/0xd6c4b8f05867e7c6 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134944.211071:0:8031:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ad800/0xd6c4b8f05867e7b8 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134944.211078:0:8031:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ad800/0xd6c4b8f05867e7b8 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134944.211084:0:8031:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ad800/0xd6c4b8f05867e7b8 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134944.211089:0:8031:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe9f68ad800 already unused, calling callback (ffffffffc1f634f0) 00010000:00010000:0.0:1783134944.211097:0:8031:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ad800/0xd6c4b8f05867e7b8 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134944.211104:0:8031:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ad800/0xd6c4b8f05867e7b8 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134944.211112:0:8031:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9fe9cc3c1b00) 00010000:00010000:0.0:1783134944.211115:0:8031:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783134944.211118:0:8031:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ad800/0xd6c4b8f05867e7b8 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134944.211125:0:8031:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ad800/0xd6c4b8f05867e7b8 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1783134944.211135:0:8031:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000004f2e67c3 reply state 000000000990faea transno 4294967306 ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ace00/0xd6c4b8f05867e7bf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x22bab6ae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783134944.211143:0:8031:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1783134944.211312:0:8031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe8c6df7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+16:9659:x1869752373889024:12345-192.168.201.41@tcp:36:rm.0 Request processed in 1861us (2181us total) trans 4294967306 rc 0/0 00000100:00100000:0.0:1783134944.211321:0:8031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 29 00010000:00010000:3.0:1783134944.211951:0:6591:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783134944.211959:0:6591:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ac200/0xd6c4b8f05867e7cd lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134944.211965:0:6591:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe9f68ac200 already unused, calling callback (ffffffffc1527ce0) 00010000:00010000:3.0:1783134944.211969:0:6591:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ac200/0xd6c4b8f05867e7cd lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134944.211976:0:6591:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ac200/0xd6c4b8f05867e7cd lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134944.211985:0:6591:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9fe9c8301900) 00010000:00010000:3.0:1783134944.211988:0:6591:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1783134944.211990:0:6591:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ac200/0xd6c4b8f05867e7cd lrc: 1/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134944.211995:0:6591:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ac200/0xd6c4b8f05867e7cd lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134944.212010:0:6591:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783134944.212012:0:6591:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783134944.212013:0:6591:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783134944.214326:0:3273:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ace00/0xd6c4b8f05867e7bf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x22bab6ae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134944.214340:0:3273:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ace00/0xd6c4b8f05867e7bf lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x22bab6ae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134944.214362:0:3273:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ace00/0xd6c4b8f05867e7bf lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x22bab6ae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134944.214368:0:3273:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe9f68ace00 already unused, calling callback (ffffffffc1f634f0) 00010000:00010000:3.0:1783134944.214373:0:3273:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ace00/0xd6c4b8f05867e7bf lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x22bab6ae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134944.214381:0:3273:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ace00/0xd6c4b8f05867e7bf lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x22bab6ae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134944.214396:0:3273:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x22bab6ae (ffff9fe9c8301400) 00010000:00010000:3.0:1783134944.214399:0:3273:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783134944.214403:0:3273:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ace00/0xd6c4b8f05867e7bf lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x22bab6ae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134944.214409:0:3273:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ace00/0xd6c4b8f05867e7bf lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x22bab6ae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783134944.220164:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:2.0:1783134944.225523:0:5772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373889280 00000100:00100000:2.0:1783134944.225539:0:5772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373889280 00000100:00100000:2.0:1783134944.225607:0:5772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 5 00000100:00100000:2.0:1783134944.225632:0:5772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe8c6df5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+15:9659:x1869752373889280:12345-192.168.201.41@tcp:35:rm.0 00000100:00100000:2.0:1783134944.228232:0:5772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe8c6df5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+16:9659:x1869752373889280:12345-192.168.201.41@tcp:35:rm.0 Request processed in 2021us (7495us total) trans 4294967307 rc 0/0 00000100:00100000:2.0:1783134944.228246:0:5772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 5 00000100:00100000:1.0:1783134944.232749:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:3.0:1783134944.232836:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373889536 00000100:00100000:3.0:1783134944.232846:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373889536 00000100:00100000:3.0:1783134944.232906:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 30 00000100:00100000:3.0:1783134944.232918:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fe9fad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+16:9659:x1869752373889536:12345-192.168.201.41@tcp:36:rm.0 00010000:00010000:3.0:1783134944.232977:0:5771:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1783134944.233002:0:5771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b74000/0xd6c4b8f05867e78e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb7185 expref: 16 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134944.233023:0:5771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829400/0xd6c4b8f05867e72c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb7162 expref: 15 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134944.233047:0:5771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9fe9cc3c1b00) 00010000:00010000:3.0:1783134944.233062:0:5771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ad000/0xd6c4b8f05867e6ed lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb7154 expref: 14 pid: 8031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134944.233070:0:5771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fe9c8301500) 00010000:00010000:3.0:1783134944.233076:0:5771:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1783134944.233095:0:5771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b74800/0xd6c4b8f05867e7d4 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134944.233107:0:5771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b74800/0xd6c4b8f05867e7d4 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134944.233115:0:5771:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b74800/0xd6c4b8f05867e7d4 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134944.233126:0:5771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b75600/0xd6c4b8f05867e7db lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134944.233133:0:5771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b75600/0xd6c4b8f05867e7db lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134944.233139:0:5771:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b75600/0xd6c4b8f05867e7db lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134944.233491:0:5771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b75400/0xd6c4b8f05867e7e2 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134944.233499:0:5771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b75400/0xd6c4b8f05867e7e2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134944.233515:0:5771:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b75400/0xd6c4b8f05867e7e2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783134944.234093:0:5771:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00010000:3.0:1783134944.234109:0:5771:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b75400/0xd6c4b8f05867e7e2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134944.234116:0:5771:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b75400/0xd6c4b8f05867e7e2 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134944.234123:0:5771:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b75400/0xd6c4b8f05867e7e2 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134944.234128:0:5771:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe9d2b75400 already unused, calling callback (ffffffffc1f634f0) 00010000:00010000:3.0:1783134944.234131:0:5771:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b75400/0xd6c4b8f05867e7e2 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134944.234138:0:5771:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b75400/0xd6c4b8f05867e7e2 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134944.234149:0:5771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9fe9cb8f4600) 00010000:00010000:3.0:1783134944.234152:0:5771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1783134944.234155:0:5771:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b75400/0xd6c4b8f05867e7e2 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134944.234161:0:5771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b75400/0xd6c4b8f05867e7e2 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134944.234193:0:5771:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b74800/0xd6c4b8f05867e7d4 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134944.234199:0:5771:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b74800/0xd6c4b8f05867e7d4 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134944.234211:0:5771:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b74800/0xd6c4b8f05867e7d4 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134944.234217:0:5771:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe9d2b74800 already unused, calling callback (ffffffffc1f634f0) 00010000:00010000:3.0:1783134944.234220:0:5771:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b74800/0xd6c4b8f05867e7d4 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134944.234226:0:5771:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b74800/0xd6c4b8f05867e7d4 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134944.234234:0:5771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fe9cb8f4c00) 00010000:00010000:3.0:1783134944.234237:0:5771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783134944.234240:0:5771:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b74800/0xd6c4b8f05867e7d4 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134944.234246:0:5771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b74800/0xd6c4b8f05867e7d4 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1783134944.234257:0:5771:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000d83bbea4 reply state 000000003d9332fc transno 4294967308 ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b75600/0xd6c4b8f05867e7db lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783134944.234266:0:5771:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1783134944.234378:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fe9fad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+15:9659:x1869752373889536:12345-192.168.201.41@tcp:36:rm.0 Request processed in 1460us (1648us total) trans 4294967308 rc 0/0 00000100:00100000:3.0:1783134944.234386:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 30 00010000:00010000:3.0:1783134944.242518:0:3272:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b75600/0xd6c4b8f05867e7db lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134944.242536:0:3272:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b75600/0xd6c4b8f05867e7db lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134944.242564:0:3272:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b75600/0xd6c4b8f05867e7db lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134944.242569:0:3272:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe9d2b75600 already unused, calling callback (ffffffffc1f634f0) 00010000:00010000:3.0:1783134944.242574:0:3272:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b75600/0xd6c4b8f05867e7db lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134944.242582:0:3272:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b75600/0xd6c4b8f05867e7db lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134944.242598:0:3272:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9fe9cb8f4300) 00010000:00010000:3.0:1783134944.242602:0:3272:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783134944.242607:0:3272:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b75600/0xd6c4b8f05867e7db lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134944.242613:0:3272:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b75600/0xd6c4b8f05867e7db lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134944.519100:0:5758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783134945.411464:0:3289:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1783134945.411511:0:3289:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe8c6df6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1869752384398592:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1783134945.411592:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783134945.411663:0:6579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384398592 00000100:00100000:3.0:1783134945.411669:0:6579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384398592 00000100:00100000:3.0:1783134945.411716:0:6579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1783134945.411726:0:6579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9f6731500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3289:x1869752384398592:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1783134945.411756:0:6579:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1783134945.411815:0:6579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9f6731500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3289:x1869752384398592:12345-0@lo:13:osp-pre-0-0.0 Request processed in 90us (223us total) trans 0 rc 0/0 00000100:00100000:3.0:1783134945.411834:0:6579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1783134945.412011:0:3286:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9fe438380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3286:1869752384398848:0@lo:400:kworker.0 00000100:00100000:0.0:1783134945.412049:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783134945.412071:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1783134945.412077:0:3286:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9fe43ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3286:1869752384398976:0@lo:400:kworker.0 00000100:00100000:0.0:1783134945.412098:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783134945.412128:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384398848 00000100:00100000:0.0:1783134945.412132:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384398848 00000100:00100000:0.0:1783134945.412168:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384398976 00000100:00100000:0.0:1783134945.412171:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384398976 00000100:00100000:0.0:1783134945.412193:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1783134945.412206:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fe43b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3286:x1869752384398848:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783134945.412241:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fe43b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3286:x1869752384398848:12345-0@lo:400:kworker.0 Request processed in 36us (191us total) trans 0 rc 0/0 00000100:00100000:0.0:1783134945.412247:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1783134945.412260:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1783134945.412265:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fe439500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3286:x1869752384398976:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783134945.412311:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fe439500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3286:x1869752384398976:12345-0@lo:400:kworker.0 Request processed in 45us (211us total) trans 0 rc 0/0 00000100:00100000:0.0:1783134945.412317:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1783134945.412339:0:3288:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9fe438a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3288:1869752384399104:0@lo:400:kworker.0 00000100:00100000:0.0:1783134945.412362:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783134945.412378:0:3288:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1783134945.412384:0:3288:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9fe43b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:88a2002e-2ea7-4f07-912a-8d001832cfc0:3288:1869752384398720:0@lo:400:kworker.0 00000100:00100000:0.0:1783134945.412406:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783134945.412426:0:3288:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9fe439f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1869752384399232:0@lo:400:kworker.0 00000100:00100000:0.0:1783134945.412449:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783134945.412474:0:6577:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384399232 00000100:00100000:0.0:1783134945.412477:0:6577:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384399232 00000100:00100000:0.0:1783134945.412502:0:6577:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1783134945.412507:0:6577:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9f5ca6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3288:x1869752384399232:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783134945.412538:0:6577:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9f5ca6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3288:x1869752384399232:12345-0@lo:400:kworker.0 Request processed in 31us (88us total) trans 0 rc 0/0 00000100:00100000:0.0:1783134945.412544:0:6577:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1783134945.412575:0:3286:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9fe43ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3286:1869752384398976:0@lo:400:kworker.0 00000100:00100000:0.0:1783134945.412583:0:3286:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9fe438380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3286:1869752384398848:0@lo:400:kworker.0 00010000:00080000:0.0:1783134945.412623:0:3288:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fe9fe439f80 x1869752384399232/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783134961 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783134945.412634:0:3288:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9fe439f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1869752384399232:0@lo:400:kworker.0 00000100:00100000:0.0:1783134945.412649:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384399104 00000100:00100000:0.0:1783134945.412652:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384399104 00000100:00100000:0.0:1783134945.412671:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1783134945.412675:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fe438700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3288:x1869752384399104:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783134945.412706:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fe438700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3288:x1869752384399104:12345-0@lo:400:kworker.0 Request processed in 30us (343us total) trans 0 rc 0/0 00000100:00100000:0.0:1783134945.412713:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1783134945.412735:0:3288:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9fe438a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3288:1869752384399104:0@lo:400:kworker.0 00000004:00080000:2.0:1783134945.412881:0:7675:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 227808599781ns, next at 228808597738ns, rc = 0 00000100:00080000:3.0:1783134945.412916:0:5766:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1783134945.412921:0:5766:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1783134945.412924:0:5766:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1783134945.413162:0:3287:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1783134945.413171:0:3287:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9f5ce1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1869752384399360:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1783134945.413199:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:3.0:1783134945.413764:0:3289:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fe8c6df6a00 x1869752384398592/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783134961 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783134945.413783:0:3289:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe8c6df6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1869752384398592:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1783134945.414952:0:5765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384398720 00000100:00100000:1.0:1783134945.414962:0:5765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384398720 00000100:00100000:1.0:1783134945.414999:0:5765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 229 00000100:00100000:1.0:1783134945.415007:0:5765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9d1653850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88a2002e-2ea7-4f07-912a-8d001832cfc0+19:3288:x1869752384398720:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783134945.415092:0:5765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9d1653850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88a2002e-2ea7-4f07-912a-8d001832cfc0+19:3288:x1869752384398720:12345-0@lo:400:kworker.0 Request processed in 86us (2684us total) trans 0 rc 0/0 00000100:00100000:1.0:1783134945.415100:0:5765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 229 00000100:00100000:3.0:1783134945.415140:0:3288:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9fe43b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:88a2002e-2ea7-4f07-912a-8d001832cfc0:3288:1869752384398720:0@lo:400:kworker.0 00000100:00100000:2.0:1783134945.418187:0:10783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384399360 00000100:00100000:2.0:1783134945.418200:0:10783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384399360 00000100:00100000:2.0:1783134945.418275:0:10783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1783134945.418300:0:10783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9f5ca4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3287:x1869752384399360:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1783134945.418328:0:10783:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1783134945.418417:0:10783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9f5ca4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3287:x1869752384399360:12345-0@lo:13:osp-pre-1-0.0 Request processed in 119us (5216us total) trans 0 rc 0/0 00000100:00100000:2.0:1783134945.418425:0:10783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00010000:00080000:3.0:1783134945.418579:0:3287:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fe9f5ce1500 x1869752384399360/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783134961 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783134945.418599:0:3287:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9f5ce1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1869752384399360:0@lo:13:osp-pre-1-0.0 00000001:00100000:2.0:1783134945.454691:0:6602:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of c936801d-68e8-41a4-8fbc-6becd5e1be74 00000020:00000080:2.0:1783134945.454702:0:6602:0:(genops.c:906:class_export_put()) final put ffff9fe8c57df800/c936801d-68e8-41a4-8fbc-6becd5e1be74 00000020:00000080:3.0:1783134945.454776:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9fe8c57df800/c936801d-68e8-41a4-8fbc-6becd5e1be74 for lustre-OST0000 00000020:00000080:3.0:1783134945.454835:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9fe8c57de000 for lustre-OST0000 00010000:00010000:3.0:1783134945.540112:0:10987:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783134946.566256:0:5757:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1783134946.939168:0:11433:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: excepting tests: 6 7a 7b 23 35 33 00010000:00010000:3.0:1783134947.591855:0:6591:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1783134947.606797:0:11481:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fffe0433400 20000000:00000080:3.0:1783134947.606816:0:11481:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9fe9f6437000 uarg=0000000000000000 20000000:01000000:3.0:1783134947.606852:0:11481:0:(mgs_llog.c:6177:mgs_set_param2()) set_param2 fs='' device='lustre' param='mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:3.0:1783134947.606858:0:11481:0:(mgs_llog.c:4638:mgs_write_log_param2()) next param 'mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:3.0:1783134947.606862:0:11481:0:(mgs_llog.c:1376:mgs_modify_param()) modify params/lustre/mdt.lustre-MDT0000.hsm_control=enabled del=0 00000040:00080000:1.0:1783134947.607729:0:11482:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 20000000:02000000:3.0:1783134947.607899:0:11481:0:(mgs_llog.c:4111:mgs_wlp_lcfg()) Setting parameter lustre.mdt.lustre-MDT0000.hsm_control=enabled in log params 00000040:00080000:3.0:1783134947.614945:0:11481:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9536 00000040:00080000:3.0:1783134947.614998:0:11481:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].8, 128 off9664 00000040:00080000:3.0:1783134947.615049:0:11481:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].9, 224 off9888 10000000:01000000:3.0:1783134947.615072:0:11481:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1783134947.615091:0:11481:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9fe9d2b75600/0xd6c4b8f05867e7e9 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134947.615456:0:11481:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9fe9c7828200/0xd6c4b8f05867e692 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd6c4b8f05867e68b expref: 18 pid: 5762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134947.615467:0:11481:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9fe9c0030400/0xd6c4b8f05867e6a0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd6c4b8f05867e699 expref: 18 pid: 5765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134947.615474:0:11481:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9fe9c0030000/0xd6c4b8f05867e6ae lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd6c4b8f05867e6a7 expref: 18 pid: 5765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134947.615482:0:11481:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9fe9fe43e200/0xd6c4b8f05867e6b5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb713f expref: 12 pid: 5763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134947.615489:0:11481:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9fe9c7828600/0xd6c4b8f05867e6bc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb7146 expref: 12 pid: 5765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134947.615496:0:11481:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9fe9d2b75600/0xd6c4b8f05867e7e9 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 11481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134947.615536:0:11481:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9fe9c7828600/0xd6c4b8f05867e6bc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb7146 expref: 12 pid: 5765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134947.615551:0:11481:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9fe9c7828600/0xd6c4b8f05867e6bc lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb7146 expref: 12 pid: 5765 timeout: 330 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783134947.615567:0:11481:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe8c6df6a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11481:1869752384399488:192.168.201.41@tcp:104: 00010000:00010000:3.0:1783134947.615682:0:11481:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9fe9fe43e200/0xd6c4b8f05867e6b5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb713f expref: 12 pid: 5763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134947.615699:0:11481:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9fe9fe43e200/0xd6c4b8f05867e6b5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb713f expref: 12 pid: 5763 timeout: 330 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783134947.615710:0:11481:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9f6fb5180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11481:1869752384399616:192.168.201.41@tcp:104: 00010000:00010000:3.0:1783134947.615743:0:11481:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9fe9c0030000/0xd6c4b8f05867e6ae lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd6c4b8f05867e6a7 expref: 18 pid: 5765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134947.615751:0:11481:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9fe9c0030000/0xd6c4b8f05867e6ae lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd6c4b8f05867e6a7 expref: 18 pid: 5765 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783134947.615759:0:11481:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9f6fb6a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11481:1869752384399744:0@lo:104: 00000100:00100000:3.0:1783134947.615798:0:11481:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1783134947.615841:0:11481:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9fe9c0030400/0xd6c4b8f05867e6a0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd6c4b8f05867e699 expref: 18 pid: 5765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134947.615849:0:11481:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9fe9c0030400/0xd6c4b8f05867e6a0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd6c4b8f05867e699 expref: 18 pid: 5765 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783134947.615858:0:11481:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9f6fb5c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11481:1869752384399872:0@lo:104: 00000100:00100000:3.0:1783134947.615878:0:11481:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1783134947.615902:0:11481:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9fe9c7828200/0xd6c4b8f05867e692 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd6c4b8f05867e68b expref: 18 pid: 5762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134947.615909:0:11481:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9fe9c7828200/0xd6c4b8f05867e692 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd6c4b8f05867e68b expref: 18 pid: 5762 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783134947.615917:0:11481:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9f6fb6300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11481:1869752384400000:0@lo:104: 00000100:00100000:3.0:1783134947.615936:0:11481:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783134947.615955:0:11481:0:(client.c:2701:ptlrpc_set_wait()) set ffff9fe9fe8a1780 going to sleep for 11 seconds 00000100:00100000:3.0:1783134947.616464:0:5753:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1783134947.616478:0:5753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384399744 00000100:00100000:3.0:1783134947.616483:0:5753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384399744 00000100:00100000:3.0:1783134947.616526:0:5753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384399872 00000100:00100000:3.0:1783134947.616529:0:5753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384399872 00000100:00100000:3.0:1783134947.616541:0:5753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384400000 00000100:00100000:3.0:1783134947.616543:0:5753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384400000 00000100:00100000:3.0:1783134947.616559:0:5753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1783134947.616567:0:5753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9f6fb5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:88a2002e-2ea7-4f07-912a-8d001832cfc0+5:11481:x1869752384399744:12345-0@lo:104: 00010000:00010000:3.0:1783134947.616579:0:5753:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.141@tcp lock: ffff9fe9c7828e00/0xd6c4b8f05867e6a7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xd6c4b8f05867e6ae expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783134947.616699:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1783134947.616708:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9f6fb5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:88a2002e-2ea7-4f07-912a-8d001832cfc0+5:11481:x1869752384399872:12345-0@lo:104: 00010000:00010000:2.0:1783134947.616716:0:6590:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.141@tcp lock: ffff9fe9c7829600/0xd6c4b8f05867e699 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xd6c4b8f05867e6a0 expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134947.616770:0:5753:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1783134947.616776:0:5753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9f6fb5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:88a2002e-2ea7-4f07-912a-8d001832cfc0+5:11481:x1869752384399744:12345-0@lo:104: Request processed in 210us (978us total) trans 0 rc 0/0 00000100:00100000:3.0:1783134947.616782:0:5753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1783134947.616801:0:5753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1783134947.616807:0:5753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9f6ff0c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:88a2002e-2ea7-4f07-912a-8d001832cfc0+4:11481:x1869752384400000:12345-0@lo:104: 00010000:00010000:3.0:1783134947.616814:0:5753:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.141@tcp lock: ffff9fe9fe43f600/0xd6c4b8f05867e68b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xd6c4b8f05867e692 expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134947.618371:0:6590:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1783134947.618381:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9f6fb5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:88a2002e-2ea7-4f07-912a-8d001832cfc0+4:11481:x1869752384399872:12345-0@lo:104: Request processed in 1674us (2500us total) trans 0 rc 0/0 00000100:00100000:2.0:1783134947.618390:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00010000:0.0:1783134947.618486:0:10987:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1783134947.618494:0:10987:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.141@tcp lock: ffff9fe9c7828e00/0xd6c4b8f05867e6a7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xd6c4b8f05867e6ae expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134947.618502:0:10987:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe9c7828e00 already unused, calling callback (ffffffffc1b40c20) 10000000:00010000:0.0:1783134947.618507:0:10987:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.141@tcp lock: ffff9fe9c7828e00/0xd6c4b8f05867e6a7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xd6c4b8f05867e6ae expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134947.618516:0:10987:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.141@tcp lock: ffff9fe9c7828e00/0xd6c4b8f05867e6a7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xd6c4b8f05867e6ae expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1783134947.618524:0:10987:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.141@tcp lock: ffff9fe9c7828e00/0xd6c4b8f05867e6a7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xd6c4b8f05867e6ae expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783134947.618543:0:10987:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1783134947.618580:0:10987:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.141@tcp lock: ffff9fe9c7828e00/0xd6c4b8f05867e6a7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd6c4b8f05867e6ae expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134947.618588:0:10987:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1783134947.618608:0:10987:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.141@tcp lock: ffff9fe9c7828e00/0xd6c4b8f05867e6a7 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd6c4b8f05867e6ae expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134947.618616:0:10987:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.141@tcp lock: ffff9fe9c7828e00/0xd6c4b8f05867e6a7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd6c4b8f05867e6ae expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134947.618628:0:10987:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783134947.618632:0:10987:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.141@tcp lock: ffff9fe9c7829600/0xd6c4b8f05867e699 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xd6c4b8f05867e6a0 expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134947.618637:0:10987:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe9c7829600 already unused, calling callback (ffffffffc1b40c20) 10000000:00010000:0.0:1783134947.618640:0:10987:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.141@tcp lock: ffff9fe9c7829600/0xd6c4b8f05867e699 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xd6c4b8f05867e6a0 expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134947.618647:0:10987:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.141@tcp lock: ffff9fe9c7829600/0xd6c4b8f05867e699 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xd6c4b8f05867e6a0 expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1783134947.618653:0:10987:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.141@tcp lock: ffff9fe9c7829600/0xd6c4b8f05867e699 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xd6c4b8f05867e6a0 expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783134947.618658:0:10987:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1783134947.618670:0:10987:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.141@tcp lock: ffff9fe9c7829600/0xd6c4b8f05867e699 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd6c4b8f05867e6a0 expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134947.618676:0:10987:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1783134947.618697:0:10987:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.141@tcp lock: ffff9fe9c7829600/0xd6c4b8f05867e699 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd6c4b8f05867e6a0 expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134947.618704:0:10987:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.141@tcp lock: ffff9fe9c7829600/0xd6c4b8f05867e699 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd6c4b8f05867e6a0 expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134947.618713:0:10987:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783134947.618715:0:10987:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783134947.618717:0:10987:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783134947.618732:0:3287:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9fe43b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:88a2002e-2ea7-4f07-912a-8d001832cfc0:3287:1869752384400128:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1783134947.618777:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783134947.618822:0:3288:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9fe438a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:88a2002e-2ea7-4f07-912a-8d001832cfc0:3288:1869752384400256:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1783134947.618842:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783134947.618871:0:5754:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384400128 00000100:00100000:0.0:1783134947.618877:0:5754:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384400128 00010000:00010000:0.0:1783134947.618901:0:5754:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9fe9c0030000/0xd6c4b8f05867e6ae lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd6c4b8f05867e6a7 expref: 19 pid: 5765 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783134947.618921:0:5754:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384400256 00000100:00100000:0.0:1783134947.618924:0:5754:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384400256 00010000:00010000:0.0:1783134947.618934:0:5754:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9fe9c0030400/0xd6c4b8f05867e6a0 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd6c4b8f05867e699 expref: 20 pid: 5765 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783134947.618953:0:5754:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1783134947.618960:0:5754:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fe439f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:88a2002e-2ea7-4f07-912a-8d001832cfc0+20:3287:x1869752384400128:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1783134947.618971:0:5754:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783134947.618975:0:5754:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9fe9c0030000/0xd6c4b8f05867e6ae lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd6c4b8f05867e6a7 expref: 20 pid: 5765 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134947.618984:0:5754:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9fe9c0030000/0xd6c4b8f05867e6ae lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd6c4b8f05867e6a7 expref: 20 pid: 5765 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134947.619006:0:5754:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783134947.619037:0:5754:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fe439f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:88a2002e-2ea7-4f07-912a-8d001832cfc0+20:3287:x1869752384400128:12345-0@lo:103:ldlm_bl.0 Request processed in 77us (259us total) trans 0 rc 0/0 00000100:00100000:0.0:1783134947.619044:0:5754:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1783134947.619059:0:5754:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1783134947.619065:0:5754:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fe438380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:88a2002e-2ea7-4f07-912a-8d001832cfc0+19:3288:x1869752384400256:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1783134947.619073:0:5754:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783134947.619077:0:5754:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9fe9c0030400/0xd6c4b8f05867e6a0 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd6c4b8f05867e699 expref: 19 pid: 5765 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134947.619086:0:5754:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9fe9c0030400/0xd6c4b8f05867e6a0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd6c4b8f05867e699 expref: 19 pid: 5765 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134947.619095:0:5754:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783134947.619141:0:5754:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fe438380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:88a2002e-2ea7-4f07-912a-8d001832cfc0+19:3288:x1869752384400256:12345-0@lo:103:ldlm_bl.0 Request processed in 65us (288us total) trans 0 rc 0/0 00000100:00100000:0.0:1783134947.619148:0:5754:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1783134947.619184:0:3288:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9fe438a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:88a2002e-2ea7-4f07-912a-8d001832cfc0:3288:1869752384400256:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1783134947.619211:0:3287:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9fe43b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:88a2002e-2ea7-4f07-912a-8d001832cfc0:3287:1869752384400128:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1783134947.619476:0:5758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783134947.619644:0:5753:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1783134947.619651:0:5753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9f6ff0c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:88a2002e-2ea7-4f07-912a-8d001832cfc0+3:11481:x1869752384400000:12345-0@lo:104: Request processed in 2844us (3713us total) trans 0 rc 0/0 00000100:00100000:3.0:1783134947.619657:0:5753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00010000:0.0:1783134947.619726:0:5757:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783134947.619732:0:5757:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.141@tcp lock: ffff9fe9fe43f600/0xd6c4b8f05867e68b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xd6c4b8f05867e692 expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134947.619739:0:5757:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe9fe43f600 already unused, calling callback (ffffffffc1b40c20) 10000000:00010000:0.0:1783134947.619743:0:5757:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.141@tcp lock: ffff9fe9fe43f600/0xd6c4b8f05867e68b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xd6c4b8f05867e692 expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134947.619763:0:5757:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.141@tcp lock: ffff9fe9fe43f600/0xd6c4b8f05867e68b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xd6c4b8f05867e692 expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1783134947.619770:0:5757:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.141@tcp lock: ffff9fe9fe43f600/0xd6c4b8f05867e68b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xd6c4b8f05867e692 expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783134947.619775:0:5757:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1783134947.619803:0:5757:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.141@tcp lock: ffff9fe9fe43f600/0xd6c4b8f05867e68b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd6c4b8f05867e692 expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134947.619809:0:5757:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1783134947.619822:0:5757:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.141@tcp lock: ffff9fe9fe43f600/0xd6c4b8f05867e68b lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd6c4b8f05867e692 expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134947.619829:0:5757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.141@tcp lock: ffff9fe9fe43f600/0xd6c4b8f05867e68b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd6c4b8f05867e692 expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134947.619842:0:5757:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783134947.619844:0:5757:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783134947.619846:0:5757:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783134947.619854:0:3289:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9fe43b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:88a2002e-2ea7-4f07-912a-8d001832cfc0:3289:1869752384400384:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1783134947.619885:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783134947.619918:0:5754:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384400384 00000100:00100000:0.0:1783134947.619922:0:5754:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384400384 00010000:00010000:0.0:1783134947.619936:0:5754:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9fe9c7828200/0xd6c4b8f05867e692 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd6c4b8f05867e68b expref: 19 pid: 5762 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783134947.619953:0:5754:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1783134947.619959:0:5754:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9d1620450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:88a2002e-2ea7-4f07-912a-8d001832cfc0+19:3289:x1869752384400384:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1783134947.619971:0:5754:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783134947.619976:0:5754:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9fe9c7828200/0xd6c4b8f05867e692 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd6c4b8f05867e68b expref: 19 pid: 5762 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134947.619983:0:5754:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9fe9c7828200/0xd6c4b8f05867e692 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd6c4b8f05867e68b expref: 19 pid: 5762 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134947.619994:0:5754:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783134947.620019:0:5754:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9d1620450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:88a2002e-2ea7-4f07-912a-8d001832cfc0+19:3289:x1869752384400384:12345-0@lo:103:ldlm_bl.0 Request processed in 59us (133us total) trans 0 rc 0/0 00000100:00100000:0.0:1783134947.620025:0:5754:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1783134947.620068:0:3289:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9fe43b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:88a2002e-2ea7-4f07-912a-8d001832cfc0:3289:1869752384400384:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1783134947.620231:0:11481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fe9c0030000/0xd6c4b8f05867e6ae lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd6c4b8f05867e6a7 expref: 18 pid: 5765 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783134947.620243:0:11481:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9f6fb6a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11481:1869752384399744:0@lo:104: 00010000:00010000:0.0:1783134947.620388:0:11481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fe9c0030400/0xd6c4b8f05867e6a0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd6c4b8f05867e699 expref: 17 pid: 5765 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783134947.620398:0:11481:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9f6fb5c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11481:1869752384399872:0@lo:104: 00010000:00010000:0.0:1783134947.620408:0:11481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fe9c7828200/0xd6c4b8f05867e692 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd6c4b8f05867e68b expref: 16 pid: 5762 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783134947.620417:0:11481:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9f6fb6300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11481:1869752384400000:0@lo:104: 00000100:00100000:1.0:1783134947.628541:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:0.0:1783134947.628569:0:11481:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe8c6df6a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11481:1869752384399488:192.168.201.41@tcp:104: 00000100:00100000:3.0:1783134947.628807:0:11481:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9f6fb5180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11481:1869752384399616:192.168.201.41@tcp:104: 00010000:00010000:3.0:1783134947.628851:0:11481:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9fe9d2b75600/0xd6c4b8f05867e7e9 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783134947.628857:0:5756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373889664 00000100:00100000:0.0:1783134947.628864:0:5756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373889664 00010000:00010000:0.0:1783134947.628898:0:5756:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9fe9c7828600/0xd6c4b8f05867e6bc lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb7146 expref: 13 pid: 5765 timeout: 330 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783134947.628934:0:5756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 33 00000100:00100000:0.0:1783134947.628944:0:5756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fe9f8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f39b22bc-4faf-4b59-bb00-2a11f91e37c0+13:2370:x1869752373889664:12345-192.168.201.41@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783134947.628966:0:5756:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783134947.628973:0:5756:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9fe9c7828600/0xd6c4b8f05867e6bc lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb7146 expref: 13 pid: 5765 timeout: 330 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134947.628985:0:5756:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9fe9c7828600/0xd6c4b8f05867e6bc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb7146 expref: 13 pid: 5765 timeout: 330 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134947.629003:0:5756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fe9c7828600/0xd6c4b8f05867e6bc lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb7146 expref: 13 pid: 5765 timeout: 330 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134947.629020:0:5756:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783134947.629074:0:5756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fe9f8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f39b22bc-4faf-4b59-bb00-2a11f91e37c0+12:2370:x1869752373889664:12345-192.168.201.41@tcp:103:ldlm_bl.0 Request processed in 127us (539us total) trans 0 rc 0/0 00000100:00100000:0.0:1783134947.629082:0:5756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 33 00000100:00100000:1.0:1783134947.631546:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:0.0:1783134947.631591:0:5754:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373889792 00000100:00100000:0.0:1783134947.631608:0:5754:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373889792 00010000:00010000:0.0:1783134947.631638:0:5754:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9fe9fe43e200/0xd6c4b8f05867e6b5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb713f expref: 12 pid: 5763 timeout: 330 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783134947.631724:0:5754:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 34 00000100:00100000:0.0:1783134947.631733:0:5754:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fe9f8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f39b22bc-4faf-4b59-bb00-2a11f91e37c0+12:2370:x1869752373889792:12345-192.168.201.41@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783134947.631747:0:5754:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783134947.631752:0:5754:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9fe9fe43e200/0xd6c4b8f05867e6b5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb713f expref: 12 pid: 5763 timeout: 330 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134947.631763:0:5754:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9fe9fe43e200/0xd6c4b8f05867e6b5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb713f expref: 12 pid: 5763 timeout: 330 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134947.631775:0:5754:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fe9fe43e200/0xd6c4b8f05867e6b5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb713f expref: 12 pid: 5763 timeout: 330 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134947.631797:0:5754:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9fe9d2b75600/0xd6c4b8f05867e7e9 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134947.631803:0:5754:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fe9d2b75600/0xd6c4b8f05867e7e9 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134947.631813:0:5754:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9fe9d2b75600/0xd6c4b8f05867e7e9 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134947.631818:0:5754:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9fe9d2b75600/0xd6c4b8f05867e7e9 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134947.631822:0:5754:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9fe9d2b75600/0xd6c4b8f05867e7e9 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134947.631826:0:5754:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9fe9d2b75600/0xd6c4b8f05867e7e9 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134947.631831:0:5754:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe9d2b75600 already unused, calling callback (ffffffffc1527ce0) 00010000:00010000:0.0:1783134947.631835:0:5754:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9fe9d2b75600/0xd6c4b8f05867e7e9 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134947.631842:0:5754:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9fe9d2b75600/0xd6c4b8f05867e7e9 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 11481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134947.631870:0:5754:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9fe9d2b75600/0xd6c4b8f05867e7e9 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134947.631881:0:5754:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783134947.631939:0:5754:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fe9f8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f39b22bc-4faf-4b59-bb00-2a11f91e37c0+11:2370:x1869752373889792:12345-192.168.201.41@tcp:103:ldlm_bl.0 Request processed in 206us (397us total) trans 0 rc 0/0 00000100:00100000:0.0:1783134947.631952:0:5754:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 34 00010000:00010000:3.0:1783134947.631998:0:11481:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9fe9d2b75600/0xd6c4b8f05867e7e9 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134947.632006:0:11481:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9fe9d2b75600/0xd6c4b8f05867e7e9 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134947.632012:0:11481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fe9d2b75600/0xd6c4b8f05867e7e9 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783134948.135010:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:1.0:1783134948.135056:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:1.0:1783134948.135084:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:1.0:1783134948.135136:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:0.0:1783134948.135145:0:5769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373890048 00000100:00100000:0.0:1783134948.135165:0:5769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373890048 00000100:00100000:1.0:1783134948.135183:0:7676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373890176 00000100:00100000:1.0:1783134948.135189:0:7676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373890176 00000100:00100000:0.0:1783134948.135230:0:5769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373890304 00000100:00100000:0.0:1783134948.135235:0:5769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373890304 00000100:00100000:1.0:1783134948.135238:0:7676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 29 00000100:00100000:1.0:1783134948.135250:0:7676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fe9fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+5:2370:x1869752373890176:12345-192.168.201.41@tcp:400:kworker.0 00000100:00100000:0.0:1783134948.135265:0:5769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 61 00000100:00100000:0.0:1783134948.135274:0:5769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fe9fa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+14:2369:x1869752373890048:12345-192.168.201.41@tcp:400:kworker.0 00000100:00100000:3.0:1783134948.135379:0:5763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373889920 00000100:00100000:3.0:1783134948.135383:0:5763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373889920 00000100:00100000:3.0:1783134948.135412:0:5763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 230 00000100:00100000:3.0:1783134948.135419:0:5763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9d1651850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f39b22bc-4faf-4b59-bb00-2a11f91e37c0+11:2370:x1869752373889920:12345-192.168.201.41@tcp:400:kworker.0 00000100:00100000:1.0:1783134948.135471:0:7676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fe9fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+5:2370:x1869752373890176:12345-192.168.201.41@tcp:400:kworker.0 Request processed in 223us (334us total) trans 0 rc 0/0 00000100:00100000:1.0:1783134948.135479:0:7676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 29 00000100:00100000:0.0:1783134948.135521:0:5769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fe9fa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+14:2369:x1869752373890048:12345-192.168.201.41@tcp:400:kworker.0 Request processed in 247us (462us total) trans 0 rc 0/0 00000100:00100000:0.0:1783134948.135540:0:5769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 61 00000100:00100000:0.0:1783134948.135556:0:5769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 62 00000100:00100000:0.0:1783134948.135565:0:5769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fe9f8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c936801d-68e8-41a4-8fbc-6becd5e1be74+5:2369:x1869752373890304:12345-192.168.201.41@tcp:400:kworker.0 00000100:00100000:0.0:1783134948.135592:0:5769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fe9f8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c936801d-68e8-41a4-8fbc-6becd5e1be74+5:2369:x1869752373890304:12345-192.168.201.41@tcp:400:kworker.0 Request processed in 28us (506us total) trans 0 rc 0/0 00000100:00100000:0.0:1783134948.135599:0:5769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 62 00000100:00080000:0.0:1783134948.135618:0:5766:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1783134948.135624:0:5766:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1783134948.139328:0:5763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9d1651850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f39b22bc-4faf-4b59-bb00-2a11f91e37c0+11:2370:x1869752373889920:12345-192.168.201.41@tcp:400:kworker.0 Request processed in 3896us (4315us total) trans 0 rc 0/0 00000100:00100000:3.0:1783134948.139344:0:5763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 230 00010000:00010000:3.0:1783134948.611533:0:6591:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1783134948.739358:0:5767:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1783134948.739364:0:5767:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff9fe8c47e1800 from 7 10000000:01000000:3.0:1783134948.739369:0:5767:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1783134948.739411:0:5767:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.141@tcp lock: ffff9fe9d2b75600/0xd6c4b8f05867e7f0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134948.739420:0:5767:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.141@tcp lock: ffff9fe9d2b75600/0xd6c4b8f05867e7f0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134948.739428:0:5767:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.141@tcp lock: ffff9fe9d2b75600/0xd6c4b8f05867e7f0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783134948.739468:0:5767:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9f6fb5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88a2002e-2ea7-4f07-912a-8d001832cfc0:5767:1869752384400512:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1783134948.739529:0:5767:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783134948.739599:0:5767:0:(client.c:2701:ptlrpc_set_wait()) set ffff9fe9fe8a1300 going to sleep for 11 seconds 00000100:00100000:2.0:1783134948.740150:0:5762:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384400512 00000100:00100000:2.0:1783134948.740165:0:5762:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384400512 00000100:00100000:2.0:1783134948.740220:0:5762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 231 00000100:00100000:2.0:1783134948.740231:0:5762:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9d1652850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88a2002e-2ea7-4f07-912a-8d001832cfc0+16:5767:x1869752384400512:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783134948.740245:0:5762:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783134948.740259:0:5762:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fe9c7829c00/0xd6c4b8f05867e7f7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd6c4b8f05867e7f0 expref: -99 pid: 5762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134948.740303:0:5762:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fe9c7829c00/0xd6c4b8f05867e7f7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd6c4b8f05867e7f0 expref: 17 pid: 5762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134948.740314:0:5762:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fe9c7829c00/0xd6c4b8f05867e7f7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd6c4b8f05867e7f0 expref: 17 pid: 5762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134948.740323:0:5762:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fe9c7829c00, rc 0) 00000100:00100000:2.0:1783134948.740369:0:5762:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9d1652850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88a2002e-2ea7-4f07-912a-8d001832cfc0+17:5767:x1869752384400512:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 140us (839us total) trans 0 rc 0/0 00000100:00100000:2.0:1783134948.740375:0:5762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 231 00000100:00100000:3.0:1783134948.740413:0:5767:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9f6fb5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88a2002e-2ea7-4f07-912a-8d001832cfc0:5767:1869752384400512:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783134948.740429:0:5767:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.141@tcp lock: ffff9fe9d2b75600/0xd6c4b8f05867e7f0 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd6c4b8f05867e7f7 expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134948.740439:0:5767:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.141@tcp lock: ffff9fe9d2b75600/0xd6c4b8f05867e7f0 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd6c4b8f05867e7f7 expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783134948.740494:0:5767:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9f6fb5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88a2002e-2ea7-4f07-912a-8d001832cfc0:5767:1869752384400640:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783134948.740522:0:5767:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783134948.740554:0:5767:0:(client.c:2701:ptlrpc_set_wait()) set ffff9fe9fe8a1300 going to sleep for 11 seconds 00000100:00100000:1.0:1783134948.740823:0:5763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384400640 00000100:00100000:1.0:1783134948.740828:0:5763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384400640 00000100:00100000:1.0:1783134948.740868:0:5763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 232 00000100:00100000:1.0:1783134948.740884:0:5763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9d1652050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88a2002e-2ea7-4f07-912a-8d001832cfc0+17:5767:x1869752384400640:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783134948.741160:0:5763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9d1652050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88a2002e-2ea7-4f07-912a-8d001832cfc0+17:5767:x1869752384400640:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 281us (638us total) trans 0 rc 0/0 00000100:00100000:1.0:1783134948.741165:0:5763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 232 00000100:00100000:3.0:1783134948.741328:0:5767:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9f6fb5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88a2002e-2ea7-4f07-912a-8d001832cfc0:5767:1869752384400640:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783134948.741357:0:5767:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9f6fb5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88a2002e-2ea7-4f07-912a-8d001832cfc0:5767:1869752384400768:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783134948.741403:0:5767:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783134948.741433:0:5767:0:(client.c:2701:ptlrpc_set_wait()) set ffff9fe9fe8a1300 going to sleep for 11 seconds 00000100:00100000:2.0:1783134948.741638:0:5762:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384400768 00000100:00100000:2.0:1783134948.741643:0:5762:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384400768 00000100:00100000:2.0:1783134948.741711:0:5762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 233 00000100:00100000:2.0:1783134948.741720:0:5762:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9d1650450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88a2002e-2ea7-4f07-912a-8d001832cfc0+17:5767:x1869752384400768:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783134948.741875:0:5762:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9d1650450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88a2002e-2ea7-4f07-912a-8d001832cfc0+17:5767:x1869752384400768:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 156us (470us total) trans 0 rc 0/0 00000100:00100000:2.0:1783134948.741882:0:5762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 233 00000100:00100000:3.0:1783134948.741946:0:5767:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9f6fb5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88a2002e-2ea7-4f07-912a-8d001832cfc0:5767:1869752384400768:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783134948.742502:0:11494:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9f6fb5180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:88a2002e-2ea7-4f07-912a-8d001832cfc0:11494:1869752384400896:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783134948.742577:0:11494:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783134948.742626:0:5762:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384400896 00000100:00100000:3.0:1783134948.742631:0:11494:0:(client.c:2701:ptlrpc_set_wait()) set ffff9fe9fe8a1840 going to sleep for 11 seconds 00000100:00100000:2.0:1783134948.742635:0:5762:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384400896 00000100:00100000:2.0:1783134948.742674:0:5762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 234 00000100:00100000:2.0:1783134948.742681:0:5762:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9d1652450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88a2002e-2ea7-4f07-912a-8d001832cfc0+17:11494:x1869752384400896:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783134948.742853:0:5762:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9d1652450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88a2002e-2ea7-4f07-912a-8d001832cfc0+17:11494:x1869752384400896:12345-0@lo:502:llog_process_th.0 Request processed in 172us (276us total) trans 0 rc 0/0 00000100:00100000:2.0:1783134948.742860:0:5762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 234 00000100:00100000:3.0:1783134948.742898:0:11494:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9f6fb5180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:88a2002e-2ea7-4f07-912a-8d001832cfc0:11494:1869752384400896:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1783134948.742928:0:11494:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1783134948.742942:0:11494:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783134948.742944:0:11494:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1783134948.742950:0:11494:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9fe8c47e1800 00000020:00000080:3.0:1783134948.742964:0:11494:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1783134948.743053:0:11494:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9f6fb5180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:88a2002e-2ea7-4f07-912a-8d001832cfc0:11494:1869752384401024:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783134948.743106:0:11494:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783134948.743129:0:11494:0:(client.c:2701:ptlrpc_set_wait()) set ffff9fe9fe8a1840 going to sleep for 11 seconds 00000100:00100000:1.0:1783134948.743322:0:5763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384401024 00000100:00100000:1.0:1783134948.743326:0:5763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384401024 00000100:00100000:1.0:1783134948.743362:0:5763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 235 00000100:00100000:1.0:1783134948.743368:0:5763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9d17a7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88a2002e-2ea7-4f07-912a-8d001832cfc0+17:11494:x1869752384401024:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783134948.743481:0:5763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9d17a7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88a2002e-2ea7-4f07-912a-8d001832cfc0+17:11494:x1869752384401024:12345-0@lo:502:llog_process_th.0 Request processed in 112us (374us total) trans 0 rc 0/0 00000100:00100000:1.0:1783134948.743487:0:5763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 235 00000100:00100000:3.0:1783134948.743806:0:11494:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9f6fb5180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:88a2002e-2ea7-4f07-912a-8d001832cfc0:11494:1869752384401024:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1783134948.743828:0:11494:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1783134948.743833:0:11494:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783134948.743834:0:11494:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:3.0:1783134948.743838:0:11494:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:1.0:1783134948.744062:0:5767:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:1.0:1783134948.744081:0:5767:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.201.141@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1783134948.744106:0:5767:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.141@tcp lock: ffff9fe9d2b75600/0xd6c4b8f05867e7f0 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd6c4b8f05867e7f7 expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134948.744117:0:5767:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.141@tcp lock: ffff9fe9d2b75600/0xd6c4b8f05867e7f0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd6c4b8f05867e7f7 expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783134948.744127:0:5767:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1783134948.744130:0:5767:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff9fea01d1b000 from 7 10000000:01000000:1.0:1783134948.744133:0:5767:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1783134948.744158:0:5767:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.141@tcp lock: ffff9fe9fe43e000/0xd6c4b8f05867e7fe lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134948.744166:0:5767:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.141@tcp lock: ffff9fe9fe43e000/0xd6c4b8f05867e7fe lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134948.744174:0:5767:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.141@tcp lock: ffff9fe9fe43e000/0xd6c4b8f05867e7fe lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783134948.744188:0:5767:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9fe9f9180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88a2002e-2ea7-4f07-912a-8d001832cfc0:5767:1869752384401152:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1783134948.744215:0:5767:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783134948.744246:0:5767:0:(client.c:2701:ptlrpc_set_wait()) set ffff9fe9cb3e93c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783134948.744732:0:5762:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384401152 00000100:00100000:3.0:1783134948.744739:0:5762:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384401152 00000100:00100000:3.0:1783134948.744832:0:5762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 236 00000100:00100000:3.0:1783134948.744842:0:5762:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9d17a7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88a2002e-2ea7-4f07-912a-8d001832cfc0+17:5767:x1869752384401152:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783134948.744853:0:5762:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783134948.744866:0:5762:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fe9d2b74800/0xd6c4b8f05867e805 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xd6c4b8f05867e7fe expref: -99 pid: 5762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134948.744888:0:5762:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fe9d2b74800/0xd6c4b8f05867e805 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd6c4b8f05867e7fe expref: 18 pid: 5762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134948.744897:0:5762:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fe9d2b74800/0xd6c4b8f05867e805 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd6c4b8f05867e7fe expref: 18 pid: 5762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134948.744905:0:5762:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fe9d2b74800, rc 0) 00000100:00100000:3.0:1783134948.744940:0:5762:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9d17a7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88a2002e-2ea7-4f07-912a-8d001832cfc0+18:5767:x1869752384401152:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 100us (723us total) trans 0 rc 0/0 00000100:00100000:3.0:1783134948.744956:0:5762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 236 00000100:00100000:2.0:1783134948.744969:0:5767:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9fe9f9180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88a2002e-2ea7-4f07-912a-8d001832cfc0:5767:1869752384401152:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783134948.744981:0:5767:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.141@tcp lock: ffff9fe9fe43e000/0xd6c4b8f05867e7fe lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd6c4b8f05867e805 expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134948.744991:0:5767:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.141@tcp lock: ffff9fe9fe43e000/0xd6c4b8f05867e7fe lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xd6c4b8f05867e805 expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783134948.745039:0:5767:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9f5ce3b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88a2002e-2ea7-4f07-912a-8d001832cfc0:5767:1869752384401280:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783134948.745068:0:5767:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783134948.745112:0:5767:0:(client.c:2701:ptlrpc_set_wait()) set ffff9fe9f42c36c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783134948.745118:0:5765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384401280 00000100:00100000:3.0:1783134948.745123:0:5765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384401280 00000100:00100000:3.0:1783134948.745155:0:5765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 237 00000100:00100000:3.0:1783134948.745163:0:5765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9d17a5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88a2002e-2ea7-4f07-912a-8d001832cfc0+18:5767:x1869752384401280:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783134948.745385:0:5765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9d17a5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88a2002e-2ea7-4f07-912a-8d001832cfc0+18:5767:x1869752384401280:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 223us (316us total) trans 0 rc 0/0 00000100:00100000:3.0:1783134948.745390:0:5765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 237 00000100:00100000:2.0:1783134948.745412:0:5767:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9f5ce3b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88a2002e-2ea7-4f07-912a-8d001832cfc0:5767:1869752384401280:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783134948.745447:0:5767:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9f5ce3b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88a2002e-2ea7-4f07-912a-8d001832cfc0:5767:1869752384401408:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783134948.745486:0:5767:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783134948.745511:0:5767:0:(client.c:2701:ptlrpc_set_wait()) set ffff9fe9f42c36c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783134948.745522:0:5762:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384401408 00000100:00100000:3.0:1783134948.745528:0:5762:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384401408 00000100:00100000:2.0:1783134948.745566:0:5763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 238 00000100:00100000:2.0:1783134948.745575:0:5763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9d17a6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88a2002e-2ea7-4f07-912a-8d001832cfc0+18:5767:x1869752384401408:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783134948.745715:0:5763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9d17a6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88a2002e-2ea7-4f07-912a-8d001832cfc0+18:5767:x1869752384401408:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 140us (227us total) trans 0 rc 0/0 00000100:00100000:2.0:1783134948.745722:0:5763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 238 00000100:00100000:3.0:1783134948.745751:0:5767:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9f5ce3b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88a2002e-2ea7-4f07-912a-8d001832cfc0:5767:1869752384401408:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783134948.746056:0:11496:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9f6fb5180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:88a2002e-2ea7-4f07-912a-8d001832cfc0:11496:1869752384401536:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783134948.746106:0:11496:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783134948.746157:0:11496:0:(client.c:2701:ptlrpc_set_wait()) set ffff9fe9fe8a1e40 going to sleep for 11 seconds 00000100:00100000:0.0:1783134948.746185:0:5765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384401536 00000100:00100000:0.0:1783134948.746189:0:5765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384401536 00000100:00100000:0.0:1783134948.746224:0:5765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 239 00000100:00100000:0.0:1783134948.746232:0:5765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9d17a7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88a2002e-2ea7-4f07-912a-8d001832cfc0+18:11496:x1869752384401536:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783134948.746409:0:5765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9d17a7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88a2002e-2ea7-4f07-912a-8d001832cfc0+18:11496:x1869752384401536:12345-0@lo:502:llog_process_th.0 Request processed in 178us (303us total) trans 0 rc 0/0 00000100:00100000:0.0:1783134948.746418:0:5765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 239 00000100:00100000:3.0:1783134948.746438:0:11496:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9f6fb5180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:88a2002e-2ea7-4f07-912a-8d001832cfc0:11496:1869752384401536:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1783134948.746468:0:11496:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1783134948.746477:0:11496:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783134948.746479:0:11496:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1783134948.746485:0:11496:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9fea01d1b000 00000020:00000080:3.0:1783134948.746488:0:11496:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1783134948.746561:0:11496:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9f6fb5180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:88a2002e-2ea7-4f07-912a-8d001832cfc0:11496:1869752384401664:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783134948.746604:0:11496:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783134948.746639:0:11496:0:(client.c:2701:ptlrpc_set_wait()) set ffff9fe9f42c36c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783134948.746894:0:5763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384401664 00000100:00100000:0.0:1783134948.746905:0:5763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384401664 00000100:00100000:0.0:1783134948.746933:0:5763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 240 00000100:00100000:0.0:1783134948.746938:0:5763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9d17a4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88a2002e-2ea7-4f07-912a-8d001832cfc0+18:11496:x1869752384401664:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783134948.747068:0:5763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9d17a4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88a2002e-2ea7-4f07-912a-8d001832cfc0+18:11496:x1869752384401664:12345-0@lo:502:llog_process_th.0 Request processed in 130us (465us total) trans 0 rc 0/0 00000100:00100000:0.0:1783134948.747074:0:5763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 240 00000100:00100000:3.0:1783134948.747110:0:11496:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9f6fb5180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:88a2002e-2ea7-4f07-912a-8d001832cfc0:11496:1869752384401664:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1783134948.747132:0:11496:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1783134948.747143:0:11496:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783134948.747145:0:11496:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:3.0:1783134948.747149:0:11496:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:2.0:1783134948.747208:0:5767:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:2.0:1783134948.747228:0:5767:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.201.141@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1783134948.747237:0:5767:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.141@tcp lock: ffff9fe9fe43e000/0xd6c4b8f05867e7fe lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd6c4b8f05867e805 expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134948.747250:0:5767:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.141@tcp lock: ffff9fe9fe43e000/0xd6c4b8f05867e7fe lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd6c4b8f05867e805 expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783134948.747258:0:5767:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1783134948.747260:0:5767:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff9fe9e0d14800 from 7 10000000:01000000:2.0:1783134948.747262:0:5767:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1783134948.747310:0:5767:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.141@tcp lock: ffff9fe9c7828400/0xd6c4b8f05867e80c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134948.747318:0:5767:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.141@tcp lock: ffff9fe9c7828400/0xd6c4b8f05867e80c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134948.747327:0:5767:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.141@tcp lock: ffff9fe9c7828400/0xd6c4b8f05867e80c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783134948.747341:0:5767:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9f5ce1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88a2002e-2ea7-4f07-912a-8d001832cfc0:5767:1869752384401792:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1783134948.747367:0:5767:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783134948.747390:0:5767:0:(client.c:2701:ptlrpc_set_wait()) set ffff9fe9fe944300 going to sleep for 11 seconds 00000100:00100000:0.0:1783134948.747404:0:5765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384401792 00000100:00100000:0.0:1783134948.747408:0:5765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384401792 00000100:00100000:0.0:1783134948.747498:0:5765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 241 00000100:00100000:0.0:1783134948.747505:0:5765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9d17a5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88a2002e-2ea7-4f07-912a-8d001832cfc0+18:5767:x1869752384401792:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783134948.747514:0:5765:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783134948.747525:0:5765:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fe9f68ac800/0xd6c4b8f05867e813 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xd6c4b8f05867e80c expref: -99 pid: 5765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134948.747544:0:5765:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fe9f68ac800/0xd6c4b8f05867e813 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd6c4b8f05867e80c expref: 19 pid: 5765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134948.747553:0:5765:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fe9f68ac800/0xd6c4b8f05867e813 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd6c4b8f05867e80c expref: 19 pid: 5765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134948.747562:0:5765:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fe9f68ac800, rc 0) 00000100:00100000:0.0:1783134948.747591:0:5765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9d17a5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88a2002e-2ea7-4f07-912a-8d001832cfc0+19:5767:x1869752384401792:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 86us (221us total) trans 0 rc 0/0 00000100:00100000:0.0:1783134948.747596:0:5765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 241 00000100:00100000:2.0:1783134948.747609:0:5767:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9f5ce1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88a2002e-2ea7-4f07-912a-8d001832cfc0:5767:1869752384401792:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783134948.747620:0:5767:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.141@tcp lock: ffff9fe9c7828400/0xd6c4b8f05867e80c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd6c4b8f05867e813 expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134948.747629:0:5767:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.141@tcp lock: ffff9fe9c7828400/0xd6c4b8f05867e80c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xd6c4b8f05867e813 expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783134948.747667:0:5767:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9f5ce1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88a2002e-2ea7-4f07-912a-8d001832cfc0:5767:1869752384401920:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783134948.747687:0:5767:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783134948.747709:0:5767:0:(client.c:2701:ptlrpc_set_wait()) set ffff9fe9fe944300 going to sleep for 11 seconds 00000100:00100000:0.0:1783134948.747720:0:5763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384401920 00000100:00100000:0.0:1783134948.747724:0:5763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384401920 00000100:00100000:0.0:1783134948.747747:0:5763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:0.0:1783134948.747753:0:5763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9d17a7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88a2002e-2ea7-4f07-912a-8d001832cfc0+19:5767:x1869752384401920:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783134948.747928:0:5763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9d17a7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88a2002e-2ea7-4f07-912a-8d001832cfc0+19:5767:x1869752384401920:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 174us (239us total) trans 0 rc 0/0 00000100:00100000:0.0:1783134948.747935:0:5763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000100:00100000:2.0:1783134948.747948:0:5767:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9f5ce1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88a2002e-2ea7-4f07-912a-8d001832cfc0:5767:1869752384401920:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783134948.747975:0:5767:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9f5ce1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88a2002e-2ea7-4f07-912a-8d001832cfc0:5767:1869752384402048:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783134948.748009:0:5767:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783134948.748035:0:5767:0:(client.c:2701:ptlrpc_set_wait()) set ffff9fe9fe944300 going to sleep for 11 seconds 00000100:00100000:1.0:1783134948.748072:0:5765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384402048 00000100:00100000:1.0:1783134948.748076:0:5765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384402048 00000100:00100000:1.0:1783134948.748151:0:5765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 243 00000100:00100000:1.0:1783134948.748160:0:5765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9d17a5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88a2002e-2ea7-4f07-912a-8d001832cfc0+19:5767:x1869752384402048:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783134948.748256:0:5765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9d17a5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88a2002e-2ea7-4f07-912a-8d001832cfc0+19:5767:x1869752384402048:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 98us (246us total) trans 0 rc 0/0 00000100:00100000:1.0:1783134948.748261:0:5765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 243 00000100:00100000:3.0:1783134948.748309:0:5767:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9f5ce1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88a2002e-2ea7-4f07-912a-8d001832cfc0:5767:1869752384402048:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783134948.748495:0:11498:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9f5ce1f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:88a2002e-2ea7-4f07-912a-8d001832cfc0:11498:1869752384402176:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783134948.748533:0:11498:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783134948.748573:0:5763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384402176 00000100:00100000:2.0:1783134948.748577:0:11498:0:(client.c:2701:ptlrpc_set_wait()) set ffff9fe9fe944300 going to sleep for 11 seconds 00000100:00100000:1.0:1783134948.748578:0:5763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384402176 00000100:00100000:1.0:1783134948.748615:0:5763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 244 00000100:00100000:1.0:1783134948.748625:0:5763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9d17a6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88a2002e-2ea7-4f07-912a-8d001832cfc0+19:11498:x1869752384402176:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783134948.748783:0:5763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9d17a6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88a2002e-2ea7-4f07-912a-8d001832cfc0+19:11498:x1869752384402176:12345-0@lo:502:llog_process_th.0 Request processed in 159us (248us total) trans 0 rc 0/0 00000100:00100000:2.0:1783134948.748791:0:11498:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9f5ce1f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:88a2002e-2ea7-4f07-912a-8d001832cfc0:11498:1869752384402176:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783134948.748793:0:5763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 244 00000020:01000000:2.0:1783134948.748813:0:11498:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1783134948.748820:0:11498:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783134948.748822:0:11498:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1783134948.748827:0:11498:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9fe9e0d14800 00000020:00000080:2.0:1783134948.748830:0:11498:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1783134948.748888:0:11498:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9f5ce1f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:88a2002e-2ea7-4f07-912a-8d001832cfc0:11498:1869752384402304:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783134948.748924:0:11498:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783134948.748941:0:11498:0:(client.c:2701:ptlrpc_set_wait()) set ffff9fe9fe944300 going to sleep for 11 seconds 00000100:00100000:1.0:1783134948.748965:0:5765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384402304 00000100:00100000:1.0:1783134948.748970:0:5765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384402304 00000100:00100000:1.0:1783134948.749000:0:5765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 245 00000100:00100000:1.0:1783134948.749009:0:5765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9d17a6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88a2002e-2ea7-4f07-912a-8d001832cfc0+19:11498:x1869752384402304:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783134948.749174:0:5765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9d17a6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88a2002e-2ea7-4f07-912a-8d001832cfc0+19:11498:x1869752384402304:12345-0@lo:502:llog_process_th.0 Request processed in 167us (250us total) trans 0 rc 0/0 00000100:00100000:1.0:1783134948.749183:0:5765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 245 00000100:00100000:2.0:1783134948.749187:0:11498:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9f5ce1f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:88a2002e-2ea7-4f07-912a-8d001832cfc0:11498:1869752384402304:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1783134948.749212:0:11498:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1783134948.749217:0:11498:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783134948.749218:0:11498:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:2.0:1783134948.749222:0:11498:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:3.0:1783134948.749403:0:5767:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:3.0:1783134948.749424:0:5767:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.201.141@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1783134948.749433:0:5767:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.141@tcp lock: ffff9fe9c7828400/0xd6c4b8f05867e80c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd6c4b8f05867e813 expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134948.749443:0:5767:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.141@tcp lock: ffff9fe9c7828400/0xd6c4b8f05867e80c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd6c4b8f05867e813 expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1783134948.753426:0:11499:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1783134948.838241:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:0.0:1783134948.839763:0:5763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373890432 00000100:00100000:0.0:1783134948.839776:0:5763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373890432 00000100:00100000:0.0:1783134948.839869:0:5763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 246 00000100:00100000:0.0:1783134948.839879:0:5763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9d17a4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f39b22bc-4faf-4b59-bb00-2a11f91e37c0+11:5575:x1869752373890432:12345-192.168.201.41@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783134948.839896:0:5763:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783134948.839914:0:5763:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fe9f68ac600/0xd6c4b8f05867e81a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x4428da03f5eb7193 expref: -99 pid: 5763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134948.839944:0:5763:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fe9f68ac600/0xd6c4b8f05867e81a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb7193 expref: 12 pid: 5763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134948.839956:0:5763:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fe9f68ac600/0xd6c4b8f05867e81a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb7193 expref: 12 pid: 5763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134948.839965:0:5763:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fe9f68ac600, rc 0) 00000100:00100000:0.0:1783134948.840029:0:5763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9d17a4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f39b22bc-4faf-4b59-bb00-2a11f91e37c0+12:5575:x1869752373890432:12345-192.168.201.41@tcp:101:ll_cfg_requeue.0 Request processed in 151us (1796us total) trans 0 rc 0/0 00000100:00100000:0.0:1783134948.840037:0:5763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 246 00000100:00100000:1.0:1783134948.843586:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:2.0:1783134948.853412:0:5762:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373890560 00000100:00100000:2.0:1783134948.853431:0:5762:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373890560 00000100:00100000:2.0:1783134948.853496:0:5762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 247 00000100:00100000:2.0:1783134948.853507:0:5762:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9d17a6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f39b22bc-4faf-4b59-bb00-2a11f91e37c0+12:5575:x1869752373890560:12345-192.168.201.41@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783134948.855267:0:5762:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9d17a6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f39b22bc-4faf-4b59-bb00-2a11f91e37c0+12:5575:x1869752373890560:12345-192.168.201.41@tcp:501:ll_cfg_requeue.0 Request processed in 1753us (11688us total) trans 0 rc 0/0 00000100:00100000:2.0:1783134948.855294:0:5762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 247 00000100:00100000:1.0:1783134948.858722:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:0.0:1783134948.869390:0:5763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373890688 00000100:00100000:0.0:1783134948.869410:0:5763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373890688 00000100:00100000:0.0:1783134948.869510:0:5763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 248 00000100:00100000:0.0:1783134948.869526:0:5763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9d17a5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f39b22bc-4faf-4b59-bb00-2a11f91e37c0+12:5575:x1869752373890688:12345-192.168.201.41@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783134948.869885:0:5763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9d17a5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f39b22bc-4faf-4b59-bb00-2a11f91e37c0+12:5575:x1869752373890688:12345-192.168.201.41@tcp:503:ll_cfg_requeue.0 Request processed in 361us (11177us total) trans 0 rc 0/0 00000100:00100000:1.0:1783134948.869895:0:5763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 248 00000100:00100000:0.0:1783134948.877160:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:3.0:1783134948.877313:0:5765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373890816 00000100:00100000:3.0:1783134948.877326:0:5765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373890816 00000100:00100000:2.0:1783134948.878457:0:5762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 249 00000100:00100000:2.0:1783134948.878485:0:5762:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9d17a4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f39b22bc-4faf-4b59-bb00-2a11f91e37c0+12:9929:x1869752373890816:12345-192.168.201.41@tcp:502:llog_process_th.0 00000100:00100000:2.0:1783134948.878769:0:5762:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9d17a4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f39b22bc-4faf-4b59-bb00-2a11f91e37c0+12:9929:x1869752373890816:12345-192.168.201.41@tcp:502:llog_process_th.0 Request processed in 298us (1623us total) trans 0 rc 0/0 00000100:00100000:2.0:1783134948.878776:0:5762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 249 00000100:00100000:2.0:1783134948.886350:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:1.0:1783134948.887101:0:5763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373890944 00000100:00100000:1.0:1783134948.887112:0:5763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373890944 00000100:00100000:1.0:1783134948.887352:0:5763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 250 00000100:00100000:1.0:1783134948.887365:0:5763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9d17a4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f39b22bc-4faf-4b59-bb00-2a11f91e37c0+12:9929:x1869752373890944:12345-192.168.201.41@tcp:502:llog_process_th.0 00000100:00100000:1.0:1783134948.887671:0:5763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9d17a4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f39b22bc-4faf-4b59-bb00-2a11f91e37c0+12:9929:x1869752373890944:12345-192.168.201.41@tcp:502:llog_process_th.0 Request processed in 307us (1328us total) trans 0 rc 0/0 00000100:00100000:1.0:1783134948.887689:0:5763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 250 00000100:00100000:1.0:1783134948.895368:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:3.0:1783134948.895886:0:5765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373891072 00000100:00100000:3.0:1783134948.895900:0:5765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373891072 00000100:00100000:3.0:1783134948.896007:0:5765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 251 00000100:00100000:3.0:1783134948.896019:0:5765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9d286b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f39b22bc-4faf-4b59-bb00-2a11f91e37c0+12:5575:x1869752373891072:12345-192.168.201.41@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783134948.896039:0:5765:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783134948.896061:0:5765:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fe9d2b75400/0xd6c4b8f05867e821 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x4428da03f5eb719a expref: -99 pid: 5765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134948.896107:0:5765:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fe9d2b75400/0xd6c4b8f05867e821 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb719a expref: 13 pid: 5765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134948.896119:0:5765:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fe9d2b75400/0xd6c4b8f05867e821 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb719a expref: 13 pid: 5765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134948.896130:0:5765:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fe9d2b75400, rc 0) 00000100:00100000:3.0:1783134948.896236:0:5765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9d286b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f39b22bc-4faf-4b59-bb00-2a11f91e37c0+13:5575:x1869752373891072:12345-192.168.201.41@tcp:101:ll_cfg_requeue.0 Request processed in 218us (882us total) trans 0 rc 0/0 00000100:00100000:3.0:1783134948.896244:0:5765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 251 00000100:00100000:1.0:1783134948.898965:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:2.0:1783134948.899079:0:5762:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373891200 00000100:00100000:2.0:1783134948.899113:0:5762:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373891200 00000100:00100000:2.0:1783134948.899191:0:5762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 252 00000100:00100000:2.0:1783134948.899202:0:5762:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9d2869850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f39b22bc-4faf-4b59-bb00-2a11f91e37c0+13:5575:x1869752373891200:12345-192.168.201.41@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783134948.900112:0:5762:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9d2869850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f39b22bc-4faf-4b59-bb00-2a11f91e37c0+13:5575:x1869752373891200:12345-192.168.201.41@tcp:501:ll_cfg_requeue.0 Request processed in 900us (1150us total) trans 0 rc 0/0 00000100:00100000:2.0:1783134948.900123:0:5762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 252 00000100:00100000:2.0:1783134948.904080:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:3.0:1783134948.907163:0:5765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373891328 00000100:00100000:3.0:1783134948.907187:0:5765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373891328 00000100:00100000:2.0:1783134948.907398:0:5765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 253 00000100:00100000:2.0:1783134948.907413:0:5765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9d286a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f39b22bc-4faf-4b59-bb00-2a11f91e37c0+13:5575:x1869752373891328:12345-192.168.201.41@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783134948.907762:0:5765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9d286a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f39b22bc-4faf-4b59-bb00-2a11f91e37c0+13:5575:x1869752373891328:12345-192.168.201.41@tcp:503:ll_cfg_requeue.0 Request processed in 351us (3696us total) trans 0 rc 0/0 00000100:00100000:2.0:1783134948.907774:0:5765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 253 00000100:00100000:1.0:1783134948.914534:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:2.0:1783134948.915028:0:5762:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373891456 00000100:00100000:2.0:1783134948.915061:0:5762:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373891456 00000100:00100000:2.0:1783134948.915155:0:5762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 254 00000100:00100000:2.0:1783134948.915169:0:5762:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9d286a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f39b22bc-4faf-4b59-bb00-2a11f91e37c0+13:9932:x1869752373891456:12345-192.168.201.41@tcp:502:llog_process_th.0 00000100:00100000:2.0:1783134948.915569:0:5762:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9d286a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f39b22bc-4faf-4b59-bb00-2a11f91e37c0+13:9932:x1869752373891456:12345-192.168.201.41@tcp:502:llog_process_th.0 Request processed in 401us (1053us total) trans 0 rc 0/0 00000100:00100000:2.0:1783134948.915579:0:5762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 254 00000100:00100000:2.0:1783134948.919868:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:1.0:1783134948.920470:0:5765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373891584 00000100:00100000:1.0:1783134948.920485:0:5765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373891584 00000100:00100000:1.0:1783134948.920603:0:5765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 255 00000100:00100000:1.0:1783134948.920615:0:5765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9d2868450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f39b22bc-4faf-4b59-bb00-2a11f91e37c0+13:9932:x1869752373891584:12345-192.168.201.41@tcp:502:llog_process_th.0 00000100:00100000:1.0:1783134948.920968:0:5765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9d2868450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f39b22bc-4faf-4b59-bb00-2a11f91e37c0+13:9932:x1869752373891584:12345-192.168.201.41@tcp:502:llog_process_th.0 Request processed in 354us (1114us total) trans 0 rc 0/0 00000100:00100000:1.0:1783134948.920978:0:5765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 255 00000001:00080000:3.0:1783134949.581646:0:5791:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967306 is committed 00000004:00080000:3.0:1783134949.581660:0:5791:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000004:00080000:3.0:1783134949.581695:0:5791:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3 committed 00000001:00080000:3.0:1783134949.581708:0:5791:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967307 is committed 00000001:00080000:3.0:1783134949.581723:0:5791:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967308 is committed 00000100:00100000:0.0:1783134949.582055:0:3287:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1783134949.582099:0:3287:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9fe9faa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1869752384402432:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1783134949.582198:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783134949.582304:0:6577:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384402432 00000100:00100000:0.0:1783134949.582314:0:6577:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384402432 00000100:00100000:0.0:1783134949.582388:0:6577:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1783134949.582400:0:6577:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fe43b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3287:x1869752384402432:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1783134949.582435:0:6577:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:2 count 1 00002000:00010000:0.0:1783134949.582480:0:6577:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2:0x0] initial LVB size: 0, mtime: 0x6a487ae0, atime: 0x6a487ae0, ctime: 0x6a487ae0, blocks: 0x1 00010000:00010000:0.0:1783134949.582490:0:6577:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d6a83bdc/0xd6c4b8f05867e828 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134949.582510:0:6577:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=231s v=(0 0) 00010000:00010000:0.0:1783134949.582515:0:6577:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783134949.582524:0:6577:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d6a83bdc/0xd6c4b8f05867e828 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134949.582544:0:6577:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d6a83bdc/0xd6c4b8f05867e828 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134949.582556:0:6577:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d6a83bdc/0xd6c4b8f05867e828 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134949.582565:0:6577:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d6a83bdc/0xd6c4b8f05867e828 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134949.582583:0:6577:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783134949.583201:0:10987:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783134949.583211:0:10987:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d6a83bdc/0xd6c4b8f05867e828 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134949.583222:0:10987:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe9f68ad800 already unused, calling callback (ffffffffc1527ce0) 00010000:00010000:1.0:1783134949.583228:0:10987:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d6a83bdc/0xd6c4b8f05867e828 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134949.583239:0:10987:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d6a83bdc/0xd6c4b8f05867e828 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134949.583265:0:10987:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d6a83bdc/0xd6c4b8f05867e828 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134949.583312:0:10987:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d6a83bdc/0xd6c4b8f05867e828 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134949.583340:0:10987:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783134949.583342:0:10987:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783134949.583343:0:10987:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1783134949.583352:0:5766:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1783134949.584241:0:6577:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fe43b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3287:x1869752384402432:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1836us (2036us total) trans 4294967300 rc 0/0 00000100:00100000:0.0:1783134949.584254:0:6577:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000004:00080000:3.0:1783134949.584431:0:3287:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9fe9fe9faa00/2, rc 0, transno 4294967300 00000100:00100000:3.0:1783134949.584440:0:3287:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9fe9faa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1869752384402432:0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1783134949.635662:0:5758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1783134949.764975:0:11499:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1783134950.533151:0:3286:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9f6fb6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1869752384402944:0@lo:400:kworker.0 00000100:00100000:3.0:1783134950.533256:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783134950.533365:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1783134950.533372:0:3286:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9f6fb5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:88a2002e-2ea7-4f07-912a-8d001832cfc0:3286:1869752384402560:0@lo:400:kworker.0 00000100:00100000:3.0:1783134950.533407:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783134950.533429:0:3286:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9f6fb5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3286:1869752384403072:0@lo:400:kworker.0 00000100:00100000:3.0:1783134950.533458:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783134950.533490:0:7676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384402944 00000100:00100000:3.0:1783134950.533500:0:7676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384402944 00000100:00100000:3.0:1783134950.533570:0:7676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1783134950.533581:0:7676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9f6fb5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3286:x1869752384402944:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783134950.533647:0:7676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9f6fb5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3286:x1869752384402944:12345-0@lo:400:kworker.0 Request processed in 67us (391us total) trans 0 rc 0/0 00000100:00100000:3.0:1783134950.533655:0:7676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00010000:00080000:3.0:1783134950.533715:0:3286:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fe9f6fb6a00 x1869752384402944/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783134966 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783134950.533749:0:3286:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9f6fb6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1869752384402944:0@lo:400:kworker.0 00000100:00100000:0.0:1783134950.534075:0:3288:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9f6fb6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3288:1869752384402688:0@lo:400:kworker.0 00000100:00100000:0.0:1783134950.534113:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783134950.534135:0:3288:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9f6fb5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1869752384403200:0@lo:400:kworker.0 00000100:00100000:0.0:1783134950.534157:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783134950.534177:0:3288:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1783134950.534182:0:3288:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9f6fb5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3288:1869752384402816:0@lo:400:kworker.0 00000100:00100000:0.0:1783134950.534202:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783134950.534217:0:3288:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9f5ce1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1869752384403328:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1783134950.534239:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783134950.534272:0:5769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384403072 00000100:00100000:0.0:1783134950.534301:0:5769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384403072 00000100:00100000:0.0:1783134950.534337:0:5769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384402688 00000100:00100000:0.0:1783134950.534340:0:5769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384402688 00000100:00100000:0.0:1783134950.534351:0:5769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384402816 00000100:00100000:0.0:1783134950.534353:0:5769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384402816 00000100:00100000:0.0:1783134950.534367:0:5769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1783134950.534374:0:5769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9f6fb7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3286:x1869752384403072:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783134950.534409:0:5769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9f6fb7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3286:x1869752384403072:12345-0@lo:400:kworker.0 Request processed in 34us (950us total) trans 0 rc 0/0 00000100:00100000:0.0:1783134950.534415:0:5769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1783134950.534427:0:5769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1783134950.534432:0:5769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fe439f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3288:x1869752384402688:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783134950.534458:0:5769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fe439f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3288:x1869752384402688:12345-0@lo:400:kworker.0 Request processed in 26us (345us total) trans 0 rc 0/0 00000100:00100000:0.0:1783134950.534471:0:5769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1783134950.534481:0:5769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1783134950.534485:0:5769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fe438a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3288:x1869752384402816:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783134950.534511:0:5769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fe438a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3288:x1869752384402816:12345-0@lo:400:kworker.0 Request processed in 25us (308us total) trans 0 rc 0/0 00000100:00100000:0.0:1783134950.534516:0:5769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1783134950.534541:0:6574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384403200 00000100:00100000:0.0:1783134950.534545:0:6574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384403200 00000100:00100000:0.0:1783134950.534566:0:6574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1783134950.534572:0:6574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fe438380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3288:x1869752384403200:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783134950.534603:0:6574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fe438380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3288:x1869752384403200:12345-0@lo:400:kworker.0 Request processed in 32us (445us total) trans 0 rc 0/0 00000100:00100000:0.0:1783134950.534609:0:6574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1783134950.534635:0:3288:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9f6fb5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3288:1869752384402816:0@lo:400:kworker.0 00000100:00100000:0.0:1783134950.534644:0:3288:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9f6fb6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3288:1869752384402688:0@lo:400:kworker.0 00000100:00100000:0.0:1783134950.534654:0:3288:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9f6fb5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1869752384403200:0@lo:400:kworker.0 00000100:00100000:2.0:1783134950.534738:0:3287:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1783134950.534752:0:3287:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9fe439c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1869752384403456:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1783134950.534786:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783134950.535014:0:6578:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384403328 00000100:00100000:3.0:1783134950.535019:0:6578:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384403328 00000100:00100000:3.0:1783134950.535102:0:6578:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384403456 00000100:00100000:3.0:1783134950.535106:0:6578:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384403456 00000100:00100000:1.0:1783134950.535250:0:5763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384402560 00000100:00100000:1.0:1783134950.535256:0:5763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384402560 00000100:00100000:1.0:1783134950.535321:0:5763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 256 00000100:00100000:1.0:1783134950.535329:0:5763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9d0e61050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88a2002e-2ea7-4f07-912a-8d001832cfc0+19:3286:x1869752384402560:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783134950.535372:0:5763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9d0e61050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88a2002e-2ea7-4f07-912a-8d001832cfc0+19:3286:x1869752384402560:12345-0@lo:400:kworker.0 Request processed in 45us (1964us total) trans 0 rc 0/0 00000100:00100000:1.0:1783134950.535378:0:5763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 256 00000100:00080000:1.0:1783134950.535438:0:5766:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1783134950.535444:0:5766:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1783134950.535832:0:3286:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9f6fb5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:88a2002e-2ea7-4f07-912a-8d001832cfc0:3286:1869752384402560:0@lo:400:kworker.0 00000100:00100000:1.0:1783134950.535848:0:3286:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9f6fb5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3286:1869752384403072:0@lo:400:kworker.0 00000100:00100000:2.0:1783134950.537664:0:10783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1783134950.537693:0:10783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fe43ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3288:x1869752384403328:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1783134950.537744:0:10783:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1783134950.537868:0:10783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fe43ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3288:x1869752384403328:12345-0@lo:13:osp-pre-1-0.0 Request processed in 191us (3627us total) trans 0 rc 0/0 00000100:00100000:2.0:1783134950.537876:0:10783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1783134950.537904:0:10783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1783134950.537913:0:10783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9f5ce3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3287:x1869752384403456:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1783134950.537938:0:10783:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1783134950.537977:0:10783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9f5ce3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3287:x1869752384403456:12345-0@lo:13:osp-pre-0-0.0 Request processed in 66us (3189us total) trans 0 rc 0/0 00000100:00100000:2.0:1783134950.537983:0:10783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00010000:00080000:2.0:1783134950.538039:0:3287:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fe9fe439c00 x1869752384403456/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783134966 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783134950.538074:0:3287:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9fe439c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1869752384403456:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1783134950.538142:0:3288:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9f5ce1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1869752384403328:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1783134950.659525:0:5757:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783134951.683714:0:6591:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783134952.707509:0:10987:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783134953.253655:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:3.0:1783134953.253707:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:3.0:1783134953.253760:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:1.0:1783134953.253776:0:5765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373891712 00000100:00100000:1.0:1783134953.253793:0:5765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373891712 00000100:00100000:3.0:1783134953.253808:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:3.0:1783134953.253859:0:8031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373891840 00000100:00100000:3.0:1783134953.253868:0:8031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373891840 00000100:00100000:1.0:1783134953.253876:0:5765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 257 00000100:00100000:1.0:1783134953.253891:0:5765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9d0e63850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f39b22bc-4faf-4b59-bb00-2a11f91e37c0+13:2368:x1869752373891712:12345-192.168.201.41@tcp:400:kworker.0 00000100:00100000:3.0:1783134953.253937:0:8031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373892096 00000100:00100000:3.0:1783134953.253943:0:8031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373892096 00000100:00100000:3.0:1783134953.253981:0:8031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 66 00000100:00100000:3.0:1783134953.253993:0:8031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9f6fb7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+5:2368:x1869752373891840:12345-192.168.201.41@tcp:400:kworker.0 00000100:00100000:1.0:1783134953.254003:0:5765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9d0e63850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f39b22bc-4faf-4b59-bb00-2a11f91e37c0+13:2368:x1869752373891712:12345-192.168.201.41@tcp:400:kworker.0 Request processed in 111us (358us total) trans 0 rc 0/0 00000100:00100000:1.0:1783134953.254022:0:5765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 257 00000100:00080000:1.0:1783134953.254073:0:5766:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1783134953.254083:0:8031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9f6fb7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+5:2368:x1869752373891840:12345-192.168.201.41@tcp:400:kworker.0 Request processed in 91us (321us total) trans 0 rc 0/0 00000100:00100000:3.0:1783134953.254092:0:8031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 66 00000100:00100000:3.0:1783134953.254115:0:8031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 67 00000100:00100000:3.0:1783134953.254138:0:8031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9f6fb4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c936801d-68e8-41a4-8fbc-6becd5e1be74+5:2368:x1869752373892096:12345-192.168.201.41@tcp:400:kworker.0 00000100:00100000:3.0:1783134953.254168:0:8031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9f6fb4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c936801d-68e8-41a4-8fbc-6becd5e1be74+5:2368:x1869752373892096:12345-192.168.201.41@tcp:400:kworker.0 Request processed in 45us (362us total) trans 0 rc 0/0 00000100:00100000:3.0:1783134953.254173:0:8031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 67 00000100:00100000:0.0:1783134953.254568:0:7676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373891968 00000100:00100000:0.0:1783134953.254574:0:7676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373891968 00000100:00100000:0.0:1783134953.254627:0:7676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 32 00000100:00100000:0.0:1783134953.254636:0:7676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9f6fb6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+5:2368:x1869752373891968:12345-192.168.201.41@tcp:400:kworker.0 00000100:00100000:0.0:1783134953.254684:0:7676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9f6fb6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+5:2368:x1869752373891968:12345-192.168.201.41@tcp:400:kworker.0 Request processed in 50us (976us total) trans 0 rc 0/0 00000100:00100000:0.0:1783134953.254691:0:7676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 32 00000100:00080000:1.0:1783134953.255631:0:5766:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1783134953.731419:0:5758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1783134954.690189:0:7470:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967300 is committed 00010000:00010000:0.0:1783134954.755604:0:5757:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783134955.651564:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1783134955.651599:0:3286:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9fe439c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1869752384403584:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1783134955.651696:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783134955.651733:0:3288:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9fe9f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:88a2002e-2ea7-4f07-912a-8d001832cfc0:3288:1869752384403712:0@lo:400:kworker.0 00000100:00100000:2.0:1783134955.651777:0:3286:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9fe9f9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3286:1869752384403968:0@lo:400:kworker.0 00000100:00100000:1.0:1783134955.651785:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783134955.651819:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783134955.651823:0:3288:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9fe9fb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3288:1869752384404224:0@lo:400:kworker.0 00000100:00100000:2.0:1783134955.651847:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1783134955.651856:0:3286:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9fe9f9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1869752384404096:0@lo:400:kworker.0 00000100:00100000:1.0:1783134955.651859:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783134955.651897:0:3288:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1783134955.651905:0:3288:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9fe9f9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3288:1869752384403840:0@lo:400:kworker.0 00000100:00100000:2.0:1783134955.651919:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783134955.651939:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783134955.651960:0:3288:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9fe9f9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1869752384404352:0@lo:400:kworker.0 00000100:00100000:1.0:1783134955.651998:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783134955.652040:0:5762:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384403712 00000100:00100000:1.0:1783134955.652049:0:5762:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384403712 00000100:00100000:2.0:1783134955.652062:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384403968 00000100:00100000:2.0:1783134955.652068:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384403968 00000100:00100000:1.0:1783134955.652112:0:5762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 258 00000100:00100000:2.0:1783134955.652120:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384404224 00000100:00100000:2.0:1783134955.652125:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384404224 00000100:00100000:1.0:1783134955.652126:0:5762:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9d0e61850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88a2002e-2ea7-4f07-912a-8d001832cfc0+19:3288:x1869752384403712:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783134955.652145:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384403840 00000100:00100000:2.0:1783134955.652148:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384403840 00000100:00100000:2.0:1783134955.652163:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1783134955.652171:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9f5ce1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3286:x1869752384403968:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783134955.652193:0:5762:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9d0e61850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88a2002e-2ea7-4f07-912a-8d001832cfc0+19:3288:x1869752384403712:12345-0@lo:400:kworker.0 Request processed in 69us (407us total) trans 0 rc 0/0 00000100:00100000:1.0:1783134955.652203:0:5762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 258 00000100:00100000:2.0:1783134955.652222:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9f5ce1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3286:x1869752384403968:12345-0@lo:400:kworker.0 Request processed in 51us (403us total) trans 0 rc 0/0 00000100:00100000:2.0:1783134955.652230:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1783134955.652246:0:6577:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384404096 00000100:00100000:2.0:1783134955.652250:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1783134955.652252:0:6577:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384404096 00000100:00100000:2.0:1783134955.652260:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fe9f8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3288:x1869752384404224:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783134955.652307:0:6577:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384404352 00000100:00100000:1.0:1783134955.652312:0:6577:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384404352 00000100:00100000:2.0:1783134955.652316:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fe9f8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3288:x1869752384404224:12345-0@lo:400:kworker.0 Request processed in 57us (459us total) trans 0 rc 0/0 00000100:00100000:2.0:1783134955.652324:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1783134955.652341:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1783134955.652345:0:6577:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1783134955.652351:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fe9fb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3288:x1869752384403840:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783134955.652377:0:6577:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9f643c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3286:x1869752384404096:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783134955.652401:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fe9fb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3288:x1869752384403840:12345-0@lo:400:kworker.0 Request processed in 51us (463us total) trans 0 rc 0/0 00000100:00100000:2.0:1783134955.652409:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1783134955.652424:0:6577:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9f643c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3286:x1869752384404096:12345-0@lo:400:kworker.0 Request processed in 50us (504us total) trans 0 rc 0/0 00000100:00100000:1.0:1783134955.652434:0:6577:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00010000:00080000:2.0:1783134955.652460:0:3286:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fe9fe9f9180 x1869752384404096/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783134971 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783134955.652478:0:3286:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9fe9f9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1869752384404096:0@lo:400:kworker.0 00000100:00100000:2.0:1783134955.652494:0:3286:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9fe9f9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3286:1869752384403968:0@lo:400:kworker.0 00000100:00080000:2.0:1783134955.652548:0:5766:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1783134955.652554:0:5766:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1783134955.652558:0:5766:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1783134955.652592:0:3288:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9fe9f9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3288:1869752384403840:0@lo:400:kworker.0 00000100:00100000:2.0:1783134955.652605:0:3288:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9fe9f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:88a2002e-2ea7-4f07-912a-8d001832cfc0:3288:1869752384403712:0@lo:400:kworker.0 00000100:00100000:2.0:1783134955.652619:0:3288:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9fe9fb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3288:1869752384404224:0@lo:400:kworker.0 00000100:00100000:1.0:1783134955.652644:0:6577:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1783134955.652654:0:6577:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fe9fa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3288:x1869752384404352:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783134955.652695:0:6577:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fe9fa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3288:x1869752384404352:12345-0@lo:400:kworker.0 Request processed in 43us (696us total) trans 0 rc 0/0 00000100:00100000:1.0:1783134955.652702:0:6577:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1783134955.652748:0:3288:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967300 gen 2 00000004:00080000:2.0:1783134955.652754:0:3288:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9fe9fe9faa00, transno 4294967300 00000100:00100000:2.0:1783134955.652770:0:3288:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9fe9f9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1869752384404352:0@lo:400:kworker.0 00000100:00100000:2.0:1783134955.652820:0:3286:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9fe43a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1869752384404480:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1783134955.652847:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783134955.652943:0:6578:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384403584 00000100:00100000:3.0:1783134955.652955:0:6578:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384403584 00000100:00100000:3.0:1783134955.653041:0:6578:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384404480 00000100:00100000:3.0:1783134955.653045:0:6578:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384404480 00000100:00100000:2.0:1783134955.654261:0:10783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1783134955.654275:0:10783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9f5ce3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1869752384403584:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1783134955.654327:0:10783:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1783134955.654403:0:10783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9f5ce3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1869752384403584:12345-0@lo:13:osp-pre-0-0.0 Request processed in 131us (2707us total) trans 0 rc 0/0 00000100:00100000:2.0:1783134955.654425:0:10783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1783134955.654448:0:10783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1783134955.654456:0:10783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9f5ce1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1869752384404480:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1783134955.654478:0:10783:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1783134955.654510:0:10783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9f5ce1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1869752384404480:12345-0@lo:13:osp-pre-1-0.0 Request processed in 57us (1663us total) trans 0 rc 0/0 00000100:00100000:2.0:1783134955.654517:0:10783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1783134955.654696:0:3286:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9fe43a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1869752384404480:0@lo:13:osp-pre-1-0.0 00010000:00080000:2.0:1783134955.654711:0:3286:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fe9fe439c00 x1869752384403584/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783134971 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783134955.654723:0:3286:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9fe439c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1869752384403584:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1783134955.779891:0:6591:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783134956.803507:0:10987:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783134957.827865:0:5758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783134958.373440:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:3.0:1783134958.373489:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:1.0:1783134958.373513:0:5763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373892224 00000100:00100000:1.0:1783134958.373525:0:5763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373892224 00000100:00100000:3.0:1783134958.373531:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:3.0:1783134958.373569:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:1.0:1783134958.373596:0:5763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 259 00000100:00100000:1.0:1783134958.373610:0:5763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9d0e62850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f39b22bc-4faf-4b59-bb00-2a11f91e37c0+13:2370:x1869752373892224:12345-192.168.201.41@tcp:400:kworker.0 00000100:00100000:1.0:1783134958.373693:0:5763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9d0e62850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f39b22bc-4faf-4b59-bb00-2a11f91e37c0+13:2370:x1869752373892224:12345-192.168.201.41@tcp:400:kworker.0 Request processed in 87us (263us total) trans 0 rc 0/0 00000100:00100000:1.0:1783134958.373702:0:5763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 259 00000100:00100000:0.0:1783134958.373796:0:6577:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373892480 00000100:00100000:0.0:1783134958.373801:0:6577:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373892480 00000100:00100000:0.0:1783134958.373863:0:6577:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 35 00000100:00100000:0.0:1783134958.373871:0:6577:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9f6fb7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+5:2370:x1869752373892480:12345-192.168.201.41@tcp:400:kworker.0 00000100:00100000:0.0:1783134958.373904:0:6577:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9f6fb7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+5:2370:x1869752373892480:12345-192.168.201.41@tcp:400:kworker.0 Request processed in 34us (416us total) trans 0 rc 0/0 00000100:00100000:0.0:1783134958.373911:0:6577:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 35 00000100:00100000:2.0:1783134958.373978:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373892352 00000100:00080000:1.0:1783134958.373990:0:5766:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1783134958.373996:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373892352 00000100:00100000:1.0:1783134958.374015:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373892608 00000100:00100000:1.0:1783134958.374021:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373892608 00000100:00100000:2.0:1783134958.374056:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 71 00000100:00100000:1.0:1783134958.374064:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 72 00000100:00100000:2.0:1783134958.374070:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9f6fb4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+5:2370:x1869752373892352:12345-192.168.201.41@tcp:400:kworker.0 00000100:00100000:1.0:1783134958.374078:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9f6fb6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c936801d-68e8-41a4-8fbc-6becd5e1be74+5:2370:x1869752373892608:12345-192.168.201.41@tcp:400:kworker.0 00000100:00100000:2.0:1783134958.374110:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9f6fb4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+5:2370:x1869752373892352:12345-192.168.201.41@tcp:400:kworker.0 Request processed in 45us (577us total) trans 0 rc 0/0 00000100:00100000:1.0:1783134958.374117:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9f6fb6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c936801d-68e8-41a4-8fbc-6becd5e1be74+5:2370:x1869752373892608:12345-192.168.201.41@tcp:400:kworker.0 Request processed in 40us (545us total) trans 0 rc 0/0 00000100:00100000:2.0:1783134958.374124:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 71 00000100:00100000:1.0:1783134958.374132:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 72 00000100:00080000:0.0:1783134958.374498:0:5766:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1783134958.854761:0:5757:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783134959.875615:0:6591:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1783134960.004065:0:11499:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1783134960.772404:0:3287:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9f6fb4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:88a2002e-2ea7-4f07-912a-8d001832cfc0:3287:1869752384404608:0@lo:400:kworker.0 00000100:00100000:2.0:1783134960.772514:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783134960.772600:0:3287:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9f6fb7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3287:1869752384405120:0@lo:400:kworker.0 00000100:00100000:2.0:1783134960.772637:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783134960.772692:0:3287:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1783134960.772700:0:3287:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9f6fb4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1869752384404992:0@lo:400:kworker.0 00000100:00100000:2.0:1783134960.772731:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783134960.772749:0:3287:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9fe9faa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1869752384405504:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1783134960.772774:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783134960.772816:0:3288:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9f6fb4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3288:1869752384404736:0@lo:400:kworker.0 00000100:00100000:2.0:1783134960.772844:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783134960.772870:0:3288:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9f6fb5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1869752384405248:0@lo:400:kworker.0 00000100:00100000:3.0:1783134960.772873:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384405120 00000100:00100000:3.0:1783134960.772892:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384405120 00000100:00100000:2.0:1783134960.772903:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783134960.772926:0:3288:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1783134960.772932:0:3288:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9f6fb6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3288:1869752384404864:0@lo:400:kworker.0 00000100:00100000:3.0:1783134960.772948:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384404736 00000100:00100000:3.0:1783134960.772952:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384404736 00000100:00100000:2.0:1783134960.772959:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783134960.773015:0:5765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384404608 00000100:00100000:0.0:1783134960.773019:0:5765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384404608 00000100:00100000:0.0:1783134960.773154:0:5765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 260 00000100:00100000:0.0:1783134960.773166:0:5765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9d0e62050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88a2002e-2ea7-4f07-912a-8d001832cfc0+19:3287:x1869752384404608:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783134960.773233:0:5765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9d0e62050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88a2002e-2ea7-4f07-912a-8d001832cfc0+19:3287:x1869752384404608:12345-0@lo:400:kworker.0 Request processed in 69us (720us total) trans 0 rc 0/0 00000100:00100000:0.0:1783134960.773242:0:5765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 260 00000100:00100000:0.0:1783134960.773311:0:7676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384404992 00000100:00100000:0.0:1783134960.773315:0:7676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384404992 00000100:00100000:0.0:1783134960.773346:0:7676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384405248 00000100:00100000:0.0:1783134960.773349:0:7676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384405248 00000100:00100000:0.0:1783134960.773373:0:7676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1783134960.773380:0:7676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9f5ce1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3287:x1869752384404992:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783134960.773410:0:7676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9f5ce1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3287:x1869752384404992:12345-0@lo:400:kworker.0 Request processed in 32us (680us total) trans 0 rc 0/0 00000100:00100000:0.0:1783134960.773415:0:7676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1783134960.773423:0:7676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1783134960.773433:0:7676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9f5ce2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3288:x1869752384405248:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783134960.773459:0:7676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9f5ce2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3288:x1869752384405248:12345-0@lo:400:kworker.0 Request processed in 26us (556us total) trans 0 rc 0/0 00000100:00100000:0.0:1783134960.773465:0:7676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00080000:0.0:1783134960.773489:0:5766:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1783134960.773494:0:5766:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1783134960.773497:0:5766:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1783134960.773525:0:3287:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fe9f6fb4700 x1869752384404992/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783134976 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783134960.773538:0:3287:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9f6fb4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1869752384404992:0@lo:400:kworker.0 00000100:00100000:0.0:1783134960.773546:0:3287:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9f6fb4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:88a2002e-2ea7-4f07-912a-8d001832cfc0:3287:1869752384404608:0@lo:400:kworker.0 00000100:00100000:2.0:1783134960.773737:0:3288:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9fe43aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1869752384405376:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1783134960.773762:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783134960.773786:0:3288:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9f6fb5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1869752384405248:0@lo:400:kworker.0 00000100:00100000:2.0:1783134960.774258:0:10783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384405504 00000100:00100000:2.0:1783134960.774263:0:10783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384405504 00000100:00100000:2.0:1783134960.774313:0:10783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384405376 00000100:00100000:2.0:1783134960.774316:0:10783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384405376 00000100:00100000:2.0:1783134960.774331:0:10783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1783134960.774339:0:10783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9f5ce2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3287:x1869752384405504:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1783134960.774373:0:10783:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1783134960.774411:0:10783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9f5ce2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3287:x1869752384405504:12345-0@lo:13:osp-pre-1-0.0 Request processed in 74us (1636us total) trans 0 rc 0/0 00000100:00100000:2.0:1783134960.774416:0:10783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1783134960.774425:0:10783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1783134960.774437:0:10783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9cb33bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3288:x1869752384405376:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1783134960.774456:0:10783:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1783134960.774488:0:10783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9cb33bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3288:x1869752384405376:12345-0@lo:13:osp-pre-0-0.0 Request processed in 49us (724us total) trans 0 rc 0/0 00000100:00100000:2.0:1783134960.774494:0:10783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1783134960.775619:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384404864 00000100:00100000:3.0:1783134960.775628:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384404864 00000100:00100000:0.0:1783134960.775633:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1783134960.775649:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9f5ce3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3287:x1869752384405120:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783134960.775670:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1783134960.775678:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9f5ce0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3288:x1869752384404736:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783134960.775722:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9f5ce3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3287:x1869752384405120:12345-0@lo:400:kworker.0 Request processed in 76us (3083us total) trans 0 rc 0/0 00000100:00100000:3.0:1783134960.775727:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9f5ce0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3288:x1869752384404736:12345-0@lo:400:kworker.0 Request processed in 48us (2881us total) trans 0 rc 0/0 00000100:00100000:0.0:1783134960.775738:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1783134960.778217:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1783134960.778234:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1783134960.778259:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9f5ce2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3288:x1869752384404864:12345-0@lo:400:kworker.0 00010000:00080000:2.0:1783134960.778351:0:3288:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fe9fe43aa00 x1869752384405376/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783134976 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783134960.778380:0:3288:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9fe43aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1869752384405376:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1783134960.778390:0:5766:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1783134960.778400:0:3288:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9f6fb4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3288:1869752384404736:0@lo:400:kworker.0 00000100:00100000:2.0:1783134960.778452:0:3287:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9fe9faa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1869752384405504:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1783134960.778468:0:3287:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9f6fb7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3287:1869752384405120:0@lo:400:kworker.0 00000100:00100000:2.0:1783134960.778500:0:3288:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9f6fb6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3288:1869752384404864:0@lo:400:kworker.0 00000100:00100000:0.0:1783134960.778708:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9f5ce2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3288:x1869752384404864:12345-0@lo:400:kworker.0 Request processed in 462us (5749us total) trans 0 rc 0/0 00000100:00100000:0.0:1783134960.778716:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00010000:00010000:1.0:1783134960.899964:0:10987:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783134961.923459:0:5758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783134962.954443:0:5757:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783134963.496216:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:3.0:1783134963.496256:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:2.0:1783134963.496402:0:5769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373892864 00000100:00100000:3.0:1783134963.496410:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:2.0:1783134963.496414:0:5769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373892864 00000100:00100000:3.0:1783134963.496450:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:1.0:1783134963.496457:0:5763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373892736 00000100:00100000:1.0:1783134963.496464:0:5763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373892736 00000100:00080000:3.0:1783134963.496480:0:5766:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1783134963.496483:0:5769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373893120 00000100:00100000:2.0:1783134963.496488:0:5769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373893120 00000100:00100000:1.0:1783134963.496509:0:5763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 261 00000100:00100000:3.0:1783134963.496519:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 76 00000100:00100000:1.0:1783134963.496523:0:5763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9d0e60450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f39b22bc-4faf-4b59-bb00-2a11f91e37c0+13:2369:x1869752373892736:12345-192.168.201.41@tcp:400:kworker.0 00000100:00100000:3.0:1783134963.496536:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9f6fb6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+5:2369:x1869752373892864:12345-192.168.201.41@tcp:400:kworker.0 00000100:00100000:2.0:1783134963.496547:0:5769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 77 00000100:00100000:2.0:1783134963.496557:0:5769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9f6fb5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c936801d-68e8-41a4-8fbc-6becd5e1be74+5:2369:x1869752373893120:12345-192.168.201.41@tcp:400:kworker.0 00000100:00100000:1.0:1783134963.496602:0:5763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9d0e60450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f39b22bc-4faf-4b59-bb00-2a11f91e37c0+13:2369:x1869752373892736:12345-192.168.201.41@tcp:400:kworker.0 Request processed in 82us (192us total) trans 0 rc 0/0 00000100:00100000:1.0:1783134963.496610:0:5763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 261 00000100:00100000:0.0:1783134963.496621:0:7676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373892992 00000100:00100000:0.0:1783134963.496627:0:7676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373892992 00000100:00100000:0.0:1783134963.496666:0:7676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 38 00000100:00100000:0.0:1783134963.496673:0:7676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9f6fb5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+5:2369:x1869752373892992:12345-192.168.201.41@tcp:400:kworker.0 00000100:00100000:3.0:1783134963.496741:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9f6fb6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+5:2369:x1869752373892864:12345-192.168.201.41@tcp:400:kworker.0 Request processed in 211us (534us total) trans 0 rc 0/0 00000100:00100000:3.0:1783134963.496754:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 76 00000100:00080000:3.0:1783134963.496779:0:5766:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1783134963.496782:0:5766:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1783134963.496816:0:5769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9f6fb5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c936801d-68e8-41a4-8fbc-6becd5e1be74+5:2369:x1869752373893120:12345-192.168.201.41@tcp:400:kworker.0 Request processed in 260us (558us total) trans 0 rc 0/0 00000100:00100000:2.0:1783134963.496825:0:5769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 77 00000100:00100000:0.0:1783134963.496849:0:7676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9f6fb5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+5:2369:x1869752373892992:12345-192.168.201.41@tcp:400:kworker.0 Request processed in 175us (398us total) trans 0 rc 0/0 00000100:00100000:0.0:1783134963.496858:0:7676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 38 00010000:00010000:3.0:1783134963.971514:0:6591:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783134964.995862:0:10987:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783134965.891588:0:3287:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9fe9fbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1869752384405632:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1783134965.891688:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783134965.892824:0:3289:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9fe9f9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3289:1869752384405888:0@lo:400:kworker.0 00000100:00100000:3.0:1783134965.892880:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783134965.892918:0:3289:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1783134965.892924:0:3289:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9fe9faa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:88a2002e-2ea7-4f07-912a-8d001832cfc0:3289:1869752384405760:0@lo:400:kworker.0 00000100:00100000:3.0:1783134965.892956:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783134965.892998:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384405888 00000100:00100000:3.0:1783134965.893007:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384405888 00000100:00100000:3.0:1783134965.893067:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1783134965.893077:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9f6fb5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3289:x1869752384405888:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783134965.893138:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9f6fb5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3289:x1869752384405888:12345-0@lo:400:kworker.0 Request processed in 61us (257us total) trans 0 rc 0/0 00000100:00100000:3.0:1783134965.893146:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1783134965.893172:0:5762:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384405760 00000100:00100000:3.0:1783134965.893176:0:5762:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384405760 00000100:00100000:3.0:1783134965.893209:0:5762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:3.0:1783134965.893216:0:5762:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9d0e62450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88a2002e-2ea7-4f07-912a-8d001832cfc0+19:3289:x1869752384405760:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783134965.893244:0:5762:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9d0e62450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88a2002e-2ea7-4f07-912a-8d001832cfc0+19:3289:x1869752384405760:12345-0@lo:400:kworker.0 Request processed in 30us (288us total) trans 0 rc 0/0 00000100:00100000:3.0:1783134965.893250:0:5762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000100:00100000:3.0:1783134965.893320:0:3289:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9fe9faa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:88a2002e-2ea7-4f07-912a-8d001832cfc0:3289:1869752384405760:0@lo:400:kworker.0 00000100:00100000:3.0:1783134965.893335:0:3289:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9fe9f9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3289:1869752384405888:0@lo:400:kworker.0 00000100:00100000:2.0:1783134965.893937:0:10783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384405632 00000100:00100000:2.0:1783134965.893950:0:10783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384405632 00000100:00100000:2.0:1783134965.894033:0:10783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1783134965.894043:0:10783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fe439880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3287:x1869752384405632:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1783134965.894081:0:10783:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1783134965.894439:0:3287:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9f6fb6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1869752384406144:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1783134965.894465:0:3289:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9fe9f9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3289:1869752384406400:0@lo:400:kworker.0 00000100:00100000:1.0:1783134965.894505:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783134965.894750:0:3289:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1783134965.894756:0:3289:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9fe9f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1869752384406272:0@lo:400:kworker.0 00000100:00100000:1.0:1783134965.894781:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783134965.894880:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384406400 00000100:00100000:1.0:1783134965.894886:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384406400 00000100:00100000:1.0:1783134965.894925:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1783134965.894935:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fe9f9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3289:x1869752384406400:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783134965.894975:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fe9f9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3289:x1869752384406400:12345-0@lo:400:kworker.0 Request processed in 43us (469us total) trans 0 rc 0/0 00000100:00100000:1.0:1783134965.894981:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1783134965.895004:0:6577:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384406272 00000100:00100000:1.0:1783134965.895007:0:6577:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384406272 00000100:00100000:1.0:1783134965.895032:0:6577:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1783134965.895039:0:6577:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fe9f9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3289:x1869752384406272:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783134965.895071:0:6577:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fe9f9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3289:x1869752384406272:12345-0@lo:400:kworker.0 Request processed in 32us (288us total) trans 0 rc 0/0 00000100:00100000:1.0:1783134965.895077:0:6577:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1783134965.895111:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:1.0:1783134965.895121:0:3289:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fe9fe9f9500 x1869752384406272/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783134981 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783134965.895136:0:3289:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9fe9f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1869752384406272:0@lo:400:kworker.0 00000100:00100000:1.0:1783134965.895151:0:3289:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9fe9f9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3289:1869752384406400:0@lo:400:kworker.0 00000100:00100000:1.0:1783134965.895195:0:6578:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384406144 00000100:00100000:1.0:1783134965.895199:0:6578:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384406144 00000100:00100000:1.0:1783134965.895215:0:6578:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1783134965.895220:0:6578:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fe43b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3287:x1869752384406144:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1783134965.895247:0:6578:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1783134965.895300:0:6578:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fe43b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3287:x1869752384406144:12345-0@lo:13:osp-pre-0-0.0 Request processed in 59us (171us total) trans 0 rc 0/0 00000100:00100000:1.0:1783134965.895307:0:6578:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00080000:1.0:1783134965.895339:0:5766:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1783134965.895345:0:5766:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1783134965.895347:0:5766:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1783134965.895361:0:3286:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9fe9fb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3286:1869752384406016:0@lo:400:kworker.0 00000100:00100000:1.0:1783134965.895388:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783134965.895415:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384406016 00000100:00100000:1.0:1783134965.895419:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384406016 00000100:00100000:1.0:1783134965.895447:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1783134965.895453:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fe9f9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3286:x1869752384406016:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783134965.895486:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fe9f9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3286:x1869752384406016:12345-0@lo:400:kworker.0 Request processed in 33us (97us total) trans 0 rc 0/0 00000100:00100000:1.0:1783134965.895492:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00080000:1.0:1783134965.895505:0:5766:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1783134965.895536:0:3286:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9fe9fb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3286:1869752384406016:0@lo:400:kworker.0 00000100:00100000:2.0:1783134965.897093:0:10783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fe439880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3287:x1869752384405632:12345-0@lo:13:osp-pre-1-0.0 Request processed in 3042us (5396us total) trans 0 rc 0/0 00000100:00100000:2.0:1783134965.897107:0:10783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1783134965.899198:0:3287:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9fe9fbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1869752384405632:0@lo:13:osp-pre-1-0.0 00010000:00080000:0.0:1783134965.899258:0:3287:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fe9f6fb6300 x1869752384406144/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783134981 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783134965.899275:0:3287:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9f6fb6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1869752384406144:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1783134966.019462:0:5758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783134967.043587:0:5757:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783134968.067553:0:6591:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783134968.612981:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:3.0:1783134968.613060:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:0.0:1783134968.613593:0:5765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373893248 00000100:00100000:0.0:1783134968.613607:0:5765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373893248 00000100:00100000:0.0:1783134968.613677:0:5765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 263 00000100:00100000:0.0:1783134968.613689:0:5765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9d0e61450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f39b22bc-4faf-4b59-bb00-2a11f91e37c0+13:2370:x1869752373893248:12345-192.168.201.41@tcp:400:kworker.0 00000100:00100000:0.0:1783134968.613816:0:5765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9d0e61450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f39b22bc-4faf-4b59-bb00-2a11f91e37c0+13:2370:x1869752373893248:12345-192.168.201.41@tcp:400:kworker.0 Request processed in 128us (849us total) trans 0 rc 0/0 00000100:00100000:0.0:1783134968.613825:0:5765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 263 00000100:00100000:2.0:1783134968.614319:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373893376 00000100:00100000:2.0:1783134968.614325:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373893376 00000100:00100000:2.0:1783134968.614386:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 81 00000100:00100000:2.0:1783134968.614396:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9f6fb5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+5:2370:x1869752373893376:12345-192.168.201.41@tcp:400:kworker.0 00000100:00100000:2.0:1783134968.614450:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9f6fb5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+5:2370:x1869752373893376:12345-192.168.201.41@tcp:400:kworker.0 Request processed in 56us (1390us total) trans 0 rc 0/0 00000100:00100000:2.0:1783134968.614457:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 81 00000100:00080000:0.0:1783134968.614657:0:5766:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1783134968.627999:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:3.0:1783134968.628056:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:1.0:1783134968.628136:0:8031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373893632 00000100:00100000:0.0:1783134968.628142:0:6574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373893504 00000100:00100000:1.0:1783134968.628149:0:8031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373893632 00000100:00100000:0.0:1783134968.628150:0:6574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373893504 00000100:00100000:1.0:1783134968.628234:0:8031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 82 00000100:00100000:1.0:1783134968.628244:0:8031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9f6fb6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c936801d-68e8-41a4-8fbc-6becd5e1be74+5:2370:x1869752373893632:12345-192.168.201.41@tcp:400:kworker.0 00000100:00100000:1.0:1783134968.628390:0:8031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9f6fb6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c936801d-68e8-41a4-8fbc-6becd5e1be74+5:2370:x1869752373893632:12345-192.168.201.41@tcp:400:kworker.0 Request processed in 146us (331us total) trans 0 rc 0/0 00000100:00100000:1.0:1783134968.628399:0:8031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 82 00000100:00100000:0.0:1783134968.628977:0:6574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 19 00000100:00100000:0.0:1783134968.628987:0:6574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9f6fb6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+5:2366:x1869752373893504:12345-192.168.201.41@tcp:9:kworker.0 00000020:00000080:0.0:1783134968.629023:0:6574:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xd6c4b8f05867e764 00000100:00080000:0.0:1783134968.629034:0:6574:0:(import.c:65:import_set_state_nolock()) ffff9fe9f8a58800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1783134968.629089:0:6574:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967300 00000100:00100000:0.0:1783134968.629589:0:6574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9f6fb6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+2:2366:x1869752373893504:12345-192.168.201.41@tcp:9:kworker.0 Request processed in 603us (1602us total) trans 0 rc 0/0 00000100:00100000:0.0:1783134968.629598:0:6574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 19 00010000:00010000:0.0:1783134968.629622:0:10987:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1783134968.633009:0:5766:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1783134968.633022:0:5766:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1783134969.092554:0:5758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1783134970.026571:0:7470:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 28f4ba61-cfae-499e-ab3d-81cb8215f7bb 00000020:00000080:2.0:1783134970.026578:0:7470:0:(genops.c:906:class_export_put()) final put ffff9fe9f8a59000/28f4ba61-cfae-499e-ab3d-81cb8215f7bb 00000020:00000080:0.0:1783134970.026630:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9fe9f8a59000/28f4ba61-cfae-499e-ab3d-81cb8215f7bb for lustre-OST0001 00000020:00000080:0.0:1783134970.026736:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9fe9f8a58800 for lustre-OST0001 00010000:00010000:0.0:1783134970.115843:0:5757:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1783134970.243917:0:11499:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000001:02000400:2.0:1783134970.278011:0:11665:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1a: Test manual lfs pcc attach with manual HSM restore ========================================================== 23:16:09 (1783134969) 00000100:00100000:1.0:1783134971.011989:0:3286:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9cb338000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:88a2002e-2ea7-4f07-912a-8d001832cfc0:3286:1869752384406528:0@lo:400:kworker.0 00000100:00100000:1.0:1783134971.012057:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783134971.012107:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1783134971.012112:0:3286:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9cb339880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3286:1869752384406656:0@lo:400:kworker.0 00000100:00100000:1.0:1783134971.012137:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783134971.012163:0:3289:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1783134971.012171:0:3289:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9cb33a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3289:1869752384406784:0@lo:400:kworker.0 00000100:00100000:1.0:1783134971.012194:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783134971.012237:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384406656 00000100:00100000:1.0:1783134971.012244:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384406656 00000100:00100000:3.0:1783134971.012259:0:5763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384406528 00000100:00100000:3.0:1783134971.012264:0:5763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384406528 00000100:00100000:1.0:1783134971.012310:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384406784 00000100:00100000:3.0:1783134971.012314:0:5763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:1.0:1783134971.012316:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384406784 00000100:00100000:3.0:1783134971.012323:0:5763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9d0e60c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88a2002e-2ea7-4f07-912a-8d001832cfc0+19:3286:x1869752384406528:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783134971.012352:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1783134971.012362:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fe9fb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3286:x1869752384406656:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783134971.012371:0:5763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9d0e60c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88a2002e-2ea7-4f07-912a-8d001832cfc0+19:3286:x1869752384406528:12345-0@lo:400:kworker.0 Request processed in 50us (313us total) trans 0 rc 0/0 00000100:00100000:3.0:1783134971.012376:0:5763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00100000:1.0:1783134971.012406:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fe9fb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3286:x1869752384406656:12345-0@lo:400:kworker.0 Request processed in 45us (267us total) trans 0 rc 0/0 00000100:00100000:1.0:1783134971.012413:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1783134971.012429:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1783134971.012449:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fe9f9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3289:x1869752384406784:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783134971.012491:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fe9f9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3289:x1869752384406784:12345-0@lo:400:kworker.0 Request processed in 43us (295us total) trans 0 rc 0/0 00000100:00100000:1.0:1783134971.012498:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00080000:1.0:1783134971.012521:0:5766:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1783134971.012553:0:3289:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9cb33a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3289:1869752384406784:0@lo:400:kworker.0 00000100:00100000:3.0:1783134971.012738:0:3286:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9cb339880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3286:1869752384406656:0@lo:400:kworker.0 00000100:00100000:3.0:1783134971.012748:0:3286:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9cb338000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:88a2002e-2ea7-4f07-912a-8d001832cfc0:3286:1869752384406528:0@lo:400:kworker.0 00000100:00100000:1.0:1783134971.012886:0:3289:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9fe9fbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1869752384406912:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1783134971.012890:0:3287:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1783134971.012901:0:3287:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9fe438380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1869752384407040:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1783134971.012922:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783134971.012948:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783134971.012976:0:6578:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384406912 00000100:00100000:1.0:1783134971.012981:0:6578:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384406912 00000100:00100000:0.0:1783134971.012983:0:6579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384407040 00000100:00100000:0.0:1783134971.012989:0:6579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384407040 00000100:00100000:1.0:1783134971.013020:0:6578:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1783134971.013029:0:6578:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fe9f9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3289:x1869752384406912:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1783134971.013055:0:6578:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1783134971.013086:0:6579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1783134971.013094:0:3288:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9cb33ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3288:1869752384407296:0@lo:400:kworker.0 00000100:00100000:0.0:1783134971.013100:0:6579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fe43aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3287:x1869752384407040:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1783134971.013101:0:6578:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fe9f9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3289:x1869752384406912:12345-0@lo:13:osp-pre-1-0.0 Request processed in 69us (175us total) trans 0 rc 0/0 00000100:00100000:1.0:1783134971.013112:0:6578:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00002000:00000024:0.0:1783134971.013122:0:6579:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1783134971.013127:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1783134971.013132:0:5766:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1783134971.013137:0:5766:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1783134971.013153:0:6579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fe43aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3287:x1869752384407040:12345-0@lo:13:osp-pre-0-0.0 Request processed in 59us (204us total) trans 0 rc 0/0 00000100:00100000:1.0:1783134971.013162:0:3287:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9cb33b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1869752384407168:0@lo:400:kworker.0 00000100:00100000:0.0:1783134971.013162:0:6579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1783134971.013163:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384407296 00000100:00100000:2.0:1783134971.013167:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384407296 00000100:00080000:0.0:1783134971.013188:0:5766:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1783134971.013200:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783134971.013201:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00010000:00080000:1.0:1783134971.013233:0:3287:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fe9fe438380 x1869752384407040/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783134987 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783134971.013234:0:6577:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384407168 00000100:00100000:0.0:1783134971.013239:0:6577:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384407168 00000100:00100000:1.0:1783134971.013255:0:3287:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9fe438380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1869752384407040:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1783134971.013273:0:6577:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1783134971.013308:0:6577:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fe9faa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3287:x1869752384407168:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783134971.013347:0:6577:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fe9faa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3287:x1869752384407168:12345-0@lo:400:kworker.0 Request processed in 68us (149us total) trans 0 rc 0/0 00000100:00100000:0.0:1783134971.013360:0:6577:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00010000:00080000:0.0:1783134971.013389:0:3287:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fe9cb33b800 x1869752384407168/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783134987 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783134971.013392:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9cb338e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3288:x1869752384407296:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783134971.013412:0:3287:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9cb33b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1869752384407168:0@lo:400:kworker.0 00000100:00100000:1.0:1783134971.013439:0:3289:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9fe9fbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1869752384406912:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1783134971.013545:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9cb338e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3288:x1869752384407296:12345-0@lo:400:kworker.0 Request processed in 335us (417us total) trans 0 rc 0/0 00000100:00100000:2.0:1783134971.013560:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1783134971.013615:0:3288:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9cb33ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3288:1869752384407296:0@lo:400:kworker.0 00010000:00010000:1.0:1783134971.139514:0:6591:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783134971.282114:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:1.0:1783134971.282271:0:8031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373893760 00000100:00100000:1.0:1783134971.282316:0:8031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373893760 00000100:00100000:1.0:1783134971.282391:0:8031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 31 00000100:00100000:1.0:1783134971.282402:0:8031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fe439c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+5:10201:x1869752373893760:12345-192.168.201.41@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1783134971.282420:0:8031:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783134971.282438:0:8031:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43f200/0xd6c4b8f05867e82f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4428da03f5eb71a1 expref: -99 pid: 8031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134971.282500:0:8031:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43fa00/0xd6c4b8f05867e836 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134971.282513:0:8031:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43fa00/0xd6c4b8f05867e836 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134971.282526:0:8031:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43fa00/0xd6c4b8f05867e836 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783134971.282726:0:8031:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:1.0:1783134971.282730:0:8031:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000100:00080000:0.0:1783134971.282748:0:5766:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00010000:1.0:1783134971.282830:0:8031:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43fa00/0xd6c4b8f05867e836 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134971.282857:0:8031:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43f200/0xd6c4b8f05867e82f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb71a1 expref: 7 pid: 8031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134971.282877:0:8031:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43fa00/0xd6c4b8f05867e836 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb71a1 expref: 6 pid: 8031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134971.282885:0:8031:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fe9e1c2b000) 00010000:00010000:1.0:1783134971.282888:0:8031:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1783134971.282898:0:8031:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fe9fe43fa00, rc 0) 00000100:00100000:1.0:1783134971.282961:0:8031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fe439c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+6:10201:x1869752373893760:12345-192.168.201.41@tcp:101:lhsmtool_posix.0 Request processed in 561us (855us total) trans 0 rc 0/0 00000100:00100000:1.0:1783134971.282969:0:8031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 31 00000100:00100000:0.0:1783134971.291075:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:1.0:1783134971.291140:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373893888 00000100:00100000:1.0:1783134971.291150:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373893888 00000100:00100000:1.0:1783134971.291209:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 32 00000100:00100000:1.0:1783134971.291219:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fe43a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+6:10202:x1869752373893888:12345-192.168.201.41@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1783134971.291239:0:5770:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783134971.291258:0:5770:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43f200/0xd6c4b8f05867e83d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4428da03f5eb71a8 expref: -99 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134971.291365:0:5770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43ec00/0xd6c4b8f05867e844 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134971.291378:0:5770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43ec00/0xd6c4b8f05867e844 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134971.291387:0:5770:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43ec00/0xd6c4b8f05867e844 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134971.291402:0:5770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43f800/0xd6c4b8f05867e84b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134971.291408:0:5770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43f800/0xd6c4b8f05867e84b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134971.291414:0:5770:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43f800/0xd6c4b8f05867e84b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134971.291849:0:5770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43ee00/0xd6c4b8f05867e852 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134971.291864:0:5770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43ee00/0xd6c4b8f05867e852 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134971.291872:0:5770:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43ee00/0xd6c4b8f05867e852 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783134971.292328:0:5770:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 6656 00000004:00200000:1.0:1783134971.292333:0:5770:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:1.0:1783134971.292409:0:5770:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43ee00/0xd6c4b8f05867e852 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134971.292420:0:5770:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43ec00/0xd6c4b8f05867e844 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134971.292426:0:5770:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43ec00/0xd6c4b8f05867e844 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134971.292433:0:5770:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43ec00/0xd6c4b8f05867e844 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134971.292440:0:5770:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe9fe43ec00 already unused, calling callback (ffffffffc1f634f0) 00010000:00010000:1.0:1783134971.292667:0:5770:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43ec00/0xd6c4b8f05867e844 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134971.292677:0:5770:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43ec00/0xd6c4b8f05867e844 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134971.292690:0:5770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fe9e1c2b000) 00010000:00010000:1.0:1783134971.292694:0:5770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783134971.292710:0:5770:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43ec00/0xd6c4b8f05867e844 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134971.292727:0:5770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43ec00/0xd6c4b8f05867e844 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134971.292740:0:5770:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43f800/0xd6c4b8f05867e84b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134971.292746:0:5770:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43f800/0xd6c4b8f05867e84b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134971.292752:0:5770:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43f800/0xd6c4b8f05867e84b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134971.292757:0:5770:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe9fe43f800 already unused, calling callback (ffffffffc1f634f0) 00010000:00010000:1.0:1783134971.292760:0:5770:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43f800/0xd6c4b8f05867e84b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134971.292767:0:5770:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43f800/0xd6c4b8f05867e84b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134971.292774:0:5770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff9fe9e1c2b700) 00010000:00010000:1.0:1783134971.292778:0:5770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783134971.292780:0:5770:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43f800/0xd6c4b8f05867e84b lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134971.292787:0:5770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43f800/0xd6c4b8f05867e84b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134971.292836:0:5770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43f200/0xd6c4b8f05867e83d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb71a8 expref: 8 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134971.292851:0:5770:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43ee00/0xd6c4b8f05867e852 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb71a8 expref: 7 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134971.292867:0:5770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9fe9e1c2b100) 00010000:00010000:1.0:1783134971.292869:0:5770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1783134971.292871:0:5770:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fe9fe43ee00, rc 0) 00000100:00100000:1.0:1783134971.293006:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fe43a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+7:10202:x1869752373893888:12345-192.168.201.41@tcp:101:lhsmtool_posix.0 Request processed in 1788us (1941us total) trans 0 rc 0/0 00000100:00100000:1.0:1783134971.293016:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 32 00000100:00100000:3.0:1783134971.300035:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:1.0:1783134971.300147:0:8031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373894144 00000100:00100000:1.0:1783134971.300155:0:8031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373894144 00000100:00100000:1.0:1783134971.300205:0:8031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 33 00000100:00100000:1.0:1783134971.300213:0:8031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9f6fb7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+7:10202:x1869752373894144:12345-192.168.201.41@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1783134971.300234:0:8031:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783134971.300253:0:8031:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43f200/0xd6c4b8f05867e859 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4428da03f5eb71af expref: -99 pid: 8031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134971.300341:0:8031:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43f800/0xd6c4b8f05867e860 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134971.300353:0:8031:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43f800/0xd6c4b8f05867e860 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134971.300361:0:8031:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43f800/0xd6c4b8f05867e860 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134971.300400:0:8031:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43ec00/0xd6c4b8f05867e867 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134971.300405:0:8031:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43ec00/0xd6c4b8f05867e867 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134971.300421:0:8031:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43ec00/0xd6c4b8f05867e867 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134971.301090:0:8031:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43e800/0xd6c4b8f05867e86e lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134971.301102:0:8031:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43e800/0xd6c4b8f05867e86e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134971.301109:0:8031:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43e800/0xd6c4b8f05867e86e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783134971.301120:0:8031:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 6656 00010000:00010000:1.0:1783134971.301334:0:8031:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43f800/0xd6c4b8f05867e860 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134971.301342:0:8031:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43f800/0xd6c4b8f05867e860 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134971.301349:0:8031:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43f800/0xd6c4b8f05867e860 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134971.301354:0:8031:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe9fe43f800 already unused, calling callback (ffffffffc1f634f0) 00010000:00010000:1.0:1783134971.301359:0:8031:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43f800/0xd6c4b8f05867e860 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134971.301367:0:8031:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43f800/0xd6c4b8f05867e860 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134971.301380:0:8031:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9fe9e1c2b100) 00010000:00010000:1.0:1783134971.301383:0:8031:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783134971.301394:0:8031:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43f800/0xd6c4b8f05867e860 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134971.301400:0:8031:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43f800/0xd6c4b8f05867e860 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134971.301413:0:8031:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43ec00/0xd6c4b8f05867e867 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134971.301419:0:8031:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43ec00/0xd6c4b8f05867e867 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134971.301425:0:8031:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43ec00/0xd6c4b8f05867e867 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134971.301431:0:8031:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe9fe43ec00 already unused, calling callback (ffffffffc1f634f0) 00010000:00010000:1.0:1783134971.301434:0:8031:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43ec00/0xd6c4b8f05867e867 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134971.301440:0:8031:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43ec00/0xd6c4b8f05867e867 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134971.301447:0:8031:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff9fe9e1c2b700) 00010000:00010000:1.0:1783134971.301450:0:8031:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783134971.301452:0:8031:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43ec00/0xd6c4b8f05867e867 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134971.301458:0:8031:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43ec00/0xd6c4b8f05867e867 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134971.301967:0:8031:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43f200/0xd6c4b8f05867e859 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb71af expref: 10 pid: 8031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134971.302061:0:8031:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43e800/0xd6c4b8f05867e86e lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb71af expref: 9 pid: 8031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134971.302070:0:8031:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9fe9e1c2b600) 00010000:00010000:1.0:1783134971.302072:0:8031:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783134971.302075:0:8031:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fe9fe43e800, rc 0) 00000100:00100000:1.0:1783134971.302148:0:8031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9f6fb7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+9:10202:x1869752373894144:12345-192.168.201.41@tcp:101:lhsmtool_posix.0 Request processed in 1935us (2121us total) trans 4294967309 rc 0/0 00000100:00100000:1.0:1783134971.302157:0:8031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 33 00000100:00100000:0.0:1783134971.305157:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:2.0:1783134971.305310:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373894272 00000100:00100000:2.0:1783134971.305319:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373894272 00000100:00100000:2.0:1783134971.305375:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 34 00000100:00100000:2.0:1783134971.305385:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fe438380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+9:10202:x1869752373894272:12345-192.168.201.41@tcp:59:lhsmtool_posix.0 00000100:00100000:2.0:1783134971.305494:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fe438380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+9:10202:x1869752373894272:12345-192.168.201.41@tcp:59:lhsmtool_posix.0 Request processed in 109us (344us total) trans 0 rc 0/0 00000100:00100000:2.0:1783134971.305502:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 34 00010000:00010000:0.0:1783134972.163551:0:10987:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1783134972.292911:0:11499:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1783134972.560607:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:2.0:1783134972.560713:0:5769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373894400 00000100:00100000:2.0:1783134972.560724:0:5769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373894400 00000100:00100000:2.0:1783134972.560782:0:5769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 35 00000100:00100000:2.0:1783134972.560793:0:5769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fe9fbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+9:10244:x1869752373894400:12345-192.168.201.41@tcp:101:lfs.0 00010000:00010000:2.0:1783134972.560815:0:5769:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783134972.560834:0:5769:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829000/0xd6c4b8f05867e87c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4428da03f5eb71b6 expref: -99 pid: 5769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134972.560890:0:5769:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828a00/0xd6c4b8f05867e883 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134972.560901:0:5769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828a00/0xd6c4b8f05867e883 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134972.560910:0:5769:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828a00/0xd6c4b8f05867e883 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134972.560923:0:5769:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829200/0xd6c4b8f05867e88a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134972.560941:0:5769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829200/0xd6c4b8f05867e88a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134972.560948:0:5769:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829200/0xd6c4b8f05867e88a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134972.561372:0:5769:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828a00/0xd6c4b8f05867e883 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134972.561382:0:5769:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828a00/0xd6c4b8f05867e883 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134972.561388:0:5769:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828a00/0xd6c4b8f05867e883 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134972.561394:0:5769:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe9c7828a00 already unused, calling callback (ffffffffc1f634f0) 00010000:00010000:2.0:1783134972.561398:0:5769:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828a00/0xd6c4b8f05867e883 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134972.561405:0:5769:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828a00/0xd6c4b8f05867e883 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134972.561418:0:5769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fe9e1c2b000) 00010000:00010000:2.0:1783134972.561421:0:5769:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783134972.561425:0:5769:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828a00/0xd6c4b8f05867e883 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134972.561430:0:5769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828a00/0xd6c4b8f05867e883 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134972.561441:0:5769:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829200/0xd6c4b8f05867e88a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134972.561452:0:5769:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829200/0xd6c4b8f05867e88a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134972.561458:0:5769:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829200/0xd6c4b8f05867e88a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134972.561463:0:5769:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe9c7829200 already unused, calling callback (ffffffffc1f634f0) 00010000:00010000:2.0:1783134972.561466:0:5769:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829200/0xd6c4b8f05867e88a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134972.561471:0:5769:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829200/0xd6c4b8f05867e88a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134972.561478:0:5769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff9fe9cc3c1200) 00010000:00010000:2.0:1783134972.561480:0:5769:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783134972.561483:0:5769:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829200/0xd6c4b8f05867e88a lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134972.561488:0:5769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829200/0xd6c4b8f05867e88a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134972.561520:0:5769:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829000/0xd6c4b8f05867e87c lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb71b6 expref: 10 pid: 5769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134972.561529:0:5769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fe9e1c2b000) 00010000:00010000:2.0:1783134972.561531:0:5769:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783134972.561535:0:5769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829000/0xd6c4b8f05867e87c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb71b6 expref: 10 pid: 5769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134972.561543:0:5769:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fe9c7829000, rc 0) 00000100:00100000:2.0:1783134972.561621:0:5769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fe9fbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+9:10244:x1869752373894400:12345-192.168.201.41@tcp:101:lfs.0 Request processed in 828us (1023us total) trans 0 rc 301/301 00000100:00100000:2.0:1783134972.561628:0:5769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 35 00000100:00100000:3.0:1783134972.573740:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:2.0:1783134972.573876:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373894656 00000100:00100000:2.0:1783134972.573886:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373894656 00000100:00100000:2.0:1783134972.573945:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 36 00000100:00100000:2.0:1783134972.573956:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9f6fb4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+9:10244:x1869752373894656:12345-192.168.201.41@tcp:36:lfs.0 00010000:00010000:2.0:1783134972.574011:0:5771:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783134972.574038:0:5771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43fa00/0xd6c4b8f05867e836 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb71a1 expref: 9 pid: 8031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134972.574055:0:5771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fe9e1c2b000) 00010000:00010000:2.0:1783134972.574066:0:5771:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1783134972.574340:0:5771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829000/0xd6c4b8f05867e891 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134972.574355:0:5771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829000/0xd6c4b8f05867e891 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134972.574364:0:5771:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829000/0xd6c4b8f05867e891 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134972.574375:0:5771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829200/0xd6c4b8f05867e898 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134972.574381:0:5771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829200/0xd6c4b8f05867e898 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134972.574388:0:5771:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829200/0xd6c4b8f05867e898 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783134972.575302:0:5771:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00010000:00010000:2.0:1783134972.575314:0:5771:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829000/0xd6c4b8f05867e891 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134972.575323:0:5771:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829000/0xd6c4b8f05867e891 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134972.575330:0:5771:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829000/0xd6c4b8f05867e891 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134972.575335:0:5771:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe9c7829000 already unused, calling callback (ffffffffc1f634f0) 00010000:00010000:2.0:1783134972.575340:0:5771:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829000/0xd6c4b8f05867e891 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134972.575348:0:5771:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829000/0xd6c4b8f05867e891 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134972.575359:0:5771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fe9cc3c1200) 00010000:00010000:2.0:1783134972.575362:0:5771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783134972.575366:0:5771:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829000/0xd6c4b8f05867e891 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134972.575372:0:5771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829000/0xd6c4b8f05867e891 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1783134972.575386:0:5771:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000f032481e reply state 000000009cf38537 transno 4294967310 ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829200/0xd6c4b8f05867e898 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783134972.575401:0:5771:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1783134972.575501:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9f6fb4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+10:10244:x1869752373894656:12345-192.168.201.41@tcp:36:lfs.0 Request processed in 1545us (1774us total) trans 4294967310 rc 0/0 00000100:00100000:2.0:1783134972.575518:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 36 00010000:00010000:1.0:1783134972.580765:0:3273:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829200/0xd6c4b8f05867e898 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134972.580783:0:3273:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829200/0xd6c4b8f05867e898 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134972.580792:0:3273:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829200/0xd6c4b8f05867e898 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134972.580799:0:3273:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe9c7829200 already unused, calling callback (ffffffffc1f634f0) 00010000:00010000:1.0:1783134972.580805:0:3273:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829200/0xd6c4b8f05867e898 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134972.580813:0:3273:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829200/0xd6c4b8f05867e898 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134972.580829:0:3273:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff9fe9cc3c1500) 00010000:00010000:1.0:1783134972.580832:0:3273:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783134972.580844:0:3273:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829200/0xd6c4b8f05867e898 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134972.580851:0:3273:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829200/0xd6c4b8f05867e898 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783134972.660100:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:1.0:1783134972.660170:0:8031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373894784 00000100:00100000:1.0:1783134972.660181:0:8031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373894784 00000100:00100000:1.0:1783134972.660251:0:8031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 37 00000100:00100000:1.0:1783134972.660263:0:8031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9f6fb5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+9:10252:x1869752373894784:12345-192.168.201.41@tcp:101:lctl.0 00010000:00010000:1.0:1783134972.660308:0:8031:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783134972.660332:0:8031:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43e400/0xd6c4b8f05867e89f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4428da03f5eb71bd expref: -99 pid: 8031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134972.660395:0:8031:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43fc00/0xd6c4b8f05867e8a6 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134972.660409:0:8031:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43fc00/0xd6c4b8f05867e8a6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134972.660422:0:8031:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43fc00/0xd6c4b8f05867e8a6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783134972.660484:0:8031:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:1.0:1783134972.660488:0:8031:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:1.0:1783134972.660530:0:8031:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43fc00/0xd6c4b8f05867e8a6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134972.660560:0:8031:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43e400/0xd6c4b8f05867e89f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb71bd expref: 11 pid: 8031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134972.660578:0:8031:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43fc00/0xd6c4b8f05867e8a6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb71bd expref: 10 pid: 8031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134972.660600:0:8031:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fe9e1c2b500) 00010000:00010000:1.0:1783134972.660603:0:8031:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1783134972.660607:0:8031:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fe9fe43fc00, rc 0) 00000100:00100000:1.0:1783134972.661277:0:8031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9f6fb5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+10:10252:x1869752373894784:12345-192.168.201.41@tcp:101:lctl.0 Request processed in 432us (602us total) trans 0 rc 0/0 00000100:00100000:1.0:1783134972.661332:0:8031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 37 00000100:00100000:3.0:1783134972.714232:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:1.0:1783134972.714353:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373894912 00000100:00100000:1.0:1783134972.714362:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373894912 00000100:00100000:1.0:1783134972.714446:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 38 00000100:00100000:1.0:1783134972.714480:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9f6fb4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+10:10258:x1869752373894912:12345-192.168.201.41@tcp:101:bash.0 00010000:00010000:1.0:1783134972.714501:0:5770:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783134972.714520:0:5770:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43e400/0xd6c4b8f05867e8ad lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4428da03f5eb71c4 expref: -99 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134972.714577:0:5770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43f600/0xd6c4b8f05867e8b4 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134972.714591:0:5770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43f600/0xd6c4b8f05867e8b4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134972.714603:0:5770:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43f600/0xd6c4b8f05867e8b4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134972.714618:0:5770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43e200/0xd6c4b8f05867e8bb lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134972.714625:0:5770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43e200/0xd6c4b8f05867e8bb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134972.714650:0:5770:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43e200/0xd6c4b8f05867e8bb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134972.715383:0:5770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43ea00/0xd6c4b8f05867e8c2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134972.715396:0:5770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43ea00/0xd6c4b8f05867e8c2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134972.715404:0:5770:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43ea00/0xd6c4b8f05867e8c2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783134972.715485:0:5770:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00000004:00200000:0.0:1783134972.715490:0:5770:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1783134972.715536:0:5770:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43ea00/0xd6c4b8f05867e8c2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134972.715549:0:5770:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43f600/0xd6c4b8f05867e8b4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134972.715555:0:5770:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43f600/0xd6c4b8f05867e8b4 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134972.715613:0:5770:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43f600/0xd6c4b8f05867e8b4 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134972.715621:0:5770:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe9fe43f600 already unused, calling callback (ffffffffc1f634f0) 00010000:00010000:0.0:1783134972.715625:0:5770:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43f600/0xd6c4b8f05867e8b4 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134972.715632:0:5770:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43f600/0xd6c4b8f05867e8b4 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134972.715652:0:5770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fe9e1c2b500) 00010000:00010000:0.0:1783134972.715655:0:5770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783134972.715659:0:5770:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43f600/0xd6c4b8f05867e8b4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134972.715665:0:5770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43f600/0xd6c4b8f05867e8b4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134972.715690:0:5770:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43e200/0xd6c4b8f05867e8bb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134972.715696:0:5770:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43e200/0xd6c4b8f05867e8bb lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134972.715702:0:5770:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43e200/0xd6c4b8f05867e8bb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134972.715707:0:5770:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe9fe43e200 already unused, calling callback (ffffffffc1f634f0) 00010000:00010000:0.0:1783134972.715709:0:5770:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43e200/0xd6c4b8f05867e8bb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134972.715715:0:5770:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43e200/0xd6c4b8f05867e8bb lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134972.715721:0:5770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff9fe9e1c2be00) 00010000:00010000:0.0:1783134972.715724:0:5770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783134972.715726:0:5770:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43e200/0xd6c4b8f05867e8bb lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134972.715732:0:5770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43e200/0xd6c4b8f05867e8bb lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134972.715775:0:5770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43e400/0xd6c4b8f05867e8ad lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb71c4 expref: 12 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134972.715789:0:5770:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43ea00/0xd6c4b8f05867e8c2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb71c4 expref: 11 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134972.715797:0:5770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9fe9e1c2bd00) 00010000:00010000:0.0:1783134972.715799:0:5770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1783134972.715802:0:5770:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fe9fe43ea00, rc 0) 00000100:00100000:0.0:1783134972.715867:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9f6fb4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+11:10258:x1869752373894912:12345-192.168.201.41@tcp:101:bash.0 Request processed in 1390us (1643us total) trans 0 rc 0/0 00000100:00100000:0.0:1783134972.715874:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 38 00000100:00100000:0.0:1783134972.720524:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:1.0:1783134972.720611:0:8031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373895168 00000100:00100000:1.0:1783134972.720620:0:8031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373895168 00000100:00100000:1.0:1783134972.720678:0:8031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 39 00000100:00100000:1.0:1783134972.720690:0:8031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe8c67ba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+11:10258:x1869752373895168:12345-192.168.201.41@tcp:101:bash.0 00010000:00010000:1.0:1783134972.720711:0:8031:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783134972.720730:0:8031:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43f400/0xd6c4b8f05867e8c9 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4428da03f5eb71cb expref: -99 pid: 8031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134972.720856:0:8031:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43e400/0xd6c4b8f05867e8d0 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134972.720870:0:8031:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43e400/0xd6c4b8f05867e8d0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134972.720881:0:8031:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43e400/0xd6c4b8f05867e8d0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134972.720943:0:8031:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43e200/0xd6c4b8f05867e8d7 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134972.720960:0:8031:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43e200/0xd6c4b8f05867e8d7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134972.720965:0:8031:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43e200/0xd6c4b8f05867e8d7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1783134972.721414:0:8031:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x2:0x0], index 0: 0 00010000:00010000:1.0:1783134972.721528:0:8031:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43f600/0xd6c4b8f05867e8de lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134972.721534:0:8031:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43f600/0xd6c4b8f05867e8de lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134972.721551:0:8031:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43f600/0xd6c4b8f05867e8de lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134972.721581:0:8031:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43e400/0xd6c4b8f05867e8d0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134972.721589:0:8031:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43e400/0xd6c4b8f05867e8d0 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134972.721596:0:8031:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43e400/0xd6c4b8f05867e8d0 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134972.721602:0:8031:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe9fe43e400 already unused, calling callback (ffffffffc1f634f0) 00010000:00010000:1.0:1783134972.721606:0:8031:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43e400/0xd6c4b8f05867e8d0 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134972.721615:0:8031:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43e400/0xd6c4b8f05867e8d0 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134972.721634:0:8031:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9fe9e1c2bd00) 00010000:00010000:1.0:1783134972.721636:0:8031:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783134972.721639:0:8031:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43e400/0xd6c4b8f05867e8d0 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134972.721643:0:8031:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43e400/0xd6c4b8f05867e8d0 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1783134972.721652:0:8031:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000cc3004c6 reply state 000000004e2cfaaa transno 4294967311 ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43e200/0xd6c4b8f05867e8d7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783134972.721657:0:8031:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1783134972.721693:0:8031:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43f400/0xd6c4b8f05867e8c9 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb71cb expref: 14 pid: 8031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134972.721712:0:8031:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43f600/0xd6c4b8f05867e8de lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb71cb expref: 13 pid: 8031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134972.721719:0:8031:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9fe9e1c2bc00) 00010000:00010000:1.0:1783134972.721722:0:8031:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1783134972.721724:0:8031:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fe9fe43f600, rc 0) 00000100:00100000:1.0:1783134972.721849:0:8031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe8c67ba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+14:10258:x1869752373895168:12345-192.168.201.41@tcp:101:bash.0 Request processed in 1162us (1331us total) trans 4294967311 rc 0/0 00000100:00100000:1.0:1783134972.721857:0:8031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 39 00000100:00100000:2.0:1783134972.728251:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00010000:00010000:3.0:1783134972.728410:0:3272:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43e200/0xd6c4b8f05867e8d7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134972.728423:0:3272:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43e200/0xd6c4b8f05867e8d7 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134972.728448:0:3272:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43e200/0xd6c4b8f05867e8d7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134972.728454:0:3272:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe9fe43e200 already unused, calling callback (ffffffffc1f634f0) 00010000:00010000:3.0:1783134972.728459:0:3272:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43e200/0xd6c4b8f05867e8d7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134972.728468:0:3272:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43e200/0xd6c4b8f05867e8d7 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134972.728483:0:3272:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9fe9e1c2bf00) 00010000:00010000:3.0:1783134972.728486:0:3272:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783134972.728489:0:3272:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43e200/0xd6c4b8f05867e8d7 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134972.728496:0:3272:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43e200/0xd6c4b8f05867e8d7 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783134972.728741:0:6574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373895296 00000100:00100000:0.0:1783134972.728751:0:6574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373895296 00000100:00100000:0.0:1783134972.728796:0:6574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 20 00000100:00100000:0.0:1783134972.728804:0:6574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9cb33ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2366:x1869752373895296:12345-192.168.201.41@tcp:8:bash.0 00010000:00080000:0.0:1783134972.728832:0:6574:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0000: connection from 28f4ba61-cfae-499e-ab3d-81cb8215f7bb@192.168.201.41@tcp t0 exp 0000000000000000 cur 255 last 0 00000020:00000080:0.0:1783134972.728857:0:6574:0:(genops.c:1406:class_connect()) connect: client 28f4ba61-cfae-499e-ab3d-81cb8215f7bb, cookie 0xd6c4b8f05867e8ec 00002000:00100000:0.0:1783134972.728869:0:6574:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 28f4ba61-cfae-499e-ab3d-81cb8215f7bb/ffff9fe9fe92f800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113653 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1783134972.728891:0:6574:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:0.0:1783134972.729107:0:6574:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1783134972.729130:0:6574:0:(import.c:65:import_set_state_nolock()) ffff9fe9fe92b000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1783134972.729193:0:6574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9cb33ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+6:2366:x1869752373895296:12345-192.168.201.41@tcp:8:bash.0 Request processed in 387us (950us total) trans 0 rc 0/0 00000100:00100000:0.0:1783134972.729210:0:6574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 20 00000100:00100000:3.0:1783134972.731410:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:1.0:1783134972.731471:0:6576:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373895424 00000100:00100000:1.0:1783134972.731478:0:6576:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373895424 00000100:00080000:0.0:1783134972.731535:0:5766:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1783134972.731558:0:6576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 21 00000100:00100000:1.0:1783134972.731581:0:6576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9f6fb4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+6:0:x1869752373895424:12345-192.168.201.41@tcp:101:bash.0 00010000:00010000:1.0:1783134972.731610:0:6576:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783134972.731630:0:6576:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e08b3987/0xd6c4b8f05867e8f3 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4428da03f5eb71d2 expref: -99 pid: 6576 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1783134972.731650:0:6576:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1783134972.731664:0:6576:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=255s v=(0 0) 00010000:00010000:1.0:1783134972.731667:0:6576:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783134972.731687:0:6576:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e08b3987/0xd6c4b8f05867e8f3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb71d2 expref: 7 pid: 6576 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134972.731702:0:6576:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000e08b3987/0xd6c4b8f05867e8f3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb71d2 expref: 7 pid: 6576 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134972.731713:0:6576:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fe9fe43e400, rc 0) 00000100:00100000:1.0:1783134972.731758:0:6576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9f6fb4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+7:0:x1869752373895424:12345-192.168.201.41@tcp:101:bash.0 Request processed in 186us (354us total) trans 0 rc 0/0 00000100:00100000:1.0:1783134972.731766:0:6576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 21 00000100:00100000:1.0:1783134972.737505:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:2.0:1783134972.737611:0:7676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373895552 00000100:00100000:2.0:1783134972.737620:0:7676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373895552 00000100:00100000:2.0:1783134972.737680:0:7676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 22 00000100:00100000:2.0:1783134972.737698:0:7676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9e0476680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+7:10258:x1869752373895552:12345-192.168.201.41@tcp:101:bash.0 00010000:00010000:2.0:1783134972.737720:0:7676:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783134972.737744:0:7676:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000db3da5fe/0xd6c4b8f05867e8fa lrc: 2/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4428da03f5eb71d9 expref: -99 pid: 7676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134972.737776:0:7676:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000e08b3987/0xd6c4b8f05867e8f3 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb71d2 expref: 8 pid: 6576 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134972.737785:0:7676:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783134972.737789:0:7676:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783134972.737794:0:7676:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000db3da5fe/0xd6c4b8f05867e8fa lrc: 4/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb71d9 expref: 8 pid: 7676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134972.737827:0:7676:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000e08b3987/0xd6c4b8f05867e8f3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb71d2 expref: 8 pid: 6576 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134972.737838:0:7676:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000e08b3987/0xd6c4b8f05867e8f3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb71d2 expref: 8 pid: 6576 timeout: 355 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783134972.737854:0:7676:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9cb33b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:7676:1869752384407424:192.168.201.41@tcp:104: 00000100:00100000:2.0:1783134972.737971:0:7676:0:(client.c:2701:ptlrpc_set_wait()) set ffff9fe9ca9306c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783134972.743918:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:0.0:1783134972.744038:0:7676:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9cb33b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:7676:1869752384407424:192.168.201.41@tcp:104: 00010000:00010000:0.0:1783134972.744065:0:7676:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000db3da5fe/0xd6c4b8f05867e8fa lrc: 3/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb71d9 expref: 8 pid: 7676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134972.744083:0:7676:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fe9c7828a00, rc 0) 00000100:00100000:0.0:1783134972.744143:0:7676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9e0476680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+8:10258:x1869752373895552:12345-192.168.201.41@tcp:101:bash.0 Request processed in 6453us (6654us total) trans 0 rc 0/0 00000100:00100000:0.0:1783134972.744152:0:7676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 22 00000100:00100000:3.0:1783134972.744667:0:5756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373895680 00000100:00100000:3.0:1783134972.744683:0:5756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373895680 00010000:00010000:3.0:1783134972.744716:0:5756:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000e08b3987/0xd6c4b8f05867e8f3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb71d2 expref: 8 pid: 6576 timeout: 355 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783134972.744749:0:5756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 35 00000100:00100000:3.0:1783134972.744759:0:5756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9cb338000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+8:2369:x1869752373895680:12345-192.168.201.41@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783134972.744773:0:5756:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783134972.744793:0:5756:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000e08b3987/0xd6c4b8f05867e8f3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb71d2 expref: 8 pid: 6576 timeout: 355 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134972.744814:0:5756:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000e08b3987/0xd6c4b8f05867e8f3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb71d2 expref: 8 pid: 6576 timeout: 355 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134972.744839:0:5756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e08b3987/0xd6c4b8f05867e8f3 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb71d2 expref: 8 pid: 6576 timeout: 355 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134972.744852:0:5756:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783134972.744856:0:5756:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783134972.744916:0:5756:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000db3da5fe/0xd6c4b8f05867e8fa lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb71d9 expref: 7 pid: 7676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134972.744927:0:5756:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000db3da5fe/0xd6c4b8f05867e8fa lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb71d9 expref: 7 pid: 7676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134972.744959:0:5756:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000db3da5fe/0xd6c4b8f05867e8fa lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb71d9 expref: 7 pid: 7676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783134972.744973:0:5756:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe8c6df5880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5756:1869752384407552:192.168.201.41@tcp:105: 00000100:00100000:3.0:1783134972.745039:0:5756:0:(client.c:2701:ptlrpc_set_wait()) set ffff9fe9c9d023c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783134972.747466:0:5756:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe8c6df5880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5756:1869752384407552:192.168.201.41@tcp:105: 00010000:00010000:3.0:1783134972.747491:0:5756:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783134972.747534:0:5756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9cb338000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+7:2369:x1869752373895680:12345-192.168.201.41@tcp:103:ldlm_bl.0 Request processed in 2776us (3625us total) trans 0 rc 0/0 00000100:00100000:3.0:1783134972.747544:0:5756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 35 00000100:00100000:2.0:1783134972.747871:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:3.0:1783134972.750818:0:5772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373895936 00000100:00100000:3.0:1783134972.750832:0:5772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373895936 00000100:00100000:3.0:1783134972.750920:0:5772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 6 00000100:00100000:3.0:1783134972.750930:0:5772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9cb339880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+13:10258:x1869752373895936:12345-192.168.201.41@tcp:35:bash.0 00000100:00100000:3.0:1783134972.751259:0:5772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9cb339880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+14:10258:x1869752373895936:12345-192.168.201.41@tcp:35:bash.0 Request processed in 330us (3387us total) trans 4294967312 rc 0/0 00000100:00100000:3.0:1783134972.751267:0:5772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 6 00000100:00100000:2.0:1783134972.804737:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:1.0:1783134972.804828:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373896192 00000100:00100000:1.0:1783134972.804838:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373896192 00000100:00100000:1.0:1783134972.804903:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 40 00000100:00100000:1.0:1783134972.804913:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9cb33a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+14:10269:x1869752373896192:12345-192.168.201.41@tcp:101:lfs.0 00010000:00010000:1.0:1783134972.804936:0:5771:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783134972.804955:0:5771:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43f000/0xd6c4b8f05867e901 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4428da03f5eb71e0 expref: -99 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783134972.805080:0:5771:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00010000:00010000:1.0:1783134972.805706:0:5771:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43f000/0xd6c4b8f05867e901 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb71e0 expref: 16 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134972.805722:0:5771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fe9e1c2b500) 00010000:00010000:1.0:1783134972.805725:0:5771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1783134972.805731:0:5771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43f000/0xd6c4b8f05867e901 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb71e0 expref: 16 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134972.805745:0:5771:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fe9fe43f000, rc 0) 00000100:00100000:1.0:1783134972.805864:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9cb33a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+15:10269:x1869752373896192:12345-192.168.201.41@tcp:101:lfs.0 Request processed in 942us (1288us total) trans 4294967313 rc 301/301 00000100:00100000:1.0:1783134972.805872:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 40 00000100:00100000:1.0:1783134972.813482:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:3.0:1783134972.813560:0:5773:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373896448 00000100:00100000:3.0:1783134972.813762:0:5773:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373896448 00000100:00100000:3.0:1783134972.813867:0:5773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 7 00000100:00100000:3.0:1783134972.813878:0:5773:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9e0475880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+15:10269:x1869752373896448:12345-192.168.201.41@tcp:35:lfs.0 00000100:00100000:3.0:1783134972.814124:0:5773:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9e0475880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+16:10269:x1869752373896448:12345-192.168.201.41@tcp:35:lfs.0 Request processed in 247us (650us total) trans 4294967314 rc 0/0 00000100:00100000:3.0:1783134972.814131:0:5773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 7 00000100:00100000:0.0:1783134972.879385:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:2.0:1783134972.879607:0:5769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373896576 00000100:00100000:2.0:1783134972.879712:0:5769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373896576 00000100:00100000:2.0:1783134972.879822:0:5769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 41 00000100:00100000:2.0:1783134972.879833:0:5769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe8c67b8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+16:10275:x1869752373896576:12345-192.168.201.41@tcp:101:lfs.0 00010000:00010000:2.0:1783134972.879857:0:5769:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783134972.879876:0:5769:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828000/0xd6c4b8f05867e90f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4428da03f5eb71e7 expref: -99 pid: 5769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134972.879942:0:5769:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829a00/0xd6c4b8f05867e916 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134972.879963:0:5769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829a00/0xd6c4b8f05867e916 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134972.879976:0:5769:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829a00/0xd6c4b8f05867e916 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783134972.880031:0:5769:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00000004:00200000:2.0:1783134972.880035:0:5769:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:2.0:1783134972.880059:0:5769:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829a00/0xd6c4b8f05867e916 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134972.880084:0:5769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828000/0xd6c4b8f05867e90f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb71e7 expref: 18 pid: 5769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134972.880104:0:5769:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829a00/0xd6c4b8f05867e916 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb71e7 expref: 17 pid: 5769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134972.880126:0:5769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9fe9e1c2bd00) 00010000:00010000:2.0:1783134972.880129:0:5769:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1783134972.880132:0:5769:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fe9c7829a00, rc 0) 00000100:00100000:2.0:1783134972.880237:0:5769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe8c67b8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+17:10275:x1869752373896576:12345-192.168.201.41@tcp:101:lfs.0 Request processed in 405us (860us total) trans 0 rc 0/0 00000100:00100000:2.0:1783134972.880244:0:5769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 41 00000100:00100000:0.0:1783134972.883251:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:2.0:1783134972.883324:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373896832 00000100:00100000:2.0:1783134972.883333:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373896832 00000100:00100000:2.0:1783134972.883386:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 42 00000100:00100000:2.0:1783134972.883398:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe8c67b9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+17:10275:x1869752373896832:12345-192.168.201.41@tcp:101:lfs.0 00010000:00010000:2.0:1783134972.883418:0:5770:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783134972.883436:0:5770:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829800/0xd6c4b8f05867e91d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4428da03f5eb71ee expref: -99 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134972.883525:0:5770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828c00/0xd6c4b8f05867e924 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134972.883537:0:5770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828c00/0xd6c4b8f05867e924 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134972.883547:0:5770:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828c00/0xd6c4b8f05867e924 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783134972.883558:0:5770:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:2.0:1783134972.883692:0:5770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829800/0xd6c4b8f05867e91d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb71ee expref: 20 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134972.883723:0:5770:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828c00/0xd6c4b8f05867e924 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb71ee expref: 19 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134972.883729:0:5770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9fe9e1c2bc00) 00010000:00010000:2.0:1783134972.883731:0:5770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1783134972.883733:0:5770:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fe9c7828c00, rc 0) 00000100:00100000:2.0:1783134972.883783:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe8c67b9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+19:10275:x1869752373896832:12345-192.168.201.41@tcp:101:lfs.0 Request processed in 389us (542us total) trans 4294967315 rc 0/0 00000100:00100000:2.0:1783134972.883794:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 42 00000100:00100000:0.0:1783134972.887084:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:0.0:1783134972.887149:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:2.0:1783134972.887158:0:5754:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373897216 00000100:00100000:2.0:1783134972.887168:0:5754:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373897216 00000100:00100000:2.0:1783134972.887231:0:5754:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 2 00000100:00100000:2.0:1783134972.887243:0:5754:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fea00bce680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+19:2369:x1869752373897216:12345-192.168.201.41@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1783134972.887247:0:8031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373897088 00000100:00100000:1.0:1783134972.887253:0:8031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373897088 00010000:00010000:2.0:1783134972.887259:0:5754:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783134972.887305:0:5754:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828c00/0xd6c4b8f05867e924 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb71ee expref: 20 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783134972.887321:0:5769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 43 00010000:00010000:2.0:1783134972.887325:0:5754:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9fe9e1c2bc00) 00000100:00100000:3.0:1783134972.887332:0:5769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fea00bcd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+19:10275:x1869752373897088:12345-192.168.201.41@tcp:101:lfs.0 00010000:00010000:2.0:1783134972.887332:0:5754:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1783134972.887351:0:5769:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783134972.887368:0:5769:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b75a00/0xd6c4b8f05867e932 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4428da03f5eb71f5 expref: -99 pid: 5769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783134972.887442:0:5754:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fea00bce680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+20:2369:x1869752373897216:12345-192.168.201.41@tcp:103:ldlm_bl.0 Request processed in 201us (496us total) trans 0 rc 0/0 00000100:00100000:2.0:1783134972.887451:0:5754:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 2 00010000:00010000:3.0:1783134972.887453:0:5769:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b74000/0xd6c4b8f05867e939 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134972.887469:0:5769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b74000/0xd6c4b8f05867e939 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134972.887477:0:5769:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b74000/0xd6c4b8f05867e939 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783134972.887499:0:5769:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:3.0:1783134972.887626:0:5769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b75a00/0xd6c4b8f05867e932 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb71f5 expref: 21 pid: 5769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134972.887642:0:5769:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b74000/0xd6c4b8f05867e939 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb71f5 expref: 20 pid: 5769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134972.887649:0:5769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9fe9e1c2bc00) 00010000:00010000:3.0:1783134972.887651:0:5769:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1783134972.887653:0:5769:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fe9d2b74000, rc 0) 00000100:00100000:3.0:1783134972.887692:0:5769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fea00bcd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+20:10275:x1869752373897088:12345-192.168.201.41@tcp:101:lfs.0 Request processed in 363us (545us total) trans 4294967316 rc 0/0 00000100:00100000:3.0:1783134972.887697:0:5769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 43 00000100:00100000:0.0:1783134972.891744:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:2.0:1783134972.891830:0:6577:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373897344 00000100:00100000:2.0:1783134972.891840:0:6577:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373897344 00000100:00100000:2.0:1783134972.891896:0:6577:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 23 00000100:00100000:2.0:1783134972.891918:0:6577:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fea00bcd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+7:2368:x1869752373897344:12345-192.168.201.41@tcp:1:lfs.0 00010000:00010000:2.0:1783134972.891960:0:6577:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c80b561a/0xd6c4b8f05867e947 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134972.891981:0:6577:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000db3da5fe/0xd6c4b8f05867e8fa lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb71d9 expref: 7 pid: 7676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134972.891991:0:6577:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783134972.891995:0:6577:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1783134972.892000:0:6577:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c80b561a/0xd6c4b8f05867e947 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134972.892036:0:6577:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000db3da5fe/0xd6c4b8f05867e8fa lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb71d9 expref: 7 pid: 7676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134972.892050:0:6577:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000db3da5fe/0xd6c4b8f05867e8fa lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb71d9 expref: 7 pid: 7676 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783134972.892065:0:6577:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9cb33b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6577:1869752384407680:192.168.201.41@tcp:104: 00000100:00100000:2.0:1783134972.892152:0:6577:0:(client.c:2701:ptlrpc_set_wait()) set ffff9fe9ca930480 going to sleep for 11 seconds 00000100:00100000:2.0:1783134972.893511:0:6577:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9cb33b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6577:1869752384407680:192.168.201.41@tcp:104: 00010000:00010000:2.0:1783134972.893533:0:6577:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000c80b561a/0xd6c4b8f05867e947 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783134972.894785:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:2.0:1783134972.894875:0:6580:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373897472 00000100:00100000:2.0:1783134972.894884:0:6580:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373897472 00002000:00100000:2.0:1783134972.894931:0:6580:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x2:0x0] (0->12) req@ffff9fea00bcf800 x1869752373897472/t0(0) o4->28f4ba61-cfae-499e-ab3d-81cb8215f7bb@192.168.201.41@tcp:143/0 lens 504/0 e 0 to 0 dl 1783134983 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1783134972.894942:0:6580:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9fea00bcf800 with x1869752373897472 ext(0->12) 00010000:00010000:2.0:1783134972.894950:0:6580:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000db3da5fe/0xd6c4b8f05867e8fa lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb71d9 expref: 8 pid: 7676 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134972.894965:0:6580:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000db3da5fe/0xd6c4b8f05867e8fa lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb71d9 expref: 8 pid: 7676 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1783134972.894972:0:6580:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9fea00bcf800 00000100:00100000:2.0:1783134972.895118:0:6580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 0 00000100:00100000:2.0:1783134972.895130:0:6580:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fea00bcf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+8:2370:x1869752373897472:12345-192.168.201.41@tcp:4:lfs.0 00000001:00100000:3.0:1783134972.921925:0:6602:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 28f4ba61-cfae-499e-ab3d-81cb8215f7bb 00000100:00100000:2.0:1783134972.922472:0:6580:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fea00bcf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+9:2370:x1869752373897472:12345-192.168.201.41@tcp:4:lfs.0 Request processed in 27339us (27684us total) trans 4294967299 rc 0/0 00000100:00100000:2.0:1783134972.922483:0:6580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 0 00002000:00100000:2.0:1783134972.922496:0:6580:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x2:0x0] (0->12) req@ffff9fea00bcf800 x1869752373897472/t4294967299(0) o4->28f4ba61-cfae-499e-ab3d-81cb8215f7bb@192.168.201.41@tcp:143/0 lens 504/448 e 0 to 0 dl 1783134983 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1783134972.922507:0:6580:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9fea00bcf800 with x1869752373897472 ext(0->12) 00010000:00010000:2.0:1783134972.922517:0:6580:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000db3da5fe/0xd6c4b8f05867e8fa lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb71d9 expref: 9 pid: 7676 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134972.922536:0:6580:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000db3da5fe/0xd6c4b8f05867e8fa lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb71d9 expref: 9 pid: 7676 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1783134972.922544:0:6580:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9fea00bcf800 00000100:00100000:0.0:1783134972.926572:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:2.0:1783134972.926652:0:5755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373897600 00000100:00100000:2.0:1783134972.926662:0:5755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373897600 00010000:00010000:2.0:1783134972.926709:0:5755:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000db3da5fe/0xd6c4b8f05867e8fa lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb71d9 expref: 9 pid: 7676 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783134972.926756:0:5755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 36 00000100:00100000:2.0:1783134972.926766:0:5755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fea00bcd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+9:2367:x1869752373897600:12345-192.168.201.41@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783134972.926781:0:5755:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1783134972.926799:0:5755:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:2.0:1783134972.926802:0:5755:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb mtime from disk: 0 -> 1783134972 00002000:00010000:2.0:1783134972.926805:0:5755:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb atime from disk: 0 -> 1783134972 00002000:00010000:2.0:1783134972.926807:0:5755:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb ctime from disk: 0 -> 1783134972 00010000:00010000:2.0:1783134972.926813:0:5755:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000db3da5fe/0xd6c4b8f05867e8fa lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb71d9 expref: 9 pid: 7676 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134972.926826:0:5755:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000db3da5fe/0xd6c4b8f05867e8fa lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb71d9 expref: 9 pid: 7676 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134972.926850:0:5755:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000db3da5fe/0xd6c4b8f05867e8fa lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb71d9 expref: 9 pid: 7676 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134972.926867:0:5755:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1783134972.926872:0:5755:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1783134972.926876:0:5755:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000c80b561a/0xd6c4b8f05867e947 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134972.926883:0:5755:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c80b561a/0xd6c4b8f05867e947 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134972.926947:0:5755:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783134972.926993:0:5755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fea00bcd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+8:2367:x1869752373897600:12345-192.168.201.41@tcp:103:ldlm_bl.0 Request processed in 229us (431us total) trans 0 rc 0/0 00000100:00100000:2.0:1783134972.926998:0:5755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 36 00010000:00010000:0.0:1783134972.927169:0:6577:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000c80b561a/0xd6c4b8f05867e947 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134972.927180:0:6577:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c80b561a/0xd6c4b8f05867e947 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134972.927203:0:6577:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c80b561a/0xd6c4b8f05867e947 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134972.927219:0:6577:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c80b561a/0xd6c4b8f05867e947 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134972.927224:0:6577:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c80b561a/0xd6c4b8f05867e947 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134972.927229:0:6577:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe9c7829800 already unused, calling callback (ffffffffc1527ce0) 00010000:00010000:0.0:1783134972.927231:0:6577:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c80b561a/0xd6c4b8f05867e947 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134972.927237:0:6577:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c80b561a/0xd6c4b8f05867e947 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134972.927245:0:6577:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c80b561a/0xd6c4b8f05867e947 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134972.927249:0:6577:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c80b561a/0xd6c4b8f05867e947 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783134972.927412:0:6577:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fea00bcd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+7:2368:x1869752373897344:12345-192.168.201.41@tcp:1:lfs.0 Request processed in 35497us (35678us total) trans 0 rc 0/0 00000100:00100000:0.0:1783134972.927420:0:6577:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 23 00000100:00100000:0.0:1783134972.934039:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:2.0:1783134972.934361:0:5772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373897856 00000100:00100000:2.0:1783134972.934371:0:5772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373897856 00000100:00100000:2.0:1783134972.934427:0:5772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 8 00000100:00100000:2.0:1783134972.934437:0:5772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9ca88c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+20:10275:x1869752373897856:12345-192.168.201.41@tcp:35:lfs.0 00000004:00010000:2.0:1783134972.934498:0:5772:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0x4:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b74000/0xd6c4b8f05867e939 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb71f5 expref: 20 pid: 5769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1783134972.934813:0:5772:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967317 00000001:00080000:2.0:1783134972.934872:0:5772:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967318 00000001:00080000:2.0:1783134972.935515:0:5772:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967319 00010000:00010000:2.0:1783134972.935571:0:5772:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828a00/0xd6c4b8f05867e94e lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134972.935587:0:5772:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43f600/0xd6c4b8f05867e8de lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb71cb expref: 24 pid: 8031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134972.935596:0:5772:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828a00/0xd6c4b8f05867e94e lrc: 4/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134972.935631:0:5772:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43f600/0xd6c4b8f05867e8de lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb71cb expref: 24 pid: 8031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134972.935645:0:5772:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43f600/0xd6c4b8f05867e8de lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb71cb expref: 24 pid: 8031 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783134972.935666:0:5772:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9cb33b800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5772:1869752384407808:192.168.201.41@tcp:104: 00000100:00100000:2.0:1783134972.935761:0:5772:0:(client.c:2701:ptlrpc_set_wait()) set ffff9fe9e9d82600 going to sleep for 11 seconds 00000100:00100000:1.0:1783134972.940702:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:3.0:1783134972.940860:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373897984 00000100:00100000:3.0:1783134972.940869:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373897984 00000100:00100000:2.0:1783134972.940881:0:5772:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9cb33b800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5772:1869752384407808:192.168.201.41@tcp:104: 00010000:00010000:2.0:1783134972.940909:0:5772:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828a00/0xd6c4b8f05867e94e lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134972.940910:0:6592:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43f600/0xd6c4b8f05867e8de lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb71cb expref: 25 pid: 8031 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783134972.940956:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 37 00000100:00100000:3.0:1783134972.940967:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9e0476300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+25:2369:x1869752373897984:12345-192.168.201.41@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783134972.940981:0:6592:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783134972.940988:0:6592:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43f600/0xd6c4b8f05867e8de lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb71cb expref: 25 pid: 8031 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134972.941000:0:6592:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43f600/0xd6c4b8f05867e8de lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb71cb expref: 25 pid: 8031 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134972.941035:0:6592:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43f600/0xd6c4b8f05867e8de lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb71cb expref: 25 pid: 8031 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134972.941049:0:6592:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9fe9e1c2bc00) 00010000:00010000:3.0:1783134972.941054:0:6592:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828a00/0xd6c4b8f05867e94e lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134972.941064:0:6592:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828a00/0xd6c4b8f05867e94e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134972.941071:0:6592:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828a00/0xd6c4b8f05867e94e lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134972.941098:0:6592:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783134972.941150:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9e0476300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+24:2369:x1869752373897984:12345-192.168.201.41@tcp:103:ldlm_bl.0 Request processed in 184us (458us total) trans 0 rc 0/0 00000100:00100000:3.0:1783134972.941158:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 37 00010000:00010000:2.0:1783134972.941573:0:5772:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828a00/0xd6c4b8f05867e94e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134972.941582:0:5772:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828a00/0xd6c4b8f05867e94e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5772 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1783134972.941722:0:5772:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967320 00000001:00080000:2.0:1783134972.941919:0:5772:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967321 00000100:00100000:2.0:1783134972.942038:0:5772:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9cb33b800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5772:1869752384407936:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1783134972.942091:0:5772:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783134972.942126:0:5772:0:(client.c:2701:ptlrpc_set_wait()) set ffff9fe9e0db5540 going to sleep for 11 seconds 00000100:00100000:3.0:1783134972.942601:0:5774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384407936 00000100:00100000:3.0:1783134972.942607:0:5774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384407936 00000100:00100000:3.0:1783134972.942649:0:5774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1783134972.942675:0:5774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fe841f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5772:x1869752384407936:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1783134972.942767:0:5774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fe841f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5772:x1869752384407936:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 111us (675us total) trans 0 rc 0/0 00000100:00100000:3.0:1783134972.942774:0:5774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1783134972.942853:0:5772:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9cb33b800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5772:1869752384407936:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:2.0:1783134972.943467:0:5772:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967322 00000100:00100000:2.0:1783134972.943524:0:5772:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9fe843480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5772:1869752384408064:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1783134972.943558:0:5772:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783134972.943638:0:5772:0:(client.c:2701:ptlrpc_set_wait()) set ffff9fe9e9d82600 going to sleep for 11 seconds 00000100:00100000:3.0:1783134972.944163:0:5774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384408064 00000100:00100000:3.0:1783134972.944171:0:5774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384408064 00000100:00100000:3.0:1783134972.944217:0:5774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1783134972.944225:0:5774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fe843100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5772:x1869752384408064:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1783134972.947221:0:5774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fe843100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5772:x1869752384408064:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 2989us (3654us total) trans 4294967300 rc 0/0 00000100:00100000:3.0:1783134972.947234:0:5774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1783134972.947336:0:5772:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9fe843480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5772:1869752384408064:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:2.0:1783134972.947408:0:5772:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967323 00010000:00010000:2.0:1783134972.947457:0:5772:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828a00/0xd6c4b8f05867e94e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134972.947478:0:5772:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828a00/0xd6c4b8f05867e94e lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134972.947633:0:5772:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828a00/0xd6c4b8f05867e94e lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134972.947642:0:5772:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe9c7828a00 already unused, calling callback (ffffffffc1f634f0) 00010000:00010000:2.0:1783134972.947647:0:5772:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828a00/0xd6c4b8f05867e94e lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134972.947654:0:5772:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828a00/0xd6c4b8f05867e94e lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134972.947678:0:5772:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9fe9e1c2bc00) 00010000:00010000:2.0:1783134972.947681:0:5772:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1783134972.947686:0:5772:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828a00/0xd6c4b8f05867e94e lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134972.947692:0:5772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828a00/0xd6c4b8f05867e94e lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5772 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1783134972.947944:0:5772:0:(mdd_object.c:4010:mdd_close()) Object [0x200000401:0x5:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1783134972.948169:0:5772:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].2, 64 off8320 00000004:00080000:2.0:1783134972.948182:0:5772:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 255343901308ns, next at 256343898888ns, rc = 0 00000001:00080000:2.0:1783134972.948188:0:5772:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967324 00010000:00010000:2.0:1783134972.948222:0:5772:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9fe9e1c2bc00) 00010000:00010000:2.0:1783134972.948225:0:5772:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1783134972.948232:0:5772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b74000/0xd6c4b8f05867e939 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb71f5 expref: 28 pid: 5769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783134972.948360:0:5772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9ca88c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+27:10275:x1869752373897856:12345-192.168.201.41@tcp:35:lfs.0 Request processed in 13923us (14331us total) trans 4294967325 rc 0/0 00000100:00100000:2.0:1783134972.948369:0:5772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 8 00000020:00080000:2.0:1783134972.948374:0:5772:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:1.0:1783134972.952876:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:2.0:1783134972.952973:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373898112 00000100:00100000:2.0:1783134972.952982:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373898112 00000100:00100000:2.0:1783134972.953081:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 44 00000100:00100000:2.0:1783134972.953092:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9e0474380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+27:10275:x1869752373898112:12345-192.168.201.41@tcp:101:lfs.0 00010000:00010000:2.0:1783134972.953115:0:5771:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783134972.953137:0:5771:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828c00/0xd6c4b8f05867e955 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4428da03f5eb71fc expref: -99 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134972.953191:0:5771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828c00/0xd6c4b8f05867e955 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb71fc expref: 28 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134972.953205:0:5771:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828c00/0xd6c4b8f05867e955 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb71fc expref: 28 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134972.953222:0:5771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9fe9cc3c1200) 00010000:00010000:2.0:1783134972.953226:0:5771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1783134972.953229:0:5771:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fe9c7828c00, rc 0) 00000100:00100000:2.0:1783134972.953308:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9e0474380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+28:10275:x1869752373898112:12345-192.168.201.41@tcp:101:lfs.0 Request processed in 218us (441us total) trans 0 rc 0/0 00000100:00100000:2.0:1783134972.953315:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 44 00000100:00100000:1.0:1783134972.960922:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:3.0:1783134972.961011:0:5773:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373898368 00000100:00100000:3.0:1783134972.961022:0:5773:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373898368 00000100:00100000:3.0:1783134972.961120:0:5773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 9 00000100:00100000:3.0:1783134972.961131:0:5773:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9cb439c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+28:10275:x1869752373898368:12345-192.168.201.41@tcp:35:lfs.0 00000100:00100000:3.0:1783134972.961398:0:5773:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9cb439c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+29:10275:x1869752373898368:12345-192.168.201.41@tcp:35:lfs.0 Request processed in 269us (486us total) trans 4294967326 rc 0/0 00000100:00100000:3.0:1783134972.961407:0:5773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 9 00000100:00100000:3.0:1783134973.004358:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:1.0:1783134973.004618:0:8031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373898624 00000100:00100000:1.0:1783134973.004628:0:8031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373898624 00000100:00100000:1.0:1783134973.004773:0:8031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 45 00000100:00100000:1.0:1783134973.004785:0:8031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe8c6df5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+29:10285:x1869752373898624:12345-192.168.201.41@tcp:101:lfs.0 00010000:00010000:1.0:1783134973.004809:0:8031:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783134973.004827:0:8031:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43f200/0xd6c4b8f05867e95c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4428da03f5eb7203 expref: -99 pid: 8031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783134973.004958:0:8031:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00010000:00010000:1.0:1783134973.005082:0:8031:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43f200/0xd6c4b8f05867e95c lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb7203 expref: 31 pid: 8031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134973.005098:0:8031:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fe9e1c2b500) 00010000:00010000:1.0:1783134973.005101:0:8031:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1783134973.005106:0:8031:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43f200/0xd6c4b8f05867e95c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb7203 expref: 31 pid: 8031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134973.005119:0:8031:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fe9fe43f200, rc 0) 00000100:00100000:1.0:1783134973.005186:0:8031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe8c6df5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+30:10285:x1869752373898624:12345-192.168.201.41@tcp:101:lfs.0 Request processed in 405us (912us total) trans 4294967327 rc 301/301 00000100:00100000:1.0:1783134973.005194:0:8031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 45 00000100:00080000:0.0:1783134973.005850:0:5766:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1783134973.008337:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:0.0:1783134973.008421:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373898752 00000100:00100000:0.0:1783134973.008441:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373898752 00000100:00100000:0.0:1783134973.008549:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 46 00000100:00100000:0.0:1783134973.008560:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9e0475c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+30:10285:x1869752373898752:12345-192.168.201.41@tcp:34:lfs.0 00010000:00010000:0.0:1783134973.008627:0:5770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ac200/0xd6c4b8f05867e96a lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134973.008643:0:5770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ac200/0xd6c4b8f05867e96a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134973.008653:0:5770:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ac200/0xd6c4b8f05867e96a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134973.008678:0:5770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ace00/0xd6c4b8f05867e971 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134973.008684:0:5770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ace00/0xd6c4b8f05867e971 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134973.008690:0:5770:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ace00/0xd6c4b8f05867e971 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134973.008775:0:5770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ad000/0xd6c4b8f05867e978 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134973.008782:0:5770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ad000/0xd6c4b8f05867e978 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134973.008788:0:5770:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ad000/0xd6c4b8f05867e978 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1783134973.008833:0:5770:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ad000/0xd6c4b8f05867e978 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134973.008854:0:5770:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ac200/0xd6c4b8f05867e96a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134973.008860:0:5770:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ac200/0xd6c4b8f05867e96a lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134973.008871:0:5770:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ac200/0xd6c4b8f05867e96a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134973.008877:0:5770:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe9f68ac200 already unused, calling callback (ffffffffc1f634f0) 00010000:00010000:0.0:1783134973.008881:0:5770:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ac200/0xd6c4b8f05867e96a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134973.008887:0:5770:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ac200/0xd6c4b8f05867e96a lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134973.008898:0:5770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9fe9e1c2bd00) 00010000:00010000:0.0:1783134973.008901:0:5770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783134973.008904:0:5770:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ac200/0xd6c4b8f05867e96a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134973.008910:0:5770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ac200/0xd6c4b8f05867e96a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134973.008922:0:5770:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ace00/0xd6c4b8f05867e971 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134973.008927:0:5770:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ace00/0xd6c4b8f05867e971 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134973.008932:0:5770:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ace00/0xd6c4b8f05867e971 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134973.008941:0:5770:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe9f68ace00 already unused, calling callback (ffffffffc1f634f0) 00010000:00010000:0.0:1783134973.008944:0:5770:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ace00/0xd6c4b8f05867e971 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134973.008949:0:5770:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ace00/0xd6c4b8f05867e971 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134973.008956:0:5770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9fe9c8301200) 00010000:00010000:0.0:1783134973.008958:0:5770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783134973.008960:0:5770:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ace00/0xd6c4b8f05867e971 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134973.008966:0:5770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ace00/0xd6c4b8f05867e971 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134973.008978:0:5770:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ad000/0xd6c4b8f05867e978 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134973.008995:0:5770:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ad000/0xd6c4b8f05867e978 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134973.009001:0:5770:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ad000/0xd6c4b8f05867e978 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134973.009005:0:5770:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe9f68ad000 already unused, calling callback (ffffffffc1f634f0) 00010000:00010000:0.0:1783134973.009008:0:5770:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ad000/0xd6c4b8f05867e978 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134973.009014:0:5770:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ad000/0xd6c4b8f05867e978 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134973.009031:0:5770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9fe9cc3c1200) 00010000:00010000:0.0:1783134973.009033:0:5770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783134973.009036:0:5770:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ad000/0xd6c4b8f05867e978 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134973.009041:0:5770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ad000/0xd6c4b8f05867e978 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783134973.009112:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9e0475c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+30:10285:x1869752373898752:12345-192.168.201.41@tcp:34:lfs.0 Request processed in 553us (782us total) trans 0 rc 0/0 00000100:00100000:0.0:1783134973.009120:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 46 00000100:00100000:2.0:1783134973.013359:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:3.0:1783134973.013484:0:5772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373899008 00000100:00100000:3.0:1783134973.013492:0:5772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373899008 00000100:00100000:3.0:1783134973.013542:0:5772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 10 00000100:00100000:3.0:1783134973.013551:0:5772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fe840e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+30:10285:x1869752373899008:12345-192.168.201.41@tcp:35:lfs.0 00000100:00100000:3.0:1783134973.013801:0:5772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fe840e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+31:10285:x1869752373899008:12345-192.168.201.41@tcp:35:lfs.0 Request processed in 251us (453us total) trans 4294967328 rc 0/0 00000100:00100000:3.0:1783134973.013806:0:5772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 10 00000100:00100000:0.0:1783134973.041676:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:1.0:1783134973.041736:0:8031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373899264 00000100:00100000:1.0:1783134973.041746:0:8031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373899264 00000100:00100000:1.0:1783134973.041806:0:8031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 47 00000100:00100000:1.0:1783134973.041819:0:8031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9ca88ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+31:10288:x1869752373899264:12345-192.168.201.41@tcp:101:lfs.0 00010000:00010000:1.0:1783134973.041842:0:8031:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783134973.041861:0:8031:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43f200/0xd6c4b8f05867e97f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4428da03f5eb720a expref: -99 pid: 8031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134973.041936:0:8031:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43ec00/0xd6c4b8f05867e986 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134973.041951:0:8031:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43ec00/0xd6c4b8f05867e986 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134973.041977:0:8031:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43ec00/0xd6c4b8f05867e986 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134973.041992:0:8031:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43f800/0xd6c4b8f05867e98d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134973.042000:0:8031:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43f800/0xd6c4b8f05867e98d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134973.042006:0:8031:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43f800/0xd6c4b8f05867e98d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134973.042130:0:8031:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43e600/0xd6c4b8f05867e994 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134973.042139:0:8031:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43e600/0xd6c4b8f05867e994 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134973.042146:0:8031:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43e600/0xd6c4b8f05867e994 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783134973.042156:0:8031:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:1.0:1783134973.042256:0:8031:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43ec00/0xd6c4b8f05867e986 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134973.042297:0:8031:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43ec00/0xd6c4b8f05867e986 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134973.042310:0:8031:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43ec00/0xd6c4b8f05867e986 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134973.042316:0:8031:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe9fe43ec00 already unused, calling callback (ffffffffc1f634f0) 00010000:00010000:1.0:1783134973.042327:0:8031:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43ec00/0xd6c4b8f05867e986 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134973.042336:0:8031:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43ec00/0xd6c4b8f05867e986 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134973.042349:0:8031:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9fe9e1c2bd00) 00010000:00010000:1.0:1783134973.042352:0:8031:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783134973.042357:0:8031:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43ec00/0xd6c4b8f05867e986 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134973.042363:0:8031:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43ec00/0xd6c4b8f05867e986 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134973.042376:0:8031:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43f800/0xd6c4b8f05867e98d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134973.042382:0:8031:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43f800/0xd6c4b8f05867e98d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134973.042388:0:8031:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43f800/0xd6c4b8f05867e98d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134973.042394:0:8031:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe9fe43f800 already unused, calling callback (ffffffffc1f634f0) 00010000:00010000:1.0:1783134973.042397:0:8031:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43f800/0xd6c4b8f05867e98d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134973.042403:0:8031:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43f800/0xd6c4b8f05867e98d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134973.042410:0:8031:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9fe9e1c2be00) 00010000:00010000:1.0:1783134973.042412:0:8031:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783134973.042421:0:8031:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43f800/0xd6c4b8f05867e98d lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134973.042426:0:8031:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43f800/0xd6c4b8f05867e98d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134973.042466:0:8031:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43f200/0xd6c4b8f05867e97f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb720a expref: 34 pid: 8031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134973.042480:0:8031:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43e600/0xd6c4b8f05867e994 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb720a expref: 33 pid: 8031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134973.042498:0:8031:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9fe9cc3c1200) 00010000:00010000:1.0:1783134973.042504:0:8031:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1783134973.042506:0:8031:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fe9fe43e600, rc 0) 00000100:00100000:1.0:1783134973.042567:0:8031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9ca88ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+33:10288:x1869752373899264:12345-192.168.201.41@tcp:101:lfs.0 Request processed in 751us (922us total) trans 4294967329 rc 0/0 00000100:00100000:1.0:1783134973.042575:0:8031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 47 00000100:00100000:2.0:1783134973.045969:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:1.0:1783134973.046070:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373899392 00000100:00100000:1.0:1783134973.046079:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373899392 00000100:00100000:1.0:1783134973.046136:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 48 00000100:00100000:1.0:1783134973.046148:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fe843800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+33:10288:x1869752373899392:12345-192.168.201.41@tcp:54:lfs.0 00010000:00010000:1.0:1783134973.046223:0:5771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43f000/0xd6c4b8f05867e9a2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134973.046240:0:5771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43f000/0xd6c4b8f05867e9a2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134973.046252:0:5771:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43f000/0xd6c4b8f05867e9a2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134973.046304:0:5771:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43f000/0xd6c4b8f05867e9a2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134973.046312:0:5771:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43f000/0xd6c4b8f05867e9a2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134973.046319:0:5771:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43f000/0xd6c4b8f05867e9a2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134973.046325:0:5771:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe9fe43f000 already unused, calling callback (ffffffffc1f634f0) 00010000:00010000:1.0:1783134973.046329:0:5771:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43f000/0xd6c4b8f05867e9a2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134973.046336:0:5771:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43f000/0xd6c4b8f05867e9a2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134973.046347:0:5771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9fe9cc3c1200) 00010000:00010000:1.0:1783134973.046350:0:5771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1783134973.046354:0:5771:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43f000/0xd6c4b8f05867e9a2 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134973.046360:0:5771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43f000/0xd6c4b8f05867e9a2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783134973.046428:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fe843800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+33:10288:x1869752373899392:12345-192.168.201.41@tcp:54:lfs.0 Request processed in 282us (481us total) trans 0 rc 0/0 00000100:00100000:1.0:1783134973.046435:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 48 00000100:00100000:2.0:1783134973.048101:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:3.0:1783134973.048150:0:5772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373899648 00000100:00100000:3.0:1783134973.048157:0:5772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373899648 00000100:00100000:3.0:1783134973.048213:0:5772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 11 00000100:00100000:3.0:1783134973.048221:0:5772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fe840380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+33:10288:x1869752373899648:12345-192.168.201.41@tcp:35:lfs.0 00000100:00100000:3.0:1783134973.048441:0:5772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fe840380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+34:10288:x1869752373899648:12345-192.168.201.41@tcp:35:lfs.0 Request processed in 220us (344us total) trans 4294967330 rc 0/0 00000100:00100000:3.0:1783134973.048449:0:5772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 11 00010000:00010000:2.0:1783134973.187456:0:5758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783134973.229341:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:3.0:1783134973.229407:0:5769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373899904 00000100:00100000:3.0:1783134973.229417:0:5769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373899904 00000100:00100000:3.0:1783134973.229537:0:5769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 49 00000100:00100000:3.0:1783134973.229549:0:5769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9ca88ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+34:10319:x1869752373899904:12345-192.168.201.41@tcp:101:cat.0 00010000:00010000:3.0:1783134973.229574:0:5769:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783134973.229599:0:5769:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b75a00/0xd6c4b8f05867e9a9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4428da03f5eb7211 expref: -99 pid: 5769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134973.229748:0:5769:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b74e00/0xd6c4b8f05867e9b0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134973.229766:0:5769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b74e00/0xd6c4b8f05867e9b0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134973.229779:0:5769:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b74e00/0xd6c4b8f05867e9b0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783134973.229792:0:5769:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:3.0:1783134973.229963:0:5769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b75a00/0xd6c4b8f05867e9a9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb7211 expref: 37 pid: 5769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134973.229984:0:5769:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b74e00/0xd6c4b8f05867e9b0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb7211 expref: 36 pid: 5769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134973.229994:0:5769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9fe9cc3c1200) 00010000:00010000:3.0:1783134973.229998:0:5769:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1783134973.230003:0:5769:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fe9d2b74e00, rc 0) 00000100:00100000:3.0:1783134973.230097:0:5769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9ca88ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+36:10319:x1869752373899904:12345-192.168.201.41@tcp:101:cat.0 Request processed in 550us (762us total) trans 4294967331 rc 0/0 00000100:00100000:3.0:1783134973.230129:0:5769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 49 00000100:00100000:2.0:1783134973.235089:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:3.0:1783134973.235191:0:5756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373900032 00000100:00100000:3.0:1783134973.235201:0:5756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373900032 00000100:00100000:3.0:1783134973.235316:0:5756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 3 00000100:00100000:3.0:1783134973.235327:0:5756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9d1622450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+36:2368:x1869752373900032:12345-192.168.201.41@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783134973.235342:0:5756:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783134973.235369:0:5756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b74e00/0xd6c4b8f05867e9b0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb7211 expref: 36 pid: 5769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134973.235392:0:5756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9fe9cc3c1200) 00010000:00010000:3.0:1783134973.235399:0:5756:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783134973.235465:0:5756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9d1622450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+35:2368:x1869752373900032:12345-192.168.201.41@tcp:103:ldlm_bl.0 Request processed in 140us (386us total) trans 0 rc 0/0 00000100:00100000:3.0:1783134973.235473:0:5756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 3 00000100:00100000:2.0:1783134973.236226:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:0.0:1783134973.236311:0:5773:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373900288 00000100:00100000:0.0:1783134973.236318:0:5773:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373900288 00000100:00100000:0.0:1783134973.236357:0:5773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 12 00000100:00100000:0.0:1783134973.236365:0:5773:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fe842d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+35:10319:x1869752373900288:12345-192.168.201.41@tcp:35:cat.0 00000100:00100000:0.0:1783134973.236838:0:5773:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fe842d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+36:10319:x1869752373900288:12345-192.168.201.41@tcp:35:cat.0 Request processed in 473us (613us total) trans 4294967332 rc 0/0 00000100:00100000:0.0:1783134973.236845:0:5773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 12 00000100:00100000:0.0:1783134973.284165:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:2.0:1783134973.284304:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373900544 00000100:00100000:2.0:1783134973.284314:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373900544 00000100:00100000:2.0:1783134973.284368:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 50 00000100:00100000:2.0:1783134973.284376:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9ca88d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+36:10325:x1869752373900544:12345-192.168.201.41@tcp:101:dd.0 00010000:00010000:2.0:1783134973.284397:0:5770:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783134973.284400:0:5770:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1783134973.284424:0:5770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829a00/0xd6c4b8f05867e916 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb71e7 expref: 36 pid: 5769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134973.284446:0:5770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9fe9e1c2bd00) 00010000:00010000:2.0:1783134973.284450:0:5770:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1783134973.284464:0:5770:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828600/0xd6c4b8f05867e9be lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4428da03f5eb7218 expref: -99 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134973.284555:0:5770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828200/0xd6c4b8f05867e9c5 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134973.284565:0:5770:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43e600/0xd6c4b8f05867e994 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb720a expref: 36 pid: 8031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134973.284573:0:5770:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828200/0xd6c4b8f05867e9c5 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134973.284608:0:5770:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43e600/0xd6c4b8f05867e994 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb720a expref: 36 pid: 8031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134973.284649:0:5770:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43e600/0xd6c4b8f05867e994 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb720a expref: 36 pid: 8031 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783134973.284674:0:5770:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9fe840a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5770:1869752384408192:192.168.201.41@tcp:104: 00000100:00100000:2.0:1783134973.285578:0:5770:0:(client.c:2701:ptlrpc_set_wait()) set ffff9fe9e9d82a80 going to sleep for 11 seconds 00000100:00100000:2.0:1783134973.293242:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:3.0:1783134973.293522:0:5754:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373900672 00000100:00100000:3.0:1783134973.293531:0:5754:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373900672 00010000:00010000:3.0:1783134973.293575:0:5754:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43e600/0xd6c4b8f05867e994 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb720a expref: 37 pid: 8031 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783134973.293618:0:5754:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 38 00000100:00100000:3.0:1783134973.293628:0:5754:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fe840000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+37:2370:x1869752373900672:12345-192.168.201.41@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783134973.293642:0:5754:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783134973.293648:0:5754:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43e600/0xd6c4b8f05867e994 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb720a expref: 37 pid: 8031 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134973.293671:0:5754:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43e600/0xd6c4b8f05867e994 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb720a expref: 37 pid: 8031 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134973.293719:0:5754:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9fe9cc3c1200) 00010000:00010000:3.0:1783134973.293724:0:5754:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828200/0xd6c4b8f05867e9c5 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134973.293734:0:5754:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828200/0xd6c4b8f05867e9c5 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134973.293742:0:5754:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828200/0xd6c4b8f05867e9c5 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134973.293762:0:5754:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783134973.293820:0:5754:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fe840000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+37:2370:x1869752373900672:12345-192.168.201.41@tcp:103:ldlm_bl.0 Request processed in 194us (590us total) trans 0 rc 0/0 00000100:00100000:3.0:1783134973.293826:0:5754:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 38 00010000:00010000:0.0:1783134973.294486:0:5770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43e600/0xd6c4b8f05867e994 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb720a expref: 36 pid: 8031 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783134973.294503:0:5770:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9fe840a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5770:1869752384408192:192.168.201.41@tcp:104: 00010000:00010000:0.0:1783134973.294521:0:5770:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828200/0xd6c4b8f05867e9c5 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134973.294534:0:5770:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828200/0xd6c4b8f05867e9c5 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134973.294538:0:5770:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828200/0xd6c4b8f05867e9c5 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783134973.294553:0:5770:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:0.0:1783134973.294730:0:5770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828600/0xd6c4b8f05867e9be lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb7218 expref: 37 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134973.294744:0:5770:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828200/0xd6c4b8f05867e9c5 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb7218 expref: 36 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134973.294749:0:5770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9fe9cc3c1200) 00010000:00010000:0.0:1783134973.294752:0:5770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1783134973.294753:0:5770:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fe9c7828200, rc 0) 00000100:00100000:0.0:1783134973.294784:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9ca88d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+36:10325:x1869752373900544:12345-192.168.201.41@tcp:101:dd.0 Request processed in 10409us (10633us total) trans 4294967333 rc 0/0 00000100:00100000:0.0:1783134973.294789:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 50 00000100:00100000:2.0:1783134973.297813:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:1.0:1783134973.298025:0:8031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373900928 00000100:00100000:1.0:1783134973.298037:0:8031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373900928 00000100:00100000:1.0:1783134973.298109:0:8031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 51 00000100:00100000:1.0:1783134973.298135:0:8031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fe842680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+36:10325:x1869752373900928:12345-192.168.201.41@tcp:36:dd.0 00010000:00010000:1.0:1783134973.298521:0:8031:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43f200/0xd6c4b8f05867e9d3 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134973.298538:0:8031:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43f200/0xd6c4b8f05867e9d3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134973.298549:0:8031:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43f200/0xd6c4b8f05867e9d3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1783134973.298602:0:8031:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967334 00000004:00010000:1.0:1783134973.298625:0:8031:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000c05b3b22 reply state 000000007354ef7a transno 4294967335 ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43f200/0xd6c4b8f05867e9d3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783134973.298635:0:8031:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1783134973.298821:0:8031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fe842680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+39:10325:x1869752373900928:12345-192.168.201.41@tcp:36:dd.0 Request processed in 689us (1020us total) trans 4294967335 rc 0/0 00000100:00100000:1.0:1783134973.298829:0:8031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 51 00000020:00080000:1.0:1783134973.298842:0:8031:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1783134973.316244:0:3273:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43f200/0xd6c4b8f05867e9d3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134973.316263:0:3273:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43f200/0xd6c4b8f05867e9d3 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134973.316270:0:3273:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43f200/0xd6c4b8f05867e9d3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134973.316316:0:3273:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe9fe43f200 already unused, calling callback (ffffffffc1f634f0) 00010000:00010000:1.0:1783134973.316322:0:3273:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43f200/0xd6c4b8f05867e9d3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134973.316349:0:3273:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43f200/0xd6c4b8f05867e9d3 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134973.316369:0:3273:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9fe9cc3c1200) 00010000:00010000:1.0:1783134973.316372:0:3273:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783134973.316378:0:3273:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43f200/0xd6c4b8f05867e9d3 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134973.316384:0:3273:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43f200/0xd6c4b8f05867e9d3 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783134973.466174:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:1.0:1783134973.469328:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373901056 00000100:00100000:1.0:1783134973.469343:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373901056 00000100:00100000:1.0:1783134973.469789:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 52 00000100:00100000:1.0:1783134973.469802:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fe840700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+38:10339:x1869752373901056:12345-192.168.201.41@tcp:101:stat.0 00010000:00010000:1.0:1783134973.469827:0:5771:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783134973.469847:0:5771:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43f200/0xd6c4b8f05867e9da lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4428da03f5eb721f expref: -99 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134973.469935:0:5771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43f800/0xd6c4b8f05867e9e1 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134973.469950:0:5771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43f800/0xd6c4b8f05867e9e1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134973.469963:0:5771:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43f800/0xd6c4b8f05867e9e1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134973.469978:0:5771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43ec00/0xd6c4b8f05867e9e8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134973.469998:0:5771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43ec00/0xd6c4b8f05867e9e8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134973.470005:0:5771:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43ec00/0xd6c4b8f05867e9e8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134973.470126:0:5771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43fa00/0xd6c4b8f05867e9ef lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134973.470138:0:5771:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828200/0xd6c4b8f05867e9c5 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb7218 expref: 39 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134973.470146:0:5771:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43fa00/0xd6c4b8f05867e9ef lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134973.470182:0:5771:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828200/0xd6c4b8f05867e9c5 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb7218 expref: 39 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134973.470197:0:5771:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828200/0xd6c4b8f05867e9c5 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb7218 expref: 39 pid: 5770 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783134973.470212:0:5771:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9e0474e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5771:1869752384408320:192.168.201.41@tcp:104: 00000100:00100000:1.0:1783134973.470348:0:5771:0:(client.c:2701:ptlrpc_set_wait()) set ffff9fe8c55ea780 going to sleep for 11 seconds 00000100:00100000:3.0:1783134973.475247:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:2.0:1783134973.475333:0:5772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373901312 00000100:00100000:2.0:1783134973.475342:0:5772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373901312 00000100:00100000:2.0:1783134973.475401:0:5772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 13 00000100:00100000:2.0:1783134973.475411:0:5772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe8c6df5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+40:5573:x1869752373901312:12345-192.168.201.41@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1783134973.475775:0:5772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe8c6df5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+41:5573:x1869752373901312:12345-192.168.201.41@tcp:35:ldlm_bl.0 Request processed in 365us (535us total) trans 4294967336 rc 0/0 00000100:00100000:2.0:1783134973.475783:0:5772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 13 00000100:00100000:1.0:1783134973.476187:0:5771:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9e0474e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5771:1869752384408320:192.168.201.41@tcp:104: 00010000:00010000:1.0:1783134973.476215:0:5771:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43fa00/0xd6c4b8f05867e9ef lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783134973.477200:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:0.0:1783134973.477637:0:5755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373901440 00000100:00100000:0.0:1783134973.477648:0:5755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373901440 00010000:00010000:0.0:1783134973.477691:0:5755:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828200/0xd6c4b8f05867e9c5 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb7218 expref: 41 pid: 5770 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783134973.477781:0:5755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 39 00000100:00100000:0.0:1783134973.477792:0:5755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fe843b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+41:2369:x1869752373901440:12345-192.168.201.41@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783134973.477808:0:5755:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783134973.477825:0:5755:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828200/0xd6c4b8f05867e9c5 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb7218 expref: 41 pid: 5770 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134973.477839:0:5755:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828200/0xd6c4b8f05867e9c5 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb7218 expref: 41 pid: 5770 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134973.477861:0:5755:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828200/0xd6c4b8f05867e9c5 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb7218 expref: 41 pid: 5770 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134973.477879:0:5755:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9fe9cc3c1200) 00010000:00010000:0.0:1783134973.477885:0:5755:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43fa00/0xd6c4b8f05867e9ef lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134973.477895:0:5755:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43fa00/0xd6c4b8f05867e9ef lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134973.477903:0:5755:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43fa00/0xd6c4b8f05867e9ef lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134973.477936:0:5755:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783134973.477991:0:5755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fe843b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+40:2369:x1869752373901440:12345-192.168.201.41@tcp:103:ldlm_bl.0 Request processed in 200us (792us total) trans 0 rc 0/0 00000100:00100000:0.0:1783134973.478000:0:5755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 39 00010000:00010000:1.0:1783134973.478060:0:5771:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43fa00/0xd6c4b8f05867e9ef lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134973.478075:0:5771:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43fa00/0xd6c4b8f05867e9ef lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783134973.478127:0:5771:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:1.0:1783134973.478132:0:5771:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1783134973.478164:0:5771:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43fa00/0xd6c4b8f05867e9ef lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134973.478177:0:5771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43fa00/0xd6c4b8f05867e9ef lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134973.478188:0:5771:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43f800/0xd6c4b8f05867e9e1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134973.478195:0:5771:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43f800/0xd6c4b8f05867e9e1 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134973.478202:0:5771:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43f800/0xd6c4b8f05867e9e1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134973.478208:0:5771:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe9fe43f800 already unused, calling callback (ffffffffc1f634f0) 00010000:00010000:1.0:1783134973.478214:0:5771:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43f800/0xd6c4b8f05867e9e1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134973.478223:0:5771:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43f800/0xd6c4b8f05867e9e1 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134973.478233:0:5771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9fe9e1c2bd00) 00010000:00010000:1.0:1783134973.478236:0:5771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783134973.478240:0:5771:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43f800/0xd6c4b8f05867e9e1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134973.478257:0:5771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43f800/0xd6c4b8f05867e9e1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134973.478270:0:5771:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43ec00/0xd6c4b8f05867e9e8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134973.478277:0:5771:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43ec00/0xd6c4b8f05867e9e8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134973.478333:0:5771:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43ec00/0xd6c4b8f05867e9e8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134973.478338:0:5771:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe9fe43ec00 already unused, calling callback (ffffffffc1f634f0) 00010000:00010000:1.0:1783134973.478342:0:5771:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43ec00/0xd6c4b8f05867e9e8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134973.478348:0:5771:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43ec00/0xd6c4b8f05867e9e8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134973.478356:0:5771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9fe9e1c2be00) 00010000:00010000:1.0:1783134973.478359:0:5771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783134973.478362:0:5771:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43ec00/0xd6c4b8f05867e9e8 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134973.478368:0:5771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43ec00/0xd6c4b8f05867e9e8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134973.478405:0:5771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43f200/0xd6c4b8f05867e9da lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb721f expref: 40 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134973.478420:0:5771:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43fa00/0xd6c4b8f05867e9ef lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb721f expref: 39 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134973.478436:0:5771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9fe9cc3c1200) 00010000:00010000:1.0:1783134973.478438:0:5771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1783134973.478441:0:5771:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fe9fe43fa00, rc 0) 00000100:00100000:1.0:1783134973.478481:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fe840700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+39:10339:x1869752373901056:12345-192.168.201.41@tcp:101:stat.0 Request processed in 8683us (12315us total) trans 0 rc 0/0 00000100:00100000:1.0:1783134973.478499:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 52 00000100:00100000:2.0:1783134973.527205:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:3.0:1783134973.527423:0:5769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373901696 00000100:00100000:3.0:1783134973.527436:0:5769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373901696 00000100:00100000:3.0:1783134973.527565:0:5769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 53 00000100:00100000:3.0:1783134973.527578:0:5769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fe841180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+39:10345:x1869752373901696:12345-192.168.201.41@tcp:36:truncate.0 00010000:00010000:3.0:1783134973.527668:0:5769:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783134973.527711:0:5769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43fa00/0xd6c4b8f05867e9ef lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb721f expref: 39 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134973.527736:0:5769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9fe9cc3c1200) 00010000:00010000:3.0:1783134973.527742:0:5769:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1783134973.528043:0:5769:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b74e00/0xd6c4b8f05867e9f6 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134973.528079:0:5769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b74e00/0xd6c4b8f05867e9f6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134973.528090:0:5769:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b74e00/0xd6c4b8f05867e9f6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1783134973.528150:0:5769:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967337 00000004:00010000:3.0:1783134973.528173:0:5769:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000474089e1 reply state 00000000991f0b46 transno 4294967338 ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b74e00/0xd6c4b8f05867e9f6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783134973.528183:0:5769:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1783134973.528517:0:5769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fe841180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+41:10345:x1869752373901696:12345-192.168.201.41@tcp:36:truncate.0 Request processed in 940us (1324us total) trans 4294967338 rc 0/0 00000100:00100000:3.0:1783134973.528526:0:5769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 53 00000020:00080000:3.0:1783134973.528531:0:5769:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1783134973.530515:0:3272:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b74e00/0xd6c4b8f05867e9f6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134973.530534:0:3272:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b74e00/0xd6c4b8f05867e9f6 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134973.530542:0:3272:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b74e00/0xd6c4b8f05867e9f6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134973.530549:0:3272:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe9d2b74e00 already unused, calling callback (ffffffffc1f634f0) 00010000:00010000:3.0:1783134973.530555:0:3272:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b74e00/0xd6c4b8f05867e9f6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134973.530564:0:3272:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b74e00/0xd6c4b8f05867e9f6 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134973.530604:0:3272:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9fe9cc3c1200) 00010000:00010000:3.0:1783134973.530608:0:3272:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783134973.530613:0:3272:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b74e00/0xd6c4b8f05867e9f6 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134973.530619:0:3272:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b74e00/0xd6c4b8f05867e9f6 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783134973.611595:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:0.0:1783134973.614099:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373901824 00000100:00100000:0.0:1783134973.614118:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373901824 00000100:00100000:0.0:1783134973.614262:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 54 00000100:00100000:0.0:1783134973.614275:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fe842a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+40:10359:x1869752373901824:12345-192.168.201.41@tcp:101:stat.0 00010000:00010000:0.0:1783134973.614321:0:5770:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783134973.614348:0:5770:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ad600/0xd6c4b8f05867e9fd lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4428da03f5eb7226 expref: -99 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134973.614461:0:5770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68adc00/0xd6c4b8f05867ea04 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134973.614479:0:5770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68adc00/0xd6c4b8f05867ea04 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134973.614493:0:5770:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68adc00/0xd6c4b8f05867ea04 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134973.614509:0:5770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ac400/0xd6c4b8f05867ea0b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134973.614515:0:5770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ac400/0xd6c4b8f05867ea0b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134973.614521:0:5770:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ac400/0xd6c4b8f05867ea0b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134973.614636:0:5770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ade00/0xd6c4b8f05867ea12 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134973.614645:0:5770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ade00/0xd6c4b8f05867ea12 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134973.614652:0:5770:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ade00/0xd6c4b8f05867ea12 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783134973.614709:0:5770:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 1234567 00000004:00200000:0.0:1783134973.614714:0:5770:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1783134973.614742:0:5770:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ade00/0xd6c4b8f05867ea12 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134973.614765:0:5770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ade00/0xd6c4b8f05867ea12 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134973.614775:0:5770:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68adc00/0xd6c4b8f05867ea04 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134973.614781:0:5770:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68adc00/0xd6c4b8f05867ea04 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134973.614789:0:5770:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68adc00/0xd6c4b8f05867ea04 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134973.614795:0:5770:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe9f68adc00 already unused, calling callback (ffffffffc1f634f0) 00010000:00010000:0.0:1783134973.614800:0:5770:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68adc00/0xd6c4b8f05867ea04 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134973.614809:0:5770:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68adc00/0xd6c4b8f05867ea04 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134973.614822:0:5770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9fe9e1c2bd00) 00010000:00010000:0.0:1783134973.614826:0:5770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783134973.614831:0:5770:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68adc00/0xd6c4b8f05867ea04 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134973.614838:0:5770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68adc00/0xd6c4b8f05867ea04 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134973.614853:0:5770:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ac400/0xd6c4b8f05867ea0b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134973.614860:0:5770:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ac400/0xd6c4b8f05867ea0b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134973.614872:0:5770:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ac400/0xd6c4b8f05867ea0b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134973.614877:0:5770:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe9f68ac400 already unused, calling callback (ffffffffc1f634f0) 00010000:00010000:0.0:1783134973.614879:0:5770:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ac400/0xd6c4b8f05867ea0b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134973.614885:0:5770:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ac400/0xd6c4b8f05867ea0b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134973.614893:0:5770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9fe9c8301200) 00010000:00010000:0.0:1783134973.614896:0:5770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783134973.614899:0:5770:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ac400/0xd6c4b8f05867ea0b lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134973.614904:0:5770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ac400/0xd6c4b8f05867ea0b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134973.614938:0:5770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ad600/0xd6c4b8f05867e9fd lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb7226 expref: 42 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134973.614967:0:5770:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ade00/0xd6c4b8f05867ea12 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb7226 expref: 41 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134973.614976:0:5770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9fe9cc3c1200) 00010000:00010000:0.0:1783134973.614978:0:5770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1783134973.614981:0:5770:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fe9f68ade00, rc 0) 00000100:00100000:0.0:1783134973.615076:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fe842a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+41:10359:x1869752373901824:12345-192.168.201.41@tcp:101:stat.0 Request processed in 803us (3496us total) trans 0 rc 0/0 00000100:00100000:0.0:1783134973.615094:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 54 00000100:00100000:2.0:1783134973.682217:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:1.0:1783134973.682506:0:8031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373902080 00000100:00100000:1.0:1783134973.682519:0:8031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373902080 00000100:00100000:1.0:1783134973.682639:0:8031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 55 00000100:00100000:1.0:1783134973.682651:0:8031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fe841500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+41:10369:x1869752373902080:12345-192.168.201.41@tcp:101:lfs.0 00010000:00010000:1.0:1783134973.682688:0:8031:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783134973.682714:0:8031:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43f200/0xd6c4b8f05867ea19 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4428da03f5eb722d expref: -99 pid: 8031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783134973.682868:0:8031:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00010000:00010000:1.0:1783134973.683022:0:8031:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43f200/0xd6c4b8f05867ea19 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb722d expref: 43 pid: 8031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134973.683039:0:8031:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fe9e1c2b500) 00010000:00010000:1.0:1783134973.683043:0:8031:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1783134973.683049:0:8031:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43f200/0xd6c4b8f05867ea19 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb722d expref: 43 pid: 8031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134973.683066:0:8031:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fe9fe43f200, rc 0) 00000100:00100000:1.0:1783134973.683155:0:8031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fe841500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+42:10369:x1869752373902080:12345-192.168.201.41@tcp:101:lfs.0 Request processed in 505us (952us total) trans 4294967339 rc 301/301 00000100:00100000:1.0:1783134973.683183:0:8031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 55 00000100:00100000:2.0:1783134973.685847:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:3.0:1783134973.685956:0:5772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373902336 00000100:00100000:3.0:1783134973.685967:0:5772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373902336 00000100:00100000:3.0:1783134973.686086:0:5772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 14 00000100:00100000:3.0:1783134973.686098:0:5772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fe841c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+42:10369:x1869752373902336:12345-192.168.201.41@tcp:35:lfs.0 00000100:00100000:3.0:1783134973.686511:0:5772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fe841c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+43:10369:x1869752373902336:12345-192.168.201.41@tcp:35:lfs.0 Request processed in 414us (675us total) trans 4294967340 rc 0/0 00000100:00100000:3.0:1783134973.686519:0:5772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 14 00000100:00100000:2.0:1783134973.722914:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:1.0:1783134973.723427:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373902592 00000100:00100000:1.0:1783134973.723440:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373902592 00000100:00100000:1.0:1783134973.723527:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 56 00000100:00100000:1.0:1783134973.723539:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fe841880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+43:10375:x1869752373902592:12345-192.168.201.41@tcp:101:bash.0 00010000:00010000:1.0:1783134973.723572:0:5771:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783134973.723606:0:5771:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43f200/0xd6c4b8f05867ea27 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4428da03f5eb7234 expref: -99 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134973.723995:0:5771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43ec00/0xd6c4b8f05867ea2e lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134973.724014:0:5771:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ade00/0xd6c4b8f05867ea12 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb7226 expref: 44 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134973.724025:0:5771:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43ec00/0xd6c4b8f05867ea2e lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134973.724070:0:5771:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ade00/0xd6c4b8f05867ea12 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb7226 expref: 44 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134973.724084:0:5771:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ade00/0xd6c4b8f05867ea12 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb7226 expref: 44 pid: 5770 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783134973.724100:0:5771:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9e0474e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5771:1869752384408448:192.168.201.41@tcp:104: 00000100:00100000:1.0:1783134973.724368:0:5771:0:(client.c:2701:ptlrpc_set_wait()) set ffff9fe8c55eae40 going to sleep for 11 seconds 00000100:00100000:2.0:1783134973.734765:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:2.0:1783134973.734812:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:2.0:1783134973.734852:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:0.0:1783134973.735031:0:5765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373902848 00000100:00100000:0.0:1783134973.735043:0:5765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373902848 00000100:00100000:0.0:1783134973.735113:0:5765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 265 00000100:00100000:0.0:1783134973.735125:0:5765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9d1657450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f39b22bc-4faf-4b59-bb00-2a11f91e37c0+13:2369:x1869752373902848:12345-192.168.201.41@tcp:400:kworker.0 00000100:00100000:3.0:1783134973.735196:0:5754:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373902720 00000100:00100000:3.0:1783134973.735201:0:5754:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373902720 00000100:00100000:0.0:1783134973.735224:0:5765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9d1657450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f39b22bc-4faf-4b59-bb00-2a11f91e37c0+13:2369:x1869752373902848:12345-192.168.201.41@tcp:400:kworker.0 Request processed in 99us (408us total) trans 0 rc 0/0 00000100:00100000:0.0:1783134973.735236:0:5765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 265 00010000:00010000:3.0:1783134973.735237:0:5754:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ade00/0xd6c4b8f05867ea12 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb7226 expref: 45 pid: 5770 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783134973.735273:0:5754:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 40 00000100:00100000:3.0:1783134973.735317:0:5754:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fe842300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+45:2369:x1869752373902720:12345-192.168.201.41@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783134973.735332:0:5754:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783134973.735339:0:5754:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ade00/0xd6c4b8f05867ea12 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb7226 expref: 45 pid: 5770 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134973.735355:0:5754:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ade00/0xd6c4b8f05867ea12 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb7226 expref: 45 pid: 5770 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134973.735400:0:5754:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9fe9cc3c1200) 00010000:00010000:3.0:1783134973.735406:0:5754:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43ec00/0xd6c4b8f05867ea2e lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134973.735418:0:5754:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43ec00/0xd6c4b8f05867ea2e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134973.735427:0:5754:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43ec00/0xd6c4b8f05867ea2e lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783134973.735440:0:5769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373902976 00000100:00100000:0.0:1783134973.735445:0:5769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373902976 00010000:00010000:3.0:1783134973.735450:0:5754:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783134973.735486:0:5754:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fe842300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+45:2369:x1869752373902720:12345-192.168.201.41@tcp:103:ldlm_bl.0 Request processed in 206us (737us total) trans 0 rc 0/0 00000100:00100000:3.0:1783134973.735493:0:5754:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 40 00000100:00100000:0.0:1783134973.735509:0:5769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 86 00000100:00100000:0.0:1783134973.735518:0:5769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fe840a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c936801d-68e8-41a4-8fbc-6becd5e1be74+5:2370:x1869752373902976:12345-192.168.201.41@tcp:400:kworker.0 00000100:00080000:3.0:1783134973.735548:0:5766:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783134973.735565:0:5769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fe840a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c936801d-68e8-41a4-8fbc-6becd5e1be74+5:2370:x1869752373902976:12345-192.168.201.41@tcp:400:kworker.0 Request processed in 47us (710us total) trans 0 rc 0/0 00000100:00100000:0.0:1783134973.735573:0:5769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 86 00010000:00010000:1.0:1783134973.736247:0:5771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ade00/0xd6c4b8f05867ea12 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb7226 expref: 44 pid: 5770 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783134973.736336:0:5771:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9e0474e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5771:1869752384408448:192.168.201.41@tcp:104: 00010000:00010000:1.0:1783134973.736367:0:5771:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43ec00/0xd6c4b8f05867ea2e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134973.736379:0:5771:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43ec00/0xd6c4b8f05867ea2e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134973.736386:0:5771:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43ec00/0xd6c4b8f05867ea2e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783134973.736410:0:5771:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 1234567 00010000:00010000:1.0:1783134973.736777:0:5771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43f200/0xd6c4b8f05867ea27 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb7234 expref: 45 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134973.736798:0:5771:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43ec00/0xd6c4b8f05867ea2e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb7234 expref: 44 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134973.736808:0:5771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9fe9cc3c1200) 00010000:00010000:1.0:1783134973.736811:0:5771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1783134973.736815:0:5771:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fe9fe43ec00, rc 0) 00000100:00100000:1.0:1783134973.736862:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fe841880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+44:10375:x1869752373902592:12345-192.168.201.41@tcp:101:bash.0 Request processed in 13326us (13962us total) trans 4294967341 rc 0/0 00000100:00100000:1.0:1783134973.736870:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 56 00000100:00100000:3.0:1783134973.739470:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:0.0:1783134973.739811:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373903232 00000100:00100000:0.0:1783134973.739824:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373903232 00000100:00100000:0.0:1783134973.739941:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 57 00000100:00100000:0.0:1783134973.739953:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe8c6df7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+44:10375:x1869752373903232:12345-192.168.201.41@tcp:36:bash.0 00010000:00010000:0.0:1783134973.740409:0:5770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68adc00/0xd6c4b8f05867ea3c lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134973.740430:0:5770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68adc00/0xd6c4b8f05867ea3c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134973.740444:0:5770:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68adc00/0xd6c4b8f05867ea3c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1783134973.740516:0:5770:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967342 00000004:00010000:0.0:1783134973.740542:0:5770:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000023f08675 reply state 00000000d4b7af9a transno 4294967343 ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68adc00/0xd6c4b8f05867ea3c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783134973.740552:0:5770:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1783134973.740668:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe8c6df7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+47:10375:x1869752373903232:12345-192.168.201.41@tcp:36:bash.0 Request processed in 704us (1195us total) trans 4294967343 rc 0/0 00000100:00100000:0.0:1783134973.740676:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 57 00000020:00080000:0.0:1783134973.740683:0:5770:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1783134973.742101:0:3273:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68adc00/0xd6c4b8f05867ea3c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134973.742114:0:3273:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68adc00/0xd6c4b8f05867ea3c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134973.742136:0:3273:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68adc00/0xd6c4b8f05867ea3c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134973.742143:0:3273:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe9f68adc00 already unused, calling callback (ffffffffc1f634f0) 00010000:00010000:1.0:1783134973.742149:0:3273:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68adc00/0xd6c4b8f05867ea3c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134973.742157:0:3273:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68adc00/0xd6c4b8f05867ea3c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134973.742177:0:3273:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9fe9cc3c1200) 00010000:00010000:1.0:1783134973.742181:0:3273:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783134973.742187:0:3273:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68adc00/0xd6c4b8f05867ea3c lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134973.742194:0:3273:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68adc00/0xd6c4b8f05867ea3c lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783134973.747464:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:1.0:1783134973.747580:0:8031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373903360 00000100:00100000:1.0:1783134973.747591:0:8031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373903360 00000100:00100000:2.0:1783134973.747771:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 58 00000100:00100000:2.0:1783134973.747802:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe8c6df4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+46:10375:x1869752373903360:12345-192.168.201.41@tcp:101:bash.0 00010000:00010000:2.0:1783134973.747837:0:5771:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783134973.747918:0:5771:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829a00/0xd6c4b8f05867ea43 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4428da03f5eb723b expref: -99 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134973.748106:0:5771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828600/0xd6c4b8f05867ea4a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134973.748123:0:5771:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43ec00/0xd6c4b8f05867ea2e lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb7234 expref: 47 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134973.748134:0:5771:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828600/0xd6c4b8f05867ea4a lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134973.748178:0:5771:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43ec00/0xd6c4b8f05867ea2e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb7234 expref: 47 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134973.748193:0:5771:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43ec00/0xd6c4b8f05867ea2e lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb7234 expref: 47 pid: 5771 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783134973.748210:0:5771:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9cb338000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5771:1869752384408576:192.168.201.41@tcp:104: 00000100:00100000:2.0:1783134973.748744:0:5771:0:(client.c:2701:ptlrpc_set_wait()) set ffff9fe9e9d82600 going to sleep for 11 seconds 00000100:00100000:2.0:1783134973.750591:0:5771:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9cb338000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5771:1869752384408576:192.168.201.41@tcp:104: 00010000:00010000:2.0:1783134973.750622:0:5771:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828600/0xd6c4b8f05867ea4a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783134973.751198:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:0.0:1783134973.751250:0:5756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373903488 00000100:00100000:0.0:1783134973.751259:0:5756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373903488 00010000:00010000:0.0:1783134973.751336:0:5756:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43ec00/0xd6c4b8f05867ea2e lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb7234 expref: 48 pid: 5771 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783134973.751372:0:5756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 41 00000100:00100000:0.0:1783134973.751383:0:5756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe8c6df7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+48:2370:x1869752373903488:12345-192.168.201.41@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783134973.751401:0:5756:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783134973.751408:0:5756:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43ec00/0xd6c4b8f05867ea2e lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb7234 expref: 48 pid: 5771 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134973.751421:0:5756:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43ec00/0xd6c4b8f05867ea2e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb7234 expref: 48 pid: 5771 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134973.751448:0:5756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43ec00/0xd6c4b8f05867ea2e lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb7234 expref: 48 pid: 5771 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134973.751467:0:5756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9fe9cc3c1200) 00010000:00010000:0.0:1783134973.751487:0:5756:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828600/0xd6c4b8f05867ea4a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134973.751498:0:5756:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828600/0xd6c4b8f05867ea4a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134973.751506:0:5756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828600/0xd6c4b8f05867ea4a lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134973.751538:0:5756:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783134973.751605:0:5756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe8c6df7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+47:2370:x1869752373903488:12345-192.168.201.41@tcp:103:ldlm_bl.0 Request processed in 223us (408us total) trans 0 rc 0/0 00010000:00010000:2.0:1783134973.751607:0:5771:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828600/0xd6c4b8f05867ea4a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783134973.751614:0:5756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 41 00010000:00010000:2.0:1783134973.751625:0:5771:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828600/0xd6c4b8f05867ea4a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783134973.751983:0:5771:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:2.0:1783134973.751988:0:5771:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1783134973.752017:0:5771:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828600/0xd6c4b8f05867ea4a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134973.752046:0:5771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829a00/0xd6c4b8f05867ea43 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb723b expref: 47 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134973.752058:0:5771:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828600/0xd6c4b8f05867ea4a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb723b expref: 46 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134973.752064:0:5771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9fe9cc3c1200) 00010000:00010000:2.0:1783134973.752066:0:5771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1783134973.752068:0:5771:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fe9c7828600, rc 0) 00000100:00100000:2.0:1783134973.752099:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe8c6df4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+46:10375:x1869752373903360:12345-192.168.201.41@tcp:101:bash.0 Request processed in 4303us (4652us total) trans 0 rc 0/0 00000100:00100000:2.0:1783134973.752106:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 58 00000100:00100000:3.0:1783134973.759269:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:0.0:1783134973.759541:0:5773:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373903744 00000100:00100000:0.0:1783134973.759555:0:5773:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373903744 00000100:00100000:0.0:1783134973.759672:0:5773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 15 00000100:00100000:0.0:1783134973.759685:0:5773:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9cb43ac50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+46:10375:x1869752373903744:12345-192.168.201.41@tcp:35:bash.0 00000100:00100000:0.0:1783134973.760195:0:5773:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9cb43ac50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+47:10375:x1869752373903744:12345-192.168.201.41@tcp:35:bash.0 Request processed in 512us (939us total) trans 4294967344 rc 0/0 00000100:00100000:0.0:1783134973.760204:0:5773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 15 00000100:00100000:0.0:1783134973.817724:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:3.0:1783134973.817820:0:5769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373904000 00000100:00100000:3.0:1783134973.817834:0:5769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373904000 00000100:00100000:3.0:1783134973.817897:0:5769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 59 00000100:00100000:3.0:1783134973.817906:0:5769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9ca88f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+47:10385:x1869752373904000:12345-192.168.201.41@tcp:101:lfs.0 00010000:00010000:3.0:1783134973.817943:0:5769:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783134973.817978:0:5769:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b74e00/0xd6c4b8f05867ea51 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4428da03f5eb7242 expref: -99 pid: 5769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783134973.818133:0:5769:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00010000:00010000:3.0:1783134973.818356:0:5769:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b74e00/0xd6c4b8f05867ea51 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb7242 expref: 49 pid: 5769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134973.818376:0:5769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fe9e1c2b500) 00010000:00010000:3.0:1783134973.818379:0:5769:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1783134973.818386:0:5769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b74e00/0xd6c4b8f05867ea51 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb7242 expref: 49 pid: 5769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134973.818405:0:5769:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fe9d2b74e00, rc 0) 00000100:00100000:3.0:1783134973.818479:0:5769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9ca88f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+48:10385:x1869752373904000:12345-192.168.201.41@tcp:101:lfs.0 Request processed in 573us (771us total) trans 4294967345 rc 301/301 00000100:00100000:3.0:1783134973.818485:0:5769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 59 00000100:00100000:1.0:1783134973.822774:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:3.0:1783134973.822865:0:8031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373904128 00000100:00100000:3.0:1783134973.822876:0:8031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373904128 00000100:00100000:3.0:1783134973.822953:0:8031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 60 00000100:00100000:3.0:1783134973.822966:0:8031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9e0474e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+48:10385:x1869752373904128:12345-192.168.201.41@tcp:34:lfs.0 00010000:00010000:3.0:1783134973.823242:0:8031:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b75a00/0xd6c4b8f05867ea5f lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134973.823265:0:8031:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b75a00/0xd6c4b8f05867ea5f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134973.823349:0:8031:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b75a00/0xd6c4b8f05867ea5f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134973.823372:0:8031:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b74400/0xd6c4b8f05867ea66 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134973.823380:0:8031:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b74400/0xd6c4b8f05867ea66 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134973.823409:0:8031:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b74400/0xd6c4b8f05867ea66 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134973.823554:0:8031:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b74c00/0xd6c4b8f05867ea6d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134973.823564:0:8031:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b74c00/0xd6c4b8f05867ea6d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134973.823572:0:8031:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b74c00/0xd6c4b8f05867ea6d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1783134973.823628:0:8031:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b74c00/0xd6c4b8f05867ea6d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134973.823643:0:8031:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b75a00/0xd6c4b8f05867ea5f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134973.823649:0:8031:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b75a00/0xd6c4b8f05867ea5f lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134973.823733:0:8031:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b75a00/0xd6c4b8f05867ea5f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134973.823743:0:8031:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe9d2b75a00 already unused, calling callback (ffffffffc1f634f0) 00010000:00010000:3.0:1783134973.823748:0:8031:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b75a00/0xd6c4b8f05867ea5f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134973.823757:0:8031:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b75a00/0xd6c4b8f05867ea5f lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134973.823773:0:8031:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9fe9e1c2bd00) 00010000:00010000:3.0:1783134973.823782:0:8031:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783134973.823789:0:8031:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b75a00/0xd6c4b8f05867ea5f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134973.823796:0:8031:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b75a00/0xd6c4b8f05867ea5f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134973.823813:0:8031:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b74400/0xd6c4b8f05867ea66 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134973.823820:0:8031:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b74400/0xd6c4b8f05867ea66 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134973.823826:0:8031:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b74400/0xd6c4b8f05867ea66 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134973.823832:0:8031:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe9d2b74400 already unused, calling callback (ffffffffc1f634f0) 00010000:00010000:3.0:1783134973.823834:0:8031:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b74400/0xd6c4b8f05867ea66 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134973.823841:0:8031:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b74400/0xd6c4b8f05867ea66 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134973.823848:0:8031:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9fe9cb8f4600) 00010000:00010000:3.0:1783134973.823851:0:8031:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783134973.823854:0:8031:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b74400/0xd6c4b8f05867ea66 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134973.823859:0:8031:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b74400/0xd6c4b8f05867ea66 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134973.823878:0:8031:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b74c00/0xd6c4b8f05867ea6d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134973.823890:0:8031:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b74c00/0xd6c4b8f05867ea6d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134973.823895:0:8031:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b74c00/0xd6c4b8f05867ea6d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134973.823901:0:8031:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe9d2b74c00 already unused, calling callback (ffffffffc1f634f0) 00010000:00010000:3.0:1783134973.823904:0:8031:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b74c00/0xd6c4b8f05867ea6d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134973.823910:0:8031:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b74c00/0xd6c4b8f05867ea6d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134973.823989:0:8031:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9fe9cc3c1200) 00010000:00010000:3.0:1783134973.823993:0:8031:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783134973.823997:0:8031:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b74c00/0xd6c4b8f05867ea6d lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134973.824003:0:8031:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b74c00/0xd6c4b8f05867ea6d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783134973.824227:0:8031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9e0474e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+48:10385:x1869752373904128:12345-192.168.201.41@tcp:34:lfs.0 Request processed in 1260us (1463us total) trans 0 rc 0/0 00000100:00100000:3.0:1783134973.824238:0:8031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 60 00000100:00100000:2.0:1783134973.827353:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:3.0:1783134973.827613:0:5772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373904384 00000100:00100000:3.0:1783134973.827626:0:5772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373904384 00000100:00100000:3.0:1783134973.827713:0:5772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 16 00000100:00100000:3.0:1783134973.827723:0:5772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9cb338000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+48:10385:x1869752373904384:12345-192.168.201.41@tcp:35:lfs.0 00000100:00100000:3.0:1783134973.828992:0:5772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9cb338000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+49:10385:x1869752373904384:12345-192.168.201.41@tcp:35:lfs.0 Request processed in 1266us (1649us total) trans 4294967346 rc 0/0 00000100:00100000:3.0:1783134973.829023:0:5772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 16 00000100:00100000:0.0:1783134973.862150:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:3.0:1783134973.862365:0:5769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373904640 00000100:00100000:3.0:1783134973.862379:0:5769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373904640 00000100:00100000:3.0:1783134973.862493:0:5769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 61 00000100:00100000:3.0:1783134973.862505:0:5769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9ca88e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+49:10388:x1869752373904640:12345-192.168.201.41@tcp:101:lfs.0 00010000:00010000:3.0:1783134973.862554:0:5769:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783134973.862583:0:5769:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b74c00/0xd6c4b8f05867ea74 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4428da03f5eb7249 expref: -99 pid: 5769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134973.862753:0:5769:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b74400/0xd6c4b8f05867ea7b lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134973.862770:0:5769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b74400/0xd6c4b8f05867ea7b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134973.862783:0:5769:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b74400/0xd6c4b8f05867ea7b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134973.862801:0:5769:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b75a00/0xd6c4b8f05867ea82 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134973.862808:0:5769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b75a00/0xd6c4b8f05867ea82 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134973.862815:0:5769:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b75a00/0xd6c4b8f05867ea82 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134973.862983:0:5769:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b74e00/0xd6c4b8f05867ea89 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134973.863005:0:5769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b74e00/0xd6c4b8f05867ea89 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134973.863013:0:5769:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b74e00/0xd6c4b8f05867ea89 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783134973.863026:0:5769:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:3.0:1783134973.863152:0:5769:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b74400/0xd6c4b8f05867ea7b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134973.863160:0:5769:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b74400/0xd6c4b8f05867ea7b lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134973.863168:0:5769:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b74400/0xd6c4b8f05867ea7b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134973.863175:0:5769:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe9d2b74400 already unused, calling callback (ffffffffc1f634f0) 00010000:00010000:3.0:1783134973.863181:0:5769:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b74400/0xd6c4b8f05867ea7b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134973.863190:0:5769:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b74400/0xd6c4b8f05867ea7b lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134973.863205:0:5769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9fe9e1c2bd00) 00010000:00010000:3.0:1783134973.863208:0:5769:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783134973.863214:0:5769:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b74400/0xd6c4b8f05867ea7b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134973.863221:0:5769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b74400/0xd6c4b8f05867ea7b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134973.863236:0:5769:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b75a00/0xd6c4b8f05867ea82 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134973.863248:0:5769:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b75a00/0xd6c4b8f05867ea82 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134973.863255:0:5769:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b75a00/0xd6c4b8f05867ea82 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134973.863261:0:5769:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe9d2b75a00 already unused, calling callback (ffffffffc1f634f0) 00010000:00010000:3.0:1783134973.863264:0:5769:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b75a00/0xd6c4b8f05867ea82 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134973.863271:0:5769:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b75a00/0xd6c4b8f05867ea82 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134973.863329:0:5769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9fe9cb8f4600) 00010000:00010000:3.0:1783134973.863333:0:5769:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783134973.863336:0:5769:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b75a00/0xd6c4b8f05867ea82 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134973.863342:0:5769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b75a00/0xd6c4b8f05867ea82 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134973.863394:0:5769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b74c00/0xd6c4b8f05867ea74 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb7249 expref: 52 pid: 5769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134973.863409:0:5769:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b74e00/0xd6c4b8f05867ea89 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb7249 expref: 51 pid: 5769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134973.863417:0:5769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9fe9cc3c1200) 00010000:00010000:3.0:1783134973.863420:0:5769:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1783134973.863431:0:5769:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fe9d2b74e00, rc 0) 00000100:00100000:3.0:1783134973.863648:0:5769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9ca88e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+51:10388:x1869752373904640:12345-192.168.201.41@tcp:101:lfs.0 Request processed in 1144us (1512us total) trans 4294967347 rc 0/0 00000100:00100000:3.0:1783134973.863665:0:5769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 61 00000100:00100000:1.0:1783134973.871205:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:1.0:1783134973.871352:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:0.0:1783134973.871621:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373904896 00000100:00100000:0.0:1783134973.871635:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373904896 00000100:00100000:0.0:1783134973.871728:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 62 00000100:00100000:0.0:1783134973.871742:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9e0475880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+51:10388:x1869752373904896:12345-192.168.201.41@tcp:54:lfs.0 00010000:00010000:0.0:1783134973.871846:0:5771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68acc00/0xd6c4b8f05867ea97 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783134973.871867:0:5754:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373904768 00000100:00100000:3.0:1783134973.871872:0:5754:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373904768 00010000:00010000:0.0:1783134973.871893:0:5771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68acc00/0xd6c4b8f05867ea97 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134973.871909:0:5771:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68acc00/0xd6c4b8f05867ea97 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134973.871951:0:5771:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68acc00/0xd6c4b8f05867ea97 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134973.871958:0:5771:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68acc00/0xd6c4b8f05867ea97 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134973.871966:0:5771:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68acc00/0xd6c4b8f05867ea97 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134973.871973:0:5771:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe9f68acc00 already unused, calling callback (ffffffffc1f634f0) 00010000:00010000:0.0:1783134973.871979:0:5771:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68acc00/0xd6c4b8f05867ea97 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134973.871988:0:5771:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68acc00/0xd6c4b8f05867ea97 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134973.872003:0:5771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9fe9cc3c1200) 00010000:00010000:0.0:1783134973.872006:0:5771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1783134973.872012:0:5771:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68acc00/0xd6c4b8f05867ea97 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134973.872019:0:5771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68acc00/0xd6c4b8f05867ea97 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783134973.872112:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9e0475880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+52:10388:x1869752373904896:12345-192.168.201.41@tcp:54:lfs.0 Request processed in 373us (758us total) trans 0 rc 0/0 00000100:00100000:0.0:1783134973.872128:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 62 00000100:00100000:2.0:1783134973.872174:0:5754:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 4 00000100:00100000:2.0:1783134973.872184:0:5754:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9e0476300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+51:2370:x1869752373904768:12345-192.168.201.41@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783134973.872197:0:5754:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783134973.872216:0:5754:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b74e00/0xd6c4b8f05867ea89 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb7249 expref: 51 pid: 5769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134973.872239:0:5754:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9fe9cc3c1200) 00010000:00010000:2.0:1783134973.872243:0:5754:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783134973.872303:0:5754:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9e0476300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+50:2370:x1869752373904768:12345-192.168.201.41@tcp:103:ldlm_bl.0 Request processed in 121us (1115us total) trans 0 rc 0/0 00000100:00100000:2.0:1783134973.872312:0:5754:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 4 00000100:00100000:1.0:1783134973.878887:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:0.0:1783134973.878994:0:5773:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373905152 00000100:00100000:0.0:1783134973.879007:0:5773:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373905152 00000100:00100000:0.0:1783134973.879087:0:5773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 17 00000100:00100000:0.0:1783134973.879098:0:5773:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9f6f64380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+50:10388:x1869752373905152:12345-192.168.201.41@tcp:35:lfs.0 00000100:00100000:0.0:1783134973.879440:0:5773:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9f6f64380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+51:10388:x1869752373905152:12345-192.168.201.41@tcp:35:lfs.0 Request processed in 343us (567us total) trans 4294967348 rc 0/0 00000100:00100000:0.0:1783134973.879449:0:5773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 17 00000100:00100000:0.0:1783134973.964005:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:2.0:1783134973.964207:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373905408 00000100:00100000:2.0:1783134973.964220:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373905408 00000100:00100000:2.0:1783134973.964381:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 63 00000100:00100000:2.0:1783134973.964395:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9ca88c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+51:10406:x1869752373905408:12345-192.168.201.41@tcp:101:cat.0 00010000:00010000:2.0:1783134973.964428:0:5770:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783134973.964456:0:5770:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829e00/0xd6c4b8f05867ea9e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4428da03f5eb7250 expref: -99 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134973.964591:0:5770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829400/0xd6c4b8f05867eaa5 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134973.964622:0:5770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829400/0xd6c4b8f05867eaa5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134973.964645:0:5770:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829400/0xd6c4b8f05867eaa5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783134973.964676:0:5770:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:2.0:1783134973.964853:0:5770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829e00/0xd6c4b8f05867ea9e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb7250 expref: 54 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134973.964876:0:5770:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829400/0xd6c4b8f05867eaa5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb7250 expref: 53 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134973.964903:0:5770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9fe9cc3c1200) 00010000:00010000:2.0:1783134973.964906:0:5770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1783134973.964911:0:5770:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fe9c7829400, rc 0) 00000100:00100000:2.0:1783134973.965007:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9ca88c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+53:10406:x1869752373905408:12345-192.168.201.41@tcp:101:cat.0 Request processed in 614us (1072us total) trans 4294967349 rc 0/0 00000100:00100000:2.0:1783134973.965016:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 63 00000100:00100000:1.0:1783134973.980886:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:0.0:1783134973.982764:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373905536 00000100:00100000:0.0:1783134973.982780:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373905536 00000100:00100000:0.0:1783134973.982942:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 64 00000100:00100000:0.0:1783134973.982955:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9f6f66d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+53:10407:x1869752373905536:12345-192.168.201.41@tcp:101:lfs.0 00010000:00010000:0.0:1783134973.982986:0:5771:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783134973.983014:0:5771:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68acc00/0xd6c4b8f05867eab3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4428da03f5eb7257 expref: -99 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134973.983107:0:5771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ad200/0xd6c4b8f05867eaba lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134973.983125:0:5771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ad200/0xd6c4b8f05867eaba lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134973.983137:0:5771:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ad200/0xd6c4b8f05867eaba lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783134973.983216:0:5771:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00000004:00200000:0.0:1783134973.983237:0:5771:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:0.0:1783134973.983270:0:5771:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ad200/0xd6c4b8f05867eaba lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134973.983342:0:5771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68acc00/0xd6c4b8f05867eab3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb7257 expref: 55 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134973.983368:0:5771:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ad200/0xd6c4b8f05867eaba lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb7257 expref: 54 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134973.983378:0:5771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9fe9e1c2bd00) 00010000:00010000:0.0:1783134973.983382:0:5771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1783134973.983387:0:5771:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fe9f68ad200, rc 0) 00000100:00100000:0.0:1783134973.983493:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9f6f66d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+54:10407:x1869752373905536:12345-192.168.201.41@tcp:101:lfs.0 Request processed in 540us (2619us total) trans 0 rc 0/0 00000100:00100000:0.0:1783134973.983501:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 64 00000100:00100000:1.0:1783134973.988047:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:3.0:1783134973.988167:0:5772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373905920 00000100:00100000:3.0:1783134973.988180:0:5772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373905920 00000100:00100000:3.0:1783134973.988249:0:5772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 18 00000100:00100000:3.0:1783134973.988262:0:5772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9f6f64a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+54:10407:x1869752373905920:12345-192.168.201.41@tcp:35:lfs.0 00000100:00100000:3.0:1783134973.989838:0:5772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9f6f64a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+55:10407:x1869752373905920:12345-192.168.201.41@tcp:35:lfs.0 Request processed in 1570us (1800us total) trans 4294967350 rc 0/0 00000100:00100000:3.0:1783134973.989852:0:5772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 18 00000100:00100000:2.0:1783134973.993330:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:3.0:1783134973.993589:0:5755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373906048 00000100:00100000:3.0:1783134973.993601:0:5755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373906048 00000100:00100000:3.0:1783134973.993787:0:5755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 5 00000100:00100000:3.0:1783134973.993800:0:5755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9cb339880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+55:10407:x1869752373906048:12345-192.168.201.41@tcp:103:lfs.0 00010000:00010000:3.0:1783134973.993819:0:5755:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1783134973.993851:0:5755:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828600/0xd6c4b8f05867ea4a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb723b expref: 55 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134973.993878:0:5755:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829400/0xd6c4b8f05867eaa5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb7250 expref: 54 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134973.993893:0:5755:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828c00/0xd6c4b8f05867e955 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb71fc expref: 53 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134973.993928:0:5755:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9fe9cc3c1200) 00010000:00010000:3.0:1783134973.993954:0:5755:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783134973.994031:0:5755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9cb339880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+52:10407:x1869752373906048:12345-192.168.201.41@tcp:103:lfs.0 Request processed in 233us (719us total) trans 0 rc 0/0 00000100:00100000:3.0:1783134973.994048:0:5755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 5 00000100:00100000:1.0:1783134973.995785:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:3.0:1783134973.995835:0:5769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373906176 00000100:00100000:3.0:1783134973.995847:0:5769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373906176 00000100:00100000:3.0:1783134973.995958:0:5769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 65 00000100:00100000:3.0:1783134973.995970:0:5769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9f6f64000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+52:10407:x1869752373906176:12345-192.168.201.41@tcp:58:lfs.0 00010000:00010000:3.0:1783134973.996142:0:5769:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b74c00/0xd6c4b8f05867eac1 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134973.996161:0:5769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b74c00/0xd6c4b8f05867eac1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134973.996174:0:5769:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b74c00/0xd6c4b8f05867eac1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1783134973.996580:0:5769:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1783134973.996839:0:5769:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 64 off8256 00000040:00080000:3.0:1783134973.996915:0:5769:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1, 136 off8328 00000100:00100000:3.0:1783134973.997032:0:5769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9f6f64000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+52:10407:x1869752373906176:12345-192.168.201.41@tcp:58:lfs.0 Request processed in 1062us (1256us total) trans 0 rc 0/0 00000100:00100000:3.0:1783134973.997041:0:5769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 65 00000100:00100000:1.0:1783134974.012387:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:3.0:1783134974.019030:0:8031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373906304 00000100:00100000:3.0:1783134974.019052:0:8031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373906304 00000100:00100000:3.0:1783134974.019160:0:8031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 66 00000100:00100000:3.0:1783134974.019187:0:8031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9f6f66680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+52:10409:x1869752373906304:12345-192.168.201.41@tcp:101:lfs.0 00010000:00010000:3.0:1783134974.019240:0:8031:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783134974.019269:0:8031:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b75a00/0xd6c4b8f05867eac8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4428da03f5eb725e expref: -99 pid: 8031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134974.019402:0:8031:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b74400/0xd6c4b8f05867eacf lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134974.019420:0:8031:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b74400/0xd6c4b8f05867eacf lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134974.019434:0:8031:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b74400/0xd6c4b8f05867eacf lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134974.019453:0:8031:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b75c00/0xd6c4b8f05867ead6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134974.019462:0:8031:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b75c00/0xd6c4b8f05867ead6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134974.019470:0:8031:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b75c00/0xd6c4b8f05867ead6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134974.019783:0:8031:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b74200/0xd6c4b8f05867eadd lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134974.019793:0:8031:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b74200/0xd6c4b8f05867eadd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134974.019801:0:8031:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b74200/0xd6c4b8f05867eadd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783134974.019845:0:8031:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:3.0:1783134974.019858:0:8031:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1783134974.019883:0:8031:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b74200/0xd6c4b8f05867eadd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134974.019898:0:8031:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b74200/0xd6c4b8f05867eadd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134974.019907:0:8031:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b74400/0xd6c4b8f05867eacf lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134974.019913:0:8031:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b74400/0xd6c4b8f05867eacf lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134974.019920:0:8031:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b74400/0xd6c4b8f05867eacf lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134974.019927:0:8031:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe9d2b74400 already unused, calling callback (ffffffffc1f634f0) 00010000:00010000:3.0:1783134974.019932:0:8031:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b74400/0xd6c4b8f05867eacf lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134974.019941:0:8031:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b74400/0xd6c4b8f05867eacf lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134974.019956:0:8031:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9fe9e1c2bd00) 00010000:00010000:3.0:1783134974.019960:0:8031:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783134974.019965:0:8031:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b74400/0xd6c4b8f05867eacf lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134974.019972:0:8031:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b74400/0xd6c4b8f05867eacf lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134974.019986:0:8031:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b75c00/0xd6c4b8f05867ead6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134974.020003:0:8031:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b75c00/0xd6c4b8f05867ead6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134974.020010:0:8031:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b75c00/0xd6c4b8f05867ead6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134974.020016:0:8031:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe9d2b75c00 already unused, calling callback (ffffffffc1f634f0) 00010000:00010000:3.0:1783134974.020020:0:8031:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b75c00/0xd6c4b8f05867ead6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134974.020028:0:8031:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b75c00/0xd6c4b8f05867ead6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134974.020036:0:8031:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9fe9cb8f4700) 00010000:00010000:3.0:1783134974.020039:0:8031:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783134974.020042:0:8031:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b75c00/0xd6c4b8f05867ead6 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134974.020048:0:8031:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b75c00/0xd6c4b8f05867ead6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134974.020088:0:8031:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b75a00/0xd6c4b8f05867eac8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb725e expref: 54 pid: 8031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134974.020104:0:8031:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b74200/0xd6c4b8f05867eadd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb725e expref: 53 pid: 8031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134974.020112:0:8031:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9fe9cb8f4600) 00010000:00010000:3.0:1783134974.020115:0:8031:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1783134974.020125:0:8031:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fe9d2b74200, rc 0) 00000100:00100000:3.0:1783134974.021340:0:8031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9f6f66680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+53:10409:x1869752373906304:12345-192.168.201.41@tcp:101:lfs.0 Request processed in 2158us (8957us total) trans 0 rc 0/0 00000100:00100000:3.0:1783134974.021353:0:8031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 66 00010000:00010000:0.0:1783134974.212876:0:5757:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1783134974.339498:0:11499:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1783134974.339512:0:11499:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1783134974.339570:0:11499:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:0.0:1783134974.339578:0:11499:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1783134974.339746:0:11499:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9fe840e00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11499:1869752384408704:192.168.201.41@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1783134974.340083:0:11499:0:(client.c:2701:ptlrpc_set_wait()) set ffff9fe9e9c69540 going to sleep for 11 seconds 00000100:00100000:1.0:1783134974.343899:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:2.0:1783134974.344027:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373906432 00000100:00100000:2.0:1783134974.344038:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373906432 00000100:00100000:2.0:1783134974.344120:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 1 00000100:00100000:2.0:1783134974.344133:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9f6f64700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+54:10420:x1869752373906432:12345-192.168.201.41@tcp:900:lhsmtool_posix.0 00000100:00100000:2.0:1783134974.344252:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9f6f64700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+54:10420:x1869752373906432:12345-192.168.201.41@tcp:900:lhsmtool_posix.0 Request processed in 121us (366us total) trans 0 rc 0/0 00000100:00100000:2.0:1783134974.344261:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 1 00000100:00100000:0.0:1783134974.344754:0:11499:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9fe840e00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11499:1869752384408704:192.168.201.41@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1783134974.352666:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:3.0:1783134974.352744:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373906560 00000100:00100000:3.0:1783134974.352756:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373906560 00000100:00100000:3.0:1783134974.352818:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 67 00000100:00100000:3.0:1783134974.352827:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fe840e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+53:10420:x1869752373906560:12345-192.168.201.41@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1783134974.352864:0:5770:0:(mdt_handler.c:7960:mdt_fid2path()) path get [0x200000401:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1783134974.352984:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fe840e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+53:10420:x1869752373906560:12345-192.168.201.41@tcp:53:lhsmtool_posix.0 Request processed in 156us (340us total) trans 0 rc 0/0 00000100:00100000:3.0:1783134974.352993:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 67 00000100:00100000:0.0:1783134974.360263:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:2.0:1783134974.360407:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373906688 00000100:00100000:2.0:1783134974.360419:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373906688 00000100:00100000:2.0:1783134974.360503:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 68 00000100:00100000:2.0:1783134974.360515:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fe840380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+53:10420:x1869752373906688:12345-192.168.201.41@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1783134974.360617:0:5771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828000/0xd6c4b8f05867eae4 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134974.360640:0:5771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828000/0xd6c4b8f05867eae4 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134974.360664:0:5771:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828000/0xd6c4b8f05867eae4 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134974.360704:0:5771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828a00/0xd6c4b8f05867eaeb lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134974.360712:0:5771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828a00/0xd6c4b8f05867eaeb lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134974.360720:0:5771:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828a00/0xd6c4b8f05867eaeb lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134974.360755:0:5771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829800/0xd6c4b8f05867eaf2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134974.360765:0:5771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829800/0xd6c4b8f05867eaf2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134974.360772:0:5771:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829800/0xd6c4b8f05867eaf2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783134974.360824:0:5771:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:2.0:1783134974.360830:0:5771:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1783134974.360851:0:5771:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829800/0xd6c4b8f05867eaf2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134974.360865:0:5771:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828000/0xd6c4b8f05867eae4 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134974.360872:0:5771:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828000/0xd6c4b8f05867eae4 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134974.360880:0:5771:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828000/0xd6c4b8f05867eae4 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134974.360896:0:5771:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe9c7828000 already unused, calling callback (ffffffffc1f634f0) 00010000:00010000:2.0:1783134974.360902:0:5771:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828000/0xd6c4b8f05867eae4 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134974.360910:0:5771:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828000/0xd6c4b8f05867eae4 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134974.360927:0:5771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9fe9e1c2b600) 00010000:00010000:2.0:1783134974.360930:0:5771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783134974.360937:0:5771:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828000/0xd6c4b8f05867eae4 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134974.360944:0:5771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828000/0xd6c4b8f05867eae4 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134974.360960:0:5771:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828a00/0xd6c4b8f05867eaeb lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134974.360966:0:5771:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828a00/0xd6c4b8f05867eaeb lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134974.360973:0:5771:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828a00/0xd6c4b8f05867eaeb lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134974.360978:0:5771:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe9c7828a00 already unused, calling callback (ffffffffc1f634f0) 00010000:00010000:2.0:1783134974.360981:0:5771:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828a00/0xd6c4b8f05867eaeb lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134974.360987:0:5771:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828a00/0xd6c4b8f05867eaeb lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134974.361006:0:5771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x3c15db59 (ffff9fe9cc3c1f00) 00010000:00010000:2.0:1783134974.361008:0:5771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783134974.361011:0:5771:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828a00/0xd6c4b8f05867eaeb lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134974.361017:0:5771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828a00/0xd6c4b8f05867eaeb lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134974.361034:0:5771:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829800/0xd6c4b8f05867eaf2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134974.361041:0:5771:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829800/0xd6c4b8f05867eaf2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134974.361048:0:5771:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829800/0xd6c4b8f05867eaf2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134974.361053:0:5771:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe9c7829800 already unused, calling callback (ffffffffc1f634f0) 00010000:00010000:2.0:1783134974.361056:0:5771:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829800/0xd6c4b8f05867eaf2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134974.361063:0:5771:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829800/0xd6c4b8f05867eaf2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134974.361070:0:5771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9fe9cb8f4600) 00010000:00010000:2.0:1783134974.361072:0:5771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783134974.361075:0:5771:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829800/0xd6c4b8f05867eaf2 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134974.361081:0:5771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829800/0xd6c4b8f05867eaf2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783134974.361184:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fe840380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+53:10420:x1869752373906688:12345-192.168.201.41@tcp:34:lhsmtool_posix.0 Request processed in 670us (937us total) trans 0 rc 0/0 00000100:00100000:2.0:1783134974.361194:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 68 00000100:00100000:3.0:1783134974.364991:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:2.0:1783134974.365207:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373906944 00000100:00100000:2.0:1783134974.365220:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373906944 00000100:00100000:2.0:1783134974.365311:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 69 00000100:00100000:2.0:1783134974.365323:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe8c6df6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+53:10420:x1869752373906944:12345-192.168.201.41@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1783134974.365351:0:5770:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783134974.365377:0:5770:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829200/0xd6c4b8f05867eaf9 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4428da03f5eb7265 expref: -99 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134974.365513:0:5770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828c00/0xd6c4b8f05867eb00 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134974.365531:0:5770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828c00/0xd6c4b8f05867eb00 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134974.365545:0:5770:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828c00/0xd6c4b8f05867eb00 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783134974.365559:0:5770:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:2.0:1783134974.365704:0:5770:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828c00/0xd6c4b8f05867eb00 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134974.365713:0:5770:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828c00/0xd6c4b8f05867eb00 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134974.365721:0:5770:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828c00/0xd6c4b8f05867eb00 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134974.365751:0:5770:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe9c7828c00 already unused, calling callback (ffffffffc1f634f0) 00010000:00010000:2.0:1783134974.365757:0:5770:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828c00/0xd6c4b8f05867eb00 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134974.365764:0:5770:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828c00/0xd6c4b8f05867eb00 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134974.365781:0:5770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9fe9cb8f4600) 00010000:00010000:2.0:1783134974.365784:0:5770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1783134974.365789:0:5770:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828c00/0xd6c4b8f05867eb00 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134974.365796:0:5770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828c00/0xd6c4b8f05867eb00 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134974.365843:0:5770:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829200/0xd6c4b8f05867eaf9 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb7265 expref: 55 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134974.365854:0:5770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9fe9e1c2b600) 00010000:00010000:2.0:1783134974.365857:0:5770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1783134974.365860:0:5770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829200/0xd6c4b8f05867eaf9 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb7265 expref: 55 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134974.365870:0:5770:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fe9c7829200, rc 0) 00000100:00100000:2.0:1783134974.365946:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe8c6df6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+54:10420:x1869752373906944:12345-192.168.201.41@tcp:101:lhsmtool_posix.0 Request processed in 625us (970us total) trans 4294967351 rc 301/301 00000100:00100000:2.0:1783134974.365955:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 69 00000100:00100000:2.0:1783134974.374797:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:3.0:1783134974.375850:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373907072 00000100:00100000:3.0:1783134974.375862:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373907072 00000100:00100000:3.0:1783134974.375949:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 70 00000100:00100000:3.0:1783134974.375962:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9cb33b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+54:10420:x1869752373907072:12345-192.168.201.41@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1783134974.376010:0:5771:0:(mdt_handler.c:7960:mdt_fid2path()) path get [0x200000401:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1783134974.376148:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9cb33b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+54:10420:x1869752373907072:12345-192.168.201.41@tcp:53:lhsmtool_posix.0 Request processed in 189us (1366us total) trans 0 rc 0/0 00000100:00100000:3.0:1783134974.376158:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 70 00000100:00100000:2.0:1783134974.389249:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:0.0:1783134974.395720:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373907328 00000100:00100000:0.0:1783134974.395742:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373907328 00000100:00100000:0.0:1783134974.396020:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 71 00000100:00100000:0.0:1783134974.396034:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9f68f4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+54:10420:x1869752373907328:12345-192.168.201.41@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1783134974.396063:0:5770:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783134974.396067:0:5770:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1783134974.396105:0:5770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ad200/0xd6c4b8f05867eaba lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb7257 expref: 54 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134974.396129:0:5770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9fe9e1c2bd00) 00010000:00010000:0.0:1783134974.396134:0:5770:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1783134974.396151:0:5770:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68adc00/0xd6c4b8f05867eb0e lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4428da03f5eb726c expref: -99 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1783134974.397190:0:5770:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x3:0x0], index 1: 0 00010000:00010000:0.0:1783134974.397571:0:5770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ac000/0xd6c4b8f05867eb15 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134974.397588:0:5770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ac000/0xd6c4b8f05867eb15 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134974.397602:0:5770:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ac000/0xd6c4b8f05867eb15 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134974.397688:0:5770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68adc00/0xd6c4b8f05867eb0e lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb726c expref: 56 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134974.397705:0:5770:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ac000/0xd6c4b8f05867eb15 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb726c expref: 55 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134974.397716:0:5770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9fe9c8301200) 00010000:00010000:0.0:1783134974.397725:0:5770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1783134974.397728:0:5770:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fe9f68ac000, rc 0) 00000100:00100000:0.0:1783134974.397832:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9f68f4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+55:10420:x1869752373907328:12345-192.168.201.41@tcp:101:lhsmtool_posix.0 Request processed in 1800us (8596us total) trans 4294967352 rc 0/0 00000100:00100000:0.0:1783134974.397842:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 71 00000100:00100000:0.0:1783134974.412864:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:2.0:1783134974.412969:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373907584 00000100:00100000:2.0:1783134974.412982:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373907584 00000100:00100000:2.0:1783134974.413060:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 72 00000100:00100000:2.0:1783134974.413073:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fe842d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+55:10420:x1869752373907584:12345-192.168.201.41@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1783134974.413153:0:5771:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783134974.413190:0:5771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ac000/0xd6c4b8f05867eb15 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb726c expref: 55 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134974.413212:0:5771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9fe9c8301200) 00010000:00010000:2.0:1783134974.413225:0:5771:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1783134974.413255:0:5771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828c00/0xd6c4b8f05867eb23 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134974.413273:0:5771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828c00/0xd6c4b8f05867eb23 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134974.413334:0:5771:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828c00/0xd6c4b8f05867eb23 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134974.413498:0:5771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829800/0xd6c4b8f05867eb2a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x405b0163 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134974.413526:0:5771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829800/0xd6c4b8f05867eb2a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x405b0163 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134974.413542:0:5771:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829800/0xd6c4b8f05867eb2a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x405b0163 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134974.413634:0:5771:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828c00/0xd6c4b8f05867eb23 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134974.413670:0:5771:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828c00/0xd6c4b8f05867eb23 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134974.413677:0:5771:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828c00/0xd6c4b8f05867eb23 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134974.413684:0:5771:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe9c7828c00 already unused, calling callback (ffffffffc1f634f0) 00010000:00010000:2.0:1783134974.413689:0:5771:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828c00/0xd6c4b8f05867eb23 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134974.413697:0:5771:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828c00/0xd6c4b8f05867eb23 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134974.413713:0:5771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9fe9e1c2bd00) 00010000:00010000:2.0:1783134974.413717:0:5771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783134974.413721:0:5771:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828c00/0xd6c4b8f05867eb23 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134974.413728:0:5771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828c00/0xd6c4b8f05867eb23 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134974.413745:0:5771:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829800/0xd6c4b8f05867eb2a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x405b0163 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134974.413751:0:5771:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829800/0xd6c4b8f05867eb2a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x405b0163 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134974.413769:0:5771:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829800/0xd6c4b8f05867eb2a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x405b0163 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134974.413775:0:5771:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe9c7829800 already unused, calling callback (ffffffffc1f634f0) 00010000:00010000:2.0:1783134974.413788:0:5771:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829800/0xd6c4b8f05867eb2a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x405b0163 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134974.413796:0:5771:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829800/0xd6c4b8f05867eb2a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x405b0163 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134974.413806:0:5771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x405b0163 (ffff9fe9cc3c1f00) 00010000:00010000:2.0:1783134974.413810:0:5771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783134974.413814:0:5771:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829800/0xd6c4b8f05867eb2a lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x405b0163 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134974.413821:0:5771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829800/0xd6c4b8f05867eb2a lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x405b0163 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783134974.413944:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fe842d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+54:10420:x1869752373907584:12345-192.168.201.41@tcp:36:lhsmtool_posix.0 Request processed in 868us (1089us total) trans 0 rc -2/-2 00000100:00100000:2.0:1783134974.413954:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 72 00000100:00100000:3.0:1783134974.425469:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:1.0:1783134974.427463:0:5769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373907712 00000100:00100000:1.0:1783134974.427490:0:5769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373907712 00000100:00100000:0.0:1783134974.427682:0:5769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 73 00000100:00100000:0.0:1783134974.427696:0:5769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe8c6df5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+54:10420:x1869752373907712:12345-192.168.201.41@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1783134974.427722:0:5769:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783134974.427753:0:5769:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ade00/0xd6c4b8f05867eb31 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4428da03f5eb7273 expref: -99 pid: 5769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134974.427796:0:5769:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ac400/0xd6c4b8f05867eb38 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134974.427813:0:5769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ac400/0xd6c4b8f05867eb38 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134974.427828:0:5769:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ac400/0xd6c4b8f05867eb38 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134974.427943:0:5769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ade00/0xd6c4b8f05867eb31 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb7273 expref: 56 pid: 5769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134974.427962:0:5769:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ac400/0xd6c4b8f05867eb38 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb7273 expref: 55 pid: 5769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134974.427972:0:5769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9fe9c8301800) 00010000:00010000:0.0:1783134974.427980:0:5769:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1783134974.427986:0:5769:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fe9f68ac400, rc 0) 00000100:00100000:0.0:1783134974.428102:0:5769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe8c6df5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+55:10420:x1869752373907712:12345-192.168.201.41@tcp:101:lhsmtool_posix.0 Request processed in 409us (2642us total) trans 0 rc 0/0 00000100:00100000:0.0:1783134974.428111:0:5769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 73 00000100:00100000:0.0:1783134974.432620:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:2.0:1783134974.432784:0:8031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373907968 00000100:00100000:2.0:1783134974.432797:0:8031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373907968 00000100:00100000:2.0:1783134974.432874:0:8031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 74 00000100:00100000:2.0:1783134974.432959:0:8031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fe841c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+55:10420:x1869752373907968:12345-192.168.201.41@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1783134974.433064:0:8031:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829800/0xd6c4b8f05867eb3f lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134974.433084:0:8031:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829800/0xd6c4b8f05867eb3f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134974.433097:0:8031:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829800/0xd6c4b8f05867eb3f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1783134974.433477:0:8031:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].3, 88 off8408 00000004:00080000:2.0:1783134974.433500:0:8031:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 256829218990ns, next at 257829216278ns, rc = 0 00000004:00010000:2.0:1783134974.433608:0:8031:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000016d0d733 reply state 000000003747b518 transno 4294967353 ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829800/0xd6c4b8f05867eb3f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783134974.433619:0:8031:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1783134974.433747:0:8031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fe841c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+57:10420:x1869752373907968:12345-192.168.201.41@tcp:36:lhsmtool_posix.0 Request processed in 791us (1137us total) trans 4294967353 rc 0/0 00000100:00100000:2.0:1783134974.433754:0:8031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 74 00010000:00010000:0.0:1783134974.435254:0:3272:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829800/0xd6c4b8f05867eb3f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134974.435273:0:3272:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829800/0xd6c4b8f05867eb3f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134974.435312:0:3272:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829800/0xd6c4b8f05867eb3f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134974.435319:0:3272:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe9c7829800 already unused, calling callback (ffffffffc1f634f0) 00010000:00010000:0.0:1783134974.435325:0:3272:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829800/0xd6c4b8f05867eb3f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134974.435335:0:3272:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829800/0xd6c4b8f05867eb3f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134974.435357:0:3272:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9fe9c8301800) 00010000:00010000:0.0:1783134974.435361:0:3272:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1783134974.435369:0:3272:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829800/0xd6c4b8f05867eb3f lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134974.435375:0:3272:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829800/0xd6c4b8f05867eb3f lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783134974.439427:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:2.0:1783134974.439567:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373908096 00000100:00100000:2.0:1783134974.439579:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373908096 00000100:00100000:2.0:1783134974.439660:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 75 00000100:00100000:2.0:1783134974.439672:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9f6f72300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+56:10420:x1869752373908096:12345-192.168.201.41@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1783134974.439705:0:5770:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783134974.439731:0:5770:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828c00/0xd6c4b8f05867eb46 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4428da03f5eb727a expref: -99 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134974.439826:0:5770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828c00/0xd6c4b8f05867eb46 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb727a expref: 57 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134974.439845:0:5770:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828c00/0xd6c4b8f05867eb46 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb727a expref: 57 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134974.439869:0:5770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9fe9c8301800) 00010000:00010000:2.0:1783134974.439873:0:5770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1783134974.439876:0:5770:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fe9c7828c00, rc 0) 00000100:00100000:2.0:1783134974.439948:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9f6f72300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+57:10420:x1869752373908096:12345-192.168.201.41@tcp:101:lhsmtool_posix.0 Request processed in 278us (533us total) trans 0 rc 0/0 00000100:00100000:2.0:1783134974.439956:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 75 00000100:00100000:3.0:1783134974.445495:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:0.0:1783134974.445571:0:6574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373908224 00000100:00100000:0.0:1783134974.445586:0:6574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373908224 00000100:00100000:0.0:1783134974.445667:0:6574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 24 00000100:00100000:0.0:1783134974.445678:0:6574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fe9f8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2366:x1869752373908224:12345-192.168.201.41@tcp:8:lhsmtool_posix.0 00010000:00080000:0.0:1783134974.445721:0:6574:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0001: connection from 28f4ba61-cfae-499e-ab3d-81cb8215f7bb@192.168.201.41@tcp t0 exp 0000000000000000 cur 256 last 0 00000020:00000080:0.0:1783134974.445765:0:6574:0:(genops.c:1406:class_connect()) connect: client 28f4ba61-cfae-499e-ab3d-81cb8215f7bb, cookie 0xd6c4b8f05867eb4d 00002000:00100000:0.0:1783134974.445782:0:6574:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 28f4ba61-cfae-499e-ab3d-81cb8215f7bb/ffff9fe9fe928800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113653 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1783134974.445816:0:6574:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1783134974.446102:0:6574:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1783134974.446142:0:6574:0:(import.c:65:import_set_state_nolock()) ffff9fe9fe929000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1783134974.447358:0:6574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fe9f8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+6:2366:x1869752373908224:12345-192.168.201.41@tcp:8:lhsmtool_posix.0 Request processed in 1675us (1865us total) trans 0 rc 0/0 00000100:00100000:0.0:1783134974.447371:0:6574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 24 00000100:00100000:3.0:1783134974.451073:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:1.0:1783134974.451168:0:6576:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373908352 00000100:00100000:1.0:1783134974.451184:0:6576:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373908352 00000100:00100000:1.0:1783134974.451406:0:6576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 25 00000100:00100000:1.0:1783134974.451424:0:6576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fe9f8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+6:0:x1869752373908352:12345-192.168.201.41@tcp:2:lhsmtool_posix.0 00000100:00080000:3.0:1783134974.452126:0:5766:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00100000:3.0:1783134974.518538:0:7470:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 28f4ba61-cfae-499e-ab3d-81cb8215f7bb 00000001:00080000:3.0:1783134974.518562:0:7470:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967301 is committed 00000100:00100000:3.0:1783134974.522030:0:6576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fe9f8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+5:0:x1869752373908352:12345-192.168.201.41@tcp:2:lhsmtool_posix.0 Request processed in 70597us (70947us total) trans 4294967301 rc 0/0 00000100:00100000:3.0:1783134974.522049:0:6576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 25 00000100:00100000:2.0:1783134974.528796:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:0.0:1783134974.529008:0:5773:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373908608 00000100:00100000:0.0:1783134974.529020:0:5773:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373908608 00000100:00100000:0.0:1783134974.529100:0:5773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 19 00000100:00100000:0.0:1783134974.529114:0:5773:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9f68f7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+57:10420:x1869752373908608:12345-192.168.201.41@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1783134974.529464:0:5773:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9f68f7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+58:10420:x1869752373908608:12345-192.168.201.41@tcp:35:lhsmtool_posix.0 Request processed in 352us (682us total) trans 4294967354 rc 0/0 00000100:00100000:0.0:1783134974.529474:0:5773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 19 00000100:00100000:0.0:1783134974.532917:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:2.0:1783134974.533192:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373908864 00000100:00100000:2.0:1783134974.533205:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373908864 00000100:00100000:2.0:1783134974.533275:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 76 00000100:00100000:2.0:1783134974.533310:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9f6f73480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+58:10420:x1869752373908864:12345-192.168.201.41@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1783134974.533459:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9f6f73480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+58:10420:x1869752373908864:12345-192.168.201.41@tcp:57:lhsmtool_posix.0 Request processed in 152us (557us total) trans 0 rc 0/0 00000100:00100000:2.0:1783134974.533468:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 76 00000100:00100000:3.0:1783134974.543565:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:2.0:1783134974.543752:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373908992 00000100:00100000:2.0:1783134974.543763:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373908992 00000100:00100000:2.0:1783134974.543825:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 77 00000100:00100000:2.0:1783134974.543837:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fea00bce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+58:10420:x1869752373908992:12345-192.168.201.41@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1783134974.543863:0:5770:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783134974.543887:0:5770:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829e00/0xd6c4b8f05867eb54 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4428da03f5eb7281 expref: -99 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134974.544193:0:5770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829a00/0xd6c4b8f05867eb5b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134974.544210:0:5770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829a00/0xd6c4b8f05867eb5b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134974.544222:0:5770:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829a00/0xd6c4b8f05867eb5b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783134974.544265:0:5770:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1783134974.544355:0:5770:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829a00/0xd6c4b8f05867eb5b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134974.544402:0:5770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829e00/0xd6c4b8f05867eb54 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb7281 expref: 60 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134974.544418:0:5770:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829a00/0xd6c4b8f05867eb5b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb7281 expref: 59 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134974.544425:0:5770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9fe9c8301800) 00010000:00010000:2.0:1783134974.544428:0:5770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1783134974.544430:0:5770:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fe9c7829a00, rc 0) 00000100:00100000:2.0:1783134974.544494:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fea00bce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+59:10420:x1869752373908992:12345-192.168.201.41@tcp:101:lhsmtool_posix.0 Request processed in 659us (945us total) trans 0 rc 0/0 00000100:00100000:2.0:1783134974.544501:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 77 00000100:00100000:2.0:1783134974.546845:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:0.0:1783134974.547462:0:7676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373909120 00000100:00100000:0.0:1783134974.547475:0:7676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373909120 00000100:00100000:0.0:1783134974.547578:0:7676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 26 00000100:00100000:0.0:1783134974.547591:0:7676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9f68f4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+5:2369:x1869752373909120:12345-192.168.201.41@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1783134974.547623:0:7676:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783134974.547724:0:7676:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d6a83bdc/0xd6c4b8f05867eb62 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4428da03f5eb7288 expref: -99 pid: 7676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1783134974.547760:0:7676:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a487afe, blocks: 0x1 00010000:00010000:0.0:1783134974.547785:0:7676:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=256s v=(0 0) 00010000:00010000:0.0:1783134974.547790:0:7676:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783134974.547801:0:7676:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d6a83bdc/0xd6c4b8f05867eb62 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb7288 expref: 6 pid: 7676 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134974.547825:0:7676:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000d6a83bdc/0xd6c4b8f05867eb62 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb7288 expref: 6 pid: 7676 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134974.547840:0:7676:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fe9f68ad800, rc 0) 00000100:00100000:0.0:1783134974.547920:0:7676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9f68f4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+6:2369:x1869752373909120:12345-192.168.201.41@tcp:101:lhsmtool_posix.0 Request processed in 331us (1084us total) trans 0 rc 0/0 00000100:00100000:0.0:1783134974.547927:0:7676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 26 00000100:00100000:0.0:1783134974.557126:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:2.0:1783134974.557173:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373909376 00000100:00100000:2.0:1783134974.557187:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373909376 00000100:00100000:2.0:1783134974.557262:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 78 00000100:00100000:2.0:1783134974.557274:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9f6f71880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+59:10420:x1869752373909376:12345-192.168.201.41@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1783134974.557448:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9f6f71880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+59:10420:x1869752373909376:12345-192.168.201.41@tcp:57:lhsmtool_posix.0 Request processed in 175us (333us total) trans 0 rc 0/0 00000100:00100000:2.0:1783134974.557467:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 78 00000100:00100000:2.0:1783134974.561664:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:0.0:1783134974.561745:0:6577:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373909504 00000100:00100000:0.0:1783134974.561756:0:6577:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373909504 00000100:00100000:0.0:1783134974.561816:0:6577:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 27 00000100:00100000:0.0:1783134974.561825:0:6577:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9f68f6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+6:10420:x1869752373909504:12345-192.168.201.41@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1783134974.561851:0:6577:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783134974.561870:0:6577:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ccdebaec/0xd6c4b8f05867eb69 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4428da03f5eb728f expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134974.561912:0:6577:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000d6a83bdc/0xd6c4b8f05867eb62 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb7288 expref: 7 pid: 7676 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134974.561920:0:6577:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783134974.561924:0:6577:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783134974.561927:0:6577:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ccdebaec/0xd6c4b8f05867eb69 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb728f expref: 7 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134974.561976:0:6577:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000d6a83bdc/0xd6c4b8f05867eb62 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb7288 expref: 7 pid: 7676 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134974.561991:0:6577:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000d6a83bdc/0xd6c4b8f05867eb62 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb7288 expref: 7 pid: 7676 timeout: 356 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783134974.562008:0:6577:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9f6f71500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6577:1869752384408832:192.168.201.41@tcp:104: 00000100:00100000:0.0:1783134974.562127:0:6577:0:(client.c:2701:ptlrpc_set_wait()) set ffff9fe9e9c69540 going to sleep for 11 seconds 00000100:00100000:3.0:1783134974.567495:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:3.0:1783134974.567536:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373909632 00000100:00100000:3.0:1783134974.567547:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373909632 00010000:00010000:3.0:1783134974.567648:0:6592:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000d6a83bdc/0xd6c4b8f05867eb62 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb7288 expref: 8 pid: 7676 timeout: 356 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783134974.567698:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 42 00000100:00100000:3.0:1783134974.567710:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9d1621450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+8:2370:x1869752373909632:12345-192.168.201.41@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783134974.567729:0:6592:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783134974.567757:0:6592:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000d6a83bdc/0xd6c4b8f05867eb62 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb7288 expref: 8 pid: 7676 timeout: 356 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134974.567773:0:6592:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000d6a83bdc/0xd6c4b8f05867eb62 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb7288 expref: 8 pid: 7676 timeout: 356 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134974.567811:0:6592:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783134974.567816:0:6592:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783134974.567826:0:6592:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000ccdebaec/0xd6c4b8f05867eb69 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb728f expref: 8 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134974.567836:0:6592:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ccdebaec/0xd6c4b8f05867eb69 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb728f expref: 8 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134974.567898:0:6592:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000ccdebaec/0xd6c4b8f05867eb69 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb728f expref: 8 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783134974.567917:0:6592:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fea00bcd880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:6592:1869752384408960:192.168.201.41@tcp:105: 00000100:00100000:3.0:1783134974.568021:0:6592:0:(client.c:2701:ptlrpc_set_wait()) set ffff9fe9c9d02480 going to sleep for 11 seconds 00010000:00010000:0.0:1783134974.568126:0:6577:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d6a83bdc/0xd6c4b8f05867eb62 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb7288 expref: 8 pid: 7676 timeout: 356 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783134974.568143:0:6577:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9f6f71500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6577:1869752384408832:192.168.201.41@tcp:104: 00010000:00010000:0.0:1783134974.568174:0:6577:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000ccdebaec/0xd6c4b8f05867eb69 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb728f expref: 7 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134974.568184:0:6577:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fe9f68ac200, rc 0) 00000100:00100000:0.0:1783134974.568223:0:6577:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9f68f6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+7:10420:x1869752373909504:12345-192.168.201.41@tcp:101:lhsmtool_posix.0 Request processed in 6398us (6583us total) trans 0 rc 0/0 00000100:00100000:0.0:1783134974.568232:0:6577:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 27 00000100:00100000:1.0:1783134974.573934:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:1.0:1783134974.574012:0:6582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373909760 00000100:00100000:1.0:1783134974.574023:0:6582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373909760 00002000:00100000:1.0:1783134974.574092:0:6582:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3:0x0] (0->8) req@ffff9fe9f6f67b80 x1869752373909760/t0(0) o4->28f4ba61-cfae-499e-ab3d-81cb8215f7bb@192.168.201.41@tcp:145/0 lens 504/0 e 0 to 0 dl 1783134985 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1783134974.574105:0:6582:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9fe9f6f67b80 with x1869752373909760 ext(0->8) 00002000:00010000:1.0:1783134974.574112:0:6582:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9fe9f6f67b80 00000100:00100000:1.0:1783134974.574145:0:6582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 0 00000100:00100000:1.0:1783134974.574157:0:6582:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9f6f67b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+7:2369:x1869752373909760:12345-192.168.201.41@tcp:4:lhsmtool_posix.0 00000100:00100000:1.0:1783134974.578625:0:6582:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9f6f67b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+9:2369:x1869752373909760:12345-192.168.201.41@tcp:4:lhsmtool_posix.0 Request processed in 4462us (4699us total) trans 4294967302 rc 0/0 00000100:00100000:1.0:1783134974.578648:0:6582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 0 00002000:00100000:1.0:1783134974.578660:0:6582:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3:0x0] (0->8) req@ffff9fe9f6f67b80 x1869752373909760/t4294967302(0) o4->28f4ba61-cfae-499e-ab3d-81cb8215f7bb@192.168.201.41@tcp:145/0 lens 504/448 e 0 to 0 dl 1783134985 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1783134974.578669:0:6582:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9fe9f6f67b80 with x1869752373909760 ext(0->8) 00002000:00010000:1.0:1783134974.578675:0:6582:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9fe9f6f67b80 00000100:00100000:0.0:1783134974.579726:0:6592:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fea00bcd880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:6592:1869752384408960:192.168.201.41@tcp:105: 00010000:00010000:0.0:1783134974.579762:0:6592:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783134974.579821:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9d1621450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+8:2370:x1869752373909632:12345-192.168.201.41@tcp:103:ldlm_bl.0 Request processed in 12112us (12339us total) trans 0 rc 0/0 00000100:00100000:0.0:1783134974.579834:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 42 00000100:00100000:2.0:1783134974.588923:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:0.0:1783134974.589387:0:5769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373909888 00000100:00100000:0.0:1783134974.589404:0:5769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373909888 00000100:00100000:0.0:1783134974.589491:0:5769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 79 00000100:00100000:0.0:1783134974.589506:0:5769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9f68f4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+59:10420:x1869752373909888:12345-192.168.201.41@tcp:44:lhsmtool_posix.0 00000040:00080000:0.0:1783134974.638055:0:11815:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1783134974.638067:0:11815:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1783134974.638106:0:11815:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:0.0:1783134974.638113:0:11815:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000001:00080000:2.0:1783134974.646259:0:5791:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967354 is committed 00000100:00100000:3.0:1783134974.646265:0:5769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9f68f4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+59:10420:x1869752373909888:12345-192.168.201.41@tcp:44:lhsmtool_posix.0 Request processed in 56752us (57340us total) trans 0 rc 0/0 00000100:00100000:3.0:1783134974.646339:0:5769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 79 00000004:00080000:2.0:1783134974.646354:0:5791:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 4 committed 00000004:00080000:2.0:1783134974.646375:0:5791:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000020:00080000:2.0:1783134974.646392:0:5791:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9fe9ca930cc0 refcount 2 committed 0 result 0 batchid 1 00000020:00080000:2.0:1783134974.646404:0:5791:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9fe9f6910900 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9fe9ca930840 00000020:00080000:2.0:1783134974.646408:0:5791:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9fe9f6910b00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9fe9fe443000 00000100:00100000:0.0:1783134974.648044:0:3288:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1783134974.648072:0:3288:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9f68f4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1869752384409088:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1783134974.648147:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783134974.648473:0:3286:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9f6f70000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1869752384409216:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1783134974.648501:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783134974.648539:0:7676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384409088 00000100:00100000:0.0:1783134974.648546:0:7676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384409088 00000020:00080000:1.0:1783134974.648586:0:5802:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 1 committed batchid 0 00000100:00100000:0.0:1783134974.648610:0:7676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384409216 00000100:00100000:0.0:1783134974.648613:0:7676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384409216 00000100:00100000:0.0:1783134974.648647:0:7676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1783134974.648664:0:7676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9f6f71500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3288:x1869752384409088:12345-0@lo:2:osp-syn-1-0.0 00000100:00080000:3.0:1783134974.648719:0:5766:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1783134974.648723:0:5766:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1783134974.648738:0:6576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1783134974.648747:0:6576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9f6f72d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3286:x1869752384409216:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1783134974.648763:0:6576:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:2 count 1 00002000:00010000:3.0:1783134974.648799:0:6576:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2:0x0] initial LVB size: 13, mtime: 0x6a487afc, atime: 0x6a487afc, ctime: 0x6a487afc, blocks: 0x1 00010000:00010000:3.0:1783134974.648808:0:6576:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000061135695/0xd6c4b8f05867eb70 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6576 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134974.648826:0:6576:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=257s v=(0 0) 00010000:00010000:3.0:1783134974.648831:0:6576:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00002000:00010000:0.0:1783134974.648834:0:7676:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:0.0:1783134974.648837:0:7676:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb mtime from disk: 0 -> 1783134974 00010000:00010000:3.0:1783134974.648838:0:6576:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000061135695/0xd6c4b8f05867eb70 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6576 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1783134974.648840:0:7676:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1783134974.648843:0:7676:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb ctime from disk: 1783134974 -> 1783134974 00002000:00010000:0.0:1783134974.648845:0:7676:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb blocks from disk: 1 -> 1 00010000:00010000:3.0:1783134974.648855:0:6576:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000061135695/0xd6c4b8f05867eb70 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6576 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134974.648877:0:6576:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000061135695/0xd6c4b8f05867eb70 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6576 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783134974.648884:0:7676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9f6f71500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3288:x1869752384409088:12345-0@lo:2:osp-syn-1-0.0 Request processed in 228us (738us total) trans 4294967303 rc 0/0 00010000:00010000:3.0:1783134974.648886:0:6576:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000061135695/0xd6c4b8f05867eb70 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6576 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783134974.648890:0:7676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00010000:00010000:3.0:1783134974.648906:0:6576:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:0.0:1783134974.648940:0:3288:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9fe9f68f4000/2, rc 0, transno 4294967303 00000100:00100000:0.0:1783134974.648947:0:3288:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9f68f4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1869752384409088:0@lo:2:osp-syn-1-0.0 00000020:00080000:1.0:1783134974.649858:0:5802:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000100:00100000:3.0:1783134974.650213:0:6576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9f6f72d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3286:x1869752384409216:12345-0@lo:6:osp-syn-0-0.0 Request processed in 1465us (1707us total) trans 4294967301 rc 0/0 00000004:00080000:0.0:1783134974.650218:0:3286:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9fe9f6f70000/2, rc 0, transno 4294967301 00000100:00100000:3.0:1783134974.650222:0:6576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1783134974.650223:0:3286:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9f6f70000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1869752384409216:0@lo:6:osp-syn-0-0.0 00010000:00010000:0.0:1783134974.650543:0:6591:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783134974.650552:0:6591:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000061135695/0xd6c4b8f05867eb70 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6576 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134974.650564:0:6591:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe9d2b75a00 already unused, calling callback (ffffffffc1527ce0) 00010000:00010000:0.0:1783134974.650569:0:6591:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000061135695/0xd6c4b8f05867eb70 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6576 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134974.650579:0:6591:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000061135695/0xd6c4b8f05867eb70 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6576 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134974.650603:0:6591:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000061135695/0xd6c4b8f05867eb70 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6576 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134974.650623:0:6591:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000061135695/0xd6c4b8f05867eb70 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6576 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134974.650724:0:6591:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783134974.650727:0:6591:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783134974.650729:0:6591:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783134974.650852:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:3.0:1783134974.651117:0:7676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373910016 00000100:00100000:3.0:1783134974.651127:0:7676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373910016 00000100:00100000:3.0:1783134974.651171:0:7676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 30 00000100:00100000:3.0:1783134974.651178:0:7676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9f68f6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+8:2370:x1869752373910016:12345-192.168.201.41@tcp:16:lhsmtool_posix.0 00000100:00100000:3.0:1783134974.686556:0:7676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9f68f6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+8:2370:x1869752373910016:12345-192.168.201.41@tcp:16:lhsmtool_posix.0 Request processed in 35358us (35688us total) trans 0 rc 0/0 00000100:00100000:3.0:1783134974.686574:0:7676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 30 00000001:00080000:3.0:1783134974.686626:0:7470:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967303 is committed 00000001:00080000:3.0:1783134974.687167:0:7470:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967302 is committed 00000100:00100000:1.0:1783134974.690094:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:2.0:1783134974.690229:0:8031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373910272 00000100:00100000:2.0:1783134974.690240:0:8031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373910272 00000100:00100000:2.0:1783134974.690361:0:8031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 80 00000100:00100000:2.0:1783134974.690373:0:8031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9f6f65180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+13:10420:x1869752373910272:12345-192.168.201.41@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1783134974.690445:0:8031:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783134974.690491:0:8031:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829a00/0xd6c4b8f05867eb5b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb7281 expref: 13 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134974.690510:0:8031:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9fe9c8301800) 00010000:00010000:2.0:1783134974.690516:0:8031:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1783134974.690550:0:8031:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828e00/0xd6c4b8f05867eb77 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134974.690566:0:8031:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828e00/0xd6c4b8f05867eb77 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134974.690576:0:8031:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828e00/0xd6c4b8f05867eb77 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1783134974.691341:0:8031:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000431662d2 reply state 0000000081b6542e transno 4294967355 ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828e00/0xd6c4b8f05867eb77 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783134974.691353:0:8031:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1783134974.691879:0:8031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9f6f65180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+14:10420:x1869752373910272:12345-192.168.201.41@tcp:36:lhsmtool_posix.0 Request processed in 1505us (1791us total) trans 4294967355 rc 0/0 00000100:00100000:3.0:1783134974.691888:0:8031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 80 00010000:00010000:1.0:1783134974.694945:0:3273:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828e00/0xd6c4b8f05867eb77 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134974.694982:0:3273:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828e00/0xd6c4b8f05867eb77 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134974.694990:0:3273:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828e00/0xd6c4b8f05867eb77 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134974.695001:0:3273:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe9c7828e00 already unused, calling callback (ffffffffc1f634f0) 00010000:00010000:1.0:1783134974.695007:0:3273:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828e00/0xd6c4b8f05867eb77 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134974.695016:0:3273:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828e00/0xd6c4b8f05867eb77 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134974.695039:0:3273:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9fe9c8301800) 00010000:00010000:1.0:1783134974.695042:0:3273:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783134974.695047:0:3273:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828e00/0xd6c4b8f05867eb77 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134974.695053:0:3273:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828e00/0xd6c4b8f05867eb77 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783134974.695459:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:2.0:1783134974.695558:0:6574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373910400 00000100:00100000:2.0:1783134974.695568:0:6574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373910400 00000100:00100000:2.0:1783134974.695620:0:6574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 31 00000100:00100000:2.0:1783134974.695648:0:6574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9f6f66a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+6:2369:x1869752373910400:12345-192.168.201.41@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1783134974.696229:0:6574:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:2.0:1783134974.696233:0:6574:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb mtime from disk: 1783134974 -> 1783134973 00002000:00010000:2.0:1783134974.696235:0:6574:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb atime from disk: 0 -> 1783134972 00002000:00010000:2.0:1783134974.696237:0:6574:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb ctime from disk: 1783134974 -> 1783134973 00002000:00010000:2.0:1783134974.696238:0:6574:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:2.0:1783134974.696590:0:6574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9f6f66a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+7:2369:x1869752373910400:12345-192.168.201.41@tcp:2:lhsmtool_posix.0 Request processed in 953us (1136us total) trans 4294967304 rc 0/0 00000100:00100000:2.0:1783134974.696598:0:6574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 31 00000100:00100000:3.0:1783134974.699807:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:3.0:1783134974.699852:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373910656 00000100:00100000:3.0:1783134974.699869:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373910656 00000100:00100000:3.0:1783134974.700049:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 81 00000100:00100000:3.0:1783134974.700063:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fea00bcd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+13:10420:x1869752373910656:12345-192.168.201.41@tcp:55:lhsmtool_posix.0 00010000:00010000:3.0:1783134974.700148:0:5770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b75c00/0xd6c4b8f05867eb7e lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134974.700170:0:5770:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ac400/0xd6c4b8f05867eb38 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb7273 expref: 13 pid: 5769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134974.700181:0:5770:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b75c00/0xd6c4b8f05867eb7e lrc: 4/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134974.700224:0:5770:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ac400/0xd6c4b8f05867eb38 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb7273 expref: 13 pid: 5769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134974.700240:0:5770:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ac400/0xd6c4b8f05867eb38 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb7273 expref: 13 pid: 5769 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783134974.700257:0:5770:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9f6733100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5770:1869752384409344:192.168.201.41@tcp:104: 00000100:00100000:3.0:1783134974.700384:0:5770:0:(client.c:2701:ptlrpc_set_wait()) set ffff9fe9c9d02f00 going to sleep for 11 seconds 00000100:00100000:3.0:1783134974.704924:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:0.0:1783134974.705013:0:5756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373910784 00000100:00100000:0.0:1783134974.705022:0:5756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373910784 00010000:00010000:0.0:1783134974.705082:0:5756:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ac400/0xd6c4b8f05867eb38 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb7273 expref: 14 pid: 5769 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783134974.705126:0:5756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 43 00000100:00100000:0.0:1783134974.705135:0:5756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9f6730700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+14:2370:x1869752373910784:12345-192.168.201.41@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783134974.705153:0:5756:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783134974.705159:0:5756:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ac400/0xd6c4b8f05867eb38 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb7273 expref: 14 pid: 5769 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134974.705172:0:5756:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ac400/0xd6c4b8f05867eb38 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb7273 expref: 14 pid: 5769 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134974.705199:0:5756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9fe9c8301800) 00010000:00010000:0.0:1783134974.705206:0:5756:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b75c00/0xd6c4b8f05867eb7e lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134974.705218:0:5756:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b75c00/0xd6c4b8f05867eb7e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134974.705238:0:5756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b75c00/0xd6c4b8f05867eb7e lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134974.705262:0:5756:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783134974.705350:0:5756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9f6730700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+14:2370:x1869752373910784:12345-192.168.201.41@tcp:103:ldlm_bl.0 Request processed in 214us (439us total) trans 0 rc 0/0 00000100:00100000:0.0:1783134974.705358:0:5756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 43 00010000:00010000:2.0:1783134974.705485:0:5770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ac400/0xd6c4b8f05867eb38 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb7273 expref: 13 pid: 5769 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783134974.705503:0:5770:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9f6733100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5770:1869752384409344:192.168.201.41@tcp:104: 00010000:00010000:2.0:1783134974.705530:0:5770:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b75c00/0xd6c4b8f05867eb7e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134974.705541:0:5770:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b75c00/0xd6c4b8f05867eb7e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134974.705550:0:5770:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b75c00/0xd6c4b8f05867eb7e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134974.705586:0:5770:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b75c00/0xd6c4b8f05867eb7e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134974.705595:0:5770:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b75c00/0xd6c4b8f05867eb7e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134974.705602:0:5770:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b75c00/0xd6c4b8f05867eb7e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134974.705615:0:5770:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe9d2b75c00 already unused, calling callback (ffffffffc1f634f0) 00010000:00010000:2.0:1783134974.705620:0:5770:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b75c00/0xd6c4b8f05867eb7e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134974.705629:0:5770:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b75c00/0xd6c4b8f05867eb7e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134974.706052:0:5770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9fe9c8301800) 00010000:00010000:2.0:1783134974.706057:0:5770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:2.0:1783134974.706062:0:5770:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b75c00/0xd6c4b8f05867eb7e lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134974.706068:0:5770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b75c00/0xd6c4b8f05867eb7e lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783134974.706134:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fea00bcd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+12:10420:x1869752373910656:12345-192.168.201.41@tcp:55:lhsmtool_posix.0 Request processed in 6073us (6341us total) trans 0 rc -22/-22 00000100:00100000:2.0:1783134974.706142:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 81 00000100:00100000:3.0:1783134974.709739:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:1.0:1783134974.710760:0:6577:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373910912 00000100:00100000:1.0:1783134974.710775:0:6577:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373910912 00000100:00100000:1.0:1783134974.710849:0:6577:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 32 00000100:00100000:1.0:1783134974.710861:0:6577:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9f6731880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+7:2369:x1869752373910912:12345-192.168.201.41@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1783134974.710920:0:6577:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000df406bb1/0xd6c4b8f05867eb85 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134974.710947:0:6577:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000ccdebaec/0xd6c4b8f05867eb69 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb728f expref: 7 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134974.710964:0:6577:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x3:0x0].0x0 since=1s v=(0 0) 00010000:00010000:1.0:1783134974.710969:0:6577:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1783134974.710974:0:6577:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000df406bb1/0xd6c4b8f05867eb85 lrc: 4/1,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134974.711018:0:6577:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000ccdebaec/0xd6c4b8f05867eb69 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb728f expref: 7 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134974.711035:0:6577:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000ccdebaec/0xd6c4b8f05867eb69 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb728f expref: 7 pid: 6577 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783134974.711053:0:6577:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9f6f65500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6577:1869752384409472:192.168.201.41@tcp:104: 00000100:00100000:1.0:1783134974.711165:0:6577:0:(client.c:2701:ptlrpc_set_wait()) set ffff9fe8c55ea300 going to sleep for 11 seconds 00000100:00100000:0.0:1783134974.715908:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:0.0:1783134974.715963:0:5754:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373911040 00000100:00100000:0.0:1783134974.715974:0:5754:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373911040 00010000:00010000:0.0:1783134974.716020:0:5754:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000ccdebaec/0xd6c4b8f05867eb69 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb728f expref: 8 pid: 6577 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783134974.716073:0:5754:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 44 00000100:00100000:0.0:1783134974.716083:0:5754:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9f6f73800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+8:2370:x1869752373911040:12345-192.168.201.41@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783134974.716103:0:5754:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783134974.716131:0:5754:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000ccdebaec/0xd6c4b8f05867eb69 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb728f expref: 8 pid: 6577 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134974.716147:0:5754:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000ccdebaec/0xd6c4b8f05867eb69 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb728f expref: 8 pid: 6577 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134974.716180:0:5754:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1783134974.716185:0:5754:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1783134974.716192:0:5754:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000df406bb1/0xd6c4b8f05867eb85 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134974.716214:0:5754:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000df406bb1/0xd6c4b8f05867eb85 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134974.716241:0:5754:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783134974.716329:0:5754:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9f6f73800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+8:2370:x1869752373911040:12345-192.168.201.41@tcp:103:ldlm_bl.0 Request processed in 246us (434us total) trans 0 rc 0/0 00000100:00100000:0.0:1783134974.716337:0:5754:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 44 00010000:00010000:1.0:1783134974.717777:0:6577:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ccdebaec/0xd6c4b8f05867eb69 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb728f expref: 7 pid: 6577 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783134974.717799:0:6577:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9f6f65500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6577:1869752384409472:192.168.201.41@tcp:104: 00010000:00010000:1.0:1783134974.717828:0:6577:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000df406bb1/0xd6c4b8f05867eb85 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134974.717842:0:6577:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000df406bb1/0xd6c4b8f05867eb85 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134974.717850:0:6577:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000df406bb1/0xd6c4b8f05867eb85 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134974.717890:0:6577:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000df406bb1/0xd6c4b8f05867eb85 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134974.717899:0:6577:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000df406bb1/0xd6c4b8f05867eb85 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134974.717906:0:6577:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000df406bb1/0xd6c4b8f05867eb85 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134974.717914:0:6577:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe9fe43f800 already unused, calling callback (ffffffffc1527ce0) 00010000:00010000:1.0:1783134974.717919:0:6577:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000df406bb1/0xd6c4b8f05867eb85 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134974.717995:0:6577:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000df406bb1/0xd6c4b8f05867eb85 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134974.718015:0:6577:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000df406bb1/0xd6c4b8f05867eb85 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134974.718022:0:6577:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000df406bb1/0xd6c4b8f05867eb85 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783134974.718226:0:6577:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9f6731880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+6:2369:x1869752373910912:12345-192.168.201.41@tcp:1:lhsmtool_posix.0 Request processed in 7365us (8499us total) trans 0 rc 0/0 00000100:00100000:1.0:1783134974.718236:0:6577:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 32 00000100:00100000:0.0:1783134974.721422:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:3.0:1783134974.721473:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373911296 00000100:00100000:3.0:1783134974.721483:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373911296 00000100:00100000:3.0:1783134974.721553:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 82 00000100:00100000:3.0:1783134974.721564:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9f6f72680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+12:10420:x1869752373911296:12345-192.168.201.41@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1783134974.721782:0:5771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b75000/0xd6c4b8f05867eb8c lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134974.721818:0:5771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b75000/0xd6c4b8f05867eb8c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134974.721830:0:5771:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b75000/0xd6c4b8f05867eb8c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134974.722106:0:5771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b74400/0xd6c4b8f05867eb93 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134974.722118:0:5771:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828c00/0xd6c4b8f05867eb46 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb727a expref: 13 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134974.722127:0:5771:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b74400/0xd6c4b8f05867eb93 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134974.722166:0:5771:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828c00/0xd6c4b8f05867eb46 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb727a expref: 13 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134974.722182:0:5771:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828c00/0xd6c4b8f05867eb46 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb727a expref: 13 pid: 5770 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783134974.722199:0:5771:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9f6732a00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5771:1869752384409600:192.168.201.41@tcp:104: 00000100:00100000:3.0:1783134974.722332:0:5771:0:(client.c:2701:ptlrpc_set_wait()) set ffff9fe9c9d02840 going to sleep for 11 seconds 00000100:00100000:3.0:1783134974.725093:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:3.0:1783134974.725130:0:5755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373911424 00000100:00100000:3.0:1783134974.725140:0:5755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373911424 00010000:00010000:3.0:1783134974.725186:0:5755:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828c00/0xd6c4b8f05867eb46 lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb727a expref: 14 pid: 5770 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783134974.725240:0:5755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 45 00000100:00100000:3.0:1783134974.725250:0:5755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9f6732680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+14:2369:x1869752373911424:12345-192.168.201.41@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783134974.725270:0:5755:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783134974.725299:0:5755:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828c00/0xd6c4b8f05867eb46 lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb727a expref: 14 pid: 5770 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134974.725314:0:5755:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828c00/0xd6c4b8f05867eb46 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb727a expref: 14 pid: 5770 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134974.725339:0:5755:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9fe9c8301800) 00010000:00010000:3.0:1783134974.725344:0:5755:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b74400/0xd6c4b8f05867eb93 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134974.725352:0:5771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828c00/0xd6c4b8f05867eb46 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb727a expref: 14 pid: 5770 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134974.725353:0:5755:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b74400/0xd6c4b8f05867eb93 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134974.725361:0:5755:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b74400/0xd6c4b8f05867eb93 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783134974.725370:0:5771:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9f6732a00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5771:1869752384409600:192.168.201.41@tcp:104: 00010000:00010000:3.0:1783134974.725380:0:5755:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1783134974.725394:0:5771:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b74400/0xd6c4b8f05867eb93 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134974.725403:0:5771:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b74400/0xd6c4b8f05867eb93 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134974.725408:0:5771:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b74400/0xd6c4b8f05867eb93 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783134974.725433:0:5755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9f6732680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+13:2369:x1869752373911424:12345-192.168.201.41@tcp:103:ldlm_bl.0 Request processed in 184us (355us total) trans 0 rc 0/0 00000100:00100000:3.0:1783134974.725441:0:5755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 45 00000001:00080000:1.0:1783134974.725650:0:5771:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967356 00000001:00080000:1.0:1783134974.725826:0:5771:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967357 00000001:00080000:1.0:1783134974.725883:0:5771:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967358 00000100:00100000:1.0:1783134974.725979:0:5771:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9f6f65500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5771:1869752384409728:0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1783134974.726037:0:5771:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783134974.726079:0:5771:0:(client.c:2701:ptlrpc_set_wait()) set ffff9fe8c55ea480 going to sleep for 11 seconds 00000100:00100000:3.0:1783134974.726147:0:5775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384409728 00000100:00100000:3.0:1783134974.726154:0:5775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384409728 00000100:00100000:3.0:1783134974.726194:0:5775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1783134974.726202:0:5775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9f6f65c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5771:x1869752384409728:12345-0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1783134974.726479:0:5775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9f6f65c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5771:x1869752384409728:12345-0@lo:1000:mdt00_002.0 Request processed in 277us (441us total) trans 0 rc 0/0 00000100:00100000:3.0:1783134974.726487:0:5775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1783134974.727847:0:5771:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967303 gen 2 00000004:00080000:1.0:1783134974.727858:0:5771:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9fe9f68f4000, transno 4294967303 00000100:00100000:1.0:1783134974.727881:0:5771:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9f6f65500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5771:1869752384409728:0@lo:1000:mdt00_002.0 00000001:00080000:1.0:1783134974.728540:0:5771:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967359 00000100:00100000:1.0:1783134974.728621:0:5771:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9f6f65500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5771:1869752384409856:0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1783134974.728830:0:5771:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783134974.728869:0:5771:0:(client.c:2701:ptlrpc_set_wait()) set ffff9fe8c55ea300 going to sleep for 11 seconds 00000100:00100000:2.0:1783134974.728945:0:5774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384409856 00000100:00100000:2.0:1783134974.728953:0:5774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384409856 00000100:00100000:2.0:1783134974.729020:0:5774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1783134974.729030:0:5774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9f6f65880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5771:x1869752384409856:12345-0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1783134974.729351:0:5774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9f6f65880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5771:x1869752384409856:12345-0@lo:1000:mdt00_002.0 Request processed in 322us (522us total) trans 4294967305 rc 0/0 00000100:00100000:2.0:1783134974.729359:0:5774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1783134974.729626:0:5771:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9f6f65500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5771:1869752384409856:0@lo:1000:mdt00_002.0 00010000:00010000:0.0:1783134974.729682:0:5771:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b74400/0xd6c4b8f05867eb93 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134974.729694:0:5771:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b74400/0xd6c4b8f05867eb93 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134974.729702:0:5771:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b74400/0xd6c4b8f05867eb93 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134974.729709:0:5771:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe9d2b74400 already unused, calling callback (ffffffffc1f634f0) 00010000:00010000:0.0:1783134974.729715:0:5771:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b74400/0xd6c4b8f05867eb93 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134974.729723:0:5771:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b74400/0xd6c4b8f05867eb93 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134974.729742:0:5771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9fe9c8301800) 00010000:00010000:0.0:1783134974.729746:0:5771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1783134974.729756:0:5771:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b74400/0xd6c4b8f05867eb93 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134974.729763:0:5771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b74400/0xd6c4b8f05867eb93 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134974.729801:0:5771:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b74c00/0xd6c4b8f05867eac1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134974.729807:0:5771:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b74c00/0xd6c4b8f05867eac1 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134974.729811:0:5771:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b74c00/0xd6c4b8f05867eac1 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134974.729815:0:5771:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe9d2b74c00 already unused, calling callback (ffffffffc1f634f0) 00010000:00010000:0.0:1783134974.729818:0:5771:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b74c00/0xd6c4b8f05867eac1 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134974.729823:0:5771:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b74c00/0xd6c4b8f05867eac1 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134974.729830:0:5771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9fe9cb8f4600) 00010000:00010000:0.0:1783134974.729833:0:5771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1783134974.729835:0:5771:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b74c00/0xd6c4b8f05867eac1 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134974.729841:0:5771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b74c00/0xd6c4b8f05867eac1 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134974.729864:0:5771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ad000/0xd6c4b8f05867eb9a lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134974.729881:0:5771:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b74200/0xd6c4b8f05867eadd lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb725e expref: 16 pid: 8031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134974.729897:0:5771:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ad000/0xd6c4b8f05867eb9a lrc: 4/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134974.729928:0:5771:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b74200/0xd6c4b8f05867eadd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb725e expref: 16 pid: 8031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134974.729942:0:5771:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b74200/0xd6c4b8f05867eadd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb725e expref: 16 pid: 8031 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783134974.729956:0:5771:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9f6f70700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5771:1869752384409984:192.168.201.41@tcp:104: 00000100:00100000:0.0:1783134974.730077:0:5771:0:(client.c:2701:ptlrpc_set_wait()) set ffff9fe9e9c696c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783134974.733566:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:2.0:1783134974.733701:0:5754:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373911552 00000100:00100000:2.0:1783134974.733712:0:5754:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373911552 00010000:00010000:2.0:1783134974.733764:0:5754:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b74200/0xd6c4b8f05867eadd lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb725e expref: 17 pid: 8031 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783134974.733820:0:5754:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 46 00000100:00100000:2.0:1783134974.733831:0:5754:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9f6732a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+17:2370:x1869752373911552:12345-192.168.201.41@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783134974.733849:0:5754:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783134974.733858:0:5754:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b74200/0xd6c4b8f05867eadd lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb725e expref: 17 pid: 8031 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134974.733872:0:5754:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b74200/0xd6c4b8f05867eadd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb725e expref: 17 pid: 8031 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134974.733900:0:5754:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9fe9cb8f4600) 00010000:00010000:2.0:1783134974.733906:0:5754:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ad000/0xd6c4b8f05867eb9a lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134974.733918:0:5754:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ad000/0xd6c4b8f05867eb9a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134974.733927:0:5754:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ad000/0xd6c4b8f05867eb9a lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134974.733948:0:5754:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783134974.734005:0:5754:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9f6732a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+17:2370:x1869752373911552:12345-192.168.201.41@tcp:103:ldlm_bl.0 Request processed in 176us (454us total) trans 0 rc 0/0 00000100:00100000:2.0:1783134974.734011:0:5754:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 46 00010000:00010000:1.0:1783134974.734333:0:5771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b74200/0xd6c4b8f05867eadd lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb725e expref: 16 pid: 8031 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783134974.734364:0:5771:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9f6f70700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5771:1869752384409984:192.168.201.41@tcp:104: 00010000:00010000:1.0:1783134974.734388:0:5771:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ad000/0xd6c4b8f05867eb9a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134974.734399:0:5771:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ad000/0xd6c4b8f05867eb9a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134974.734406:0:5771:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ad000/0xd6c4b8f05867eb9a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134974.734421:0:5771:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ad000/0xd6c4b8f05867eb9a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134974.734428:0:5771:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ad000/0xd6c4b8f05867eb9a lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134974.734435:0:5771:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ad000/0xd6c4b8f05867eb9a lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134974.734441:0:5771:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe9f68ad000 already unused, calling callback (ffffffffc1f634f0) 00010000:00010000:1.0:1783134974.734446:0:5771:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ad000/0xd6c4b8f05867eb9a lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134974.734453:0:5771:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ad000/0xd6c4b8f05867eb9a lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134974.734463:0:5771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9fe9cb8f4600) 00010000:00010000:1.0:1783134974.734466:0:5771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783134974.734471:0:5771:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ad000/0xd6c4b8f05867eb9a lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134974.734487:0:5771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ad000/0xd6c4b8f05867eb9a lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134974.734500:0:5771:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b75000/0xd6c4b8f05867eb8c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134974.734506:0:5771:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b75000/0xd6c4b8f05867eb8c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134974.734512:0:5771:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b75000/0xd6c4b8f05867eb8c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134974.734517:0:5771:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe9d2b75000 already unused, calling callback (ffffffffc1f634f0) 00010000:00010000:1.0:1783134974.734520:0:5771:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b75000/0xd6c4b8f05867eb8c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134974.734526:0:5771:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b75000/0xd6c4b8f05867eb8c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134974.734534:0:5771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9fe9cb8f4600) 00010000:00010000:1.0:1783134974.734536:0:5771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1783134974.734539:0:5771:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b75000/0xd6c4b8f05867eb8c lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134974.734545:0:5771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b75000/0xd6c4b8f05867eb8c lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783134974.734814:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9f6f72680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+15:10420:x1869752373911296:12345-192.168.201.41@tcp:57:lhsmtool_posix.0 Request processed in 13251us (13404us total) trans 4294967360 rc 0/0 00000100:00100000:1.0:1783134974.734824:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 82 00000020:00080000:1.0:1783134974.734833:0:5771:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:3.0:1783134974.735000:0:11499:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1783134974.735007:0:11499:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1783134974.735044:0:11499:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:3.0:1783134974.735053:0:11499:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1783134974.737189:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:1.0:1783134974.737363:0:5773:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373911808 00000100:00100000:1.0:1783134974.737374:0:5773:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373911808 00000100:00100000:1.0:1783134974.737440:0:5773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 20 00000100:00100000:1.0:1783134974.737452:0:5773:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9f6733100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+15:10420:x1869752373911808:12345-192.168.201.41@tcp:35:lhsmtool_posix.0 00000004:00080000:1.0:1783134974.738321:0:5773:0:(mdd_object.c:4010:mdd_close()) Object [0x200000401:0x6:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:1.0:1783134974.738439:0:5773:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967361 00010000:00010000:1.0:1783134974.738490:0:5773:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43f800/0xd6c4b8f05867eba1 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134974.738509:0:5773:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43f800/0xd6c4b8f05867eba1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134974.738523:0:5773:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43f800/0xd6c4b8f05867eba1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134974.738533:0:5773:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43f800/0xd6c4b8f05867eba1 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134974.738540:0:5773:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43f800/0xd6c4b8f05867eba1 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134974.738545:0:5773:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43f800/0xd6c4b8f05867eba1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134974.738666:0:5773:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1783134974.738811:0:5773:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9f6733100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+17:10420:x1869752373911808:12345-192.168.201.41@tcp:35:lhsmtool_posix.0 Request processed in 1359us (1629us total) trans 4294967362 rc 0/0 00000100:00100000:1.0:1783134974.738820:0:5773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 20 00000020:00080000:1.0:1783134974.738825:0:5773:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1783134974.738868:0:10987:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783134974.738877:0:10987:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43f800/0xd6c4b8f05867eba1 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134974.738884:0:10987:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe9fe43f800 already unused, calling callback (ffffffffc1527ce0) 00010000:00010000:3.0:1783134974.738888:0:10987:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43f800/0xd6c4b8f05867eba1 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134974.738896:0:10987:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43f800/0xd6c4b8f05867eba1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134974.738910:0:10987:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9fe9e1c2bf00) 00010000:00010000:3.0:1783134974.738914:0:10987:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1783134974.738918:0:10987:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43f800/0xd6c4b8f05867eba1 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134974.738925:0:10987:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43f800/0xd6c4b8f05867eba1 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134974.738941:0:10987:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783134974.738943:0:10987:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783134974.738950:0:10987:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783134975.236826:0:5758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783134976.131603:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1783134976.131749:0:3288:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9f68f4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3288:1869752384410240:0@lo:400:kworker.0 00000100:00100000:0.0:1783134976.131856:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783134976.131929:0:3288:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1783134976.131935:0:3288:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9f68f7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3288:1869752384410368:0@lo:400:kworker.0 00000100:00100000:0.0:1783134976.131963:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783134976.132350:0:3288:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9fe843b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1869752384410752:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1783134976.132384:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783134976.132660:0:3286:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9f68f5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1869752384410496:0@lo:400:kworker.0 00000100:00100000:3.0:1783134976.132704:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783134976.132768:0:3286:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9f68f4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:88a2002e-2ea7-4f07-912a-8d001832cfc0:3286:1869752384410112:0@lo:400:kworker.0 00000100:00100000:3.0:1783134976.132809:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783134976.132831:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1783134976.132837:0:3286:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9f6f66300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1869752384410624:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1783134976.132857:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783134976.132888:0:5769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384410240 00000100:00100000:3.0:1783134976.132897:0:5769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384410240 00000100:00100000:3.0:1783134976.132945:0:5769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384410368 00000100:00100000:3.0:1783134976.132948:0:5769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384410368 00000100:00100000:3.0:1783134976.132981:0:5769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1783134976.132990:0:5769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9f6f70700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3288:x1869752384410240:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783134976.133048:0:5769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9f6f70700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3288:x1869752384410240:12345-0@lo:400:kworker.0 Request processed in 58us (1192us total) trans 0 rc 0/0 00000100:00100000:3.0:1783134976.133055:0:5769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1783134976.133076:0:5769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1783134976.133082:0:5769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fe840000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3288:x1869752384410368:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783134976.133107:0:5769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fe840000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3288:x1869752384410368:12345-0@lo:400:kworker.0 Request processed in 25us (1144us total) trans 0 rc 0/0 00000100:00100000:3.0:1783134976.133113:0:5769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1783134976.133131:0:5762:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384410112 00000100:00100000:3.0:1783134976.133134:0:5762:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384410112 00000100:00100000:3.0:1783134976.133157:0:5762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:3.0:1783134976.133163:0:5762:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9d1654050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88a2002e-2ea7-4f07-912a-8d001832cfc0+19:3286:x1869752384410112:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783134976.133211:0:5762:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9d1654050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88a2002e-2ea7-4f07-912a-8d001832cfc0+19:3286:x1869752384410112:12345-0@lo:400:kworker.0 Request processed in 48us (402us total) trans 0 rc 0/0 00000100:00100000:3.0:1783134976.133218:0:5762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00100000:3.0:1783134976.133245:0:10783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384410752 00000100:00100000:3.0:1783134976.133248:0:10783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384410752 00000100:00100000:3.0:1783134976.133274:0:10783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384410624 00000100:00100000:3.0:1783134976.133295:0:10783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384410624 00000100:00100000:3.0:1783134976.133313:0:10783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1783134976.133319:0:10783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fe842300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3288:x1869752384410752:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1783134976.133351:0:10783:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1783134976.133383:0:10783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fe842300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3288:x1869752384410752:12345-0@lo:13:osp-pre-1-0.0 Request processed in 65us (999us total) trans 0 rc 0/0 00000100:00080000:2.0:1783134976.133584:0:5766:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1783134976.133589:0:5766:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1783134976.133592:0:5766:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1783134976.133657:0:3286:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9f68f4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:88a2002e-2ea7-4f07-912a-8d001832cfc0:3286:1869752384410112:0@lo:400:kworker.0 00000100:00100000:2.0:1783134976.133692:0:6579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1783134976.133701:0:6579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9f5ca4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3286:x1869752384410624:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1783134976.133723:0:6579:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:2.0:1783134976.133761:0:6579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9f5ca4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3286:x1869752384410624:12345-0@lo:13:osp-pre-0-0.0 Request processed in 62us (902us total) trans 0 rc 0/0 00000100:00100000:2.0:1783134976.133767:0:6579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1783134976.133866:0:3286:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9f6f66300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1869752384410624:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1783134976.133902:0:3289:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9f68f6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3289:1869752384410880:0@lo:400:kworker.0 00000100:00100000:2.0:1783134976.133933:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783134976.133973:0:5769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384410880 00000100:00100000:2.0:1783134976.133977:0:5769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384410880 00000100:00100000:2.0:1783134976.134010:0:5769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1783134976.134017:0:5769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9f68f4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3289:x1869752384410880:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783134976.134051:0:5769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9f68f4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3289:x1869752384410880:12345-0@lo:400:kworker.0 Request processed in 35us (116us total) trans 0 rc 0/0 00000100:00100000:2.0:1783134976.134057:0:5769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00080000:2.0:1783134976.134072:0:5766:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1783134976.134089:0:3289:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9f68f6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3289:1869752384410880:0@lo:400:kworker.0 00000100:00100000:2.0:1783134976.134127:0:3288:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9fe843b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1869752384410752:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1783134976.134138:0:3288:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9f68f7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3288:1869752384410368:0@lo:400:kworker.0 00000100:00100000:2.0:1783134976.134151:0:3288:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9f68f4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3288:1869752384410240:0@lo:400:kworker.0 00000100:00100000:3.0:1783134976.134214:0:10783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1783134976.134510:0:6576:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384410496 00000100:00100000:0.0:1783134976.134515:0:6576:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384410496 00000100:00100000:0.0:1783134976.134591:0:6576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1783134976.134600:0:6576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9f5ca5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3286:x1869752384410496:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783134976.134668:0:6576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9f5ca5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3286:x1869752384410496:12345-0@lo:400:kworker.0 Request processed in 69us (1962us total) trans 0 rc 0/0 00000100:00100000:0.0:1783134976.134674:0:6576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1783134976.134747:0:3286:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9f68f5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1869752384410496:0@lo:400:kworker.0 00010000:00010000:2.0:1783134976.260055:0:5757:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1783134976.267094:0:11866:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1783134976.267104:0:11866:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1783134976.267147:0:11866:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:2.0:1783134976.267155:0:11866:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1783134976.367647:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:1.0:1783134976.367839:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373912064 00000100:00100000:1.0:1783134976.367857:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373912064 00000100:00080000:3.0:1783134976.367911:0:5766:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1783134976.367947:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 83 00000100:00100000:1.0:1783134976.367959:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9f5ca7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+17:10438:x1869752373912064:12345-192.168.201.41@tcp:101:lfs.0 00010000:00010000:1.0:1783134976.367990:0:5771:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783134976.368014:0:5771:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43f000/0xd6c4b8f05867eba8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4428da03f5eb7296 expref: -99 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134976.368338:0:5771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43e600/0xd6c4b8f05867ebaf lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134976.368356:0:5771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43e600/0xd6c4b8f05867ebaf lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134976.368370:0:5771:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43e600/0xd6c4b8f05867ebaf lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783134976.368384:0:5771:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00010000:00010000:1.0:1783134976.368556:0:5771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43f000/0xd6c4b8f05867eba8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb7296 expref: 20 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134976.368569:0:5771:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43e600/0xd6c4b8f05867ebaf lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb7296 expref: 19 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134976.368576:0:5771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9fe9e1c2bd00) 00010000:00010000:1.0:1783134976.368578:0:5771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1783134976.368583:0:5771:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fe9fe43e600, rc 0) 00000100:00100000:1.0:1783134976.368665:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9f5ca7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+19:10438:x1869752373912064:12345-192.168.201.41@tcp:101:lfs.0 Request processed in 707us (1029us total) trans 4294967363 rc 0/0 00000100:00100000:1.0:1783134976.368673:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 83 00000100:00100000:2.0:1783134976.376336:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:0.0:1783134976.377721:0:5769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373912192 00000100:00100000:0.0:1783134976.377737:0:5769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373912192 00000100:00100000:0.0:1783134976.377810:0:5769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 84 00000100:00100000:0.0:1783134976.377822:0:5769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9f68f4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+19:10438:x1869752373912192:12345-192.168.201.41@tcp:34:lfs.0 00010000:00010000:0.0:1783134976.377923:0:5769:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ade00/0xd6c4b8f05867ebbd lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134976.377945:0:5769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ade00/0xd6c4b8f05867ebbd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134976.377958:0:5769:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ade00/0xd6c4b8f05867ebbd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134976.377977:0:5769:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68aca00/0xd6c4b8f05867ebc4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134976.377984:0:5769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68aca00/0xd6c4b8f05867ebc4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134976.377990:0:5769:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68aca00/0xd6c4b8f05867ebc4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134976.378363:0:5769:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ad200/0xd6c4b8f05867ebcb lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134976.378372:0:5769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ad200/0xd6c4b8f05867ebcb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134976.378378:0:5769:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ad200/0xd6c4b8f05867ebcb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1783134976.378424:0:5769:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ad200/0xd6c4b8f05867ebcb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134976.378443:0:5769:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ade00/0xd6c4b8f05867ebbd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134976.378450:0:5769:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ade00/0xd6c4b8f05867ebbd lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134976.378457:0:5769:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ade00/0xd6c4b8f05867ebbd lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134976.378463:0:5769:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe9f68ade00 already unused, calling callback (ffffffffc1f634f0) 00010000:00010000:0.0:1783134976.378467:0:5769:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ade00/0xd6c4b8f05867ebbd lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134976.378475:0:5769:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ade00/0xd6c4b8f05867ebbd lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134976.378488:0:5769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9fe9e1c2bd00) 00010000:00010000:0.0:1783134976.378491:0:5769:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783134976.378497:0:5769:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ade00/0xd6c4b8f05867ebbd lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134976.378503:0:5769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ade00/0xd6c4b8f05867ebbd lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134976.378513:0:5769:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68aca00/0xd6c4b8f05867ebc4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134976.378519:0:5769:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68aca00/0xd6c4b8f05867ebc4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134976.378524:0:5769:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68aca00/0xd6c4b8f05867ebc4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134976.378534:0:5769:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe9f68aca00 already unused, calling callback (ffffffffc1f634f0) 00010000:00010000:0.0:1783134976.378537:0:5769:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68aca00/0xd6c4b8f05867ebc4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134976.378543:0:5769:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68aca00/0xd6c4b8f05867ebc4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134976.378551:0:5769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9fe9c8301800) 00010000:00010000:0.0:1783134976.378553:0:5769:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783134976.378556:0:5769:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68aca00/0xd6c4b8f05867ebc4 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134976.378561:0:5769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68aca00/0xd6c4b8f05867ebc4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134976.378574:0:5769:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ad200/0xd6c4b8f05867ebcb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134976.378580:0:5769:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ad200/0xd6c4b8f05867ebcb lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134976.378585:0:5769:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ad200/0xd6c4b8f05867ebcb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134976.378589:0:5769:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe9f68ad200 already unused, calling callback (ffffffffc1f634f0) 00010000:00010000:0.0:1783134976.378592:0:5769:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ad200/0xd6c4b8f05867ebcb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134976.378597:0:5769:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ad200/0xd6c4b8f05867ebcb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134976.378625:0:5769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9fe9c8301100) 00010000:00010000:0.0:1783134976.378627:0:5769:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783134976.378630:0:5769:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ad200/0xd6c4b8f05867ebcb lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134976.378637:0:5769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ad200/0xd6c4b8f05867ebcb lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783134976.378740:0:5769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9f68f4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+19:10438:x1869752373912192:12345-192.168.201.41@tcp:34:lfs.0 Request processed in 919us (2853us total) trans 0 rc 0/0 00000100:00100000:0.0:1783134976.378748:0:5769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 84 00000100:00100000:3.0:1783134976.401804:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:0.0:1783134976.403763:0:8031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373912448 00000100:00100000:0.0:1783134976.403783:0:8031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373912448 00000100:00100000:0.0:1783134976.403903:0:8031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 85 00000100:00100000:0.0:1783134976.403915:0:8031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9f5ca5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+19:10441:x1869752373912448:12345-192.168.201.41@tcp:101:lfs.0 00010000:00010000:0.0:1783134976.403941:0:8031:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783134976.403964:0:8031:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ad200/0xd6c4b8f05867ebd2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4428da03f5eb729d expref: -99 pid: 8031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134976.404059:0:8031:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68aca00/0xd6c4b8f05867ebd9 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134976.404077:0:8031:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68aca00/0xd6c4b8f05867ebd9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134976.404090:0:8031:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68aca00/0xd6c4b8f05867ebd9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134976.404107:0:8031:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ade00/0xd6c4b8f05867ebe0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134976.404123:0:8031:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ade00/0xd6c4b8f05867ebe0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134976.404130:0:8031:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ade00/0xd6c4b8f05867ebe0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134976.404561:0:8031:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ac000/0xd6c4b8f05867ebe7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134976.404573:0:8031:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ac000/0xd6c4b8f05867ebe7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134976.404581:0:8031:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ac000/0xd6c4b8f05867ebe7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783134976.404594:0:8031:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 9 00010000:00010000:0.0:1783134976.404727:0:8031:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68aca00/0xd6c4b8f05867ebd9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134976.404736:0:8031:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68aca00/0xd6c4b8f05867ebd9 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134976.404744:0:8031:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68aca00/0xd6c4b8f05867ebd9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134976.404751:0:8031:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe9f68aca00 already unused, calling callback (ffffffffc1f634f0) 00010000:00010000:0.0:1783134976.404757:0:8031:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68aca00/0xd6c4b8f05867ebd9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134976.404766:0:8031:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68aca00/0xd6c4b8f05867ebd9 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134976.404793:0:8031:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9fe9e1c2bd00) 00010000:00010000:0.0:1783134976.404797:0:8031:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783134976.404803:0:8031:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68aca00/0xd6c4b8f05867ebd9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134976.404810:0:8031:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68aca00/0xd6c4b8f05867ebd9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134976.404822:0:8031:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ade00/0xd6c4b8f05867ebe0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134976.404829:0:8031:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ade00/0xd6c4b8f05867ebe0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134976.404835:0:8031:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ade00/0xd6c4b8f05867ebe0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134976.404840:0:8031:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe9f68ade00 already unused, calling callback (ffffffffc1f634f0) 00010000:00010000:0.0:1783134976.404844:0:8031:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ade00/0xd6c4b8f05867ebe0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134976.404849:0:8031:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ade00/0xd6c4b8f05867ebe0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134976.404856:0:8031:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9fe9c8301100) 00010000:00010000:0.0:1783134976.404858:0:8031:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783134976.404861:0:8031:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ade00/0xd6c4b8f05867ebe0 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134976.404867:0:8031:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ade00/0xd6c4b8f05867ebe0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134976.404927:0:8031:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ad200/0xd6c4b8f05867ebd2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb729d expref: 22 pid: 8031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134976.404942:0:8031:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ac000/0xd6c4b8f05867ebe7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb729d expref: 21 pid: 8031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134976.404950:0:8031:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9fe9c8301800) 00010000:00010000:0.0:1783134976.404953:0:8031:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1783134976.404955:0:8031:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fe9f68ac000, rc 0) 00000100:00100000:0.0:1783134976.405058:0:8031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9f5ca5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+21:10441:x1869752373912448:12345-192.168.201.41@tcp:101:lfs.0 Request processed in 1145us (3264us total) trans 4294967364 rc 0/0 00000100:00100000:0.0:1783134976.405069:0:8031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 85 00000100:00100000:1.0:1783134976.409075:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:2.0:1783134976.409316:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373912576 00000100:00100000:2.0:1783134976.409329:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373912576 00000100:00100000:2.0:1783134976.409395:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 86 00000100:00100000:2.0:1783134976.409407:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9f6f65f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+21:10441:x1869752373912576:12345-192.168.201.41@tcp:54:lfs.0 00010000:00010000:2.0:1783134976.409495:0:5770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828000/0xd6c4b8f05867ebf5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134976.409515:0:5770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828000/0xd6c4b8f05867ebf5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134976.409528:0:5770:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828000/0xd6c4b8f05867ebf5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134976.409560:0:5770:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828000/0xd6c4b8f05867ebf5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134976.409568:0:5770:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828000/0xd6c4b8f05867ebf5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134976.409575:0:5770:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828000/0xd6c4b8f05867ebf5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134976.409582:0:5770:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe9c7828000 already unused, calling callback (ffffffffc1f634f0) 00010000:00010000:2.0:1783134976.409587:0:5770:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828000/0xd6c4b8f05867ebf5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134976.409595:0:5770:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828000/0xd6c4b8f05867ebf5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134976.409639:0:5770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9fe9c8301800) 00010000:00010000:2.0:1783134976.409642:0:5770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1783134976.409648:0:5770:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828000/0xd6c4b8f05867ebf5 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134976.409655:0:5770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828000/0xd6c4b8f05867ebf5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783134976.409754:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9f6f65f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+21:10441:x1869752373912576:12345-192.168.201.41@tcp:54:lfs.0 Request processed in 348us (696us total) trans 0 rc 0/0 00000100:00100000:2.0:1783134976.409762:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 86 00000100:00100000:3.0:1783134976.412396:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:2.0:1783134976.412677:0:5772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373912832 00000100:00100000:2.0:1783134976.412690:0:5772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373912832 00000100:00100000:2.0:1783134976.412750:0:5772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 21 00000100:00100000:2.0:1783134976.412764:0:5772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9cb43b450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+21:10441:x1869752373912832:12345-192.168.201.41@tcp:35:lfs.0 00000100:00100000:2.0:1783134976.413072:0:5772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9cb43b450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+22:10441:x1869752373912832:12345-192.168.201.41@tcp:35:lfs.0 Request processed in 310us (690us total) trans 4294967365 rc 0/0 00000100:00100000:2.0:1783134976.413081:0:5772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 21 00000100:00100000:1.0:1783134976.427238:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:3.0:1783134976.427325:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373913088 00000100:00100000:3.0:1783134976.427339:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373913088 00000100:00100000:3.0:1783134976.427407:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 87 00000100:00100000:3.0:1783134976.427420:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9f6f67480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+22:9962:x1869752373913088:12345-192.168.201.41@tcp:101:bash.0 00010000:00010000:3.0:1783134976.427451:0:5771:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783134976.427477:0:5771:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b75c00/0xd6c4b8f05867ebfc lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4428da03f5eb72a4 expref: -99 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134976.427623:0:5771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b74600/0xd6c4b8f05867ec03 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134976.427656:0:5771:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ac000/0xd6c4b8f05867ebe7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb729d expref: 23 pid: 8031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134976.427667:0:5771:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b74600/0xd6c4b8f05867ec03 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134976.427710:0:5771:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ac000/0xd6c4b8f05867ebe7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb729d expref: 23 pid: 8031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134976.427725:0:5771:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ac000/0xd6c4b8f05867ebe7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb729d expref: 23 pid: 8031 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783134976.427742:0:5771:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9f5ca7800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5771:1869752384411008:192.168.201.41@tcp:104: 00000100:00100000:3.0:1783134976.427865:0:5771:0:(client.c:2701:ptlrpc_set_wait()) set ffff9fe9c9d02a80 going to sleep for 11 seconds 00000100:00100000:1.0:1783134976.430329:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:3.0:1783134976.430360:0:5771:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9f5ca7800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5771:1869752384411008:192.168.201.41@tcp:104: 00010000:00010000:3.0:1783134976.430399:0:5771:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b74600/0xd6c4b8f05867ec03 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783134976.430474:0:5755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373913216 00000100:00100000:2.0:1783134976.430482:0:5755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373913216 00010000:00010000:2.0:1783134976.430543:0:5755:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ac000/0xd6c4b8f05867ebe7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb729d expref: 24 pid: 8031 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783134976.430580:0:5755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 47 00000100:00100000:2.0:1783134976.430591:0:5755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9f6f67100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+24:2369:x1869752373913216:12345-192.168.201.41@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783134976.430619:0:5755:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783134976.430644:0:5755:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ac000/0xd6c4b8f05867ebe7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb729d expref: 24 pid: 8031 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134976.430658:0:5755:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ac000/0xd6c4b8f05867ebe7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb729d expref: 24 pid: 8031 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134976.430688:0:5755:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ac000/0xd6c4b8f05867ebe7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb729d expref: 24 pid: 8031 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134976.430705:0:5755:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9fe9c8301800) 00010000:00010000:2.0:1783134976.430710:0:5755:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b74600/0xd6c4b8f05867ec03 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134976.430720:0:5755:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b74600/0xd6c4b8f05867ec03 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134976.430726:0:5755:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b74600/0xd6c4b8f05867ec03 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134976.430752:0:5755:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783134976.430809:0:5755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9f6f67100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+23:2369:x1869752373913216:12345-192.168.201.41@tcp:103:ldlm_bl.0 Request processed in 220us (493us total) trans 0 rc 0/0 00000100:00100000:2.0:1783134976.430814:0:5755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 47 00010000:00010000:1.0:1783134976.430901:0:5771:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b74600/0xd6c4b8f05867ec03 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134976.430912:0:5771:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b74600/0xd6c4b8f05867ec03 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783134976.430938:0:5771:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 9 00010000:00010000:1.0:1783134976.431211:0:5771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b75c00/0xd6c4b8f05867ebfc lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb72a4 expref: 24 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134976.431229:0:5771:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b74600/0xd6c4b8f05867ec03 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb72a4 expref: 23 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134976.431237:0:5771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9fe9c8301800) 00010000:00010000:1.0:1783134976.431241:0:5771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1783134976.431243:0:5771:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fe9d2b74600, rc 0) 00000100:00100000:1.0:1783134976.431271:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9f6f67480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+23:9962:x1869752373913088:12345-192.168.201.41@tcp:101:bash.0 Request processed in 3855us (4048us total) trans 4294967366 rc 0/0 00000100:00100000:1.0:1783134976.431304:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 87 00000100:00100000:2.0:1783134976.436002:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:0.0:1783134976.436700:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373913472 00000100:00100000:0.0:1783134976.436715:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373913472 00000100:00100000:0.0:1783134976.436795:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 88 00000100:00100000:0.0:1783134976.436806:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9f68f7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+23:9962:x1869752373913472:12345-192.168.201.41@tcp:36:bash.0 00010000:00010000:0.0:1783134976.437155:0:5770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68aca00/0xd6c4b8f05867ec11 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134976.437177:0:5770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68aca00/0xd6c4b8f05867ec11 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134976.437191:0:5770:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68aca00/0xd6c4b8f05867ec11 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1783134976.437252:0:5770:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967367 00000004:00010000:0.0:1783134976.438656:0:5770:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000ad11189a reply state 00000000b6cd46ba transno 4294967368 ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68aca00/0xd6c4b8f05867ec11 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783134976.438697:0:5770:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:0.0:1783134976.438845:0:5770:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967368 00000100:00100000:0.0:1783134976.439005:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9f68f7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+27:9962:x1869752373913472:12345-192.168.201.41@tcp:36:bash.0 Request processed in 2196us (3013us total) trans 4294967369 rc 0/0 00000100:00100000:0.0:1783134976.439015:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 88 00000020:00080000:0.0:1783134976.439021:0:5770:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00010000:00010000:3.0:1783134976.443661:0:3272:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68aca00/0xd6c4b8f05867ec11 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134976.443685:0:3272:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68aca00/0xd6c4b8f05867ec11 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134976.443801:0:3272:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68aca00/0xd6c4b8f05867ec11 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134976.443811:0:3272:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe9f68aca00 already unused, calling callback (ffffffffc1f634f0) 00010000:00010000:3.0:1783134976.443833:0:3272:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68aca00/0xd6c4b8f05867ec11 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134976.443842:0:3272:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68aca00/0xd6c4b8f05867ec11 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134976.443864:0:3272:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9fe9c8301800) 00010000:00010000:3.0:1783134976.443867:0:3272:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783134976.443872:0:3272:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68aca00/0xd6c4b8f05867ec11 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134976.443878:0:3272:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68aca00/0xd6c4b8f05867ec11 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783134976.444564:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:2.0:1783134976.444683:0:8031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373913600 00000100:00100000:2.0:1783134976.444694:0:8031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373913600 00000100:00100000:2.0:1783134976.444842:0:8031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 89 00000100:00100000:2.0:1783134976.444855:0:8031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fe843b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+26:9962:x1869752373913600:12345-192.168.201.41@tcp:101:bash.0 00010000:00010000:2.0:1783134976.444885:0:8031:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783134976.444913:0:8031:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828a00/0xd6c4b8f05867ec18 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4428da03f5eb72ab expref: -99 pid: 8031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134976.445033:0:8031:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828a00/0xd6c4b8f05867ec18 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb72ab expref: 27 pid: 8031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134976.445050:0:8031:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828a00/0xd6c4b8f05867ec18 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb72ab expref: 27 pid: 8031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134976.445075:0:8031:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9fe9c8301800) 00010000:00010000:2.0:1783134976.445078:0:8031:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1783134976.445080:0:8031:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fe9c7828a00, rc 0) 00000100:00100000:2.0:1783134976.445226:0:8031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fe843b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+27:9962:x1869752373913600:12345-192.168.201.41@tcp:101:bash.0 Request processed in 373us (669us total) trans 0 rc 0/0 00000100:00100000:2.0:1783134976.445232:0:8031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 89 00000100:00100000:1.0:1783134976.448253:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:3.0:1783134976.449040:0:7676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373913728 00000100:00100000:3.0:1783134976.449053:0:7676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373913728 00000100:00100000:3.0:1783134976.449161:0:7676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 33 00000100:00100000:3.0:1783134976.449175:0:7676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9f6f64e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+6:9962:x1869752373913728:12345-192.168.201.41@tcp:101:bash.0 00010000:00010000:3.0:1783134976.449201:0:7676:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783134976.449236:0:7676:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000061135695/0xd6c4b8f05867ec1f lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4428da03f5eb72b2 expref: -99 pid: 7676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1783134976.449273:0:7676:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3:0x0] initial LVB size: 9, mtime: 0x6a487afd, atime: 0x6a487afc, ctime: 0x6a487afd, blocks: 0xb 00010000:00010000:3.0:1783134976.449325:0:7676:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=258s v=(0 0) 00010000:00010000:3.0:1783134976.449332:0:7676:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783134976.449343:0:7676:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000061135695/0xd6c4b8f05867ec1f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb72b2 expref: 7 pid: 7676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134976.449366:0:7676:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000061135695/0xd6c4b8f05867ec1f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb72b2 expref: 7 pid: 7676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134976.449403:0:7676:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fe9d2b75a00, rc 0) 00000100:00100000:3.0:1783134976.449490:0:7676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9f6f64e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+7:9962:x1869752373913728:12345-192.168.201.41@tcp:101:bash.0 Request processed in 317us (1250us total) trans 0 rc 0/0 00000100:00100000:3.0:1783134976.449498:0:7676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 33 00000100:00080000:2.0:1783134976.449594:0:5766:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1783134976.451537:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:2.0:1783134976.451679:0:6580:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373913856 00000100:00100000:2.0:1783134976.451688:0:6580:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373913856 00002000:00010000:2.0:1783134976.451727:0:6580:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/3 (0->18446744073709551615) 00002000:00100000:2.0:1783134976.451732:0:6580:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9fe9f5ca7800 with x1869752373913856 ext(0->18446744073709551615) 00002000:00010000:2.0:1783134976.451742:0:6580:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9fe9f5ca7800. 00000100:00100000:2.0:1783134976.451767:0:6580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 1 00000100:00100000:2.0:1783134976.451774:0:6580:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9f5ca7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+7:2369:x1869752373913856:12345-192.168.201.41@tcp:10:bash.0 00002000:00010000:2.0:1783134976.452064:0:6580:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:2.0:1783134976.452067:0:6580:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb mtime from disk: 1783134973 -> 1783134976 00002000:00010000:2.0:1783134976.452070:0:6580:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb atime from disk: 1783134972 -> 1783134972 00002000:00010000:2.0:1783134976.452071:0:6580:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb ctime from disk: 1783134973 -> 1783134976 00002000:00010000:2.0:1783134976.452085:0:6580:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:2.0:1783134976.452146:0:6580:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9f5ca7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+8:2369:x1869752373913856:12345-192.168.201.41@tcp:10:bash.0 Request processed in 372us (617us total) trans 4294967306 rc 0/0 00000100:00100000:2.0:1783134976.452193:0:6580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 1 00002000:00010000:2.0:1783134976.452197:0:6580:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/3 (0->18446744073709551615) 00002000:00100000:2.0:1783134976.452199:0:6580:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9fe9f5ca7800 with x1869752373913856 ext(0->18446744073709551615) 00002000:00010000:2.0:1783134976.452203:0:6580:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9fe9f5ca7800. 00000100:00100000:0.0:1783134976.496633:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:2.0:1783134976.496839:0:5769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373913984 00000100:00100000:2.0:1783134976.496856:0:5769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373913984 00000100:00100000:2.0:1783134976.496974:0:5769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 90 00000100:00100000:2.0:1783134976.496987:0:5769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe8c6df7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+27:10456:x1869752373913984:12345-192.168.201.41@tcp:34:lfs.0 00010000:00010000:2.0:1783134976.497092:0:5769:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829800/0xd6c4b8f05867ec26 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134976.497115:0:5769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829800/0xd6c4b8f05867ec26 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134976.497131:0:5769:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829800/0xd6c4b8f05867ec26 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134976.497151:0:5769:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829200/0xd6c4b8f05867ec2d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134976.497159:0:5769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829200/0xd6c4b8f05867ec2d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134976.497166:0:5769:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829200/0xd6c4b8f05867ec2d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134976.497630:0:5769:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829400/0xd6c4b8f05867ec34 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134976.497648:0:5769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829400/0xd6c4b8f05867ec34 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134976.497656:0:5769:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829400/0xd6c4b8f05867ec34 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1783134976.497712:0:5769:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829400/0xd6c4b8f05867ec34 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134976.497726:0:5769:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829800/0xd6c4b8f05867ec26 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134976.497734:0:5769:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829800/0xd6c4b8f05867ec26 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134976.497742:0:5769:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829800/0xd6c4b8f05867ec26 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134976.497749:0:5769:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe9c7829800 already unused, calling callback (ffffffffc1f634f0) 00010000:00010000:2.0:1783134976.497755:0:5769:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829800/0xd6c4b8f05867ec26 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134976.497764:0:5769:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829800/0xd6c4b8f05867ec26 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134976.497779:0:5769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9fe9e1c2bd00) 00010000:00010000:2.0:1783134976.497783:0:5769:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783134976.497790:0:5769:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829800/0xd6c4b8f05867ec26 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134976.497797:0:5769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829800/0xd6c4b8f05867ec26 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134976.497821:0:5769:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829200/0xd6c4b8f05867ec2d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134976.497828:0:5769:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829200/0xd6c4b8f05867ec2d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134976.497834:0:5769:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829200/0xd6c4b8f05867ec2d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134976.497839:0:5769:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe9c7829200 already unused, calling callback (ffffffffc1f634f0) 00010000:00010000:2.0:1783134976.497842:0:5769:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829200/0xd6c4b8f05867ec2d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134976.497848:0:5769:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829200/0xd6c4b8f05867ec2d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134976.497856:0:5769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9fe9cc3c1800) 00010000:00010000:2.0:1783134976.497859:0:5769:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783134976.497862:0:5769:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829200/0xd6c4b8f05867ec2d lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134976.497867:0:5769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829200/0xd6c4b8f05867ec2d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134976.497884:0:5769:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829400/0xd6c4b8f05867ec34 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134976.497890:0:5769:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829400/0xd6c4b8f05867ec34 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134976.497896:0:5769:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829400/0xd6c4b8f05867ec34 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134976.497907:0:5769:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe9c7829400 already unused, calling callback (ffffffffc1f634f0) 00010000:00010000:2.0:1783134976.497910:0:5769:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829400/0xd6c4b8f05867ec34 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134976.497916:0:5769:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829400/0xd6c4b8f05867ec34 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134976.497925:0:5769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9fe9c8301800) 00010000:00010000:2.0:1783134976.497927:0:5769:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783134976.497930:0:5769:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829400/0xd6c4b8f05867ec34 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134976.497936:0:5769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829400/0xd6c4b8f05867ec34 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783134976.498041:0:5769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe8c6df7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+27:10456:x1869752373913984:12345-192.168.201.41@tcp:34:lfs.0 Request processed in 1056us (1433us total) trans 0 rc 0/0 00000100:00100000:2.0:1783134976.498051:0:5769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 90 00000100:00100000:1.0:1783134976.532827:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:3.0:1783134976.532926:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373914240 00000100:00100000:3.0:1783134976.532940:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373914240 00000100:00100000:3.0:1783134976.533029:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 91 00000100:00100000:3.0:1783134976.533109:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9f6f67800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+27:10459:x1869752373914240:12345-192.168.201.41@tcp:101:lfs.0 00010000:00010000:3.0:1783134976.533138:0:5771:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783134976.533171:0:5771:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b74e00/0xd6c4b8f05867ec3b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4428da03f5eb72b9 expref: -99 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134976.533388:0:5771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b74000/0xd6c4b8f05867ec42 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134976.533409:0:5771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b74000/0xd6c4b8f05867ec42 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134976.533543:0:5771:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b74000/0xd6c4b8f05867ec42 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134976.533565:0:5771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b75800/0xd6c4b8f05867ec49 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134976.533575:0:5771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b75800/0xd6c4b8f05867ec49 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134976.533633:0:5771:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b75800/0xd6c4b8f05867ec49 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134976.534773:0:5771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b75c00/0xd6c4b8f05867ec50 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134976.534792:0:5771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b75c00/0xd6c4b8f05867ec50 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134976.534801:0:5771:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b75c00/0xd6c4b8f05867ec50 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783134976.534815:0:5771:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:3.0:1783134976.534954:0:5771:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b74000/0xd6c4b8f05867ec42 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134976.534963:0:5771:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b74000/0xd6c4b8f05867ec42 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134976.534971:0:5771:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b74000/0xd6c4b8f05867ec42 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134976.534978:0:5771:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe9d2b74000 already unused, calling callback (ffffffffc1f634f0) 00010000:00010000:3.0:1783134976.534984:0:5771:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b74000/0xd6c4b8f05867ec42 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134976.534993:0:5771:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b74000/0xd6c4b8f05867ec42 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134976.535009:0:5771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9fe9e1c2bd00) 00010000:00010000:3.0:1783134976.535013:0:5771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783134976.535030:0:5771:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b74000/0xd6c4b8f05867ec42 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134976.535108:0:5771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b74000/0xd6c4b8f05867ec42 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134976.535125:0:5771:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b75800/0xd6c4b8f05867ec49 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134976.535131:0:5771:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b75800/0xd6c4b8f05867ec49 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134976.535137:0:5771:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b75800/0xd6c4b8f05867ec49 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134976.535143:0:5771:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe9d2b75800 already unused, calling callback (ffffffffc1f634f0) 00010000:00010000:3.0:1783134976.535146:0:5771:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b75800/0xd6c4b8f05867ec49 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134976.535153:0:5771:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b75800/0xd6c4b8f05867ec49 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134976.535161:0:5771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9fe9cb8f4000) 00010000:00010000:3.0:1783134976.535163:0:5771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783134976.535167:0:5771:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b75800/0xd6c4b8f05867ec49 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134976.535172:0:5771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b75800/0xd6c4b8f05867ec49 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134976.535234:0:5771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b74e00/0xd6c4b8f05867ec3b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb72b9 expref: 30 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134976.535263:0:5771:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b75c00/0xd6c4b8f05867ec50 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb72b9 expref: 29 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134976.535271:0:5771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9fe9c8301800) 00010000:00010000:3.0:1783134976.535274:0:5771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1783134976.535276:0:5771:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fe9d2b75c00, rc 0) 00000100:00100000:3.0:1783134976.538735:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9f6f67800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+29:10459:x1869752373914240:12345-192.168.201.41@tcp:101:lfs.0 Request processed in 5622us (5917us total) trans 4294967370 rc 0/0 00000100:00100000:3.0:1783134976.538748:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 91 00000100:00100000:3.0:1783134976.542187:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:0.0:1783134976.542264:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373914368 00000100:00100000:0.0:1783134976.542275:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373914368 00000100:00100000:0.0:1783134976.542428:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 92 00000100:00100000:0.0:1783134976.542442:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9f5ca6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+29:10459:x1869752373914368:12345-192.168.201.41@tcp:54:lfs.0 00010000:00010000:0.0:1783134976.542889:0:5770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ada00/0xd6c4b8f05867ec5e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134976.542915:0:5770:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b74600/0xd6c4b8f05867ec03 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb72a4 expref: 29 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134976.542924:0:5770:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ada00/0xd6c4b8f05867ec5e lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134976.542969:0:5770:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b74600/0xd6c4b8f05867ec03 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb72a4 expref: 29 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134976.542982:0:5770:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b74600/0xd6c4b8f05867ec03 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb72a4 expref: 29 pid: 5771 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783134976.542997:0:5770:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9e0476300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5770:1869752384411136:192.168.201.41@tcp:104: 00000100:00100000:0.0:1783134976.543168:0:5770:0:(client.c:2701:ptlrpc_set_wait()) set ffff9fe9fe944240 going to sleep for 11 seconds 00000100:00100000:2.0:1783134976.544998:0:5770:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9e0476300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5770:1869752384411136:192.168.201.41@tcp:104: 00010000:00010000:2.0:1783134976.545039:0:5770:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ada00/0xd6c4b8f05867ec5e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783134976.545212:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:1.0:1783134976.547532:0:5773:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373914624 00000100:00100000:1.0:1783134976.547548:0:5773:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373914624 00000100:00100000:1.0:1783134976.547646:0:5773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 22 00000100:00100000:1.0:1783134976.547659:0:5773:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9f5ca4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+30:5572:x1869752373914624:12345-192.168.201.41@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1783134976.548093:0:5773:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9f5ca4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+31:5572:x1869752373914624:12345-192.168.201.41@tcp:35:ldlm_bl.0 Request processed in 436us (2881us total) trans 4294967371 rc 0/0 00000100:00100000:1.0:1783134976.548121:0:5773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 22 00000100:00100000:0.0:1783134976.549821:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:2.0:1783134976.549942:0:5754:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373914752 00000100:00100000:2.0:1783134976.549954:0:5754:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373914752 00010000:00010000:2.0:1783134976.550003:0:5754:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b74600/0xd6c4b8f05867ec03 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb72a4 expref: 31 pid: 5771 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783134976.550088:0:5754:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 48 00000100:00100000:2.0:1783134976.550096:0:5754:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9e0476300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+31:2369:x1869752373914752:12345-192.168.201.41@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783134976.550128:0:5754:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783134976.550134:0:5754:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b74600/0xd6c4b8f05867ec03 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb72a4 expref: 31 pid: 5771 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134976.550146:0:5754:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b74600/0xd6c4b8f05867ec03 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb72a4 expref: 31 pid: 5771 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134976.550168:0:5754:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b74600/0xd6c4b8f05867ec03 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb72a4 expref: 31 pid: 5771 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134976.550183:0:5754:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9fe9c8301800) 00010000:00010000:2.0:1783134976.550187:0:5754:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ada00/0xd6c4b8f05867ec5e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134976.550196:0:5754:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ada00/0xd6c4b8f05867ec5e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134976.550202:0:5754:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ada00/0xd6c4b8f05867ec5e lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134976.550232:0:5754:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783134976.550343:0:5754:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9e0476300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+30:2369:x1869752373914752:12345-192.168.201.41@tcp:103:ldlm_bl.0 Request processed in 245us (532us total) trans 0 rc 0/0 00000100:00100000:2.0:1783134976.550351:0:5754:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 48 00010000:00010000:3.0:1783134976.550412:0:5770:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ada00/0xd6c4b8f05867ec5e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134976.550422:0:5770:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ada00/0xd6c4b8f05867ec5e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134976.550460:0:5770:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ada00/0xd6c4b8f05867ec5e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134976.550468:0:5770:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ada00/0xd6c4b8f05867ec5e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134976.550476:0:5770:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ada00/0xd6c4b8f05867ec5e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134976.550482:0:5770:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe9f68ada00 already unused, calling callback (ffffffffc1f634f0) 00010000:00010000:3.0:1783134976.550488:0:5770:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ada00/0xd6c4b8f05867ec5e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134976.550505:0:5770:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ada00/0xd6c4b8f05867ec5e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134976.550516:0:5770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9fe9c8301800) 00010000:00010000:3.0:1783134976.550519:0:5770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1783134976.550523:0:5770:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ada00/0xd6c4b8f05867ec5e lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134976.550529:0:5770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ada00/0xd6c4b8f05867ec5e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783134976.550576:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9f5ca6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+29:10459:x1869752373914368:12345-192.168.201.41@tcp:54:lfs.0 Request processed in 8138us (8401us total) trans 0 rc 0/0 00000100:00100000:3.0:1783134976.550585:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 92 00000100:00100000:3.0:1783134976.556483:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:2.0:1783134976.557710:0:5772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373915008 00000100:00100000:2.0:1783134976.557726:0:5772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373915008 00000100:00100000:2.0:1783134976.557799:0:5772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 23 00000100:00100000:2.0:1783134976.557808:0:5772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9f5ca6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+29:10459:x1869752373915008:12345-192.168.201.41@tcp:35:lfs.0 00000100:00100000:2.0:1783134976.558136:0:5772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9f5ca6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+30:10459:x1869752373915008:12345-192.168.201.41@tcp:35:lfs.0 Request processed in 328us (1669us total) trans 4294967372 rc 0/0 00000100:00100000:2.0:1783134976.558143:0:5772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 23 00000100:00100000:1.0:1783134976.613778:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:2.0:1783134976.614246:0:8031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373915264 00000100:00100000:2.0:1783134976.614258:0:8031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373915264 00000100:00100000:2.0:1783134976.614350:0:8031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 93 00000100:00100000:2.0:1783134976.614366:0:8031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9f6f64380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+30:10470:x1869752373915264:12345-192.168.201.41@tcp:101:cat.0 00010000:00010000:2.0:1783134976.614393:0:8031:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783134976.614415:0:8031:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829400/0xd6c4b8f05867ec65 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4428da03f5eb72c0 expref: -99 pid: 8031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134976.614494:0:8031:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829200/0xd6c4b8f05867ec6c lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134976.614507:0:8031:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829200/0xd6c4b8f05867ec6c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134976.614518:0:8031:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829200/0xd6c4b8f05867ec6c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134976.614529:0:8031:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829800/0xd6c4b8f05867ec73 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134976.614534:0:8031:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829800/0xd6c4b8f05867ec73 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134976.614538:0:8031:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829800/0xd6c4b8f05867ec73 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134976.614955:0:8031:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829000/0xd6c4b8f05867ec7a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134976.614972:0:8031:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829000/0xd6c4b8f05867ec7a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134976.614979:0:8031:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829000/0xd6c4b8f05867ec7a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783134976.614990:0:8031:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 8 00010000:00010000:2.0:1783134976.615112:0:8031:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829200/0xd6c4b8f05867ec6c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134976.615120:0:8031:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829200/0xd6c4b8f05867ec6c lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134976.615127:0:8031:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829200/0xd6c4b8f05867ec6c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134976.615133:0:8031:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe9c7829200 already unused, calling callback (ffffffffc1f634f0) 00010000:00010000:2.0:1783134976.615138:0:8031:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829200/0xd6c4b8f05867ec6c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134976.615145:0:8031:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829200/0xd6c4b8f05867ec6c lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134976.615158:0:8031:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9fe9e1c2bd00) 00010000:00010000:2.0:1783134976.615162:0:8031:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783134976.615166:0:8031:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829200/0xd6c4b8f05867ec6c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134976.615173:0:8031:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829200/0xd6c4b8f05867ec6c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134976.615185:0:8031:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829800/0xd6c4b8f05867ec73 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134976.615197:0:8031:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829800/0xd6c4b8f05867ec73 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134976.615203:0:8031:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829800/0xd6c4b8f05867ec73 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134976.615208:0:8031:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe9c7829800 already unused, calling callback (ffffffffc1f634f0) 00010000:00010000:2.0:1783134976.615210:0:8031:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829800/0xd6c4b8f05867ec73 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134976.615216:0:8031:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829800/0xd6c4b8f05867ec73 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134976.615223:0:8031:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9fe9cc3c1800) 00010000:00010000:2.0:1783134976.615225:0:8031:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783134976.615228:0:8031:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829800/0xd6c4b8f05867ec73 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134976.615234:0:8031:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829800/0xd6c4b8f05867ec73 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134976.615325:0:8031:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829400/0xd6c4b8f05867ec65 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb72c0 expref: 33 pid: 8031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134976.615341:0:8031:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829000/0xd6c4b8f05867ec7a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb72c0 expref: 32 pid: 8031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134976.615349:0:8031:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9fe9c8301800) 00010000:00010000:2.0:1783134976.615352:0:8031:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1783134976.615360:0:8031:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fe9c7829000, rc 0) 00000100:00100000:2.0:1783134976.615445:0:8031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9f6f64380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+32:10470:x1869752373915264:12345-192.168.201.41@tcp:101:cat.0 Request processed in 1081us (1681us total) trans 4294967373 rc 0/0 00000100:00100000:2.0:1783134976.615454:0:8031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 93 00000100:00100000:0.0:1783134976.619859:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:2.0:1783134976.619908:0:5772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373915520 00000100:00100000:2.0:1783134976.619921:0:5772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373915520 00000100:00100000:2.0:1783134976.619988:0:5772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 24 00000100:00100000:2.0:1783134976.619999:0:5772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9cb338000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+32:10470:x1869752373915520:12345-192.168.201.41@tcp:35:cat.0 00000100:00100000:2.0:1783134976.620554:0:5772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9cb338000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+33:10470:x1869752373915520:12345-192.168.201.41@tcp:35:cat.0 Request processed in 554us (705us total) trans 4294967374 rc 0/0 00000100:00100000:2.0:1783134976.620563:0:5772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 24 00000100:00100000:1.0:1783134976.635440:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:2.0:1783134976.635559:0:5769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373915776 00000100:00100000:2.0:1783134976.635573:0:5769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373915776 00000100:00100000:2.0:1783134976.635661:0:5769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 94 00000100:00100000:2.0:1783134976.635674:0:5769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9f6f64a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+33:10471:x1869752373915776:12345-192.168.201.41@tcp:36:rm.0 00010000:00010000:2.0:1783134976.635758:0:5769:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1783134976.635796:0:5769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829000/0xd6c4b8f05867ec7a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb72c0 expref: 33 pid: 8031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134976.635824:0:5769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b75c00/0xd6c4b8f05867ec50 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb72b9 expref: 32 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134976.635839:0:5769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828a00/0xd6c4b8f05867ec18 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb72ab expref: 31 pid: 8031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134976.635854:0:5769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9fe9c8301800) 00010000:00010000:2.0:1783134976.635868:0:5769:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1783134976.635914:0:5769:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829400/0xd6c4b8f05867ec88 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134976.635930:0:5769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829400/0xd6c4b8f05867ec88 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134976.635940:0:5769:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829400/0xd6c4b8f05867ec88 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134976.635955:0:5769:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829800/0xd6c4b8f05867ec8f lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134976.635962:0:5769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829800/0xd6c4b8f05867ec8f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134976.635968:0:5769:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829800/0xd6c4b8f05867ec8f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134976.636366:0:5769:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829200/0xd6c4b8f05867ec96 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134976.636376:0:5769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829200/0xd6c4b8f05867ec96 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134976.636384:0:5769:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829200/0xd6c4b8f05867ec96 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1783134976.637070:0:5769:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].4, 64 off8472 00000004:00080000:2.0:1783134976.637083:0:5769:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 259032802770ns, next at 260032799742ns, rc = 0 00010000:00010000:2.0:1783134976.637148:0:5769:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828000/0xd6c4b8f05867ec9d lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134976.637159:0:5769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828000/0xd6c4b8f05867ec9d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134976.637176:0:5769:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828000/0xd6c4b8f05867ec9d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134976.637184:0:5769:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828000/0xd6c4b8f05867ec9d lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134976.637189:0:5769:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828000/0xd6c4b8f05867ec9d lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134976.637193:0:5769:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828000/0xd6c4b8f05867ec9d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134976.637216:0:5769:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1783134976.637237:0:5769:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829200/0xd6c4b8f05867ec96 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134976.637242:0:5769:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829200/0xd6c4b8f05867ec96 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134976.637249:0:5769:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829200/0xd6c4b8f05867ec96 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134976.637255:0:5769:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe9c7829200 already unused, calling callback (ffffffffc1f634f0) 00010000:00010000:2.0:1783134976.637260:0:5769:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829200/0xd6c4b8f05867ec96 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134976.637268:0:5769:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829200/0xd6c4b8f05867ec96 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134976.637320:0:5769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9fe9cc3c1f00) 00010000:00010000:2.0:1783134976.637323:0:5769:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1783134976.637334:0:5769:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829200/0xd6c4b8f05867ec96 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134976.637340:0:5769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829200/0xd6c4b8f05867ec96 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134976.637359:0:5769:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829400/0xd6c4b8f05867ec88 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134976.637365:0:5769:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829400/0xd6c4b8f05867ec88 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134976.637371:0:5769:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829400/0xd6c4b8f05867ec88 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134976.637375:0:5769:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe9c7829400 already unused, calling callback (ffffffffc1f634f0) 00010000:00010000:2.0:1783134976.637378:0:5769:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829400/0xd6c4b8f05867ec88 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134976.637383:0:5769:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829400/0xd6c4b8f05867ec88 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134976.637391:0:5769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9fe9e1c2bd00) 00010000:00010000:2.0:1783134976.637393:0:5769:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783134976.637395:0:5769:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829400/0xd6c4b8f05867ec88 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134976.637401:0:5769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829400/0xd6c4b8f05867ec88 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1783134976.637410:0:5769:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000e2767e75 reply state 00000000ab2fa972 transno 4294967375 ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829800/0xd6c4b8f05867ec8f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783134976.637431:0:5769:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1783134976.637545:0:5769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9f6f64a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+32:10471:x1869752373915776:12345-192.168.201.41@tcp:36:rm.0 Request processed in 1868us (2116us total) trans 4294967375 rc 0/0 00000100:00100000:2.0:1783134976.637555:0:5769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 94 00010000:00010000:0.0:1783134976.637663:0:6591:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783134976.637673:0:6591:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828000/0xd6c4b8f05867ec9d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134976.637680:0:6591:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe9c7828000 already unused, calling callback (ffffffffc1527ce0) 00010000:00010000:0.0:1783134976.637683:0:6591:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828000/0xd6c4b8f05867ec9d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134976.637690:0:6591:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828000/0xd6c4b8f05867ec9d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134976.637699:0:6591:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9fe9cc3c1f00) 00010000:00010000:0.0:1783134976.637702:0:6591:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1783134976.637705:0:6591:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828000/0xd6c4b8f05867ec9d lrc: 1/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134976.637711:0:6591:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828000/0xd6c4b8f05867ec9d lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134976.637730:0:6591:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783134976.637732:0:6591:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783134976.637734:0:6591:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783134976.642467:0:3273:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829800/0xd6c4b8f05867ec8f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134976.642491:0:3273:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829800/0xd6c4b8f05867ec8f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134976.642500:0:3273:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829800/0xd6c4b8f05867ec8f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134976.642507:0:3273:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe9c7829800 already unused, calling callback (ffffffffc1f634f0) 00010000:00010000:3.0:1783134976.642514:0:3273:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829800/0xd6c4b8f05867ec8f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134976.642522:0:3273:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829800/0xd6c4b8f05867ec8f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134976.642570:0:3273:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9fe9cc3c1800) 00010000:00010000:3.0:1783134976.642574:0:3273:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783134976.642580:0:3273:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829800/0xd6c4b8f05867ec8f lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134976.642586:0:3273:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829800/0xd6c4b8f05867ec8f lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783134976.664119:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:2.0:1783134976.664219:0:8031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373916032 00000100:00100000:2.0:1783134976.664229:0:8031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373916032 00000100:00100000:2.0:1783134976.664324:0:8031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 95 00000100:00100000:2.0:1783134976.664333:0:8031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9f6f66300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+31:10477:x1869752373916032:12345-192.168.201.41@tcp:101:bash.0 00010000:00010000:2.0:1783134976.664362:0:8031:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783134976.664385:0:8031:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829400/0xd6c4b8f05867eca4 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4428da03f5eb72c7 expref: -99 pid: 8031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134976.664523:0:8031:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829200/0xd6c4b8f05867ecab lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134976.664538:0:8031:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829200/0xd6c4b8f05867ecab lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134976.664551:0:8031:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829200/0xd6c4b8f05867ecab lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134976.664569:0:8031:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828a00/0xd6c4b8f05867ecb2 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134976.664577:0:8031:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828a00/0xd6c4b8f05867ecb2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134976.664584:0:8031:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828a00/0xd6c4b8f05867ecb2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1783134976.665190:0:8031:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x3:0x0], index 0: 0 00010000:00010000:2.0:1783134976.665380:0:8031:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829000/0xd6c4b8f05867ecb9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134976.665389:0:8031:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829000/0xd6c4b8f05867ecb9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134976.665395:0:8031:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829000/0xd6c4b8f05867ecb9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134976.665423:0:8031:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829200/0xd6c4b8f05867ecab lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134976.665429:0:8031:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829200/0xd6c4b8f05867ecab lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134976.665434:0:8031:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829200/0xd6c4b8f05867ecab lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134976.665438:0:8031:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe9c7829200 already unused, calling callback (ffffffffc1f634f0) 00010000:00010000:2.0:1783134976.665441:0:8031:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829200/0xd6c4b8f05867ecab lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134976.665446:0:8031:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829200/0xd6c4b8f05867ecab lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134976.665456:0:8031:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9fe9e1c2bd00) 00010000:00010000:2.0:1783134976.665458:0:8031:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783134976.665463:0:8031:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829200/0xd6c4b8f05867ecab lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134976.665474:0:8031:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829200/0xd6c4b8f05867ecab lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1783134976.665485:0:8031:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000008327a83f reply state 00000000b59e27e8 transno 4294967376 ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828a00/0xd6c4b8f05867ecb2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783134976.665492:0:8031:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1783134976.665517:0:8031:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829400/0xd6c4b8f05867eca4 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb72c7 expref: 34 pid: 8031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134976.665527:0:8031:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829000/0xd6c4b8f05867ecb9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb72c7 expref: 33 pid: 8031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134976.665534:0:8031:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9fe9cc3c1b00) 00010000:00010000:2.0:1783134976.665536:0:8031:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1783134976.665539:0:8031:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fe9c7829000, rc 0) 00000100:00100000:2.0:1783134976.665650:0:8031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9f6f66300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+34:10477:x1869752373916032:12345-192.168.201.41@tcp:101:bash.0 Request processed in 1316us (1544us total) trans 4294967376 rc 0/0 00000100:00100000:2.0:1783134976.665659:0:8031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 95 00010000:00010000:3.0:1783134976.668016:0:3272:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828a00/0xd6c4b8f05867ecb2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134976.668032:0:3272:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828a00/0xd6c4b8f05867ecb2 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134976.668038:0:3272:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828a00/0xd6c4b8f05867ecb2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134976.668042:0:3272:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe9c7828a00 already unused, calling callback (ffffffffc1f634f0) 00010000:00010000:3.0:1783134976.668046:0:3272:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828a00/0xd6c4b8f05867ecb2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134976.668051:0:3272:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828a00/0xd6c4b8f05867ecb2 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134976.668067:0:3272:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9fe9cc3c1a00) 00010000:00010000:3.0:1783134976.668069:0:3272:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783134976.668072:0:3272:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828a00/0xd6c4b8f05867ecb2 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134976.668075:0:3272:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828a00/0xd6c4b8f05867ecb2 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783134976.668438:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:2.0:1783134976.668512:0:6574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373916160 00000100:00100000:2.0:1783134976.668523:0:6574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373916160 00000100:00100000:2.0:1783134976.668597:0:6574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 34 00000100:00100000:2.0:1783134976.668620:0:6574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fe82ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+7:2367:x1869752373916160:12345-192.168.201.41@tcp:101:bash.0 00010000:00010000:2.0:1783134976.668646:0:6574:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783134976.668670:0:6574:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000095ed05d7/0xd6c4b8f05867ecc7 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4428da03f5eb72ce expref: -99 pid: 6574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1783134976.668714:0:6574:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1783134976.668740:0:6574:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=259s v=(0 0) 00010000:00010000:2.0:1783134976.668745:0:6574:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783134976.668756:0:6574:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000095ed05d7/0xd6c4b8f05867ecc7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb72ce expref: 8 pid: 6574 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134976.668776:0:6574:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000095ed05d7/0xd6c4b8f05867ecc7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb72ce expref: 8 pid: 6574 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134976.668790:0:6574:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fe9c7828600, rc 0) 00000100:00100000:2.0:1783134976.668848:0:6574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fe82ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+8:2367:x1869752373916160:12345-192.168.201.41@tcp:101:bash.0 Request processed in 231us (414us total) trans 0 rc 0/0 00000100:00100000:2.0:1783134976.668855:0:6574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 34 00000100:00080000:3.0:1783134976.668945:0:5766:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1783134976.670872:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:2.0:1783134976.670934:0:6577:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373916288 00000100:00100000:2.0:1783134976.670944:0:6577:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373916288 00000100:00100000:2.0:1783134976.671039:0:6577:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 35 00000100:00100000:2.0:1783134976.671052:0:6577:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fe828a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+8:10477:x1869752373916288:12345-192.168.201.41@tcp:101:bash.0 00010000:00010000:2.0:1783134976.671074:0:6577:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783134976.671095:0:6577:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006747ba8e/0xd6c4b8f05867ecce lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4428da03f5eb72d5 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134976.671133:0:6577:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000095ed05d7/0xd6c4b8f05867ecc7 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb72ce expref: 9 pid: 6574 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134976.671166:0:6577:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783134976.671170:0:6577:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783134976.671177:0:6577:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006747ba8e/0xd6c4b8f05867ecce lrc: 4/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb72d5 expref: 9 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134976.671217:0:6577:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000095ed05d7/0xd6c4b8f05867ecc7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb72ce expref: 9 pid: 6574 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134976.671233:0:6577:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000095ed05d7/0xd6c4b8f05867ecc7 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb72ce expref: 9 pid: 6574 timeout: 359 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783134976.671249:0:6577:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9f68f7b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6577:1869752384411264:192.168.201.41@tcp:104: 00000100:00100000:2.0:1783134976.671407:0:6577:0:(client.c:2701:ptlrpc_set_wait()) set ffff9fe9f615c6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783134976.678307:0:6577:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9f68f7b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6577:1869752384411264:192.168.201.41@tcp:104: 00010000:00010000:2.0:1783134976.678358:0:6577:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000006747ba8e/0xd6c4b8f05867ecce lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb72d5 expref: 9 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134976.678386:0:6577:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fe9c7829600, rc 0) 00000100:00100000:2.0:1783134976.678526:0:6577:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fe828a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+9:10477:x1869752373916288:12345-192.168.201.41@tcp:101:bash.0 Request processed in 7475us (7659us total) trans 0 rc 0/0 00000100:00100000:2.0:1783134976.678546:0:6577:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 35 00000100:00100000:0.0:1783134976.678760:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:2.0:1783134976.678862:0:5755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373916416 00000100:00100000:2.0:1783134976.678870:0:5755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373916416 00010000:00010000:2.0:1783134976.678908:0:5755:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000095ed05d7/0xd6c4b8f05867ecc7 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb72ce expref: 9 pid: 6574 timeout: 359 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783134976.678962:0:5755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 49 00000100:00100000:2.0:1783134976.678972:0:5755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9d1620c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+9:2370:x1869752373916416:12345-192.168.201.41@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783134976.678989:0:5755:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783134976.679014:0:5755:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000095ed05d7/0xd6c4b8f05867ecc7 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb72ce expref: 9 pid: 6574 timeout: 359 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134976.679028:0:5755:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000095ed05d7/0xd6c4b8f05867ecc7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb72ce expref: 9 pid: 6574 timeout: 359 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134976.679057:0:5755:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000095ed05d7/0xd6c4b8f05867ecc7 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb72ce expref: 9 pid: 6574 timeout: 359 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134976.679077:0:5755:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783134976.679083:0:5755:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783134976.679093:0:5755:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000006747ba8e/0xd6c4b8f05867ecce lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb72d5 expref: 8 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134976.679105:0:5755:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006747ba8e/0xd6c4b8f05867ecce lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb72d5 expref: 8 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134976.679144:0:5755:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000006747ba8e/0xd6c4b8f05867ecce lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb72d5 expref: 8 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783134976.679161:0:5755:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9f68f7b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5755:1869752384411392:192.168.201.41@tcp:105: 00000100:00100000:2.0:1783134976.679236:0:5755:0:(client.c:2701:ptlrpc_set_wait()) set ffff9fe9f615c6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783134976.683416:0:5755:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9f68f7b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5755:1869752384411392:192.168.201.41@tcp:105: 00010000:00010000:2.0:1783134976.683459:0:5755:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783134976.683733:0:5755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9d1620c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+8:2370:x1869752373916416:12345-192.168.201.41@tcp:103:ldlm_bl.0 Request processed in 4760us (4972us total) trans 0 rc 0/0 00000100:00100000:2.0:1783134976.683746:0:5755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 49 00000100:00100000:0.0:1783134976.684142:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:2.0:1783134976.684376:0:5773:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373916672 00000100:00100000:2.0:1783134976.684386:0:5773:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373916672 00000100:00100000:2.0:1783134976.684493:0:5773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 25 00000100:00100000:2.0:1783134976.684504:0:5773:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9cb339880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+33:10477:x1869752373916672:12345-192.168.201.41@tcp:35:bash.0 00000100:00100000:2.0:1783134976.684977:0:5773:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9cb339880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+34:10477:x1869752373916672:12345-192.168.201.41@tcp:35:bash.0 Request processed in 475us (836us total) trans 4294967377 rc 0/0 00000100:00100000:2.0:1783134976.684983:0:5773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 25 00000100:00100000:0.0:1783134976.772180:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:3.0:1783134976.772308:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373916800 00000100:00100000:3.0:1783134976.772321:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373916800 00000100:00100000:3.0:1783134976.772402:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 96 00000100:00100000:3.0:1783134976.772414:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9f6897800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+34:10493:x1869752373916800:12345-192.168.201.41@tcp:101:lfs.0 00010000:00010000:3.0:1783134976.772496:0:5770:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783134976.772740:0:5770:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b74e00/0xd6c4b8f05867ecd5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4428da03f5eb72dc expref: -99 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134976.772818:0:5770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b75800/0xd6c4b8f05867ecdc lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134976.772833:0:5770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b75800/0xd6c4b8f05867ecdc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134976.772843:0:5770:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b75800/0xd6c4b8f05867ecdc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783134976.772964:0:5770:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00000004:00200000:3.0:1783134976.772967:0:5770:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:3.0:1783134976.772989:0:5770:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b75800/0xd6c4b8f05867ecdc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134976.773073:0:5770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b74e00/0xd6c4b8f05867ecd5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb72dc expref: 36 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134976.773101:0:5770:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b75800/0xd6c4b8f05867ecdc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb72dc expref: 35 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134976.773119:0:5770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9fe9e1c2bd00) 00010000:00010000:3.0:1783134976.773121:0:5770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1783134976.773124:0:5770:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fe9d2b75800, rc 0) 00000100:00100000:3.0:1783134976.773191:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9f6897800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+35:10493:x1869752373916800:12345-192.168.201.41@tcp:101:lfs.0 Request processed in 779us (1025us total) trans 0 rc 0/0 00000100:00100000:3.0:1783134976.773198:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 96 00000100:00100000:1.0:1783134976.779074:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:3.0:1783134976.779181:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373917056 00000100:00100000:3.0:1783134976.779194:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373917056 00000100:00100000:3.0:1783134976.779270:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 97 00000100:00100000:3.0:1783134976.779428:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fe828000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+35:10493:x1869752373917056:12345-192.168.201.41@tcp:101:lfs.0 00010000:00010000:3.0:1783134976.779460:0:5771:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783134976.779488:0:5771:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b74e00/0xd6c4b8f05867ece3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4428da03f5eb72e3 expref: -99 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134976.779648:0:5771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b74000/0xd6c4b8f05867ecea lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134976.779665:0:5771:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829000/0xd6c4b8f05867ecb9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb72c7 expref: 36 pid: 8031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134976.779676:0:5771:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b74000/0xd6c4b8f05867ecea lrc: 4/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134976.779753:0:5771:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829000/0xd6c4b8f05867ecb9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb72c7 expref: 36 pid: 8031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134976.779770:0:5771:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829000/0xd6c4b8f05867ecb9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb72c7 expref: 36 pid: 8031 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783134976.779797:0:5771:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9f68f2680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5771:1869752384411520:192.168.201.41@tcp:104: 00000100:00100000:3.0:1783134976.779993:0:5771:0:(client.c:2701:ptlrpc_set_wait()) set ffff9fe9c9d02a80 going to sleep for 11 seconds 00000100:00100000:1.0:1783134976.788799:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:0.0:1783134976.789230:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373917184 00000100:00100000:0.0:1783134976.789243:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373917184 00000100:00100000:3.0:1783134976.789864:0:5771:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9f68f2680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5771:1869752384411520:192.168.201.41@tcp:104: 00010000:00010000:3.0:1783134976.789906:0:5771:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b74000/0xd6c4b8f05867ecea lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134976.790135:0:6592:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829000/0xd6c4b8f05867ecb9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb72c7 expref: 37 pid: 8031 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783134976.790252:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 50 00000100:00100000:0.0:1783134976.790265:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fe82a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+37:2369:x1869752373917184:12345-192.168.201.41@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783134976.790311:0:6592:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783134976.790320:0:6592:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829000/0xd6c4b8f05867ecb9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb72c7 expref: 37 pid: 8031 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134976.790334:0:6592:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829000/0xd6c4b8f05867ecb9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb72c7 expref: 37 pid: 8031 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134976.790361:0:6592:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829000/0xd6c4b8f05867ecb9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb72c7 expref: 37 pid: 8031 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134976.790381:0:6592:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9fe9cc3c1b00) 00010000:00010000:0.0:1783134976.790387:0:6592:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b74000/0xd6c4b8f05867ecea lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134976.790398:0:6592:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b74000/0xd6c4b8f05867ecea lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134976.790406:0:6592:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b74000/0xd6c4b8f05867ecea lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134976.790435:0:6592:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1783134976.790467:0:5771:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b74000/0xd6c4b8f05867ecea lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134976.790477:0:5771:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b74000/0xd6c4b8f05867ecea lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783134976.790502:0:5771:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00000100:00100000:0.0:1783134976.790504:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fe82a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+36:2369:x1869752373917184:12345-192.168.201.41@tcp:103:ldlm_bl.0 Request processed in 240us (1718us total) trans 0 rc 0/0 00000100:00100000:0.0:1783134976.790528:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 50 00010000:00010000:3.0:1783134976.791675:0:5771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b74e00/0xd6c4b8f05867ece3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb72e3 expref: 37 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134976.791701:0:5771:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b74000/0xd6c4b8f05867ecea lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb72e3 expref: 36 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134976.791711:0:5771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9fe9cc3c1b00) 00010000:00010000:3.0:1783134976.791714:0:5771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1783134976.791717:0:5771:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fe9d2b74000, rc 0) 00000100:00100000:3.0:1783134976.791858:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fe828000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+36:10493:x1869752373917056:12345-192.168.201.41@tcp:101:lfs.0 Request processed in 12578us (12799us total) trans 4294967378 rc 0/0 00000100:00100000:3.0:1783134976.791865:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 97 00000100:00100000:1.0:1783134976.796018:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:2.0:1783134976.796110:0:5769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373917440 00000100:00100000:2.0:1783134976.796123:0:5769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373917440 00000100:00100000:2.0:1783134976.796197:0:5769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 98 00000100:00100000:2.0:1783134976.796209:0:5769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fe828700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+36:10493:x1869752373917440:12345-192.168.201.41@tcp:101:lfs.0 00010000:00010000:2.0:1783134976.796240:0:5769:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783134976.796244:0:5769:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1783134976.796276:0:5769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b74000/0xd6c4b8f05867ecea lrc: 0/0,0 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb72e3 expref: 36 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134976.796342:0:5769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9fe9cc3c1b00) 00010000:00010000:2.0:1783134976.796354:0:5769:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1783134976.796372:0:5769:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828600/0xd6c4b8f05867ecf8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4428da03f5eb72ea expref: -99 pid: 5769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134976.796533:0:5769:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829400/0xd6c4b8f05867ecff lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134976.796550:0:5769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829400/0xd6c4b8f05867ecff lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134976.796562:0:5769:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829400/0xd6c4b8f05867ecff lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783134976.796577:0:5769:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:2.0:1783134976.796743:0:5769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828600/0xd6c4b8f05867ecf8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb72ea expref: 38 pid: 5769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134976.796761:0:5769:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829400/0xd6c4b8f05867ecff lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb72ea expref: 37 pid: 5769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134976.796769:0:5769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9fe9cc3c1f00) 00010000:00010000:2.0:1783134976.796772:0:5769:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1783134976.796774:0:5769:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fe9c7829400, rc 0) 00000100:00100000:2.0:1783134976.796858:0:5769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fe828700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+37:10493:x1869752373917440:12345-192.168.201.41@tcp:101:lfs.0 Request processed in 650us (855us total) trans 4294967379 rc 0/0 00000100:00100000:2.0:1783134976.796866:0:5769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 98 00000100:00100000:1.0:1783134976.800039:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:2.0:1783134976.800668:0:8031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373917568 00000100:00100000:2.0:1783134976.800680:0:8031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373917568 00000100:00100000:2.0:1783134976.800750:0:8031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 99 00000100:00100000:2.0:1783134976.800763:0:8031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fe82bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+37:10493:x1869752373917568:12345-192.168.201.41@tcp:101:lfs.0 00010000:00010000:2.0:1783134976.800794:0:8031:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783134976.800833:0:8031:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829200/0xd6c4b8f05867ed0d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4428da03f5eb72f1 expref: -99 pid: 8031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134976.800907:0:8031:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829200/0xd6c4b8f05867ed0d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb72f1 expref: 38 pid: 8031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134976.800924:0:8031:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829200/0xd6c4b8f05867ed0d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb72f1 expref: 38 pid: 8031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134976.800948:0:8031:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9fe9cc3c1f00) 00010000:00010000:2.0:1783134976.800952:0:8031:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1783134976.800956:0:8031:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fe9c7829200, rc 0) 00000100:00100000:2.0:1783134976.801028:0:8031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fe82bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+38:10493:x1869752373917568:12345-192.168.201.41@tcp:101:lfs.0 Request processed in 267us (999us total) trans 0 rc 0/0 00000100:00100000:2.0:1783134976.801037:0:8031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 99 00000100:00100000:1.0:1783134976.807001:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:0.0:1783134976.807092:0:6576:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373917696 00000100:00100000:0.0:1783134976.807124:0:6576:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373917696 00000100:00100000:0.0:1783134976.807190:0:6576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 36 00000100:00100000:0.0:1783134976.807201:0:6576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fe829180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+8:2369:x1869752373917696:12345-192.168.201.41@tcp:1:lfs.0 00010000:00010000:0.0:1783134976.807258:0:6576:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fa01f675/0xd6c4b8f05867ed14 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6576 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134976.807306:0:6576:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000006747ba8e/0xd6c4b8f05867ecce lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb72d5 expref: 8 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134976.807317:0:6576:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783134976.807323:0:6576:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1783134976.807329:0:6576:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fa01f675/0xd6c4b8f05867ed14 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6576 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134976.807376:0:6576:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000006747ba8e/0xd6c4b8f05867ecce lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb72d5 expref: 8 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134976.807393:0:6576:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000006747ba8e/0xd6c4b8f05867ecce lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb72d5 expref: 8 pid: 6577 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783134976.807412:0:6576:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9f6894380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6576:1869752384411648:192.168.201.41@tcp:104: 00000100:00100000:0.0:1783134976.807537:0:6576:0:(client.c:2701:ptlrpc_set_wait()) set ffff9fe9fe9449c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783134976.811276:0:6576:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9f6894380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6576:1869752384411648:192.168.201.41@tcp:104: 00010000:00010000:0.0:1783134976.811367:0:6576:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000fa01f675/0xd6c4b8f05867ed14 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6576 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783134976.811696:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:0.0:1783134976.811771:0:6581:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373917824 00000100:00100000:0.0:1783134976.811780:0:6581:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373917824 00002000:00100000:0.0:1783134976.811835:0:6581:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3:0x0] (0->8) req@ffff9fe9fe82aa00 x1869752373917824/t0(0) o4->28f4ba61-cfae-499e-ab3d-81cb8215f7bb@192.168.201.41@tcp:147/0 lens 504/0 e 0 to 0 dl 1783134987 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1783134976.811847:0:6581:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9fe9fe82aa00 with x1869752373917824 ext(0->8) 00010000:00010000:0.0:1783134976.811856:0:6581:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000006747ba8e/0xd6c4b8f05867ecce lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb72d5 expref: 9 pid: 6577 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134976.811933:0:6581:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000006747ba8e/0xd6c4b8f05867ecce lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb72d5 expref: 9 pid: 6577 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1783134976.811942:0:6581:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9fe9fe82aa00 00000100:00100000:0.0:1783134976.811981:0:6581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 1 00000100:00100000:0.0:1783134976.811992:0:6581:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fe82aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+9:2369:x1869752373917824:12345-192.168.201.41@tcp:4:lfs.0 00000100:00100000:0.0:1783134976.812673:0:6581:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fe82aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+11:2369:x1869752373917824:12345-192.168.201.41@tcp:4:lfs.0 Request processed in 681us (977us total) trans 4294967302 rc 0/0 00000100:00100000:0.0:1783134976.812683:0:6581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 1 00002000:00100000:0.0:1783134976.812690:0:6581:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3:0x0] (0->8) req@ffff9fe9fe82aa00 x1869752373917824/t4294967302(0) o4->28f4ba61-cfae-499e-ab3d-81cb8215f7bb@192.168.201.41@tcp:147/0 lens 504/448 e 0 to 0 dl 1783134987 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1783134976.812699:0:6581:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9fe9fe82aa00 with x1869752373917824 ext(0->8) 00010000:00010000:0.0:1783134976.812706:0:6581:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000006747ba8e/0xd6c4b8f05867ecce lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb72d5 expref: 11 pid: 6577 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134976.812731:0:6581:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000006747ba8e/0xd6c4b8f05867ecce lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb72d5 expref: 11 pid: 6577 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1783134976.812738:0:6581:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9fe9fe82aa00 00000100:00100000:1.0:1783134976.816032:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:3.0:1783134976.817141:0:5756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373917952 00000100:00100000:3.0:1783134976.817174:0:5756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373917952 00010000:00010000:3.0:1783134976.817229:0:5756:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000006747ba8e/0xd6c4b8f05867ecce lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb72d5 expref: 11 pid: 6577 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783134976.817334:0:5756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 51 00000100:00100000:3.0:1783134976.817347:0:5756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fe829500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+11:2370:x1869752373917952:12345-192.168.201.41@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783134976.817367:0:5756:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1783134976.817392:0:5756:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:3.0:1783134976.817395:0:5756:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb mtime from disk: 0 -> 1783134976 00002000:00010000:3.0:1783134976.817397:0:5756:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb atime from disk: 0 -> 1783134976 00002000:00010000:3.0:1783134976.817400:0:5756:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb ctime from disk: 0 -> 1783134976 00010000:00010000:3.0:1783134976.817418:0:5756:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000006747ba8e/0xd6c4b8f05867ecce lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb72d5 expref: 11 pid: 6577 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134976.817436:0:5756:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000006747ba8e/0xd6c4b8f05867ecce lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb72d5 expref: 11 pid: 6577 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134976.817462:0:5756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006747ba8e/0xd6c4b8f05867ecce lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb72d5 expref: 11 pid: 6577 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134976.818624:0:5756:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1783134976.818630:0:5756:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1783134976.818639:0:5756:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000fa01f675/0xd6c4b8f05867ed14 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6576 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134976.818661:0:5756:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fa01f675/0xd6c4b8f05867ed14 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6576 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134976.818736:0:5756:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1783134976.818794:0:6576:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000fa01f675/0xd6c4b8f05867ed14 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6576 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134976.818808:0:6576:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fa01f675/0xd6c4b8f05867ed14 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6576 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134976.818845:0:6576:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fa01f675/0xd6c4b8f05867ed14 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6576 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134976.818855:0:6576:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fa01f675/0xd6c4b8f05867ed14 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6576 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134976.818865:0:6576:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fa01f675/0xd6c4b8f05867ed14 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6576 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134976.818884:0:6576:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe9f68ade00 already unused, calling callback (ffffffffc1527ce0) 00010000:00010000:0.0:1783134976.818890:0:6576:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fa01f675/0xd6c4b8f05867ed14 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6576 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134976.818900:0:6576:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fa01f675/0xd6c4b8f05867ed14 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6576 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134976.818931:0:6576:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fa01f675/0xd6c4b8f05867ed14 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6576 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134976.818940:0:6576:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fa01f675/0xd6c4b8f05867ed14 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6576 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783134976.819067:0:5756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fe829500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+10:2370:x1869752373917952:12345-192.168.201.41@tcp:103:ldlm_bl.0 Request processed in 1717us (3045us total) trans 0 rc 0/0 00000100:00100000:0.0:1783134976.819078:0:6576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fe829180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+10:2369:x1869752373917696:12345-192.168.201.41@tcp:1:lfs.0 Request processed in 11876us (12088us total) trans 0 rc 0/0 00000100:00100000:3.0:1783134976.819081:0:5756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 51 00000100:00100000:0.0:1783134976.819093:0:6576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 36 00000100:00100000:0.0:1783134976.822254:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:3.0:1783134976.822377:0:5772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373918208 00000100:00100000:3.0:1783134976.822392:0:5772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373918208 00000100:00100000:3.0:1783134976.822481:0:5772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 26 00000100:00100000:3.0:1783134976.822494:0:5772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9cb438050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+38:10493:x1869752373918208:12345-192.168.201.41@tcp:35:lfs.0 00000004:00010000:3.0:1783134976.822578:0:5772:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0x7:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829400/0xd6c4b8f05867ecff lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb72ea expref: 38 pid: 5769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1783134976.823364:0:5772:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967380 00000001:00080000:3.0:1783134976.823532:0:5772:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967381 00000001:00080000:3.0:1783134976.824223:0:5772:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967382 00010000:00010000:3.0:1783134976.824353:0:5772:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b74e00/0xd6c4b8f05867ed1b lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134976.824376:0:5772:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829200/0xd6c4b8f05867ed0d lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb72f1 expref: 42 pid: 8031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134976.824387:0:5772:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b74e00/0xd6c4b8f05867ed1b lrc: 4/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134976.824443:0:5772:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829200/0xd6c4b8f05867ed0d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb72f1 expref: 42 pid: 8031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134976.825007:0:5772:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829200/0xd6c4b8f05867ed0d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb72f1 expref: 42 pid: 8031 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783134976.825045:0:5772:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9f68f2680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5772:1869752384411776:192.168.201.41@tcp:104: 00000100:00100000:3.0:1783134976.825341:0:5772:0:(client.c:2701:ptlrpc_set_wait()) set ffff9fe9c9d02a80 going to sleep for 11 seconds 00000100:00100000:1.0:1783134976.828035:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:3.0:1783134976.828224:0:5772:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9f68f2680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5772:1869752384411776:192.168.201.41@tcp:104: 00010000:00010000:3.0:1783134976.828260:0:5772:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b74e00/0xd6c4b8f05867ed1b lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5772 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783134976.828445:0:5754:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373918336 00000100:00100000:2.0:1783134976.828454:0:5754:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373918336 00010000:00010000:2.0:1783134976.828508:0:5754:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829200/0xd6c4b8f05867ed0d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb72f1 expref: 43 pid: 8031 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783134976.828553:0:5754:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 52 00000100:00100000:2.0:1783134976.828563:0:5754:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fe829c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+43:2369:x1869752373918336:12345-192.168.201.41@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783134976.828583:0:5754:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783134976.828591:0:5754:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829200/0xd6c4b8f05867ed0d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb72f1 expref: 43 pid: 8031 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134976.828616:0:5754:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829200/0xd6c4b8f05867ed0d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb72f1 expref: 43 pid: 8031 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134976.828666:0:5754:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829200/0xd6c4b8f05867ed0d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb72f1 expref: 43 pid: 8031 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134976.828685:0:5754:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9fe9cc3c1f00) 00010000:00010000:2.0:1783134976.828691:0:5754:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b74e00/0xd6c4b8f05867ed1b lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134976.828702:0:5754:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b74e00/0xd6c4b8f05867ed1b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134976.828711:0:5754:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b74e00/0xd6c4b8f05867ed1b lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134976.828741:0:5754:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783134976.828810:0:5754:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fe829c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+42:2369:x1869752373918336:12345-192.168.201.41@tcp:103:ldlm_bl.0 Request processed in 247us (792us total) trans 0 rc 0/0 00000100:00100000:2.0:1783134976.828819:0:5754:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 52 00010000:00010000:3.0:1783134976.829099:0:5772:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b74e00/0xd6c4b8f05867ed1b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134976.829109:0:5772:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b74e00/0xd6c4b8f05867ed1b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5772 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1783134976.829270:0:5772:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967383 00000001:00080000:3.0:1783134976.830163:0:5772:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967384 00000100:00100000:3.0:1783134976.830391:0:5772:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9f68f2680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5772:1869752384411904:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1783134976.830653:0:5772:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783134976.830699:0:5772:0:(client.c:2701:ptlrpc_set_wait()) set ffff9fe9c9d02d80 going to sleep for 11 seconds 00000100:00100000:0.0:1783134976.830770:0:5775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384411904 00000100:00100000:0.0:1783134976.830780:0:5775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384411904 00000100:00100000:0.0:1783134976.830879:0:5775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1783134976.830891:0:5775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9f68f7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:5772:x1869752384411904:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1783134976.830998:0:5775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9f68f7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:5772:x1869752384411904:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 109us (346us total) trans 0 rc 0/0 00000100:00100000:0.0:1783134976.831005:0:5775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1783134976.831043:0:5772:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9f68f2680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5772:1869752384411904:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:3.0:1783134976.832122:0:5772:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967385 00000100:00100000:3.0:1783134976.832216:0:5772:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9f68f2680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5772:1869752384412032:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1783134976.832320:0:5772:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783134976.832354:0:5772:0:(client.c:2701:ptlrpc_set_wait()) set ffff9fe9c9d02a80 going to sleep for 11 seconds 00000100:00100000:2.0:1783134976.834224:0:5774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384412032 00000100:00100000:2.0:1783134976.834240:0:5774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384412032 00000100:00100000:2.0:1783134976.834381:0:5774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1783134976.834394:0:5774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9f68f0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:5772:x1869752384412032:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1783134976.834790:0:5774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9f68f0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+8:5772:x1869752384412032:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 397us (2511us total) trans 4294967303 rc 0/0 00000100:00100000:2.0:1783134976.834800:0:5774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1783134976.834976:0:5772:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9f68f2680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5772:1869752384412032:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:3.0:1783134976.835071:0:5772:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967386 00010000:00010000:3.0:1783134976.835129:0:5772:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b74e00/0xd6c4b8f05867ed1b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134976.835141:0:5772:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b74e00/0xd6c4b8f05867ed1b lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134976.835166:0:5772:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b74e00/0xd6c4b8f05867ed1b lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134976.835174:0:5772:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe9d2b74e00 already unused, calling callback (ffffffffc1f634f0) 00010000:00010000:3.0:1783134976.835179:0:5772:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b74e00/0xd6c4b8f05867ed1b lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134976.835190:0:5772:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b74e00/0xd6c4b8f05867ed1b lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134976.835209:0:5772:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9fe9cc3c1f00) 00010000:00010000:3.0:1783134976.835213:0:5772:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1783134976.835218:0:5772:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b74e00/0xd6c4b8f05867ed1b lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134976.835225:0:5772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b74e00/0xd6c4b8f05867ed1b lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5772 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1783134976.835496:0:5772:0:(mdd_object.c:4010:mdd_close()) Object [0x200000401:0x8:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:3.0:1783134976.835649:0:5772:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].3, 64 off8384 00000004:00080000:3.0:1783134976.835662:0:5772:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 259231381623ns, next at 260231379327ns, rc = 0 00000001:00080000:3.0:1783134976.835668:0:5772:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967387 00010000:00010000:3.0:1783134976.835699:0:5772:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9fe9cc3c1f00) 00010000:00010000:3.0:1783134976.835713:0:5772:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1783134976.835722:0:5772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829400/0xd6c4b8f05867ecff lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb72ea expref: 46 pid: 5769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783134976.837446:0:5772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9cb438050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+45:10493:x1869752373918208:12345-192.168.201.41@tcp:35:lfs.0 Request processed in 14941us (15192us total) trans 4294967388 rc 0/0 00000100:00100000:2.0:1783134976.837588:0:5772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 26 00000020:00080000:2.0:1783134976.837607:0:5772:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:1.0:1783134976.846367:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:3.0:1783134976.846572:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373918464 00000100:00100000:3.0:1783134976.846585:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373918464 00000100:00100000:2.0:1783134976.849132:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 100 00000100:00100000:2.0:1783134976.849151:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fe829880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+45:10493:x1869752373918464:12345-192.168.201.41@tcp:101:lfs.0 00010000:00010000:2.0:1783134976.849183:0:5770:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783134976.849214:0:5770:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829200/0xd6c4b8f05867ed22 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4428da03f5eb72f8 expref: -99 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134976.849315:0:5770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829200/0xd6c4b8f05867ed22 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb72f8 expref: 46 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134976.849333:0:5770:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829200/0xd6c4b8f05867ed22 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb72f8 expref: 46 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134976.849356:0:5770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9fe9cc3c1b00) 00010000:00010000:2.0:1783134976.849359:0:5770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1783134976.849364:0:5770:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fe9c7829200, rc 0) 00000100:00100000:2.0:1783134976.849446:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fe829880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+46:10493:x1869752373918464:12345-192.168.201.41@tcp:101:lfs.0 Request processed in 301us (3095us total) trans 0 rc 0/0 00000100:00100000:2.0:1783134976.849454:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 100 00000100:00100000:1.0:1783134976.856617:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:2.0:1783134976.856786:0:5773:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373918720 00000100:00100000:2.0:1783134976.856798:0:5773:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373918720 00000100:00100000:2.0:1783134976.857000:0:5773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 27 00000100:00100000:2.0:1783134976.857013:0:5773:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fe82a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+46:10493:x1869752373918720:12345-192.168.201.41@tcp:35:lfs.0 00000100:00100000:2.0:1783134976.857350:0:5773:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fe82a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+47:10493:x1869752373918720:12345-192.168.201.41@tcp:35:lfs.0 Request processed in 339us (754us total) trans 4294967389 rc 0/0 00000100:00100000:2.0:1783134976.857380:0:5773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 27 00000100:00100000:1.0:1783134976.920181:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:3.0:1783134976.920672:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373918848 00000100:00100000:3.0:1783134976.920685:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373918848 00000100:00100000:3.0:1783134976.920762:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 101 00000100:00100000:3.0:1783134976.920774:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fe829f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+47:10503:x1869752373918848:12345-192.168.201.41@tcp:34:lfs.0 00010000:00010000:3.0:1783134976.920879:0:5771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b74e00/0xd6c4b8f05867ed29 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134976.920901:0:5771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b74e00/0xd6c4b8f05867ed29 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134976.920914:0:5771:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b74e00/0xd6c4b8f05867ed29 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134976.920933:0:5771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b75000/0xd6c4b8f05867ed30 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134976.920941:0:5771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b75000/0xd6c4b8f05867ed30 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134976.920947:0:5771:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b75000/0xd6c4b8f05867ed30 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134976.921074:0:5771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b74200/0xd6c4b8f05867ed37 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134976.921084:0:5771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b74200/0xd6c4b8f05867ed37 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134976.921106:0:5771:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b74200/0xd6c4b8f05867ed37 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1783134976.921166:0:5771:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b74200/0xd6c4b8f05867ed37 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134976.921200:0:5771:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b74e00/0xd6c4b8f05867ed29 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134976.921207:0:5771:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b74e00/0xd6c4b8f05867ed29 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134976.921214:0:5771:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b74e00/0xd6c4b8f05867ed29 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134976.921221:0:5771:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe9d2b74e00 already unused, calling callback (ffffffffc1f634f0) 00010000:00010000:3.0:1783134976.921225:0:5771:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b74e00/0xd6c4b8f05867ed29 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134976.921232:0:5771:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b74e00/0xd6c4b8f05867ed29 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134976.921246:0:5771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9fe9e1c2bd00) 00010000:00010000:3.0:1783134976.921260:0:5771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783134976.921265:0:5771:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b74e00/0xd6c4b8f05867ed29 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134976.921271:0:5771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b74e00/0xd6c4b8f05867ed29 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134976.921345:0:5771:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b75000/0xd6c4b8f05867ed30 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134976.921352:0:5771:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b75000/0xd6c4b8f05867ed30 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134976.921358:0:5771:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b75000/0xd6c4b8f05867ed30 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134976.921370:0:5771:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe9d2b75000 already unused, calling callback (ffffffffc1f634f0) 00010000:00010000:3.0:1783134976.921373:0:5771:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b75000/0xd6c4b8f05867ed30 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134976.921379:0:5771:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b75000/0xd6c4b8f05867ed30 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134976.921387:0:5771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9fe9cb8f4000) 00010000:00010000:3.0:1783134976.921390:0:5771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783134976.921392:0:5771:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b75000/0xd6c4b8f05867ed30 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134976.921398:0:5771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b75000/0xd6c4b8f05867ed30 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134976.921417:0:5771:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b74200/0xd6c4b8f05867ed37 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134976.921433:0:5771:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b74200/0xd6c4b8f05867ed37 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134976.921438:0:5771:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b74200/0xd6c4b8f05867ed37 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134976.921442:0:5771:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe9d2b74200 already unused, calling callback (ffffffffc1f634f0) 00010000:00010000:3.0:1783134976.921445:0:5771:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b74200/0xd6c4b8f05867ed37 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134976.921451:0:5771:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b74200/0xd6c4b8f05867ed37 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134976.921477:0:5771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9fe9cc3c1b00) 00010000:00010000:3.0:1783134976.921480:0:5771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783134976.921483:0:5771:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b74200/0xd6c4b8f05867ed37 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134976.921489:0:5771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b74200/0xd6c4b8f05867ed37 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783134976.921826:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fe829f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+47:10503:x1869752373918848:12345-192.168.201.41@tcp:34:lfs.0 Request processed in 1050us (1656us total) trans 0 rc 0/0 00000100:00100000:3.0:1783134976.921836:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 101 00000100:00100000:1.0:1783134976.943238:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:0.0:1783134976.943916:0:5769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373919104 00000100:00100000:0.0:1783134976.943929:0:5769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373919104 00000100:00100000:0.0:1783134976.944052:0:5769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 102 00000100:00100000:0.0:1783134976.944064:0:5769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fe82b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+47:10506:x1869752373919104:12345-192.168.201.41@tcp:101:lfs.0 00010000:00010000:0.0:1783134976.944102:0:5769:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783134976.944128:0:5769:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ade00/0xd6c4b8f05867ed3e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4428da03f5eb72ff expref: -99 pid: 5769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134976.944230:0:5769:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ad200/0xd6c4b8f05867ed45 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134976.944244:0:5769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ad200/0xd6c4b8f05867ed45 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134976.944254:0:5769:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ad200/0xd6c4b8f05867ed45 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134976.944270:0:5769:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ad600/0xd6c4b8f05867ed4c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134976.944277:0:5769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ad600/0xd6c4b8f05867ed4c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134976.944309:0:5769:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ad600/0xd6c4b8f05867ed4c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134976.944482:0:5769:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ad800/0xd6c4b8f05867ed53 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134976.944489:0:5769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ad800/0xd6c4b8f05867ed53 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134976.944494:0:5769:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ad800/0xd6c4b8f05867ed53 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783134976.944503:0:5769:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:0.0:1783134976.944962:0:5769:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ad200/0xd6c4b8f05867ed45 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134976.944970:0:5769:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ad200/0xd6c4b8f05867ed45 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134976.944987:0:5769:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ad200/0xd6c4b8f05867ed45 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134976.944993:0:5769:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe9f68ad200 already unused, calling callback (ffffffffc1f634f0) 00010000:00010000:0.0:1783134976.944998:0:5769:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ad200/0xd6c4b8f05867ed45 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134976.945006:0:5769:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ad200/0xd6c4b8f05867ed45 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134976.945022:0:5769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9fe9e1c2bd00) 00010000:00010000:0.0:1783134976.945025:0:5769:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783134976.945030:0:5769:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ad200/0xd6c4b8f05867ed45 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134976.945035:0:5769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ad200/0xd6c4b8f05867ed45 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134976.945047:0:5769:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ad600/0xd6c4b8f05867ed4c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134976.945051:0:5769:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ad600/0xd6c4b8f05867ed4c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134976.945057:0:5769:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ad600/0xd6c4b8f05867ed4c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134976.945063:0:5769:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe9f68ad600 already unused, calling callback (ffffffffc1f634f0) 00010000:00010000:0.0:1783134976.945065:0:5769:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ad600/0xd6c4b8f05867ed4c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134976.945084:0:5769:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ad600/0xd6c4b8f05867ed4c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134976.945092:0:5769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9fe9c8301100) 00010000:00010000:0.0:1783134976.945095:0:5769:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783134976.945098:0:5769:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ad600/0xd6c4b8f05867ed4c lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134976.945104:0:5769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ad600/0xd6c4b8f05867ed4c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134976.945154:0:5769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ade00/0xd6c4b8f05867ed3e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb72ff expref: 50 pid: 5769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134976.945171:0:5769:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ad800/0xd6c4b8f05867ed53 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb72ff expref: 49 pid: 5769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134976.945178:0:5769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9fe9cc3c1b00) 00010000:00010000:0.0:1783134976.945180:0:5769:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1783134976.945181:0:5769:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fe9f68ad800, rc 0) 00000100:00100000:0.0:1783134976.945360:0:5769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fe82b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+49:10506:x1869752373919104:12345-192.168.201.41@tcp:101:lfs.0 Request processed in 1297us (2133us total) trans 4294967390 rc 0/0 00000100:00100000:0.0:1783134976.945369:0:5769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 102 00000100:00100000:1.0:1783134976.950530:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:2.0:1783134976.950818:0:8031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373919232 00000100:00100000:2.0:1783134976.951166:0:8031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373919232 00000100:00100000:2.0:1783134976.951247:0:8031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 103 00000100:00100000:2.0:1783134976.951260:0:8031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fe82b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+49:10506:x1869752373919232:12345-192.168.201.41@tcp:54:lfs.0 00010000:00010000:2.0:1783134976.951384:0:8031:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828600/0xd6c4b8f05867ed61 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134976.951406:0:8031:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828600/0xd6c4b8f05867ed61 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134976.951426:0:8031:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828600/0xd6c4b8f05867ed61 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134976.951459:0:8031:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828600/0xd6c4b8f05867ed61 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134976.951467:0:8031:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828600/0xd6c4b8f05867ed61 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134976.951475:0:8031:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828600/0xd6c4b8f05867ed61 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134976.951482:0:8031:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe9c7828600 already unused, calling callback (ffffffffc1f634f0) 00010000:00010000:2.0:1783134976.951487:0:8031:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828600/0xd6c4b8f05867ed61 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134976.951495:0:8031:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828600/0xd6c4b8f05867ed61 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134976.951510:0:8031:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9fe9cc3c1b00) 00010000:00010000:2.0:1783134976.951533:0:8031:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1783134976.951539:0:8031:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828600/0xd6c4b8f05867ed61 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134976.951546:0:8031:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828600/0xd6c4b8f05867ed61 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783134976.952545:0:8031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fe82b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+49:10506:x1869752373919232:12345-192.168.201.41@tcp:54:lfs.0 Request processed in 1280us (2022us total) trans 0 rc 0/0 00000100:00100000:2.0:1783134976.952557:0:8031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 103 00000100:00100000:1.0:1783134976.957606:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:0.0:1783134976.958563:0:5772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373919488 00000100:00100000:0.0:1783134976.958579:0:5772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373919488 00000100:00100000:0.0:1783134976.958724:0:5772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 28 00000100:00100000:0.0:1783134976.958738:0:5772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fe828e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+49:10506:x1869752373919488:12345-192.168.201.41@tcp:35:lfs.0 00000100:00100000:0.0:1783134976.959081:0:5772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fe828e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+50:10506:x1869752373919488:12345-192.168.201.41@tcp:35:lfs.0 Request processed in 346us (1495us total) trans 4294967391 rc 0/0 00000100:00100000:0.0:1783134976.959089:0:5772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 28 00000100:00100000:1.0:1783134977.005067:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:2.0:1783134977.005184:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373919744 00000100:00100000:2.0:1783134977.005196:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373919744 00000100:00100000:2.0:1783134977.005257:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 104 00000100:00100000:2.0:1783134977.005266:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fe82b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+50:10516:x1869752373919744:12345-192.168.201.41@tcp:101:bash.0 00010000:00010000:2.0:1783134977.005523:0:5770:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783134977.005528:0:5770:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1783134977.005566:0:5770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b75800/0xd6c4b8f05867ecdc lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb72dc expref: 50 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134977.005591:0:5770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9fe9e1c2bd00) 00010000:00010000:2.0:1783134977.005607:0:5770:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1783134977.005631:0:5770:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828600/0xd6c4b8f05867ed68 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4428da03f5eb7306 expref: -99 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134977.005939:0:5770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828c00/0xd6c4b8f05867ed6f lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134977.005958:0:5770:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ad800/0xd6c4b8f05867ed53 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb72ff expref: 50 pid: 5769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134977.005990:0:5770:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828c00/0xd6c4b8f05867ed6f lrc: 4/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134977.006339:0:5770:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ad800/0xd6c4b8f05867ed53 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb72ff expref: 50 pid: 5769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134977.006409:0:5770:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ad800/0xd6c4b8f05867ed53 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb72ff expref: 50 pid: 5769 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783134977.006494:0:5770:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9f68f6a00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5770:1869752384412160:192.168.201.41@tcp:104: 00000100:00100000:2.0:1783134977.006731:0:5770:0:(client.c:2701:ptlrpc_set_wait()) set ffff9fe9f615cc00 going to sleep for 11 seconds 00000100:00100000:2.0:1783134977.008762:0:5770:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9f68f6a00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5770:1869752384412160:192.168.201.41@tcp:104: 00010000:00010000:2.0:1783134977.008794:0:5770:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828c00/0xd6c4b8f05867ed6f lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783134977.009551:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:2.0:1783134977.009635:0:5755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373919872 00000100:00100000:2.0:1783134977.009645:0:5755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373919872 00010000:00010000:2.0:1783134977.009688:0:5755:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ad800/0xd6c4b8f05867ed53 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb72ff expref: 51 pid: 5769 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783134977.009718:0:5755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 53 00000100:00100000:2.0:1783134977.009726:0:5755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fe828380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+51:2369:x1869752373919872:12345-192.168.201.41@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783134977.009742:0:5755:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783134977.009747:0:5755:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ad800/0xd6c4b8f05867ed53 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb72ff expref: 51 pid: 5769 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134977.009776:0:5755:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ad800/0xd6c4b8f05867ed53 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb72ff expref: 51 pid: 5769 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134977.009798:0:5755:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ad800/0xd6c4b8f05867ed53 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb72ff expref: 51 pid: 5769 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134977.009814:0:5755:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9fe9cc3c1b00) 00010000:00010000:2.0:1783134977.009817:0:5755:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828c00/0xd6c4b8f05867ed6f lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134977.009835:0:5755:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828c00/0xd6c4b8f05867ed6f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134977.009842:0:5755:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828c00/0xd6c4b8f05867ed6f lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134977.009870:0:5755:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783134977.009923:0:5755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fe828380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+50:2369:x1869752373919872:12345-192.168.201.41@tcp:103:ldlm_bl.0 Request processed in 198us (376us total) trans 0 rc 0/0 00000100:00100000:2.0:1783134977.009928:0:5755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 53 00010000:00010000:0.0:1783134977.010390:0:5770:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828c00/0xd6c4b8f05867ed6f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134977.010398:0:5770:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828c00/0xd6c4b8f05867ed6f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783134977.010419:0:5770:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:0.0:1783134977.010593:0:5770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828600/0xd6c4b8f05867ed68 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb7306 expref: 51 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134977.010633:0:5770:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828c00/0xd6c4b8f05867ed6f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb7306 expref: 50 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134977.010643:0:5770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9fe9cc3c1b00) 00010000:00010000:0.0:1783134977.010646:0:5770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1783134977.010649:0:5770:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fe9c7828c00, rc 0) 00000100:00100000:0.0:1783134977.010687:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fe82b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+50:10516:x1869752373919744:12345-192.168.201.41@tcp:101:bash.0 Request processed in 5423us (5633us total) trans 4294967392 rc 0/0 00000100:00100000:0.0:1783134977.010694:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 104 00000100:00100000:1.0:1783134977.012619:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:3.0:1783134977.012697:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373920128 00000100:00100000:3.0:1783134977.012707:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373920128 00000100:00100000:3.0:1783134977.012757:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 105 00000100:00100000:3.0:1783134977.012766:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9f6fe7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+50:10516:x1869752373920128:12345-192.168.201.41@tcp:36:bash.0 00010000:00010000:3.0:1783134977.013091:0:5771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b74200/0xd6c4b8f05867ed7d lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134977.013112:0:5771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b74200/0xd6c4b8f05867ed7d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134977.013125:0:5771:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b74200/0xd6c4b8f05867ed7d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1783134977.013179:0:5771:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967393 00000004:00010000:3.0:1783134977.013198:0:5771:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000c556889e reply state 000000006d393c7e transno 4294967394 ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b74200/0xd6c4b8f05867ed7d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783134977.013204:0:5771:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1783134977.013329:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9f6fe7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+53:10516:x1869752373920128:12345-192.168.201.41@tcp:36:bash.0 Request processed in 564us (719us total) trans 4294967394 rc 0/0 00000100:00100000:3.0:1783134977.013336:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 105 00000020:00080000:3.0:1783134977.013340:0:5771:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1783134977.016119:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:0.0:1783134977.016179:0:5769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373920256 00000100:00100000:0.0:1783134977.016190:0:5769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373920256 00000100:00100000:0.0:1783134977.016248:0:5769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 106 00000100:00100000:0.0:1783134977.016256:0:5769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9f6fe5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+53:10516:x1869752373920256:12345-192.168.201.41@tcp:101:bash.0 00010000:00010000:0.0:1783134977.016298:0:5769:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783134977.016339:0:5769:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ade00/0xd6c4b8f05867ed84 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4428da03f5eb730d expref: -99 pid: 5769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134977.016469:0:5769:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ad600/0xd6c4b8f05867ed8b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134977.016486:0:5769:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828c00/0xd6c4b8f05867ed6f lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb7306 expref: 54 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134977.016492:0:5769:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b74200/0xd6c4b8f05867ed7d lrc: 2/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134977.016498:0:5769:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ad600/0xd6c4b8f05867ed8b lrc: 5/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134977.016514:0:5769:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b74200/0xd6c4b8f05867ed7d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134977.016538:0:5769:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828c00/0xd6c4b8f05867ed6f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb7306 expref: 54 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134977.016549:0:5769:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828c00/0xd6c4b8f05867ed6f lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb7306 expref: 54 pid: 5770 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783134977.016562:0:5769:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9f6894380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5769:1869752384412288:192.168.201.41@tcp:104: 00000100:00100000:0.0:1783134977.016671:0:5769:0:(client.c:2701:ptlrpc_set_wait()) set ffff9fe9fe944540 going to sleep for 11 seconds 00010000:00010000:3.0:1783134977.018552:0:3273:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b74200/0xd6c4b8f05867ed7d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000020 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134977.018566:0:3273:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b74200/0xd6c4b8f05867ed7d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000020 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134977.018571:0:3273:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b74200/0xd6c4b8f05867ed7d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134977.018575:0:3273:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe9d2b74200 already unused, calling callback (ffffffffc1f634f0) 00010000:00010000:3.0:1783134977.018579:0:3273:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b74200/0xd6c4b8f05867ed7d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134977.018587:0:3273:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b74200/0xd6c4b8f05867ed7d lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000020 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134977.018619:0:3273:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9fe9cc3c1b00) 00010000:00010000:3.0:1783134977.018623:0:3273:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783134977.018627:0:3273:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ad600/0xd6c4b8f05867ed8b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134977.018639:0:3273:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b74200/0xd6c4b8f05867ed7d lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000020 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134977.018646:0:3273:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b74200/0xd6c4b8f05867ed7d lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000020 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783134977.018868:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:2.0:1783134977.018920:0:5754:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373920384 00000100:00100000:2.0:1783134977.018929:0:5754:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373920384 00010000:00010000:2.0:1783134977.018962:0:5754:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828c00/0xd6c4b8f05867ed6f lrc: 5/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb7306 expref: 54 pid: 5770 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783134977.018997:0:5754:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 54 00000100:00100000:2.0:1783134977.019004:0:5754:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9f6fe6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+54:2370:x1869752373920384:12345-192.168.201.41@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783134977.019050:0:5754:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783134977.019056:0:5754:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828c00/0xd6c4b8f05867ed6f lrc: 5/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb7306 expref: 54 pid: 5770 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134977.019066:0:5754:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828c00/0xd6c4b8f05867ed6f lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb7306 expref: 54 pid: 5770 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134977.019080:0:5754:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9fe9cc3c1b00) 00010000:00010000:2.0:1783134977.019083:0:5754:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ad600/0xd6c4b8f05867ed8b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134977.019089:0:5754:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ad600/0xd6c4b8f05867ed8b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134977.019094:0:5754:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ad600/0xd6c4b8f05867ed8b lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134977.019110:0:5754:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783134977.019162:0:5754:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9f6fe6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+54:2370:x1869752373920384:12345-192.168.201.41@tcp:103:ldlm_bl.0 Request processed in 157us (297us total) trans 0 rc 0/0 00000100:00100000:2.0:1783134977.019167:0:5754:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 54 00010000:00010000:0.0:1783134977.019877:0:5769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828c00/0xd6c4b8f05867ed6f lrc: 0/0,0 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb7306 expref: 53 pid: 5770 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783134977.019894:0:5769:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9f6894380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5769:1869752384412288:192.168.201.41@tcp:104: 00010000:00010000:0.0:1783134977.019925:0:5769:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ad600/0xd6c4b8f05867ed8b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134977.019933:0:5769:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ad600/0xd6c4b8f05867ed8b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134977.019937:0:5769:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ad600/0xd6c4b8f05867ed8b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783134977.019988:0:5769:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:0.0:1783134977.019992:0:5769:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1783134977.020012:0:5769:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ad600/0xd6c4b8f05867ed8b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134977.020039:0:5769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ade00/0xd6c4b8f05867ed84 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb730d expref: 53 pid: 5769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134977.020050:0:5769:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ad600/0xd6c4b8f05867ed8b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb730d expref: 52 pid: 5769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134977.020056:0:5769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9fe9cc3c1b00) 00010000:00010000:0.0:1783134977.020057:0:5769:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1783134977.020059:0:5769:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fe9f68ad600, rc 0) 00000100:00100000:0.0:1783134977.020126:0:5769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9f6fe5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+52:10516:x1869752373920256:12345-192.168.201.41@tcp:101:bash.0 Request processed in 3871us (4018us total) trans 0 rc 0/0 00000100:00100000:0.0:1783134977.020132:0:5769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 106 00000100:00100000:1.0:1783134977.021785:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:2.0:1783134977.024112:0:5773:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373920640 00000100:00100000:2.0:1783134977.024126:0:5773:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373920640 00000100:00100000:2.0:1783134977.024196:0:5773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 29 00000100:00100000:2.0:1783134977.024205:0:5773:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9f6fe5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+52:10516:x1869752373920640:12345-192.168.201.41@tcp:35:bash.0 00000100:00100000:2.0:1783134977.024519:0:5773:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9f6fe5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+53:10516:x1869752373920640:12345-192.168.201.41@tcp:35:bash.0 Request processed in 314us (2741us total) trans 4294967395 rc 0/0 00000100:00100000:2.0:1783134977.024526:0:5773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 29 00000100:00100000:1.0:1783134977.073473:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:3.0:1783134977.073696:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373920768 00000100:00100000:3.0:1783134977.073708:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373920768 00000100:00100000:3.0:1783134977.073849:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 107 00000100:00100000:3.0:1783134977.073862:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9f6fe5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+53:10522:x1869752373920768:12345-192.168.201.41@tcp:101:lfs.0 00010000:00010000:3.0:1783134977.073899:0:5771:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783134977.073926:0:5771:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b74200/0xd6c4b8f05867ed92 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4428da03f5eb7314 expref: -99 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134977.074008:0:5771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b75000/0xd6c4b8f05867ed99 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134977.074025:0:5771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b75000/0xd6c4b8f05867ed99 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134977.074049:0:5771:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b75000/0xd6c4b8f05867ed99 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783134977.074142:0:5771:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00000004:00200000:3.0:1783134977.074147:0:5771:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:3.0:1783134977.074175:0:5771:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b75000/0xd6c4b8f05867ed99 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134977.074203:0:5771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b74200/0xd6c4b8f05867ed92 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb7314 expref: 55 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134977.074224:0:5771:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b75000/0xd6c4b8f05867ed99 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb7314 expref: 54 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134977.074234:0:5771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9fe9e1c2bd00) 00010000:00010000:3.0:1783134977.074237:0:5771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1783134977.074242:0:5771:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fe9d2b75000, rc 0) 00000100:00100000:3.0:1783134977.074374:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9f6fe5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+54:10522:x1869752373920768:12345-192.168.201.41@tcp:101:lfs.0 Request processed in 514us (915us total) trans 0 rc 0/0 00000100:00100000:3.0:1783134977.074390:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 107 00000100:00100000:1.0:1783134977.077214:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:2.0:1783134977.077483:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373920896 00000100:00100000:2.0:1783134977.077495:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373920896 00000100:00100000:0.0:1783134977.077579:0:5769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 108 00000100:00100000:0.0:1783134977.077594:0:5769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9f6fe5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+54:10522:x1869752373920896:12345-192.168.201.41@tcp:101:lfs.0 00010000:00010000:0.0:1783134977.077633:0:5769:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783134977.077676:0:5769:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ade00/0xd6c4b8f05867eda0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4428da03f5eb731b expref: -99 pid: 5769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134977.077752:0:5769:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ad200/0xd6c4b8f05867eda7 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134977.077769:0:5769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ad200/0xd6c4b8f05867eda7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134977.077781:0:5769:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ad200/0xd6c4b8f05867eda7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134977.077796:0:5769:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ace00/0xd6c4b8f05867edae lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134977.077803:0:5769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ace00/0xd6c4b8f05867edae lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134977.077810:0:5769:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ace00/0xd6c4b8f05867edae lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134977.077918:0:5769:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ac400/0xd6c4b8f05867edb5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134977.077926:0:5769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ac400/0xd6c4b8f05867edb5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134977.077932:0:5769:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ac400/0xd6c4b8f05867edb5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783134977.077972:0:5769:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:0.0:1783134977.077976:0:5769:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1783134977.077995:0:5769:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ac400/0xd6c4b8f05867edb5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134977.078024:0:5769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ac400/0xd6c4b8f05867edb5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134977.078034:0:5769:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ad200/0xd6c4b8f05867eda7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134977.078040:0:5769:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ad200/0xd6c4b8f05867eda7 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134977.078048:0:5769:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ad200/0xd6c4b8f05867eda7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134977.078054:0:5769:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe9f68ad200 already unused, calling callback (ffffffffc1f634f0) 00010000:00010000:0.0:1783134977.078059:0:5769:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ad200/0xd6c4b8f05867eda7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134977.078067:0:5769:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ad200/0xd6c4b8f05867eda7 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134977.078080:0:5769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9fe9e1c2bd00) 00010000:00010000:0.0:1783134977.078083:0:5769:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783134977.078087:0:5769:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ad200/0xd6c4b8f05867eda7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134977.078094:0:5769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ad200/0xd6c4b8f05867eda7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134977.078106:0:5769:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ace00/0xd6c4b8f05867edae lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134977.078112:0:5769:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ace00/0xd6c4b8f05867edae lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134977.078124:0:5769:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ace00/0xd6c4b8f05867edae lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134977.078129:0:5769:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe9f68ace00 already unused, calling callback (ffffffffc1f634f0) 00010000:00010000:0.0:1783134977.078132:0:5769:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ace00/0xd6c4b8f05867edae lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134977.078137:0:5769:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ace00/0xd6c4b8f05867edae lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134977.078143:0:5769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9fe9c8301100) 00010000:00010000:0.0:1783134977.078146:0:5769:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783134977.078148:0:5769:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ace00/0xd6c4b8f05867edae lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134977.078153:0:5769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ace00/0xd6c4b8f05867edae lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134977.078192:0:5769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ade00/0xd6c4b8f05867eda0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb731b expref: 56 pid: 5769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134977.078204:0:5769:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ac400/0xd6c4b8f05867edb5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb731b expref: 55 pid: 5769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134977.078211:0:5769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9fe9cc3c1b00) 00010000:00010000:0.0:1783134977.078219:0:5769:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1783134977.078222:0:5769:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fe9f68ac400, rc 0) 00000100:00100000:0.0:1783134977.078323:0:5769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9f6fe5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+55:10522:x1869752373920896:12345-192.168.201.41@tcp:101:lfs.0 Request processed in 732us (1121us total) trans 0 rc 0/0 00000100:00100000:0.0:1783134977.078339:0:5769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 108 00000100:00100000:1.0:1783134977.081669:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:1.0:1783134977.081725:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:0.0:1783134977.081787:0:8031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373921280 00000100:00100000:0.0:1783134977.081800:0:8031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373921280 00000100:00100000:0.0:1783134977.081866:0:8031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 109 00000100:00100000:0.0:1783134977.081877:0:8031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9f6fe5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+55:10522:x1869752373921280:12345-192.168.201.41@tcp:101:lfs.0 00010000:00010000:0.0:1783134977.081906:0:8031:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1783134977.081927:0:5755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373921024 00010000:00010000:0.0:1783134977.081928:0:8031:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ad000/0xd6c4b8f05867edbc lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4428da03f5eb7322 expref: -99 pid: 8031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783134977.081934:0:5755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373921024 00000100:00100000:2.0:1783134977.081987:0:5755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 6 00000100:00100000:2.0:1783134977.081999:0:5755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9f6fe6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+57:2370:x1869752373921024:12345-192.168.201.41@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783134977.082012:0:5755:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783134977.082041:0:5755:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ac400/0xd6c4b8f05867edb5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb731b expref: 57 pid: 5769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134977.082050:0:8031:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ac200/0xd6c4b8f05867edc3 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134977.082225:0:5755:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9fe9cc3c1b00) 00010000:00010000:2.0:1783134977.082232:0:5755:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783134977.082320:0:5755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9f6fe6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+56:2370:x1869752373921024:12345-192.168.201.41@tcp:103:ldlm_bl.0 Request processed in 325us (665us total) trans 0 rc 0/0 00000100:00100000:2.0:1783134977.082329:0:5755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 6 00010000:00010000:0.0:1783134977.084849:0:8031:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ad600/0xd6c4b8f05867ed8b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb730d expref: 55 pid: 5769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134977.084869:0:8031:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ac200/0xd6c4b8f05867edc3 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134977.084927:0:8031:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ad600/0xd6c4b8f05867ed8b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb730d expref: 55 pid: 5769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134977.084948:0:8031:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ad600/0xd6c4b8f05867ed8b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb730d expref: 55 pid: 5769 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783134977.084968:0:8031:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9f6894380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8031:1869752384412416:192.168.201.41@tcp:104: 00000100:00100000:0.0:1783134977.085105:0:8031:0:(client.c:2701:ptlrpc_set_wait()) set ffff9fe9fe944540 going to sleep for 11 seconds 00000100:00100000:0.0:1783134977.086891:0:8031:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9f6894380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8031:1869752384412416:192.168.201.41@tcp:104: 00010000:00010000:0.0:1783134977.086950:0:8031:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ac200/0xd6c4b8f05867edc3 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783134977.087665:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:2.0:1783134977.088014:0:5754:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373921408 00000100:00100000:2.0:1783134977.088024:0:5754:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373921408 00010000:00010000:2.0:1783134977.088084:0:5754:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ad600/0xd6c4b8f05867ed8b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb730d expref: 56 pid: 5769 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783134977.088139:0:5754:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 55 00000100:00100000:2.0:1783134977.088151:0:5754:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9d1620850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+56:2369:x1869752373921408:12345-192.168.201.41@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783134977.088172:0:5754:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783134977.088181:0:5754:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ad600/0xd6c4b8f05867ed8b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb730d expref: 56 pid: 5769 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134977.088196:0:5754:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ad600/0xd6c4b8f05867ed8b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb730d expref: 56 pid: 5769 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134977.088234:0:5754:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ad600/0xd6c4b8f05867ed8b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb730d expref: 56 pid: 5769 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134977.088255:0:5754:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9fe9cc3c1b00) 00010000:00010000:2.0:1783134977.088261:0:5754:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ac200/0xd6c4b8f05867edc3 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134977.088272:0:5754:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ac200/0xd6c4b8f05867edc3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134977.088306:0:5754:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ac200/0xd6c4b8f05867edc3 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134977.088334:0:5754:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783134977.088398:0:5754:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9d1620850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+55:2369:x1869752373921408:12345-192.168.201.41@tcp:103:ldlm_bl.0 Request processed in 248us (735us total) trans 0 rc 0/0 00000100:00100000:2.0:1783134977.088407:0:5754:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 55 00010000:00010000:0.0:1783134977.088500:0:8031:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ac200/0xd6c4b8f05867edc3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134977.088511:0:8031:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ac200/0xd6c4b8f05867edc3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783134977.088538:0:8031:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:0.0:1783134977.088762:0:8031:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ad000/0xd6c4b8f05867edbc lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb7322 expref: 56 pid: 8031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134977.088780:0:8031:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ac200/0xd6c4b8f05867edc3 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb7322 expref: 55 pid: 8031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134977.088790:0:8031:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9fe9cc3c1b00) 00010000:00010000:0.0:1783134977.088793:0:8031:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1783134977.088796:0:8031:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fe9f68ac200, rc 0) 00000100:00100000:0.0:1783134977.088825:0:8031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9f6fe5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+55:10522:x1869752373921280:12345-192.168.201.41@tcp:101:lfs.0 Request processed in 6950us (7099us total) trans 4294967396 rc 0/0 00000100:00100000:0.0:1783134977.088832:0:8031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 109 00000100:00100000:1.0:1783134977.091070:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:3.0:1783134977.091265:0:5756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373921664 00000100:00100000:3.0:1783134977.091276:0:5756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373921664 00000100:00100000:3.0:1783134977.091374:0:5756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 7 00000100:00100000:3.0:1783134977.091384:0:5756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9f6fe7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+55:10522:x1869752373921664:12345-192.168.201.41@tcp:103:lfs.0 00010000:00010000:3.0:1783134977.091402:0:5756:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783134977.091429:0:5756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829200/0xd6c4b8f05867ed22 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb72f8 expref: 55 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134977.091450:0:5756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9fe9cc3c1b00) 00010000:00010000:3.0:1783134977.091456:0:5756:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783134977.091515:0:5756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9f6fe7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+54:10522:x1869752373921664:12345-192.168.201.41@tcp:103:lfs.0 Request processed in 132us (457us total) trans 0 rc 0/0 00000100:00100000:3.0:1783134977.091523:0:5756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 7 00000100:00100000:3.0:1783134977.098906:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:2.0:1783134977.100344:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373921792 00000100:00100000:2.0:1783134977.100362:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373921792 00000100:00100000:2.0:1783134977.100440:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 110 00000100:00100000:2.0:1783134977.100453:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9f68f3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+54:10522:x1869752373921792:12345-192.168.201.41@tcp:58:lfs.0 00010000:00010000:2.0:1783134977.100604:0:5770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829e00/0xd6c4b8f05867edd1 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134977.100626:0:5770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829e00/0xd6c4b8f05867edd1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134977.100645:0:5770:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829e00/0xd6c4b8f05867edd1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1783134977.100925:0:5770:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].2, 136 off8464 00000100:00100000:2.0:1783134977.101050:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9f68f3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+54:10522:x1869752373921792:12345-192.168.201.41@tcp:58:lfs.0 Request processed in 599us (2158us total) trans 0 rc 0/0 00000100:00100000:2.0:1783134977.101060:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 110 00000100:00100000:1.0:1783134977.106259:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:3.0:1783134977.106344:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373921920 00000100:00100000:3.0:1783134977.106366:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373921920 00000100:00100000:3.0:1783134977.106443:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 111 00000100:00100000:3.0:1783134977.106455:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9f6fe7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+54:10522:x1869752373921920:12345-192.168.201.41@tcp:101:lfs.0 00010000:00010000:3.0:1783134977.106482:0:5771:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783134977.106508:0:5771:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b74200/0xd6c4b8f05867edd8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4428da03f5eb7329 expref: -99 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134977.106748:0:5771:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829e00/0xd6c4b8f05867edd1 lrc: 2/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134977.106763:0:5771:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b74200/0xd6c4b8f05867edd8 lrc: 4/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb7329 expref: 55 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134977.106796:0:5771:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829e00/0xd6c4b8f05867edd1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134977.106811:0:5771:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b74200/0xd6c4b8f05867edd8 lrc: 3/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb7329 expref: 55 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134977.106827:0:5771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9fe9cc3c1b00) 00010000:00010000:3.0:1783134977.106830:0:5771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1783134977.106835:0:5771:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b74200/0xd6c4b8f05867edd8 lrc: 3/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb7329 expref: 55 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134977.106844:0:5771:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fe9d2b74200, rc 0) 00000100:00100000:3.0:1783134977.106926:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9f6fe7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+55:10522:x1869752373921920:12345-192.168.201.41@tcp:101:lfs.0 Request processed in 472us (694us total) trans 0 rc 0/0 00000100:00100000:3.0:1783134977.106934:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 111 00010000:00010000:3.0:1783134977.285178:0:10987:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1783134977.795550:0:11499:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1783134977.795561:0:11499:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1783134977.795824:0:11499:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 3 00000040:00080000:3.0:1783134977.795833:0:11499:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1783134977.796262:0:11499:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9f68f1180 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11499:1869752384412544:192.168.201.41@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1783134977.796474:0:11499:0:(client.c:2701:ptlrpc_set_wait()) set ffff9fe9c9d02f00 going to sleep for 11 seconds 00000100:00100000:1.0:1783134977.802205:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:2.0:1783134977.802459:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373922048 00000100:00100000:2.0:1783134977.802471:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373922048 00000100:00100000:3.0:1783134977.802650:0:11499:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9f68f1180 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11499:1869752384412544:192.168.201.41@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1783134977.802691:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 112 00000100:00100000:2.0:1783134977.802706:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9f6fe4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+55:10523:x1869752373922048:12345-192.168.201.41@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1783134977.802764:0:5770:0:(mdt_handler.c:7960:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1783134977.802918:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9f6fe4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+55:10523:x1869752373922048:12345-192.168.201.41@tcp:53:lhsmtool_posix.0 Request processed in 215us (726us total) trans 0 rc 0/0 00000100:00100000:2.0:1783134977.802930:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 112 00000100:00100000:1.0:1783134977.806380:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:3.0:1783134977.806445:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373922176 00000100:00100000:3.0:1783134977.806457:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373922176 00000100:00100000:3.0:1783134977.806594:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 113 00000100:00100000:3.0:1783134977.806624:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9f6fe7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+55:10523:x1869752373922176:12345-192.168.201.41@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1783134977.806720:0:5771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b74e00/0xd6c4b8f05867eddf lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134977.806741:0:5771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b74e00/0xd6c4b8f05867eddf lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134977.806757:0:5771:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b74e00/0xd6c4b8f05867eddf lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134977.809481:0:5771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b74c00/0xd6c4b8f05867ede6 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134977.809503:0:5771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b74c00/0xd6c4b8f05867ede6 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134977.809515:0:5771:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b74c00/0xd6c4b8f05867ede6 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134977.809543:0:5771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b74400/0xd6c4b8f05867eded lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134977.809552:0:5771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b74400/0xd6c4b8f05867eded lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134977.809558:0:5771:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b74400/0xd6c4b8f05867eded lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783134977.809609:0:5771:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:3.0:1783134977.809614:0:5771:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1783134977.809627:0:5771:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b74400/0xd6c4b8f05867eded lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134977.809733:0:5771:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b74e00/0xd6c4b8f05867eddf lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134977.809741:0:5771:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b74e00/0xd6c4b8f05867eddf lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134977.809748:0:5771:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b74e00/0xd6c4b8f05867eddf lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134977.809754:0:5771:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe9d2b74e00 already unused, calling callback (ffffffffc1f634f0) 00010000:00010000:3.0:1783134977.809759:0:5771:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b74e00/0xd6c4b8f05867eddf lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134977.809767:0:5771:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b74e00/0xd6c4b8f05867eddf lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134977.809780:0:5771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9fe9e1c2b600) 00010000:00010000:3.0:1783134977.809783:0:5771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783134977.809787:0:5771:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b74e00/0xd6c4b8f05867eddf lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134977.809794:0:5771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b74e00/0xd6c4b8f05867eddf lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134977.809810:0:5771:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b74c00/0xd6c4b8f05867ede6 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134977.809817:0:5771:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b74c00/0xd6c4b8f05867ede6 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134977.809823:0:5771:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b74c00/0xd6c4b8f05867ede6 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134977.809833:0:5771:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe9d2b74c00 already unused, calling callback (ffffffffc1f634f0) 00010000:00010000:3.0:1783134977.809837:0:5771:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b74c00/0xd6c4b8f05867ede6 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134977.809843:0:5771:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b74c00/0xd6c4b8f05867ede6 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134977.809850:0:5771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x77a79f1b (ffff9fe9cb8f4000) 00010000:00010000:3.0:1783134977.809852:0:5771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783134977.809855:0:5771:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b74c00/0xd6c4b8f05867ede6 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134977.809860:0:5771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b74c00/0xd6c4b8f05867ede6 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134977.809874:0:5771:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b74400/0xd6c4b8f05867eded lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134977.809880:0:5771:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b74400/0xd6c4b8f05867eded lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134977.809886:0:5771:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b74400/0xd6c4b8f05867eded lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134977.809891:0:5771:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe9d2b74400 already unused, calling callback (ffffffffc1f634f0) 00010000:00010000:3.0:1783134977.809894:0:5771:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b74400/0xd6c4b8f05867eded lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134977.809900:0:5771:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b74400/0xd6c4b8f05867eded lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134977.809949:0:5771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9fe9cc3c1b00) 00010000:00010000:3.0:1783134977.809951:0:5771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783134977.809955:0:5771:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b74400/0xd6c4b8f05867eded lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134977.809961:0:5771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b74400/0xd6c4b8f05867eded lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783134977.810119:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9f6fe7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+55:10523:x1869752373922176:12345-192.168.201.41@tcp:34:lhsmtool_posix.0 Request processed in 3495us (3745us total) trans 0 rc 0/0 00000100:00100000:3.0:1783134977.810130:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 113 00000100:00100000:1.0:1783134977.813412:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:0.0:1783134977.813518:0:5769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373922432 00000100:00100000:0.0:1783134977.813529:0:5769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373922432 00000100:00100000:0.0:1783134977.813601:0:5769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 114 00000100:00100000:0.0:1783134977.813614:0:5769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9f6fe4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+55:10523:x1869752373922432:12345-192.168.201.41@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1783134977.813642:0:5769:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783134977.813664:0:5769:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ad000/0xd6c4b8f05867edf4 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4428da03f5eb7330 expref: -99 pid: 5769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134977.813801:0:5769:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ade00/0xd6c4b8f05867edfb lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134977.813819:0:5769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ade00/0xd6c4b8f05867edfb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134977.813832:0:5769:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ade00/0xd6c4b8f05867edfb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783134977.813846:0:5769:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:0.0:1783134977.814414:0:5769:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ade00/0xd6c4b8f05867edfb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134977.814424:0:5769:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ade00/0xd6c4b8f05867edfb lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134977.814431:0:5769:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ade00/0xd6c4b8f05867edfb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134977.814438:0:5769:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe9f68ade00 already unused, calling callback (ffffffffc1f634f0) 00010000:00010000:0.0:1783134977.814443:0:5769:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ade00/0xd6c4b8f05867edfb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134977.814451:0:5769:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ade00/0xd6c4b8f05867edfb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134977.814466:0:5769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9fe9cc3c1b00) 00010000:00010000:0.0:1783134977.814469:0:5769:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1783134977.814474:0:5769:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ade00/0xd6c4b8f05867edfb lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134977.814493:0:5769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ade00/0xd6c4b8f05867edfb lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134977.814543:0:5769:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ad000/0xd6c4b8f05867edf4 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb7330 expref: 57 pid: 5769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134977.814555:0:5769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9fe9e1c2b600) 00010000:00010000:0.0:1783134977.814558:0:5769:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1783134977.814562:0:5769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ad000/0xd6c4b8f05867edf4 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb7330 expref: 57 pid: 5769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134977.814574:0:5769:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fe9f68ad000, rc 0) 00000100:00100000:0.0:1783134977.814663:0:5769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9f6fe4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+56:10523:x1869752373922432:12345-192.168.201.41@tcp:101:lhsmtool_posix.0 Request processed in 1048us (1261us total) trans 4294967397 rc 301/301 00000100:00100000:0.0:1783134977.814672:0:5769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 114 00000100:00100000:2.0:1783134977.817682:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:0.0:1783134977.820706:0:8031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373922560 00000100:00100000:0.0:1783134977.820727:0:8031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373922560 00000100:00100000:0.0:1783134977.820819:0:8031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 115 00000100:00100000:0.0:1783134977.820831:0:8031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9f68f6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+56:10523:x1869752373922560:12345-192.168.201.41@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1783134977.820878:0:8031:0:(mdt_handler.c:7960:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1783134977.821019:0:8031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9f68f6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+56:10523:x1869752373922560:12345-192.168.201.41@tcp:53:lhsmtool_posix.0 Request processed in 190us (3345us total) trans 0 rc 0/0 00000100:00100000:0.0:1783134977.821027:0:8031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 115 00000100:00100000:1.0:1783134977.832661:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:2.0:1783134977.832743:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373922816 00000100:00100000:2.0:1783134977.832757:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373922816 00000100:00100000:2.0:1783134977.832832:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 116 00000100:00100000:2.0:1783134977.832843:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9f6fe6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+56:10523:x1869752373922816:12345-192.168.201.41@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1783134977.832869:0:5770:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783134977.832874:0:5770:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1783134977.832918:0:5770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b75000/0xd6c4b8f05867ed99 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb7314 expref: 56 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134977.832952:0:5770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9fe9e1c2bd00) 00010000:00010000:2.0:1783134977.832958:0:5770:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1783134977.832975:0:5770:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828e00/0xd6c4b8f05867ee09 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4428da03f5eb7337 expref: -99 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1783134977.833674:0:5770:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x4:0x0], index 1: 0 00010000:00010000:2.0:1783134977.833923:0:5770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828200/0xd6c4b8f05867ee10 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134977.833939:0:5770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828200/0xd6c4b8f05867ee10 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134977.833951:0:5770:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828200/0xd6c4b8f05867ee10 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134977.834015:0:5770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828e00/0xd6c4b8f05867ee09 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb7337 expref: 58 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134977.834035:0:5770:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828200/0xd6c4b8f05867ee10 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb7337 expref: 57 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134977.834043:0:5770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9fe9cc3c1200) 00010000:00010000:2.0:1783134977.834046:0:5770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1783134977.834049:0:5770:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fe9c7828200, rc 0) 00000100:00100000:2.0:1783134977.834129:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9f6fe6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+57:10523:x1869752373922816:12345-192.168.201.41@tcp:101:lhsmtool_posix.0 Request processed in 1287us (1483us total) trans 4294967398 rc 0/0 00000100:00100000:2.0:1783134977.834135:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 116 00000100:00100000:1.0:1783134977.842238:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:0.0:1783134977.842370:0:8031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373923072 00000100:00100000:0.0:1783134977.842382:0:8031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373923072 00000100:00100000:0.0:1783134977.842446:0:8031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 117 00000100:00100000:0.0:1783134977.842475:0:8031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9f6fe4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+57:10523:x1869752373923072:12345-192.168.201.41@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1783134977.842552:0:8031:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783134977.842598:0:8031:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828200/0xd6c4b8f05867ee10 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb7337 expref: 57 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134977.842626:0:8031:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9fe9cc3c1200) 00010000:00010000:0.0:1783134977.842641:0:8031:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1783134977.842669:0:8031:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ad000/0xd6c4b8f05867ee1e lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134977.842692:0:8031:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ad000/0xd6c4b8f05867ee1e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134977.842705:0:8031:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ad000/0xd6c4b8f05867ee1e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134977.842722:0:8031:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ade00/0xd6c4b8f05867ee25 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0xd789e103 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134977.842729:0:8031:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ade00/0xd6c4b8f05867ee25 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xd789e103 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134977.842736:0:8031:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ade00/0xd6c4b8f05867ee25 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xd789e103 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134977.842835:0:8031:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ad000/0xd6c4b8f05867ee1e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134977.842843:0:8031:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ad000/0xd6c4b8f05867ee1e lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134977.842865:0:8031:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ad000/0xd6c4b8f05867ee1e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134977.842872:0:8031:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe9f68ad000 already unused, calling callback (ffffffffc1f634f0) 00010000:00010000:0.0:1783134977.842878:0:8031:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ad000/0xd6c4b8f05867ee1e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134977.842887:0:8031:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ad000/0xd6c4b8f05867ee1e lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134977.842897:0:8031:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9fe9e1c2bd00) 00010000:00010000:0.0:1783134977.842900:0:8031:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783134977.842905:0:8031:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ad000/0xd6c4b8f05867ee1e lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134977.842911:0:8031:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ad000/0xd6c4b8f05867ee1e lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134977.842936:0:8031:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ade00/0xd6c4b8f05867ee25 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xd789e103 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134977.842942:0:8031:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ade00/0xd6c4b8f05867ee25 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xd789e103 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134977.842948:0:8031:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ade00/0xd6c4b8f05867ee25 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xd789e103 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134977.842952:0:8031:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe9f68ade00 already unused, calling callback (ffffffffc1f634f0) 00010000:00010000:0.0:1783134977.842955:0:8031:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ade00/0xd6c4b8f05867ee25 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xd789e103 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134977.842972:0:8031:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ade00/0xd6c4b8f05867ee25 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xd789e103 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134977.842980:0:8031:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0xd789e103 (ffff9fe9c8301100) 00010000:00010000:0.0:1783134977.842983:0:8031:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783134977.842986:0:8031:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ade00/0xd6c4b8f05867ee25 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0xd789e103 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134977.842992:0:8031:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ade00/0xd6c4b8f05867ee25 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0xd789e103 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783134977.843106:0:8031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9f6fe4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+56:10523:x1869752373923072:12345-192.168.201.41@tcp:36:lhsmtool_posix.0 Request processed in 633us (884us total) trans 0 rc -2/-2 00000100:00100000:0.0:1783134977.843114:0:8031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 117 00000100:00100000:1.0:1783134977.845033:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:0.0:1783134977.845125:0:5769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373923200 00000100:00100000:0.0:1783134977.845136:0:5769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373923200 00000100:00100000:0.0:1783134977.845199:0:5769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 118 00000100:00100000:0.0:1783134977.845211:0:5769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9f6fe4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+56:10523:x1869752373923200:12345-192.168.201.41@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1783134977.845243:0:5769:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783134977.845268:0:5769:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ace00/0xd6c4b8f05867ee2c lrc: 2/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4428da03f5eb733e expref: -99 pid: 5769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134977.845364:0:5769:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ad200/0xd6c4b8f05867ee33 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134977.845379:0:5769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ad200/0xd6c4b8f05867ee33 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134977.845391:0:5769:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ad200/0xd6c4b8f05867ee33 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134977.845510:0:5769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ace00/0xd6c4b8f05867ee2c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb733e expref: 58 pid: 5769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134977.845529:0:5769:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ad200/0xd6c4b8f05867ee33 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb733e expref: 57 pid: 5769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134977.845538:0:5769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9fe9c8301d00) 00010000:00010000:0.0:1783134977.845540:0:5769:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1783134977.845543:0:5769:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fe9f68ad200, rc 0) 00000100:00100000:0.0:1783134977.845608:0:5769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9f6fe4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+57:10523:x1869752373923200:12345-192.168.201.41@tcp:101:lhsmtool_posix.0 Request processed in 399us (586us total) trans 0 rc 0/0 00000100:00100000:0.0:1783134977.845616:0:5769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 118 00000100:00100000:1.0:1783134977.851995:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:3.0:1783134977.852653:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373923456 00000100:00100000:3.0:1783134977.852666:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373923456 00000100:00100000:3.0:1783134977.852726:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 119 00000100:00100000:3.0:1783134977.852736:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9f6fe6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+57:10523:x1869752373923456:12345-192.168.201.41@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1783134977.852833:0:5771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b74400/0xd6c4b8f05867ee3a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134977.852851:0:5771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b74400/0xd6c4b8f05867ee3a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134977.852861:0:5771:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b74400/0xd6c4b8f05867ee3a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1783134977.853155:0:5771:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].5, 88 off8560 00000004:00080000:3.0:1783134977.853164:0:5771:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 260248883464ns, next at 261248881879ns, rc = 0 00000004:00010000:3.0:1783134977.853250:0:5771:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000073cd527f reply state 00000000b7a4a1df transno 4294967399 ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b74400/0xd6c4b8f05867ee3a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783134977.853307:0:5771:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1783134977.853645:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9f6fe6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+59:10523:x1869752373923456:12345-192.168.201.41@tcp:36:lhsmtool_posix.0 Request processed in 907us (1664us total) trans 4294967399 rc 0/0 00000100:00100000:2.0:1783134977.853655:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 119 00010000:00010000:3.0:1783134977.855024:0:3272:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b74400/0xd6c4b8f05867ee3a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134977.855040:0:3272:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b74400/0xd6c4b8f05867ee3a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134977.855049:0:3272:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b74400/0xd6c4b8f05867ee3a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134977.855056:0:3272:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe9d2b74400 already unused, calling callback (ffffffffc1f634f0) 00010000:00010000:3.0:1783134977.855062:0:3272:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b74400/0xd6c4b8f05867ee3a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134977.855070:0:3272:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b74400/0xd6c4b8f05867ee3a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134977.855090:0:3272:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9fe9c8301d00) 00010000:00010000:3.0:1783134977.855093:0:3272:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1783134977.855098:0:3272:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b74400/0xd6c4b8f05867ee3a lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134977.855103:0:3272:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b74400/0xd6c4b8f05867ee3a lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783134977.855535:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:0.0:1783134977.855620:0:5769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373923584 00000100:00100000:0.0:1783134977.855632:0:5769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373923584 00000100:00100000:0.0:1783134977.855772:0:5769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 120 00000100:00100000:0.0:1783134977.855785:0:5769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9f6fe4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+58:10523:x1869752373923584:12345-192.168.201.41@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1783134977.855819:0:5769:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783134977.855842:0:5769:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ade00/0xd6c4b8f05867ee41 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4428da03f5eb7345 expref: -99 pid: 5769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134977.855923:0:5769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ade00/0xd6c4b8f05867ee41 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb7345 expref: 59 pid: 5769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134977.855944:0:5769:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ade00/0xd6c4b8f05867ee41 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb7345 expref: 59 pid: 5769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134977.855991:0:5769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9fe9c8301d00) 00010000:00010000:0.0:1783134977.855995:0:5769:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1783134977.855998:0:5769:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fe9f68ade00, rc 0) 00000100:00100000:0.0:1783134977.856069:0:5769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9f6fe4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+59:10523:x1869752373923584:12345-192.168.201.41@tcp:101:lhsmtool_posix.0 Request processed in 282us (536us total) trans 0 rc 0/0 00000100:00100000:0.0:1783134977.856076:0:5769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 120 00000100:00100000:1.0:1783134977.857779:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:3.0:1783134977.857986:0:7676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373923712 00000100:00100000:3.0:1783134977.857998:0:7676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373923712 00000100:00100000:3.0:1783134977.858065:0:7676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 37 00000100:00100000:3.0:1783134977.858076:0:7676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9f6fe6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+8:2370:x1869752373923712:12345-192.168.201.41@tcp:2:lhsmtool_posix.0 00000100:00100000:3.0:1783134977.858754:0:7676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9f6fe6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+9:2370:x1869752373923712:12345-192.168.201.41@tcp:2:lhsmtool_posix.0 Request processed in 678us (982us total) trans 4294967307 rc 0/0 00000100:00100000:3.0:1783134977.858780:0:7676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 37 00000100:00100000:1.0:1783134977.865645:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:2.0:1783134977.865737:0:5773:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373923968 00000100:00100000:2.0:1783134977.865751:0:5773:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373923968 00000100:00100000:2.0:1783134977.865853:0:5773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 30 00000100:00100000:2.0:1783134977.865868:0:5773:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9f6fe6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+59:10523:x1869752373923968:12345-192.168.201.41@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1783134977.866182:0:5773:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9f6fe6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+60:10523:x1869752373923968:12345-192.168.201.41@tcp:35:lhsmtool_posix.0 Request processed in 318us (551us total) trans 4294967400 rc 0/0 00000100:00100000:2.0:1783134977.866191:0:5773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 30 00000100:00100000:1.0:1783134977.868019:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:0.0:1783134977.868089:0:8031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373924224 00000100:00100000:0.0:1783134977.868101:0:8031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373924224 00000100:00100000:0.0:1783134977.868166:0:8031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 121 00000100:00100000:0.0:1783134977.868176:0:8031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fe7d0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+60:10523:x1869752373924224:12345-192.168.201.41@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1783134977.868595:0:8031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fe7d0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+60:10523:x1869752373924224:12345-192.168.201.41@tcp:57:lhsmtool_posix.0 Request processed in 164us (329us total) trans 0 rc 0/0 00000100:00100000:0.0:1783134977.868607:0:8031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 121 00000100:00100000:1.0:1783134977.873708:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:2.0:1783134977.873792:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373924352 00000100:00100000:2.0:1783134977.873805:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373924352 00000100:00100000:2.0:1783134977.873884:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 122 00000100:00100000:2.0:1783134977.873897:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fe7d2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+60:10523:x1869752373924352:12345-192.168.201.41@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1783134977.873936:0:5770:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783134977.873968:0:5770:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828e00/0xd6c4b8f05867ee48 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4428da03f5eb734c expref: -99 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134977.874067:0:5770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828800/0xd6c4b8f05867ee4f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134977.874084:0:5770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828800/0xd6c4b8f05867ee4f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134977.875227:0:5770:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828800/0xd6c4b8f05867ee4f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783134977.875299:0:5770:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1783134977.875325:0:5770:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828800/0xd6c4b8f05867ee4f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134977.875370:0:5770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828e00/0xd6c4b8f05867ee48 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb734c expref: 62 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134977.875421:0:5770:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828800/0xd6c4b8f05867ee4f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb734c expref: 61 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134977.875431:0:5770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9fe9c8301d00) 00010000:00010000:2.0:1783134977.875434:0:5770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1783134977.875438:0:5770:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fe9c7828800, rc 0) 00000100:00100000:2.0:1783134977.875517:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fe7d2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+61:10523:x1869752373924352:12345-192.168.201.41@tcp:101:lhsmtool_posix.0 Request processed in 1621us (1824us total) trans 0 rc 0/0 00000100:00100000:2.0:1783134977.875526:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 122 00000100:00100000:1.0:1783134977.880524:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:2.0:1783134977.880624:0:6574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373924480 00000100:00100000:2.0:1783134977.880640:0:6574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373924480 00000100:00100000:2.0:1783134977.880789:0:6574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 38 00000100:00100000:2.0:1783134977.880801:0:6574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fe7d0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+9:2370:x1869752373924480:12345-192.168.201.41@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1783134977.880819:0:6574:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783134977.880845:0:6574:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b06bbad6/0xd6c4b8f05867ee56 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4428da03f5eb7353 expref: -99 pid: 6574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1783134977.880874:0:6574:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a487b01, blocks: 0x1 00010000:00010000:2.0:1783134977.880894:0:6574:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=260s v=(0 0) 00010000:00010000:2.0:1783134977.880899:0:6574:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783134977.880909:0:6574:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b06bbad6/0xd6c4b8f05867ee56 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb7353 expref: 10 pid: 6574 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134977.880928:0:6574:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000b06bbad6/0xd6c4b8f05867ee56 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb7353 expref: 10 pid: 6574 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134977.880963:0:6574:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fe9c7828200, rc 0) 00000100:00100000:2.0:1783134977.881029:0:6574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fe7d0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+10:2370:x1869752373924480:12345-192.168.201.41@tcp:101:lhsmtool_posix.0 Request processed in 230us (521us total) trans 0 rc 0/0 00000100:00100000:2.0:1783134977.881036:0:6574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 38 00000100:00100000:1.0:1783134977.884028:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:2.0:1783134977.884112:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373924736 00000100:00100000:2.0:1783134977.884124:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373924736 00000100:00100000:2.0:1783134977.884194:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 123 00000100:00100000:2.0:1783134977.884204:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fe7d0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+61:10523:x1869752373924736:12345-192.168.201.41@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1783134977.884332:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fe7d0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+61:10523:x1869752373924736:12345-192.168.201.41@tcp:57:lhsmtool_posix.0 Request processed in 128us (317us total) trans 0 rc 0/0 00000100:00100000:2.0:1783134977.884340:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 123 00000100:00100000:1.0:1783134977.887151:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:2.0:1783134977.887826:0:6577:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373924864 00000100:00100000:2.0:1783134977.887840:0:6577:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373924864 00000100:00100000:2.0:1783134977.887906:0:6577:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 39 00000100:00100000:2.0:1783134977.887916:0:6577:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fe7d2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+10:10523:x1869752373924864:12345-192.168.201.41@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1783134977.887936:0:6577:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783134977.887960:0:6577:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007c6793cf/0xd6c4b8f05867ee5d lrc: 2/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4428da03f5eb735a expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134977.887993:0:6577:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000b06bbad6/0xd6c4b8f05867ee56 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb7353 expref: 11 pid: 6574 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134977.888003:0:6577:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783134977.888008:0:6577:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783134977.888029:0:6577:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007c6793cf/0xd6c4b8f05867ee5d lrc: 4/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb735a expref: 11 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134977.888064:0:6577:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000b06bbad6/0xd6c4b8f05867ee56 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb7353 expref: 11 pid: 6574 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134977.888079:0:6577:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000b06bbad6/0xd6c4b8f05867ee56 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb7353 expref: 11 pid: 6574 timeout: 360 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783134977.888093:0:6577:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9f68f5500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6577:1869752384412672:192.168.201.41@tcp:104: 00000100:00100000:2.0:1783134977.888199:0:6577:0:(client.c:2701:ptlrpc_set_wait()) set ffff9fe8c4fb9480 going to sleep for 11 seconds 00000100:00100000:2.0:1783134977.890104:0:6577:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9f68f5500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6577:1869752384412672:192.168.201.41@tcp:104: 00010000:00010000:2.0:1783134977.890137:0:6577:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000007c6793cf/0xd6c4b8f05867ee5d lrc: 3/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb735a expref: 11 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134977.890155:0:6577:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fe9c7828e00, rc 0) 00000100:00100000:2.0:1783134977.890218:0:6577:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fe7d2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+11:10523:x1869752373924864:12345-192.168.201.41@tcp:101:lhsmtool_posix.0 Request processed in 2304us (3079us total) trans 0 rc 0/0 00000100:00100000:2.0:1783134977.890226:0:6577:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 39 00000100:00100000:1.0:1783134977.892797:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:2.0:1783134977.892878:0:5754:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373924992 00000100:00100000:2.0:1783134977.892894:0:5754:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373924992 00010000:00010000:2.0:1783134977.892952:0:5754:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000b06bbad6/0xd6c4b8f05867ee56 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb7353 expref: 11 pid: 6574 timeout: 360 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783134977.893065:0:5754:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 56 00000100:00100000:2.0:1783134977.893077:0:5754:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fe7d0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+11:2369:x1869752373924992:12345-192.168.201.41@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783134977.893109:0:5754:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783134977.893133:0:5754:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000b06bbad6/0xd6c4b8f05867ee56 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb7353 expref: 11 pid: 6574 timeout: 360 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134977.893148:0:5754:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000b06bbad6/0xd6c4b8f05867ee56 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb7353 expref: 11 pid: 6574 timeout: 360 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134977.893174:0:5754:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b06bbad6/0xd6c4b8f05867ee56 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb7353 expref: 11 pid: 6574 timeout: 360 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134977.893193:0:5754:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783134977.893198:0:5754:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783134977.893207:0:5754:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000007c6793cf/0xd6c4b8f05867ee5d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb735a expref: 10 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134977.893218:0:5754:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007c6793cf/0xd6c4b8f05867ee5d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb735a expref: 10 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134977.893258:0:5754:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000007c6793cf/0xd6c4b8f05867ee5d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb735a expref: 10 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783134977.893272:0:5754:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9f68f5500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5754:1869752384412800:192.168.201.41@tcp:105: 00000100:00100000:2.0:1783134977.893440:0:5754:0:(client.c:2701:ptlrpc_set_wait()) set ffff9fe8c4fb9480 going to sleep for 11 seconds 00000100:00100000:2.0:1783134977.897609:0:5754:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9f68f5500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5754:1869752384412800:192.168.201.41@tcp:105: 00010000:00010000:2.0:1783134977.897643:0:5754:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783134977.897739:0:5754:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fe7d0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+10:2369:x1869752373924992:12345-192.168.201.41@tcp:103:ldlm_bl.0 Request processed in 4662us (4959us total) trans 0 rc 0/0 00000100:00100000:2.0:1783134977.897751:0:5754:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 56 00000100:00100000:3.0:1783134977.898528:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:2.0:1783134977.898647:0:6580:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373925120 00000100:00100000:2.0:1783134977.898657:0:6580:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373925120 00002000:00100000:2.0:1783134977.898716:0:6580:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x4:0x0] (0->12) req@ffff9fe9f68f1180 x1869752373925120/t0(0) o4->28f4ba61-cfae-499e-ab3d-81cb8215f7bb@192.168.201.41@tcp:148/0 lens 504/0 e 0 to 0 dl 1783134988 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1783134977.898729:0:6580:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9fe9f68f1180 with x1869752373925120 ext(0->12) 00002000:00010000:2.0:1783134977.898737:0:6580:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9fe9f68f1180 00000100:00100000:2.0:1783134977.898776:0:6580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 2 00000100:00100000:2.0:1783134977.898786:0:6580:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9f68f1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+10:2369:x1869752373925120:12345-192.168.201.41@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1783134977.899620:0:6580:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9f68f1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+12:2369:x1869752373925120:12345-192.168.201.41@tcp:4:lhsmtool_posix.0 Request processed in 833us (1099us total) trans 4294967308 rc 0/0 00000100:00100000:2.0:1783134977.899630:0:6580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 2 00002000:00100000:2.0:1783134977.899637:0:6580:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x4:0x0] (0->12) req@ffff9fe9f68f1180 x1869752373925120/t4294967308(0) o4->28f4ba61-cfae-499e-ab3d-81cb8215f7bb@192.168.201.41@tcp:148/0 lens 504/448 e 0 to 0 dl 1783134988 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1783134977.899646:0:6580:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9fe9f68f1180 with x1869752373925120 ext(0->12) 00002000:00010000:2.0:1783134977.899650:0:6580:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9fe9f68f1180 00000100:00100000:1.0:1783134977.902254:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:0.0:1783134977.902523:0:5769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373925248 00000100:00100000:0.0:1783134977.902534:0:5769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373925248 00000100:00100000:2.0:1783134977.902626:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 124 00000100:00100000:2.0:1783134977.902639:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fe7d3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+61:10523:x1869752373925248:12345-192.168.201.41@tcp:44:lhsmtool_posix.0 00000001:00080000:1.0:1783134977.936550:0:5791:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967397 is committed 00000020:00080000:1.0:1783134977.936624:0:5791:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9fe8c55ea480 refcount 2 committed 0 result 0 batchid 2 00000020:00080000:1.0:1783134977.936630:0:5791:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9fe9f8a99a00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9fe8c55ead80 00000020:00080000:1.0:1783134977.936634:0:5791:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9fe9f8a99600 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9fe9f6cb9800 00000020:00080000:1.0:1783134977.936663:0:5791:0:(update_trans.c:1341:distribute_txn_batchid_cb()) lustre-MDT0000: 1 batchid updated 00000020:00080000:1.0:1783134977.936674:0:5802:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 2 committed batchid 1 00000020:00080000:1.0:1783134977.936852:0:5802:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000001:00080000:1.0:1783134977.936868:0:5791:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967400 is committed 00000004:00080000:1.0:1783134977.936889:0:5791:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 5 committed 00000100:00100000:1.0:1783134977.937024:0:3286:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9fe7d1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1869752384412928:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1783134977.937091:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783134977.937160:0:6574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384412928 00000100:00100000:1.0:1783134977.937167:0:6574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384412928 00000100:00100000:1.0:1783134977.937212:0:6574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1783134977.937222:0:6574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fe7d2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3286:x1869752384412928:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1783134977.937248:0:6574:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:3 count 1 00010000:00010000:1.0:1783134977.937271:0:6574:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000df406bb1/0xd6c4b8f05867ee64 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134977.937314:0:6574:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000061135695/0xd6c4b8f05867ec1f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb72b2 expref: 11 pid: 7676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134977.937323:0:6574:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x3:0x0].0x0 since=2s v=(0 0) 00010000:00010000:1.0:1783134977.937327:0:6574:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1783134977.937332:0:6574:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000df406bb1/0xd6c4b8f05867ee64 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134977.937356:0:6574:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000061135695/0xd6c4b8f05867ec1f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb72b2 expref: 11 pid: 7676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134977.937369:0:6574:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000061135695/0xd6c4b8f05867ec1f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb72b2 expref: 11 pid: 7676 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783134977.937388:0:6574:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9fe7d1500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6574:1869752384413056:192.168.201.41@tcp:104: 00000100:00100000:1.0:1783134977.937436:0:6574:0:(client.c:2701:ptlrpc_set_wait()) set ffff9fe8c55eac00 going to sleep for 11 seconds 00000004:00080000:1.0:1783134977.937458:0:5791:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 6 committed 00000004:00080000:1.0:1783134977.937470:0:5791:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3 committed 00000020:00080000:1.0:1783134977.937482:0:5791:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9fe9c9d02d80 refcount 2 committed 0 result 0 batchid 3 00000020:00080000:1.0:1783134977.937485:0:5791:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9fe8c4dfd800 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9fe9c9d02c00 00000020:00080000:1.0:1783134977.937488:0:5791:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9fe9f6910500 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9fe9fe443000 00000100:00100000:1.0:1783134977.937535:0:3287:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9fe7d1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1869752384413184:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1783134977.937560:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783134977.937602:0:7676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384413184 00000100:00100000:1.0:1783134977.937605:0:7676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384413184 00000100:00100000:1.0:1783134977.937628:0:7676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1783134977.937635:0:7676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fe7d1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3287:x1869752384413184:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1783134977.937749:0:7676:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:1.0:1783134977.937752:0:7676:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb mtime from disk: 0 -> 1783134977 00002000:00010000:1.0:1783134977.937755:0:7676:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1783134977.937757:0:7676:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb ctime from disk: 1783134977 -> 1783134977 00002000:00010000:1.0:1783134977.937759:0:7676:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1783134977.937794:0:7676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fe7d1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+8:3287:x1869752384413184:12345-0@lo:2:osp-syn-1-0.0 Request processed in 159us (233us total) trans 4294967309 rc 0/0 00000100:00100000:1.0:1783134977.937800:0:7676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000004:00080000:1.0:1783134977.937836:0:3287:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9fe9fe7d1c00/2, rc 0, transno 4294967309 00000100:00100000:1.0:1783134977.937841:0:3287:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9fe7d1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1869752384413184:0@lo:2:osp-syn-1-0.0 00000020:00080000:1.0:1783134977.937866:0:5802:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 3 committed batchid 1 00000020:00080000:1.0:1783134977.937891:0:5802:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:3.0:1783134977.938022:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fe7d3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+15:10523:x1869752373925248:12345-192.168.201.41@tcp:44:lhsmtool_posix.0 Request processed in 35384us (35779us total) trans 0 rc 0/0 00000100:00100000:3.0:1783134977.938031:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 124 00000100:00100000:3.0:1783134977.938354:0:3288:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9f6894380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1869752384413312:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1783134977.938386:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783134977.938462:0:7676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384413312 00000100:00100000:0.0:1783134977.938466:0:7676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384413312 00000100:00100000:0.0:1783134977.938500:0:7676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1783134977.938508:0:7676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9f68f2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+8:3288:x1869752384413312:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1783134977.938523:0:7676:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:3 count 1 00002000:00010000:0.0:1783134977.938547:0:7676:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3:0x0] initial LVB size: 9, mtime: 0x6a487b00, atime: 0x6a487b00, ctime: 0x6a487b00, blocks: 0x1 00010000:00010000:0.0:1783134977.938553:0:7676:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d4155092/0xd6c4b8f05867ee6b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 7676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134977.938565:0:7676:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=260s v=(0 0) 00010000:00010000:0.0:1783134977.938576:0:7676:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783134977.938592:0:7676:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d4155092/0xd6c4b8f05867ee6b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 7676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134977.938608:0:7676:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d4155092/0xd6c4b8f05867ee6b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 7676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134977.938618:0:7676:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d4155092/0xd6c4b8f05867ee6b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 7676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134977.938625:0:7676:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d4155092/0xd6c4b8f05867ee6b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 7676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134977.938644:0:7676:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1783134977.939072:0:7676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9f68f2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+9:3288:x1869752384413312:12345-0@lo:6:osp-syn-0-0.0 Request processed in 564us (684us total) trans 4294967304 rc 0/0 00000100:00100000:0.0:1783134977.939079:0:7676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00010000:00010000:0.0:1783134977.939099:0:5758:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783134977.939105:0:5758:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d4155092/0xd6c4b8f05867ee6b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 7676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134977.939114:0:5758:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe9f68ace00 already unused, calling callback (ffffffffc1527ce0) 00010000:00010000:0.0:1783134977.939118:0:5758:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d4155092/0xd6c4b8f05867ee6b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 7676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134977.939128:0:5758:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d4155092/0xd6c4b8f05867ee6b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 7676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134977.939156:0:5758:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d4155092/0xd6c4b8f05867ee6b lrc: 1/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 7676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134977.939164:0:5758:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d4155092/0xd6c4b8f05867ee6b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 7676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134977.939181:0:5758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783134977.939183:0:5758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783134977.939185:0:5758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1783134977.939208:0:3288:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9fe9f6894380/2, rc 0, transno 4294967304 00000100:00100000:0.0:1783134977.939214:0:3288:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9f6894380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1869752384413312:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1783134977.943920:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:3.0:1783134977.944017:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:1.0:1783134977.944093:0:6574:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9fe7d1500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6574:1869752384413056:192.168.201.41@tcp:104: 00010000:00010000:1.0:1783134977.944130:0:6574:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000df406bb1/0xd6c4b8f05867ee64 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783134977.944227:0:5755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373925504 00000100:00100000:2.0:1783134977.944235:0:5755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373925504 00010000:00010000:2.0:1783134977.944300:0:5755:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000061135695/0xd6c4b8f05867ec1f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb72b2 expref: 12 pid: 7676 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783134977.944371:0:5755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 57 00000100:00100000:2.0:1783134977.944383:0:5755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9f68f1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+12:2369:x1869752373925504:12345-192.168.201.41@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783134977.944400:0:5755:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783134977.944406:0:5755:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000061135695/0xd6c4b8f05867ec1f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb72b2 expref: 12 pid: 7676 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134977.944419:0:5755:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000061135695/0xd6c4b8f05867ec1f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb72b2 expref: 12 pid: 7676 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134977.944441:0:5755:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000061135695/0xd6c4b8f05867ec1f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb72b2 expref: 12 pid: 7676 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134977.944457:0:5755:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1783134977.944462:0:5755:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1783134977.944468:0:5755:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000df406bb1/0xd6c4b8f05867ee64 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134977.944477:0:5755:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000df406bb1/0xd6c4b8f05867ee64 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134977.944511:0:5755:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783134977.944599:0:5755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9f68f1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+11:2369:x1869752373925504:12345-192.168.201.41@tcp:103:ldlm_bl.0 Request processed in 219us (580us total) trans 0 rc 0/0 00000100:00100000:2.0:1783134977.944607:0:5755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 57 00000100:00100000:0.0:1783134977.944694:0:6576:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373925376 00000100:00100000:0.0:1783134977.944700:0:6576:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373925376 00000100:00100000:0.0:1783134977.944744:0:6576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 43 00000100:00100000:0.0:1783134977.944752:0:6576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9f68f1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+11:2370:x1869752373925376:12345-192.168.201.41@tcp:16:lhsmtool_posix.0 00010000:00010000:1.0:1783134977.944863:0:6574:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000df406bb1/0xd6c4b8f05867ee64 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134977.944873:0:6574:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000df406bb1/0xd6c4b8f05867ee64 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134977.944883:0:6574:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000df406bb1/0xd6c4b8f05867ee64 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134977.944892:0:6574:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000df406bb1/0xd6c4b8f05867ee64 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134977.944915:0:6574:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1783134977.945491:0:6574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fe7d2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+8:3286:x1869752384412928:12345-0@lo:6:osp-syn-1-0.0 Request processed in 8266us (8394us total) trans 4294967310 rc 0/0 00010000:00010000:0.0:1783134977.949002:0:5757:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783134977.949013:0:5757:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000df406bb1/0xd6c4b8f05867ee64 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134977.949024:0:5757:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe9fe43f800 already unused, calling callback (ffffffffc1527ce0) 00010000:00010000:0.0:1783134977.949028:0:5757:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000df406bb1/0xd6c4b8f05867ee64 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134977.949036:0:5757:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000df406bb1/0xd6c4b8f05867ee64 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134977.949067:0:5757:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000df406bb1/0xd6c4b8f05867ee64 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134977.949072:0:5757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000df406bb1/0xd6c4b8f05867ee64 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134977.949088:0:5757:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783134977.949089:0:5757:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783134977.949090:0:5757:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783134977.949929:0:6574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000004:00080000:1.0:1783134977.950008:0:3286:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9fe9fe7d1180/2, rc 0, transno 4294967310 00000100:00100000:1.0:1783134977.950016:0:3286:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9fe7d1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1869752384412928:0@lo:6:osp-syn-1-0.0 00000001:00080000:3.0:1783134977.986039:0:7470:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967310 is committed 00000001:00080000:3.0:1783134977.986067:0:7470:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967308 is committed 00000100:00100000:0.0:1783134977.986258:0:6576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9f68f1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+6:2370:x1869752373925376:12345-192.168.201.41@tcp:16:lhsmtool_posix.0 Request processed in 41500us (42346us total) trans 0 rc 0/0 00000100:00100000:0.0:1783134977.986270:0:6576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 43 00000100:00100000:3.0:1783134977.989958:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:2.0:1783134977.990057:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373925760 00000100:00100000:2.0:1783134977.990066:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373925760 00000100:00100000:2.0:1783134977.990173:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 125 00000100:00100000:2.0:1783134977.990184:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9f68f1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+15:10523:x1869752373925760:12345-192.168.201.41@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1783134977.990239:0:5771:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783134977.990265:0:5771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828800/0xd6c4b8f05867ee4f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb734c expref: 15 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134977.990324:0:5771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9fe9c8301d00) 00010000:00010000:2.0:1783134977.990331:0:5771:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1783134977.990361:0:5771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828200/0xd6c4b8f05867ee72 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134977.990375:0:5771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828200/0xd6c4b8f05867ee72 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134977.990386:0:5771:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828200/0xd6c4b8f05867ee72 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1783134977.990658:0:5771:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000efbb9855 reply state 00000000ba78761f transno 4294967401 ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828200/0xd6c4b8f05867ee72 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783134977.990667:0:5771:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1783134977.990764:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9f68f1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+16:10523:x1869752373925760:12345-192.168.201.41@tcp:36:lhsmtool_posix.0 Request processed in 582us (816us total) trans 4294967401 rc 0/0 00000100:00100000:2.0:1783134977.990772:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 125 00010000:00010000:3.0:1783134977.995514:0:3273:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828200/0xd6c4b8f05867ee72 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134977.995532:0:3273:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828200/0xd6c4b8f05867ee72 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134977.995540:0:3273:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828200/0xd6c4b8f05867ee72 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134977.995547:0:3273:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe9c7828200 already unused, calling callback (ffffffffc1f634f0) 00010000:00010000:3.0:1783134977.995552:0:3273:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828200/0xd6c4b8f05867ee72 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134977.995561:0:3273:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828200/0xd6c4b8f05867ee72 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134977.995578:0:3273:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9fe9c8301d00) 00010000:00010000:3.0:1783134977.995611:0:3273:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783134977.995616:0:3273:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828200/0xd6c4b8f05867ee72 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134977.995622:0:3273:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828200/0xd6c4b8f05867ee72 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783134977.996075:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:0.0:1783134977.996248:0:6577:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373925888 00000100:00100000:0.0:1783134977.996258:0:6577:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373925888 00000100:00100000:0.0:1783134977.996339:0:6577:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 44 00000100:00100000:0.0:1783134977.996350:0:6577:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9f68f2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+6:2368:x1869752373925888:12345-192.168.201.41@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1783134977.996608:0:6577:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:0.0:1783134977.996612:0:6577:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb mtime from disk: 1783134977 -> 1783134976 00002000:00010000:0.0:1783134977.996614:0:6577:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb atime from disk: 0 -> 1783134976 00002000:00010000:0.0:1783134977.996616:0:6577:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb ctime from disk: 1783134977 -> 1783134976 00002000:00010000:0.0:1783134977.996619:0:6577:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:0.0:1783134977.996674:0:6577:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9f68f2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+7:2368:x1869752373925888:12345-192.168.201.41@tcp:2:lhsmtool_posix.0 Request processed in 325us (603us total) trans 4294967311 rc 0/0 00000100:00100000:0.0:1783134977.996684:0:6577:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 44 00000100:00100000:0.0:1783134977.998199:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:2.0:1783134977.998435:0:5769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373926144 00000100:00100000:2.0:1783134977.998443:0:5769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373926144 00000100:00100000:2.0:1783134977.998521:0:5769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 126 00000100:00100000:2.0:1783134977.998531:0:5769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9f6896d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+15:10523:x1869752373926144:12345-192.168.201.41@tcp:55:lhsmtool_posix.0 00010000:00010000:2.0:1783134977.998619:0:5769:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829a00/0xd6c4b8f05867ee79 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134977.998635:0:5769:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ad200/0xd6c4b8f05867ee33 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb733e expref: 15 pid: 5769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134977.998643:0:5769:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829a00/0xd6c4b8f05867ee79 lrc: 4/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134977.998673:0:5769:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ad200/0xd6c4b8f05867ee33 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb733e expref: 15 pid: 5769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134977.998686:0:5769:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ad200/0xd6c4b8f05867ee33 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb733e expref: 15 pid: 5769 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783134977.998699:0:5769:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9f68f5500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5769:1869752384413440:192.168.201.41@tcp:104: 00000100:00100000:2.0:1783134977.998780:0:5769:0:(client.c:2701:ptlrpc_set_wait()) set ffff9fe9cb3e90c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783134978.004960:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:1.0:1783134978.005015:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373926272 00000100:00100000:1.0:1783134978.005024:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373926272 00000100:00100000:2.0:1783134978.005068:0:5769:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9f68f5500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5769:1869752384413440:192.168.201.41@tcp:104: 00010000:00010000:1.0:1783134978.005089:0:6592:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ad200/0xd6c4b8f05867ee33 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb733e expref: 16 pid: 5769 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134978.005097:0:5769:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829a00/0xd6c4b8f05867ee79 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783134978.005139:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 58 00000100:00080000:3.0:1783134978.005152:0:5766:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1783134978.005153:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9f68f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+16:2369:x1869752373926272:12345-192.168.201.41@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1783134978.005170:0:6592:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783134978.005177:0:6592:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ad200/0xd6c4b8f05867ee33 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb733e expref: 16 pid: 5769 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134978.005190:0:6592:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ad200/0xd6c4b8f05867ee33 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb733e expref: 16 pid: 5769 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134978.005212:0:6592:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ad200/0xd6c4b8f05867ee33 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb733e expref: 16 pid: 5769 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134978.005228:0:6592:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9fe9c8301d00) 00010000:00010000:1.0:1783134978.005233:0:6592:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829a00/0xd6c4b8f05867ee79 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134978.005243:0:6592:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829a00/0xd6c4b8f05867ee79 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134978.005250:0:6592:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829a00/0xd6c4b8f05867ee79 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134978.005303:0:6592:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783134978.005347:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9f68f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+15:2369:x1869752373926272:12345-192.168.201.41@tcp:103:ldlm_bl.0 Request processed in 198us (397us total) trans 0 rc 0/0 00000100:00100000:1.0:1783134978.005355:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 58 00010000:00010000:2.0:1783134978.005439:0:5769:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829a00/0xd6c4b8f05867ee79 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134978.005447:0:5769:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829a00/0xd6c4b8f05867ee79 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134978.005477:0:5769:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829a00/0xd6c4b8f05867ee79 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134978.005495:0:5769:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829a00/0xd6c4b8f05867ee79 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134978.005501:0:5769:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829a00/0xd6c4b8f05867ee79 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134978.005507:0:5769:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe9c7829a00 already unused, calling callback (ffffffffc1f634f0) 00010000:00010000:2.0:1783134978.005511:0:5769:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829a00/0xd6c4b8f05867ee79 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134978.005519:0:5769:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829a00/0xd6c4b8f05867ee79 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134978.005530:0:5769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9fe9c8301d00) 00010000:00010000:2.0:1783134978.005534:0:5769:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:2.0:1783134978.005538:0:5769:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829a00/0xd6c4b8f05867ee79 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134978.005555:0:5769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829a00/0xd6c4b8f05867ee79 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783134978.005658:0:5769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9f6896d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+14:10523:x1869752373926144:12345-192.168.201.41@tcp:55:lhsmtool_posix.0 Request processed in 7129us (7462us total) trans 0 rc -22/-22 00000100:00100000:2.0:1783134978.005667:0:5769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 126 00000100:00100000:3.0:1783134978.008019:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:1.0:1783134978.008086:0:6574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373926400 00000100:00100000:1.0:1783134978.008094:0:6574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373926400 00000100:00080000:3.0:1783134978.008150:0:5766:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1783134978.008153:0:6574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 45 00000100:00100000:1.0:1783134978.008164:0:6574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9f68f3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+7:2367:x1869752373926400:12345-192.168.201.41@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1783134978.008204:0:6574:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000e08b3987/0xd6c4b8f05867ee80 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134978.008223:0:6574:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000007c6793cf/0xd6c4b8f05867ee5d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb735a expref: 7 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134978.008232:0:6574:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783134978.008237:0:6574:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1783134978.008242:0:6574:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e08b3987/0xd6c4b8f05867ee80 lrc: 4/1,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134978.008272:0:6574:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000007c6793cf/0xd6c4b8f05867ee5d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb735a expref: 7 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134978.008308:0:6574:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000007c6793cf/0xd6c4b8f05867ee5d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb735a expref: 7 pid: 6577 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783134978.008327:0:6574:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9fe7d1500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6574:1869752384413568:192.168.201.41@tcp:104: 00000100:00100000:1.0:1783134978.008394:0:6574:0:(client.c:2701:ptlrpc_set_wait()) set ffff9fe8c55ea840 going to sleep for 11 seconds 00000100:00100000:2.0:1783134978.010216:0:6574:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9fe7d1500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6574:1869752384413568:192.168.201.41@tcp:104: 00010000:00010000:2.0:1783134978.010243:0:6574:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000e08b3987/0xd6c4b8f05867ee80 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783134978.011059:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:0.0:1783134978.011701:0:5756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373926528 00000100:00100000:0.0:1783134978.011709:0:5756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373926528 00010000:00010000:0.0:1783134978.011744:0:5756:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000007c6793cf/0xd6c4b8f05867ee5d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb735a expref: 8 pid: 6577 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783134978.011786:0:5756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 59 00000100:00100000:0.0:1783134978.011796:0:5756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9f68f3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+8:2369:x1869752373926528:12345-192.168.201.41@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783134978.011810:0:5756:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783134978.011834:0:5756:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000007c6793cf/0xd6c4b8f05867ee5d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb735a expref: 8 pid: 6577 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134978.011847:0:5756:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000007c6793cf/0xd6c4b8f05867ee5d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb735a expref: 8 pid: 6577 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134978.011871:0:5756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007c6793cf/0xd6c4b8f05867ee5d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb735a expref: 8 pid: 6577 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134978.011896:0:5756:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1783134978.011900:0:5756:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1783134978.011905:0:5756:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000e08b3987/0xd6c4b8f05867ee80 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134978.011916:0:5756:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e08b3987/0xd6c4b8f05867ee80 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134978.011939:0:5756:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783134978.011993:0:5756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9f68f3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+7:2369:x1869752373926528:12345-192.168.201.41@tcp:103:ldlm_bl.0 Request processed in 198us (935us total) trans 0 rc 0/0 00010000:00010000:1.0:1783134978.011994:0:6574:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000e08b3987/0xd6c4b8f05867ee80 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783134978.012012:0:5756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 59 00010000:00010000:1.0:1783134978.012147:0:6574:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e08b3987/0xd6c4b8f05867ee80 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134978.012175:0:6574:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000e08b3987/0xd6c4b8f05867ee80 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134978.012184:0:6574:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e08b3987/0xd6c4b8f05867ee80 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134978.012192:0:6574:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e08b3987/0xd6c4b8f05867ee80 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134978.012199:0:6574:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe9fe43e400 already unused, calling callback (ffffffffc1527ce0) 00010000:00010000:1.0:1783134978.012203:0:6574:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e08b3987/0xd6c4b8f05867ee80 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134978.012211:0:6574:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e08b3987/0xd6c4b8f05867ee80 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134978.012223:0:6574:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e08b3987/0xd6c4b8f05867ee80 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134978.012230:0:6574:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e08b3987/0xd6c4b8f05867ee80 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783134978.012299:0:6574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9f68f3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+6:2367:x1869752373926400:12345-192.168.201.41@tcp:1:lhsmtool_posix.0 Request processed in 4137us (4285us total) trans 0 rc 0/0 00000100:00100000:1.0:1783134978.012306:0:6574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 45 00000100:00100000:3.0:1783134978.014660:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:0.0:1783134978.014714:0:8031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373926784 00000100:00100000:0.0:1783134978.014721:0:8031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373926784 00000100:00100000:0.0:1783134978.014758:0:8031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 127 00000100:00100000:0.0:1783134978.014764:0:8031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9f68f0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+14:10523:x1869752373926784:12345-192.168.201.41@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1783134978.014823:0:8031:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ad000/0xd6c4b8f05867ee87 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134978.014835:0:8031:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ad000/0xd6c4b8f05867ee87 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134978.014860:0:8031:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ad000/0xd6c4b8f05867ee87 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134978.015056:0:8031:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ad200/0xd6c4b8f05867ee8e lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134978.015068:0:8031:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ade00/0xd6c4b8f05867ee41 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb7345 expref: 15 pid: 5769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134978.015076:0:8031:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ad200/0xd6c4b8f05867ee8e lrc: 4/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134978.015106:0:8031:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ade00/0xd6c4b8f05867ee41 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb7345 expref: 15 pid: 5769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134978.015119:0:8031:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ade00/0xd6c4b8f05867ee41 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb7345 expref: 15 pid: 5769 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783134978.015152:0:8031:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9f6894a80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8031:1869752384413696:192.168.201.41@tcp:104: 00000100:00100000:0.0:1783134978.015228:0:8031:0:(client.c:2701:ptlrpc_set_wait()) set ffff9fe9fe944c00 going to sleep for 11 seconds 00000100:00100000:0.0:1783134978.017236:0:8031:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9f6894a80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8031:1869752384413696:192.168.201.41@tcp:104: 00010000:00010000:0.0:1783134978.017259:0:8031:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ad200/0xd6c4b8f05867ee8e lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783134978.017689:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:1.0:1783134978.017761:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373926912 00000100:00100000:1.0:1783134978.017770:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373926912 00010000:00010000:1.0:1783134978.017803:0:6592:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ade00/0xd6c4b8f05867ee41 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb7345 expref: 16 pid: 5769 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783134978.017839:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 60 00000100:00100000:1.0:1783134978.017848:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9f68f3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+16:2369:x1869752373926912:12345-192.168.201.41@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1783134978.017872:0:6592:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783134978.017879:0:6592:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ade00/0xd6c4b8f05867ee41 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb7345 expref: 16 pid: 5769 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134978.017891:0:6592:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ade00/0xd6c4b8f05867ee41 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb7345 expref: 16 pid: 5769 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134978.017910:0:6592:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ade00/0xd6c4b8f05867ee41 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb7345 expref: 16 pid: 5769 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134978.017924:0:6592:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9fe9c8301d00) 00010000:00010000:1.0:1783134978.017929:0:6592:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ad200/0xd6c4b8f05867ee8e lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134978.017937:0:6592:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ad200/0xd6c4b8f05867ee8e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134978.017945:0:6592:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ad200/0xd6c4b8f05867ee8e lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134978.017972:0:6592:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1783134978.017998:0:8031:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ad200/0xd6c4b8f05867ee8e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134978.018004:0:8031:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ad200/0xd6c4b8f05867ee8e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783134978.018018:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9f68f3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+15:2369:x1869752373926912:12345-192.168.201.41@tcp:103:ldlm_bl.0 Request processed in 171us (330us total) trans 0 rc 0/0 00000100:00100000:1.0:1783134978.018036:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 60 00000001:00080000:0.0:1783134978.018166:0:8031:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967402 00000001:00080000:0.0:1783134978.018340:0:8031:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967403 00000001:00080000:0.0:1783134978.018384:0:8031:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967404 00000100:00100000:0.0:1783134978.018455:0:8031:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9f6894a80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:8031:1869752384413824:0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1783134978.018499:0:8031:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783134978.018532:0:8031:0:(client.c:2701:ptlrpc_set_wait()) set ffff9fe9fe944480 going to sleep for 11 seconds 00000100:00100000:2.0:1783134978.018608:0:5774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384413824 00000100:00100000:2.0:1783134978.018618:0:5774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384413824 00000100:00100000:2.0:1783134978.018664:0:5774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1783134978.018670:0:5774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9f6894000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:8031:x1869752384413824:12345-0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1783134978.018744:0:5774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9f6894000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:8031:x1869752384413824:12345-0@lo:1000:mdt00_003.0 Request processed in 74us (243us total) trans 0 rc 0/0 00000100:00100000:2.0:1783134978.018751:0:5774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00080000:0.0:1783134978.019053:0:5766:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1783134978.019078:0:8031:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 2 00000004:00080000:0.0:1783134978.019083:0:8031:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967305 committed transno 4294967310 00000004:00080000:0.0:1783134978.019098:0:8031:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9fe9fe7d1c00, transno 4294967309 00000004:00080000:0.0:1783134978.019115:0:8031:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9fe9fe7d1180, transno 4294967310 00000100:00100000:0.0:1783134978.019121:0:8031:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9f6894a80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:8031:1869752384413824:0@lo:1000:mdt00_003.0 00000001:00080000:0.0:1783134978.019536:0:8031:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967405 00000100:00100000:0.0:1783134978.019660:0:8031:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9f6894a80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:8031:1869752384413952:0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1783134978.019701:0:8031:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783134978.019716:0:8031:0:(client.c:2701:ptlrpc_set_wait()) set ffff9fe9fe944c00 going to sleep for 11 seconds 00000100:00100000:2.0:1783134978.019833:0:5774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384413952 00000100:00100000:2.0:1783134978.019838:0:5774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384413952 00000100:00100000:2.0:1783134978.019869:0:5774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1783134978.019877:0:5774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9f6896680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:8031:x1869752384413952:12345-0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1783134978.020050:0:5774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9f6896680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:8031:x1869752384413952:12345-0@lo:1000:mdt00_003.0 Request processed in 174us (348us total) trans 4294967312 rc 0/0 00000100:00100000:2.0:1783134978.020057:0:5774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1783134978.020091:0:8031:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9f6894a80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:8031:1869752384413952:0@lo:1000:mdt00_003.0 00010000:00010000:1.0:1783134978.020116:0:8031:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ad200/0xd6c4b8f05867ee8e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134978.020125:0:8031:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ad200/0xd6c4b8f05867ee8e lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134978.020131:0:8031:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ad200/0xd6c4b8f05867ee8e lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134978.020138:0:8031:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe9f68ad200 already unused, calling callback (ffffffffc1f634f0) 00010000:00010000:1.0:1783134978.020143:0:8031:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ad200/0xd6c4b8f05867ee8e lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134978.020150:0:8031:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ad200/0xd6c4b8f05867ee8e lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134978.020163:0:8031:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9fe9c8301d00) 00010000:00010000:1.0:1783134978.020166:0:8031:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1783134978.020169:0:8031:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ad200/0xd6c4b8f05867ee8e lrc: 2/0,0 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134978.020175:0:8031:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ad200/0xd6c4b8f05867ee8e lrc: 0/0,0 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134978.020200:0:8031:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829e00/0xd6c4b8f05867edd1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134978.020206:0:8031:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829e00/0xd6c4b8f05867edd1 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134978.020223:0:8031:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829e00/0xd6c4b8f05867edd1 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134978.020228:0:8031:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe9c7829e00 already unused, calling callback (ffffffffc1f634f0) 00010000:00010000:1.0:1783134978.020230:0:8031:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829e00/0xd6c4b8f05867edd1 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134978.020235:0:8031:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829e00/0xd6c4b8f05867edd1 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134978.020243:0:8031:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9fe9cc3c1b00) 00010000:00010000:1.0:1783134978.020245:0:8031:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1783134978.020250:0:8031:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b74200/0xd6c4b8f05867edd8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb7329 expref: 18 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134978.020260:0:8031:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b74200/0xd6c4b8f05867edd8 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb7329 expref: 18 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134978.020267:0:8031:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b74200/0xd6c4b8f05867edd8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb7329 expref: 18 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134978.020306:0:8031:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b74200/0xd6c4b8f05867edd8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb7329 expref: 18 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783134978.020317:0:8031:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9fe7d1c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8031:1869752384414080:192.168.201.41@tcp:105: 00000100:00100000:1.0:1783134978.020379:0:8031:0:(client.c:2701:ptlrpc_set_wait()) set ffff9fe8c55eaf00 going to sleep for 11 seconds 00000100:00100000:1.0:1783134978.023410:0:8031:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9fe7d1c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8031:1869752384414080:192.168.201.41@tcp:105: 00010000:00010000:1.0:1783134978.023458:0:8031:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829e00/0xd6c4b8f05867edd1 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134978.023469:0:8031:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829e00/0xd6c4b8f05867edd1 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134978.023499:0:8031:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43e400/0xd6c4b8f05867ee95 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134978.023513:0:8031:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43e400/0xd6c4b8f05867ee95 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134978.023524:0:8031:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43e400/0xd6c4b8f05867ee95 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134978.023535:0:8031:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43e400/0xd6c4b8f05867ee95 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134978.023930:0:8031:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43e400/0xd6c4b8f05867ee95 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134978.023940:0:8031:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43e400/0xd6c4b8f05867ee95 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134978.023947:0:8031:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe9fe43e400 already unused, calling callback (ffffffffc1f634f0) 00010000:00010000:1.0:1783134978.023951:0:8031:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43e400/0xd6c4b8f05867ee95 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134978.023960:0:8031:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43e400/0xd6c4b8f05867ee95 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134978.023973:0:8031:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9fe9cc3c1b00) 00010000:00010000:1.0:1783134978.023976:0:8031:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783134978.023987:0:8031:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43e400/0xd6c4b8f05867ee95 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134978.023993:0:8031:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43e400/0xd6c4b8f05867ee95 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134978.024004:0:8031:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ad000/0xd6c4b8f05867ee87 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134978.024011:0:8031:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ad000/0xd6c4b8f05867ee87 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134978.024016:0:8031:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ad000/0xd6c4b8f05867ee87 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134978.024021:0:8031:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe9f68ad000 already unused, calling callback (ffffffffc1f634f0) 00010000:00010000:1.0:1783134978.024024:0:8031:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ad000/0xd6c4b8f05867ee87 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134978.024030:0:8031:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ad000/0xd6c4b8f05867ee87 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134978.024037:0:8031:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9fe9cc3c1b00) 00010000:00010000:1.0:1783134978.024040:0:8031:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1783134978.024042:0:8031:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ad000/0xd6c4b8f05867ee87 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134978.024048:0:8031:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ad000/0xd6c4b8f05867ee87 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783134978.024138:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:0.0:1783134978.024380:0:5772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373927040 00000100:00100000:0.0:1783134978.024388:0:5772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373927040 00000100:00100000:0.0:1783134978.024441:0:5772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 31 00000100:00100000:0.0:1783134978.024449:0:5772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9f68f0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+19:10522:x1869752373927040:12345-192.168.201.41@tcp:49:lfs.0 00000100:00100000:0.0:1783134978.024575:0:5772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9f68f0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+19:10522:x1869752373927040:12345-192.168.201.41@tcp:49:lfs.0 Request processed in 126us (438us total) trans 0 rc 0/0 00000100:00100000:0.0:1783134978.024593:0:5772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 31 00000040:00080000:3.0:1783134978.026118:0:11499:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1783134978.026147:0:11499:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1783134978.027560:0:11499:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:3.0:1783134978.027576:0:11499:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1783134978.028243:0:8031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9f68f0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+18:10523:x1869752373926784:12345-192.168.201.41@tcp:57:lhsmtool_posix.0 Request processed in 13472us (13582us total) trans 4294967406 rc 0/0 00000100:00100000:0.0:1783134978.028254:0:8031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 127 00000020:00080000:0.0:1783134978.028261:0:8031:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:3.0:1783134978.028275:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:3.0:1783134978.028389:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373927296 00000100:00100000:3.0:1783134978.028397:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373927296 00000100:00100000:3.0:1783134978.028631:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 128 00000100:00100000:3.0:1783134978.028641:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9f68f2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+18:10522:x1869752373927296:12345-192.168.201.41@tcp:58:lfs.0 00000040:00080000:3.0:1783134978.028950:0:5770:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].3, 136 off8600 00000100:00100000:3.0:1783134978.029007:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9f68f2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+18:10522:x1869752373927296:12345-192.168.201.41@tcp:58:lfs.0 Request processed in 367us (732us total) trans 0 rc 0/0 00000100:00100000:3.0:1783134978.029015:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 128 00000100:00100000:3.0:1783134978.032026:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:0.0:1783134978.035910:0:5772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373927552 00000100:00100000:0.0:1783134978.035926:0:5772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373927552 00000100:00100000:0.0:1783134978.036148:0:5772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 32 00000100:00100000:0.0:1783134978.036159:0:5772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9cb439050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+18:10523:x1869752373927552:12345-192.168.201.41@tcp:35:lhsmtool_posix.0 00000004:00080000:0.0:1783134978.037102:0:5772:0:(mdd_object.c:4010:mdd_close()) Object [0x200000401:0x9:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:0.0:1783134978.037221:0:5772:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967407 00010000:00010000:0.0:1783134978.037268:0:5772:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ac400/0xd6c4b8f05867ee9c lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134978.037300:0:5772:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ac400/0xd6c4b8f05867ee9c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134978.037313:0:5772:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ac400/0xd6c4b8f05867ee9c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134978.037334:0:5772:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ac400/0xd6c4b8f05867ee9c lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134978.037341:0:5772:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ac400/0xd6c4b8f05867ee9c lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134978.037347:0:5772:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ac400/0xd6c4b8f05867ee9c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134978.037371:0:5772:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1783134978.037472:0:5772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9cb439050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+20:10523:x1869752373927552:12345-192.168.201.41@tcp:35:lhsmtool_posix.0 Request processed in 1312us (5450us total) trans 4294967408 rc 0/0 00000100:00100000:0.0:1783134978.037480:0:5772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 32 00000020:00080000:0.0:1783134978.037486:0:5772:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1783134978.037610:0:6591:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783134978.037617:0:6591:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ac400/0xd6c4b8f05867ee9c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134978.037635:0:6591:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe9f68ac400 already unused, calling callback (ffffffffc1527ce0) 00010000:00010000:1.0:1783134978.037640:0:6591:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ac400/0xd6c4b8f05867ee9c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134978.037647:0:6591:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ac400/0xd6c4b8f05867ee9c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134978.037660:0:6591:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9fe9c8301200) 00010000:00010000:1.0:1783134978.037663:0:6591:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1783134978.037668:0:6591:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ac400/0xd6c4b8f05867ee9c lrc: 1/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134978.037674:0:6591:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ac400/0xd6c4b8f05867ee9c lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134978.037694:0:6591:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783134978.037696:0:6591:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783134978.037698:0:6591:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783134978.066463:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:2.0:1783134978.066573:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373927680 00000100:00100000:2.0:1783134978.066594:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373927680 00000100:00100000:2.0:1783134978.066698:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 129 00000100:00100000:2.0:1783134978.066708:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9f6894700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+20:10525:x1869752373927680:12345-192.168.201.41@tcp:101:lfs.0 00010000:00010000:2.0:1783134978.066732:0:5771:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783134978.066752:0:5771:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829a00/0xd6c4b8f05867eea3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4428da03f5eb7361 expref: -99 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134978.066846:0:5771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829200/0xd6c4b8f05867eeaa lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134978.066862:0:5771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829200/0xd6c4b8f05867eeaa lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134978.066888:0:5771:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829200/0xd6c4b8f05867eeaa lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134978.066914:0:5771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828c00/0xd6c4b8f05867eeb1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134978.066923:0:5771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828c00/0xd6c4b8f05867eeb1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134978.066930:0:5771:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828c00/0xd6c4b8f05867eeb1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134978.067391:0:5771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828600/0xd6c4b8f05867eeb8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134978.067405:0:5771:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ac200/0xd6c4b8f05867edc3 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb7322 expref: 21 pid: 8031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134978.067413:0:5771:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828600/0xd6c4b8f05867eeb8 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134978.067448:0:5771:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ac200/0xd6c4b8f05867edc3 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb7322 expref: 21 pid: 8031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134978.067462:0:5771:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ac200/0xd6c4b8f05867edc3 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb7322 expref: 21 pid: 8031 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783134978.067477:0:5771:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9f68f5500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5771:1869752384414208:192.168.201.41@tcp:104: 00000100:00100000:2.0:1783134978.067587:0:5771:0:(client.c:2701:ptlrpc_set_wait()) set ffff9fe9cb3e90c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783134978.069575:0:5771:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9f68f5500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5771:1869752384414208:192.168.201.41@tcp:104: 00010000:00010000:2.0:1783134978.069621:0:5771:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828600/0xd6c4b8f05867eeb8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783134978.073832:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:2.0:1783134978.074418:0:5773:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373927936 00000100:00100000:2.0:1783134978.074427:0:5773:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373927936 00000100:00100000:2.0:1783134978.074522:0:5773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 33 00000100:00100000:2.0:1783134978.074533:0:5773:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9f6897b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+22:5573:x1869752373927936:12345-192.168.201.41@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1783134978.074805:0:5773:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9f6897b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+23:5573:x1869752373927936:12345-192.168.201.41@tcp:35:ldlm_bl.0 Request processed in 273us (981us total) trans 4294967409 rc 0/0 00000100:00100000:2.0:1783134978.074814:0:5773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 33 00000100:00100000:0.0:1783134978.076961:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:3.0:1783134978.077052:0:5756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373928064 00000100:00100000:3.0:1783134978.077061:0:5756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373928064 00010000:00010000:3.0:1783134978.077094:0:5756:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ac200/0xd6c4b8f05867edc3 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb7322 expref: 23 pid: 8031 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783134978.077133:0:5756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 61 00000100:00100000:3.0:1783134978.077143:0:5756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9d1623050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+23:2370:x1869752373928064:12345-192.168.201.41@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783134978.077157:0:5756:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783134978.077164:0:5756:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ac200/0xd6c4b8f05867edc3 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb7322 expref: 23 pid: 8031 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134978.077177:0:5756:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ac200/0xd6c4b8f05867edc3 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb7322 expref: 23 pid: 8031 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134978.077200:0:5756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ac200/0xd6c4b8f05867edc3 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb7322 expref: 23 pid: 8031 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134978.077217:0:5756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9fe9cc3c1b00) 00010000:00010000:3.0:1783134978.077222:0:5756:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828600/0xd6c4b8f05867eeb8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134978.077232:0:5756:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828600/0xd6c4b8f05867eeb8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134978.077240:0:5756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828600/0xd6c4b8f05867eeb8 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134978.077274:0:5756:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783134978.077370:0:5756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9d1623050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+22:2370:x1869752373928064:12345-192.168.201.41@tcp:103:ldlm_bl.0 Request processed in 228us (416us total) trans 0 rc 0/0 00000100:00100000:3.0:1783134978.077378:0:5756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 61 00010000:00010000:1.0:1783134978.077473:0:5771:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828600/0xd6c4b8f05867eeb8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134978.077482:0:5771:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828600/0xd6c4b8f05867eeb8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783134978.077523:0:5771:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:1.0:1783134978.077528:0:5771:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1783134978.077547:0:5771:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828600/0xd6c4b8f05867eeb8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134978.077560:0:5771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828600/0xd6c4b8f05867eeb8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134978.077595:0:5771:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829200/0xd6c4b8f05867eeaa lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134978.077613:0:5771:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829200/0xd6c4b8f05867eeaa lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134978.077621:0:5771:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829200/0xd6c4b8f05867eeaa lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134978.077627:0:5771:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe9c7829200 already unused, calling callback (ffffffffc1f634f0) 00010000:00010000:1.0:1783134978.077631:0:5771:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829200/0xd6c4b8f05867eeaa lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134978.077639:0:5771:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829200/0xd6c4b8f05867eeaa lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134978.077650:0:5771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9fe9e1c2bd00) 00010000:00010000:1.0:1783134978.077653:0:5771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783134978.077658:0:5771:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829200/0xd6c4b8f05867eeaa lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134978.077664:0:5771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829200/0xd6c4b8f05867eeaa lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134978.077676:0:5771:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828c00/0xd6c4b8f05867eeb1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134978.077682:0:5771:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828c00/0xd6c4b8f05867eeb1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134978.077688:0:5771:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828c00/0xd6c4b8f05867eeb1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134978.077702:0:5771:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe9c7828c00 already unused, calling callback (ffffffffc1f634f0) 00010000:00010000:1.0:1783134978.077706:0:5771:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828c00/0xd6c4b8f05867eeb1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134978.077713:0:5771:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828c00/0xd6c4b8f05867eeb1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134978.077722:0:5771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9fe9cc3c1600) 00010000:00010000:1.0:1783134978.077724:0:5771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783134978.077727:0:5771:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828c00/0xd6c4b8f05867eeb1 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134978.077733:0:5771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828c00/0xd6c4b8f05867eeb1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134978.077769:0:5771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829a00/0xd6c4b8f05867eea3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb7361 expref: 22 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134978.077784:0:5771:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828600/0xd6c4b8f05867eeb8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb7361 expref: 21 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134978.077791:0:5771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9fe9cc3c1b00) 00010000:00010000:1.0:1783134978.077794:0:5771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1783134978.077796:0:5771:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fe9c7828600, rc 0) 00000100:00100000:1.0:1783134978.077822:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9f6894700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+21:10525:x1869752373927680:12345-192.168.201.41@tcp:101:lfs.0 Request processed in 11116us (11369us total) trans 0 rc 0/0 00000100:00100000:1.0:1783134978.077830:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 129 00000001:00080000:1.0:1783134978.225753:0:6602:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967304 is committed 00000001:00080000:1.0:1783134978.225775:0:6602:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967302 is committed 00010000:00010000:3.0:1783134978.309568:0:10987:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1783134978.650886:0:11920:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1783134978.650893:0:11920:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1783134978.650934:0:11920:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:1.0:1783134978.650939:0:11920:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1783134978.855416:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:3.0:1783134978.855450:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:3.0:1783134978.855471:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:3.0:1783134978.855495:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:3.0:1783134978.855518:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:2.0:1783134978.855613:0:5763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373928192 00000100:00100000:2.0:1783134978.855623:0:5763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373928192 00000100:00100000:2.0:1783134978.855670:0:5763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 267 00000100:00100000:2.0:1783134978.855677:0:5763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9d1655050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f39b22bc-4faf-4b59-bb00-2a11f91e37c0+13:2369:x1869752373928192:12345-192.168.201.41@tcp:400:kworker.0 00000100:00100000:0.0:1783134978.855685:0:6577:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373928448 00000100:00100000:0.0:1783134978.855692:0:6577:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373928448 00000100:00100000:0.0:1783134978.855733:0:6577:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373928576 00000100:00100000:2.0:1783134978.855736:0:5763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9d1655050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f39b22bc-4faf-4b59-bb00-2a11f91e37c0+13:2369:x1869752373928192:12345-192.168.201.41@tcp:400:kworker.0 Request processed in 59us (327us total) trans 0 rc 0/0 00000100:00100000:0.0:1783134978.855738:0:6577:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373928576 00000100:00100000:2.0:1783134978.855745:0:5763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 267 00000100:00100000:0.0:1783134978.855771:0:6577:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 42 00000100:00100000:2.0:1783134978.855774:0:5769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373928704 00000100:00100000:2.0:1783134978.855778:0:5769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373928704 00000100:00100000:0.0:1783134978.855783:0:6577:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9f68f1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+5:2369:x1869752373928448:12345-192.168.201.41@tcp:400:kworker.0 00000100:00100000:2.0:1783134978.855800:0:5769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373928320 00000100:00100000:2.0:1783134978.855803:0:5769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373928320 00000100:00100000:2.0:1783134978.855817:0:5769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 90 00000100:00100000:2.0:1783134978.855827:0:5769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9f68f1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c936801d-68e8-41a4-8fbc-6becd5e1be74+5:2369:x1869752373928704:12345-192.168.201.41@tcp:400:kworker.0 00000100:00100000:0.0:1783134978.855828:0:6577:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9f68f1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+5:2369:x1869752373928448:12345-192.168.201.41@tcp:400:kworker.0 Request processed in 45us (372us total) trans 0 rc 0/0 00000100:00100000:0.0:1783134978.855840:0:6577:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 42 00000100:00100000:2.0:1783134978.855853:0:5769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9f68f1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c936801d-68e8-41a4-8fbc-6becd5e1be74+5:2369:x1869752373928704:12345-192.168.201.41@tcp:400:kworker.0 Request processed in 30us (380us total) trans 0 rc 0/0 00000100:00100000:2.0:1783134978.855861:0:5769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 90 00000100:00100000:0.0:1783134978.855862:0:6577:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 43 00000100:00100000:0.0:1783134978.855873:0:6577:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9f68f3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+6:2369:x1869752373928576:12345-192.168.201.41@tcp:400:kworker.0 00000100:00100000:2.0:1783134978.855883:0:5769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 91 00000100:00100000:2.0:1783134978.855891:0:5769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9f68f3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+21:2369:x1869752373928320:12345-192.168.201.41@tcp:400:kworker.0 00000100:00100000:0.0:1783134978.855923:0:6577:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9f68f3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+6:2369:x1869752373928576:12345-192.168.201.41@tcp:400:kworker.0 Request processed in 51us (402us total) trans 0 rc 0/0 00000100:00100000:2.0:1783134978.855930:0:5769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9f68f3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+21:2369:x1869752373928320:12345-192.168.201.41@tcp:400:kworker.0 Request processed in 38us (432us total) trans 0 rc 0/0 00000100:00100000:0.0:1783134978.855936:0:6577:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 43 00000100:00100000:2.0:1783134978.855940:0:5769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 91 00000100:00080000:0.0:1783134978.855963:0:5766:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1783134978.855968:0:5766:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000040:00080000:3.0:1783134979.075495:0:11499:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1783134979.075503:0:11499:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1783134979.075528:0:11499:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:3.0:1783134979.075533:0:11499:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1783134979.075735:0:11499:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9f68f0a80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11499:1869752384414336:192.168.201.41@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1783134979.076058:0:11499:0:(client.c:2701:ptlrpc_set_wait()) set ffff9fe9c9d023c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783134979.079035:0:11499:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9f68f0a80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11499:1869752384414336:192.168.201.41@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1783134979.080644:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:0.0:1783134979.080753:0:5769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373928832 00000100:00100000:0.0:1783134979.080760:0:5769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373928832 00000100:00100000:0.0:1783134979.080804:0:5769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 130 00000100:00100000:0.0:1783134979.080810:0:5769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9f68f5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+21:10537:x1869752373928832:12345-192.168.201.41@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1783134979.080835:0:5769:0:(mdt_handler.c:7960:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1783134979.080921:0:5769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9f68f5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+21:10537:x1869752373928832:12345-192.168.201.41@tcp:53:lhsmtool_posix.0 Request processed in 110us (282us total) trans 0 rc 0/0 00000100:00100000:0.0:1783134979.080929:0:5769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 130 00000100:00100000:3.0:1783134979.083176:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:1.0:1783134979.083322:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373929088 00000100:00100000:1.0:1783134979.083330:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373929088 00000100:00100000:1.0:1783134979.083428:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 131 00000100:00100000:1.0:1783134979.083438:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9f68f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+21:10537:x1869752373929088:12345-192.168.201.41@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1783134979.083456:0:5770:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783134979.083477:0:5770:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43f400/0xd6c4b8f05867eebf lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4428da03f5eb7368 expref: -99 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134979.083591:0:5770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43e200/0xd6c4b8f05867eec6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134979.083605:0:5770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43e200/0xd6c4b8f05867eec6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134979.083618:0:5770:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43e200/0xd6c4b8f05867eec6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783134979.083629:0:5770:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:1.0:1783134979.083739:0:5770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43f400/0xd6c4b8f05867eebf lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb7368 expref: 24 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134979.083754:0:5770:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43e200/0xd6c4b8f05867eec6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb7368 expref: 23 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134979.083760:0:5770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9fe9cc3c1b00) 00010000:00010000:1.0:1783134979.083772:0:5770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1783134979.083775:0:5770:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fe9fe43e200, rc 0) 00000100:00100000:1.0:1783134979.083843:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9f68f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+23:10537:x1869752373929088:12345-192.168.201.41@tcp:101:lhsmtool_posix.0 Request processed in 406us (673us total) trans 4294967410 rc 0/0 00000100:00100000:1.0:1783134979.083850:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 131 00000100:00100000:1.0:1783134979.087084:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:1.0:1783134979.087152:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:0.0:1783134979.087217:0:5754:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373929216 00000100:00100000:0.0:1783134979.087226:0:5754:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373929216 00000100:00100000:0.0:1783134979.087321:0:5754:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 8 00000100:00100000:0.0:1783134979.087332:0:5754:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fe7d1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+23:2370:x1869752373929216:12345-192.168.201.41@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783134979.087347:0:5754:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783134979.087370:0:5754:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43e200/0xd6c4b8f05867eec6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb7368 expref: 23 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134979.087388:0:5754:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9fe9cc3c1b00) 00010000:00010000:0.0:1783134979.087393:0:5754:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783134979.087440:0:5754:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fe7d1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+22:2370:x1869752373929216:12345-192.168.201.41@tcp:103:ldlm_bl.0 Request processed in 109us (365us total) trans 0 rc 0/0 00000100:00100000:0.0:1783134979.087460:0:5754:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 8 00000100:00100000:2.0:1783134979.087744:0:5769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373929472 00000100:00100000:2.0:1783134979.087748:0:5769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373929472 00000100:00100000:2.0:1783134979.087788:0:5769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 132 00000100:00100000:2.0:1783134979.087795:0:5769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fe7d1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+22:10537:x1869752373929472:12345-192.168.201.41@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1783134979.087859:0:5769:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829400/0xd6c4b8f05867eed4 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134979.087873:0:5769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829400/0xd6c4b8f05867eed4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134979.087882:0:5769:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829400/0xd6c4b8f05867eed4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134979.088093:0:5769:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829400/0xd6c4b8f05867eed4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134979.088101:0:5769:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829400/0xd6c4b8f05867eed4 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134979.088108:0:5769:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829400/0xd6c4b8f05867eed4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134979.088115:0:5769:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe9c7829400 already unused, calling callback (ffffffffc1f634f0) 00010000:00010000:2.0:1783134979.088119:0:5769:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829400/0xd6c4b8f05867eed4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134979.088137:0:5769:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829400/0xd6c4b8f05867eed4 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134979.088148:0:5769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9fe9cc3c1b00) 00010000:00010000:2.0:1783134979.088151:0:5769:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1783134979.088155:0:5769:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829400/0xd6c4b8f05867eed4 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134979.088161:0:5769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829400/0xd6c4b8f05867eed4 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783134979.088497:0:5769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fe7d1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+23:10537:x1869752373929472:12345-192.168.201.41@tcp:57:lhsmtool_posix.0 Request processed in 701us (1341us total) trans 4294967411 rc 0/0 00000100:00100000:2.0:1783134979.088506:0:5769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 132 00000040:00080000:3.0:1783134979.088724:0:11499:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1783134979.088729:0:11499:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1783134979.089176:0:11499:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:3.0:1783134979.089183:0:11499:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1783134979.092139:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:0.0:1783134979.092468:0:5772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373929728 00000100:00100000:0.0:1783134979.092478:0:5772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373929728 00000100:00100000:0.0:1783134979.092547:0:5772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 34 00000100:00100000:0.0:1783134979.092555:0:5772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fe7d2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+23:10537:x1869752373929728:12345-192.168.201.41@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1783134979.092874:0:5772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fe7d2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+24:10537:x1869752373929728:12345-192.168.201.41@tcp:35:lhsmtool_posix.0 Request processed in 318us (742us total) trans 4294967412 rc 0/0 00000100:00100000:0.0:1783134979.092883:0:5772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 34 00010000:00010000:0.0:1783134979.333347:0:5758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1783134980.099864:0:11499:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1783134980.099873:0:11499:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1783134980.099908:0:11499:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:3.0:1783134980.099915:0:11499:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:3.0:1783134980.231454:0:11971:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1783134980.231464:0:11971:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1783134980.231508:0:11971:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:3.0:1783134980.231515:0:11971:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1783134980.312848:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:3.0:1783134980.312911:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373929984 00000100:00100000:3.0:1783134980.312925:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373929984 00000100:00100000:3.0:1783134980.312982:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 133 00000100:00100000:3.0:1783134980.312991:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fe7d1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+24:10558:x1869752373929984:12345-192.168.201.41@tcp:101:lfs.0 00010000:00010000:3.0:1783134980.313010:0:5771:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783134980.313029:0:5771:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b74c00/0xd6c4b8f05867eedb lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4428da03f5eb736f expref: -99 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134980.313178:0:5771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b74400/0xd6c4b8f05867eee2 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134980.313191:0:5771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b74400/0xd6c4b8f05867eee2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134980.313202:0:5771:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b74400/0xd6c4b8f05867eee2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783134980.313212:0:5771:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:3.0:1783134980.313342:0:5771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b74c00/0xd6c4b8f05867eedb lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb736f expref: 27 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134980.313357:0:5771:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b74400/0xd6c4b8f05867eee2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb736f expref: 26 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134980.313366:0:5771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9fe9cc3c1b00) 00010000:00010000:3.0:1783134980.313369:0:5771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1783134980.313371:0:5771:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fe9d2b74400, rc 0) 00000100:00100000:3.0:1783134980.313415:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fe7d1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+26:10558:x1869752373929984:12345-192.168.201.41@tcp:101:lfs.0 Request processed in 426us (575us total) trans 4294967413 rc 0/0 00000100:00100000:3.0:1783134980.313421:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 133 00000100:00080000:0.0:1783134980.313909:0:5766:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1783134980.315832:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:1.0:1783134980.315909:0:5769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373930112 00000100:00100000:1.0:1783134980.315917:0:5769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373930112 00000100:00100000:1.0:1783134980.315970:0:5769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 134 00000100:00100000:1.0:1783134980.315980:0:5769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9f68f0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+26:10558:x1869752373930112:12345-192.168.201.41@tcp:54:lfs.0 00010000:00010000:1.0:1783134980.316044:0:5769:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43e400/0xd6c4b8f05867eef0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134980.316058:0:5769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43e400/0xd6c4b8f05867eef0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134980.316069:0:5769:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43e400/0xd6c4b8f05867eef0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134980.316090:0:5769:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43e400/0xd6c4b8f05867eef0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134980.316097:0:5769:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43e400/0xd6c4b8f05867eef0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134980.316103:0:5769:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43e400/0xd6c4b8f05867eef0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134980.316120:0:5769:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe9fe43e400 already unused, calling callback (ffffffffc1f634f0) 00010000:00010000:1.0:1783134980.316124:0:5769:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43e400/0xd6c4b8f05867eef0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134980.316132:0:5769:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43e400/0xd6c4b8f05867eef0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134980.316143:0:5769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9fe9cc3c1b00) 00010000:00010000:1.0:1783134980.316146:0:5769:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1783134980.316150:0:5769:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43e400/0xd6c4b8f05867eef0 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134980.316156:0:5769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43e400/0xd6c4b8f05867eef0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783134980.316213:0:5769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9f68f0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+26:10558:x1869752373930112:12345-192.168.201.41@tcp:54:lfs.0 Request processed in 235us (386us total) trans 0 rc 0/0 00000100:00100000:1.0:1783134980.316221:0:5769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 134 00010000:00010000:0.0:1783134980.358522:0:5757:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783134980.368356:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:0.0:1783134980.368431:0:6577:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373930240 00000100:00100000:0.0:1783134980.368441:0:6577:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373930240 00000100:00080000:2.0:1783134980.368509:0:5766:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1783134980.368513:0:6577:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 46 00000100:00100000:0.0:1783134980.368524:0:6577:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fe7d3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+6:2368:x1869752373930240:12345-192.168.201.41@tcp:101:cat.0 00010000:00010000:0.0:1783134980.368549:0:6577:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783134980.368579:0:6577:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fd8fb796/0xd6c4b8f05867eef7 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4428da03f5eb7376 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1783134980.368606:0:6577:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4:0x0] initial LVB size: 13, mtime: 0x6a487b00, atime: 0x6a487b00, ctime: 0x6a487b00, blocks: 0xb 00010000:00010000:0.0:1783134980.368628:0:6577:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=262s v=(0 0) 00010000:00010000:0.0:1783134980.368632:0:6577:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783134980.368644:0:6577:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fd8fb796/0xd6c4b8f05867eef7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb7376 expref: 7 pid: 6577 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134980.368663:0:6577:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000fd8fb796/0xd6c4b8f05867eef7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb7376 expref: 7 pid: 6577 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134980.368690:0:6577:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fe9f68adc00, rc 0) 00000100:00100000:0.0:1783134980.368757:0:6577:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fe7d3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+7:2368:x1869752373930240:12345-192.168.201.41@tcp:101:cat.0 Request processed in 234us (410us total) trans 0 rc 0/0 00000100:00100000:0.0:1783134980.368764:0:6577:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 46 00000100:00100000:1.0:1783134980.372108:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:0.0:1783134980.372188:0:6581:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373930368 00000100:00100000:0.0:1783134980.372199:0:6581:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373930368 00002000:00100000:0.0:1783134980.372245:0:6581:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x4:0x0] (0->4095) req@ffff9fe9fe7d3100 x1869752373930368/t0(0) o3->28f4ba61-cfae-499e-ab3d-81cb8215f7bb@192.168.201.41@tcp:151/0 lens 488/0 e 0 to 0 dl 1783134991 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1783134980.372256:0:6581:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9fe9fe7d3100 with x1869752373930368 ext(0->4095) 00002000:00010000:0.0:1783134980.372263:0:6581:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9fe9fe7d3100 00000100:00100000:0.0:1783134980.372324:0:6581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 3 00000100:00100000:0.0:1783134980.372334:0:6581:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fe7d3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+7:2368:x1869752373930368:12345-192.168.201.41@tcp:3:cat.0 00000100:00100000:0.0:1783134980.372600:0:6581:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fe7d3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+7:2368:x1869752373930368:12345-192.168.201.41@tcp:3:cat.0 Request processed in 267us (502us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1783134980.372608:0:6581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 3 00002000:00100000:0.0:1783134980.372615:0:6581:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x4:0x0] (0->4095) req@ffff9fe9fe7d3100 x1869752373930368/t0(0) o3->28f4ba61-cfae-499e-ab3d-81cb8215f7bb@192.168.201.41@tcp:151/0 lens 488/4536 e 0 to 0 dl 1783134991 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1783134980.372624:0:6581:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9fe9fe7d3100 with x1869752373930368 ext(0->4095) 00002000:00010000:0.0:1783134980.372627:0:6581:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9fe9fe7d3100 00000100:00100000:2.0:1783134981.253511:0:3288:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1783134981.253554:0:3288:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9f68f5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1869752384414464:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1783134981.253647:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783134981.253727:0:6579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384414464 00000100:00100000:2.0:1783134981.253736:0:6579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384414464 00000100:00100000:2.0:1783134981.253803:0:6579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1783134981.253815:0:6579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9f68f5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3288:x1869752384414464:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1783134981.253864:0:6579:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1783134981.253918:0:6579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9f68f5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3288:x1869752384414464:12345-0@lo:13:osp-pre-1-0.0 Request processed in 105us (271us total) trans 0 rc 0/0 00000100:00100000:2.0:1783134981.253926:0:6579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00080000:2.0:1783134981.253952:0:5766:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1783134981.253995:0:3288:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9f68f5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1869752384414464:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1783134981.254379:0:3288:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9f6fc0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3288:1869752384414848:0@lo:400:kworker.0 00000100:00100000:3.0:1783134981.254417:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783134981.254438:0:3288:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1783134981.254443:0:3288:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9f6fc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1869752384414976:0@lo:400:kworker.0 00000100:00100000:3.0:1783134981.254468:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783134981.254496:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384414848 00000100:00100000:3.0:1783134981.254500:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384414848 00000100:00100000:3.0:1783134981.254553:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1783134981.254561:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9f6fc2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3288:x1869752384414848:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783134981.254600:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9f6fc2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3288:x1869752384414848:12345-0@lo:400:kworker.0 Request processed in 40us (182us total) trans 0 rc 0/0 00000100:00100000:3.0:1783134981.254606:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1783134981.254626:0:6576:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384414976 00000100:00100000:3.0:1783134981.254630:0:6576:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384414976 00000100:00100000:3.0:1783134981.254655:0:6576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1783134981.254663:0:6576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9f6fc0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3288:x1869752384414976:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783134981.254693:0:6576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9f6fc0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3288:x1869752384414976:12345-0@lo:400:kworker.0 Request processed in 31us (224us total) trans 0 rc 0/0 00000100:00100000:3.0:1783134981.254699:0:6576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00080000:3.0:1783134981.254713:0:5766:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1783134981.254716:0:5766:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1783134981.254733:0:3288:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967304 gen 2 00000004:00080000:3.0:1783134981.254739:0:3288:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967300 committed transno 4294967304 00000004:00080000:3.0:1783134981.254762:0:3288:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9fe9f6f70000, transno 4294967301 00000004:00080000:3.0:1783134981.254772:0:3288:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967303 committed transno 4294967304 00000004:00080000:3.0:1783134981.254783:0:3288:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9fe9f6894380, transno 4294967304 00000100:00100000:3.0:1783134981.254789:0:3288:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9f6fc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1869752384414976:0@lo:400:kworker.0 00000100:00100000:3.0:1783134981.254808:0:3288:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9f6fc0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3288:1869752384414848:0@lo:400:kworker.0 00000100:00100000:2.0:1783134981.255164:0:3286:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9f68f0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:88a2002e-2ea7-4f07-912a-8d001832cfc0:3286:1869752384414592:0@lo:400:kworker.0 00000100:00100000:2.0:1783134981.255202:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783134981.255237:0:3286:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9f6fc0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3286:1869752384415104:0@lo:400:kworker.0 00000100:00100000:2.0:1783134981.255258:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783134981.255274:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1783134981.255300:0:3286:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9f6fc3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3286:1869752384414720:0@lo:400:kworker.0 00000100:00100000:2.0:1783134981.255324:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783134981.255472:0:3287:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9fe7d0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1869752384415232:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1783134981.255502:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783134981.255543:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384415104 00000100:00100000:1.0:1783134981.255547:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384415104 00000100:00100000:1.0:1783134981.255581:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384414720 00000100:00100000:1.0:1783134981.255584:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384414720 00000100:00100000:1.0:1783134981.255596:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1783134981.255602:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9f68f5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3286:x1869752384415104:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783134981.255643:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9f68f5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3286:x1869752384415104:12345-0@lo:400:kworker.0 Request processed in 42us (384us total) trans 0 rc 0/0 00000100:00100000:1.0:1783134981.255650:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1783134981.255663:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1783134981.255668:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9f68f6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3286:x1869752384414720:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783134981.255693:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9f68f6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3286:x1869752384414720:12345-0@lo:400:kworker.0 Request processed in 25us (368us total) trans 0 rc 0/0 00000100:00100000:1.0:1783134981.255698:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1783134981.255723:0:6578:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384415232 00000100:00100000:1.0:1783134981.255726:0:6578:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384415232 00000100:00100000:1.0:1783134981.255751:0:6578:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1783134981.255757:0:6578:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fe7d3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3287:x1869752384415232:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1783134981.255779:0:6578:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1783134981.255814:0:6578:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fe7d3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3287:x1869752384415232:12345-0@lo:13:osp-pre-0-0.0 Request processed in 57us (311us total) trans 0 rc 0/0 00000100:00100000:1.0:1783134981.255821:0:6578:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00080000:1.0:1783134981.255834:0:5766:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1783134981.255855:0:3287:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9fe7d0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1869752384415232:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1783134981.255886:0:3286:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9f6fc3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3286:1869752384414720:0@lo:400:kworker.0 00000100:00100000:1.0:1783134981.255896:0:3286:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9f6fc0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3286:1869752384415104:0@lo:400:kworker.0 00000100:00100000:3.0:1783134981.256030:0:5765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384414592 00000100:00100000:3.0:1783134981.256034:0:5765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384414592 00000100:00100000:3.0:1783134981.256119:0:5765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000100:00100000:3.0:1783134981.256127:0:5765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9d1657850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88a2002e-2ea7-4f07-912a-8d001832cfc0+19:3286:x1869752384414592:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783134981.256167:0:5765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9d1657850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88a2002e-2ea7-4f07-912a-8d001832cfc0+19:3286:x1869752384414592:12345-0@lo:400:kworker.0 Request processed in 42us (965us total) trans 0 rc 0/0 00000100:00100000:3.0:1783134981.256173:0:5765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00000100:00100000:1.0:1783134981.256228:0:3286:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9f68f0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:88a2002e-2ea7-4f07-912a-8d001832cfc0:3286:1869752384414592:0@lo:400:kworker.0 00010000:00010000:1.0:1783134981.380174:0:6591:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783134982.403624:0:10987:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783134983.028242:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:1.0:1783134983.028403:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373930496 00000100:00100000:1.0:1783134983.028413:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373930496 00000100:00100000:1.0:1783134983.028519:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 135 00000100:00100000:1.0:1783134983.028530:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9f6fc0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+26:10202:x1869752373930496:12345-192.168.201.41@tcp:60:lhsmtool_posix.0 00000100:00100000:1.0:1783134983.028638:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9f6fc0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+26:10202:x1869752373930496:12345-192.168.201.41@tcp:60:lhsmtool_posix.0 Request processed in 106us (400us total) trans 0 rc 0/0 00000100:00100000:1.0:1783134983.028646:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 135 00000100:00080000:3.0:1783134983.028728:0:5766:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1783134983.031387:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:1.0:1783134983.031589:0:5773:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373930752 00000100:00100000:1.0:1783134983.031598:0:5773:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373930752 00000100:00100000:1.0:1783134983.031644:0:5773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 35 00000100:00100000:1.0:1783134983.031663:0:5773:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9f68f5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+26:10202:x1869752373930752:12345-192.168.201.41@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1783134983.032074:0:5773:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9f68f5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+27:10202:x1869752373930752:12345-192.168.201.41@tcp:35:lhsmtool_posix.0 Request processed in 420us (692us total) trans 4294967414 rc 0/0 00000100:00100000:1.0:1783134983.032083:0:5773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 35 00000100:00100000:0.0:1783134983.160121:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:1.0:1783134983.160244:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373930880 00000100:00100000:1.0:1783134983.160253:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373930880 00000100:00100000:1.0:1783134983.160339:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 136 00000100:00100000:1.0:1783134983.160350:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9f6895180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c936801d-68e8-41a4-8fbc-6becd5e1be74+5:11009:x1869752373930880:12345-192.168.201.41@tcp:101:lsof.0 00000100:00080000:3.0:1783134983.160404:0:5766:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1783134983.160433:0:5771:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783134983.160454:0:5771:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43ec00/0xd6c4b8f05867eefe lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4428da03f5eb737d expref: -99 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134983.160525:0:5771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43e400/0xd6c4b8f05867ef05 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134983.160539:0:5771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43e400/0xd6c4b8f05867ef05 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134983.160552:0:5771:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43e400/0xd6c4b8f05867ef05 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783134983.160758:0:5771:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:1.0:1783134983.160762:0:5771:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:1.0:1783134983.160849:0:5771:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43e400/0xd6c4b8f05867ef05 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134983.160868:0:5771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43ec00/0xd6c4b8f05867eefe lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb737d expref: 7 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134983.160881:0:5771:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43e400/0xd6c4b8f05867ef05 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb737d expref: 6 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134983.160888:0:5771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fe9e1c2b500) 00010000:00010000:1.0:1783134983.160890:0:5771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1783134983.160892:0:5771:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fe9fe43e400, rc 0) 00000100:00100000:1.0:1783134983.160950:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9f6895180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c936801d-68e8-41a4-8fbc-6becd5e1be74+6:11009:x1869752373930880:12345-192.168.201.41@tcp:101:lsof.0 Request processed in 603us (839us total) trans 0 rc 0/0 00000100:00100000:1.0:1783134983.160957:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 136 00000001:00080000:3.0:1783134983.323962:0:7470:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967311 is committed 00000001:00080000:3.0:1783134983.323980:0:7470:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967312 is committed 00000001:00080000:3.0:1783134983.325306:0:5791:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967412 is committed 00000020:00080000:3.0:1783134983.325333:0:5791:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9fe9fe944480 refcount 2 committed 0 result 0 batchid 4 00000020:00080000:3.0:1783134983.325339:0:5791:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9fe9c83c2c00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9fe9fe944240 00000020:00080000:3.0:1783134983.325343:0:5791:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9fe9c83c2200 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9fe9fe440000 00000020:00080000:1.0:1783134983.325364:0:5802:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4 committed batchid 1 00000001:00080000:3.0:1783134983.325367:0:5791:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967414 is committed 00000020:00080000:3.0:1783134983.325379:0:5791:0:(update_trans.c:1341:distribute_txn_batchid_cb()) lustre-MDT0000: 3 batchid updated 00000020:00080000:3.0:1783134983.325383:0:5791:0:(update_trans.c:1341:distribute_txn_batchid_cb()) lustre-MDT0000: 2 batchid updated 00000020:00080000:1.0:1783134983.325589:0:5802:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 3 00010000:00010000:0.0:1783134983.428668:0:5758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783134983.972224:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:3.0:1783134983.972259:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:0.0:1783134983.972303:0:5762:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373931008 00000100:00100000:0.0:1783134983.972312:0:5762:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373931008 00000100:00100000:3.0:1783134983.972334:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:0.0:1783134983.972370:0:5762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 269 00000100:00100000:0.0:1783134983.972379:0:5762:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9d1655850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f39b22bc-4faf-4b59-bb00-2a11f91e37c0+13:2369:x1869752373931008:12345-192.168.201.41@tcp:400:kworker.0 00000100:00100000:1.0:1783134983.972434:0:7676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373931264 00000100:00100000:1.0:1783134983.972439:0:7676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373931264 00000100:00100000:1.0:1783134983.972498:0:7676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 45 00000100:00100000:1.0:1783134983.972506:0:7676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9f6fc3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+5:2369:x1869752373931264:12345-192.168.201.41@tcp:400:kworker.0 00000100:00100000:0.0:1783134983.972528:0:5762:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9d1655850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f39b22bc-4faf-4b59-bb00-2a11f91e37c0+13:2369:x1869752373931008:12345-192.168.201.41@tcp:400:kworker.0 Request processed in 150us (312us total) trans 0 rc 0/0 00000100:00100000:0.0:1783134983.972536:0:5762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 269 00000100:00100000:1.0:1783134983.972546:0:7676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9f6fc3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+5:2369:x1869752373931264:12345-192.168.201.41@tcp:400:kworker.0 Request processed in 43us (287us total) trans 0 rc 0/0 00000100:00100000:1.0:1783134983.972560:0:7676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 45 00000100:00080000:0.0:1783134983.972575:0:5766:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1783134983.972714:0:5769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373931520 00000100:00100000:2.0:1783134983.972718:0:5769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373931520 00000100:00100000:2.0:1783134983.972765:0:5769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 95 00000100:00100000:2.0:1783134983.972773:0:5769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9f6fc0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c936801d-68e8-41a4-8fbc-6becd5e1be74+6:2369:x1869752373931520:12345-192.168.201.41@tcp:400:kworker.0 00000100:00100000:2.0:1783134983.972810:0:5769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9f6fc0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c936801d-68e8-41a4-8fbc-6becd5e1be74+6:2369:x1869752373931520:12345-192.168.201.41@tcp:400:kworker.0 Request processed in 38us (475us total) trans 0 rc 0/0 00000100:00100000:2.0:1783134983.972816:0:5769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 95 00000100:00100000:3.0:1783134983.973394:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:3.0:1783134983.973467:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:0.0:1783134983.973517:0:6576:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373931392 00000100:00100000:0.0:1783134983.973521:0:6576:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373931392 00000100:00100000:0.0:1783134983.973565:0:6576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 46 00000100:00100000:0.0:1783134983.973572:0:6576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9f6fc0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+6:2369:x1869752373931392:12345-192.168.201.41@tcp:400:kworker.0 00000100:00080000:3.0:1783134983.973601:0:5766:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1783134983.973609:0:6576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9f6fc0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+6:2369:x1869752373931392:12345-192.168.201.41@tcp:400:kworker.0 Request processed in 37us (141us total) trans 0 rc 0/0 00000100:00100000:0.0:1783134983.973616:0:6576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 46 00000100:00100000:2.0:1783134983.974005:0:8031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373931136 00000100:00100000:2.0:1783134983.974010:0:8031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373931136 00000100:00100000:2.0:1783134983.974046:0:8031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 96 00000100:00100000:2.0:1783134983.974053:0:8031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9f6fc2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+13:2369:x1869752373931136:12345-192.168.201.41@tcp:400:kworker.0 00000100:00100000:2.0:1783134983.974136:0:8031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9f6fc2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+13:2369:x1869752373931136:12345-192.168.201.41@tcp:400:kworker.0 Request processed in 83us (742us total) trans 0 rc 0/0 00000100:00100000:2.0:1783134983.974143:0:8031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 96 00010000:00010000:0.0:1783134984.451811:0:5757:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1783134984.580783:0:12170:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1b: Test manual lfs pcc attach with restore on remote access ========================================================== 23:16:23 (1783134983) 00000100:00100000:3.0:1783134985.251527:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:2.0:1783134985.251706:0:5769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373931776 00000100:00100000:2.0:1783134985.251717:0:5769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373931776 00000100:00100000:2.0:1783134985.251907:0:5769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 137 00000100:00100000:2.0:1783134985.251920:0:5769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9f6fc3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+13:11274:x1869752373931776:12345-192.168.201.41@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1783134985.251959:0:5769:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783134985.251983:0:5769:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829000/0xd6c4b8f05867ef0c lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4428da03f5eb7384 expref: -99 pid: 5769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134985.252065:0:5769:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828a00/0xd6c4b8f05867ef13 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134985.252081:0:5769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828a00/0xd6c4b8f05867ef13 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134985.252094:0:5769:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828a00/0xd6c4b8f05867ef13 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134985.252110:0:5769:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829800/0xd6c4b8f05867ef1a lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134985.252118:0:5769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829800/0xd6c4b8f05867ef1a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134985.252124:0:5769:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829800/0xd6c4b8f05867ef1a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134985.252602:0:5769:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828000/0xd6c4b8f05867ef21 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134985.252613:0:5769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828000/0xd6c4b8f05867ef21 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134985.252621:0:5769:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828000/0xd6c4b8f05867ef21 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783134985.252632:0:5769:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 6656 00010000:00010000:2.0:1783134985.253241:0:5769:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828a00/0xd6c4b8f05867ef13 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134985.253251:0:5769:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828a00/0xd6c4b8f05867ef13 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134985.253258:0:5769:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828a00/0xd6c4b8f05867ef13 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134985.253264:0:5769:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe9c7828a00 already unused, calling callback (ffffffffc1f634f0) 00010000:00010000:2.0:1783134985.253268:0:5769:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828a00/0xd6c4b8f05867ef13 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134985.253275:0:5769:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828a00/0xd6c4b8f05867ef13 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134985.253315:0:5769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9fe9e1c2b100) 00010000:00010000:2.0:1783134985.253318:0:5769:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783134985.253323:0:5769:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828a00/0xd6c4b8f05867ef13 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134985.253328:0:5769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828a00/0xd6c4b8f05867ef13 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134985.253344:0:5769:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829800/0xd6c4b8f05867ef1a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134985.253349:0:5769:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829800/0xd6c4b8f05867ef1a lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134985.253355:0:5769:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829800/0xd6c4b8f05867ef1a lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134985.253370:0:5769:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe9c7829800 already unused, calling callback (ffffffffc1f634f0) 00010000:00010000:2.0:1783134985.253373:0:5769:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829800/0xd6c4b8f05867ef1a lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134985.253379:0:5769:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829800/0xd6c4b8f05867ef1a lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134985.253387:0:5769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff9fe9cc3c1400) 00010000:00010000:2.0:1783134985.253389:0:5769:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783134985.253392:0:5769:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829800/0xd6c4b8f05867ef1a lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134985.253397:0:5769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829800/0xd6c4b8f05867ef1a lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134985.254056:0:5769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829000/0xd6c4b8f05867ef0c lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb7384 expref: 16 pid: 5769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134985.254074:0:5769:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828000/0xd6c4b8f05867ef21 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb7384 expref: 15 pid: 5769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134985.254081:0:5769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9fe9e1c2b600) 00010000:00010000:2.0:1783134985.254084:0:5769:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783134985.254086:0:5769:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fe9c7828000, rc 0) 00000100:00100000:2.0:1783134985.254170:0:5769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9f6fc3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+15:11274:x1869752373931776:12345-192.168.201.41@tcp:101:lhsmtool_posix.0 Request processed in 2253us (2655us total) trans 4294967415 rc 0/0 00000100:00100000:2.0:1783134985.254179:0:5769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 137 00000100:00080000:3.0:1783134985.256755:0:5766:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1783134985.258394:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:0.0:1783134985.258465:0:5756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373931904 00000100:00100000:0.0:1783134985.258476:0:5756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373931904 00000100:00100000:0.0:1783134985.258583:0:5756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 9 00000100:00100000:0.0:1783134985.258595:0:5756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9f6fc1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+15:2368:x1869752373931904:12345-192.168.201.41@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783134985.258610:0:5756:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783134985.258633:0:5756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828000/0xd6c4b8f05867ef21 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb7384 expref: 15 pid: 5769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134985.258655:0:5756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9fe9e1c2b600) 00010000:00010000:0.0:1783134985.258660:0:5756:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783134985.258712:0:5756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9f6fc1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+14:2368:x1869752373931904:12345-192.168.201.41@tcp:103:ldlm_bl.0 Request processed in 119us (322us total) trans 0 rc 0/0 00000100:00100000:0.0:1783134985.258736:0:5756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 9 00000100:00100000:3.0:1783134985.258826:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:1.0:1783134985.259273:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373932032 00000100:00100000:1.0:1783134985.259295:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373932032 00000100:00100000:1.0:1783134985.259336:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 138 00000100:00100000:1.0:1783134985.259345:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9f6fc2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+14:11274:x1869752373932032:12345-192.168.201.41@tcp:59:lhsmtool_posix.0 00000100:00100000:1.0:1783134985.259426:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9f6fc2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+14:11274:x1869752373932032:12345-192.168.201.41@tcp:59:lhsmtool_posix.0 Request processed in 83us (600us total) trans 0 rc 0/0 00000100:00100000:1.0:1783134985.259430:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 138 00010000:00010000:1.0:1783134985.475512:0:6591:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1783134986.253778:0:11499:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1783134986.253788:0:11499:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1783134986.255365:0:11499:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:1.0:1783134986.255381:0:11499:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1783134986.371391:0:3288:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9fe7d0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1869752384415360:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1783134986.371476:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783134986.371513:0:10783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384415360 00000100:00100000:0.0:1783134986.371522:0:10783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384415360 00000100:00080000:1.0:1783134986.371553:0:5766:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1783134986.371587:0:10783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1783134986.371599:0:10783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fe7d0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3288:x1869752384415360:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1783134986.371632:0:10783:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1783134986.371676:0:10783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fe7d0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3288:x1869752384415360:12345-0@lo:13:osp-pre-0-0.0 Request processed in 81us (200us total) trans 0 rc 0/0 00000100:00100000:0.0:1783134986.371683:0:10783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1783134986.371709:0:3288:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9fe7d0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1869752384415360:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1783134986.373320:0:3286:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9f6895500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3286:1869752384415616:0@lo:400:kworker.0 00000100:00100000:1.0:1783134986.373373:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783134986.373412:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1783134986.373417:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384415616 00000100:00100000:1.0:1783134986.373421:0:3286:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9f6895c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3286:1869752384415744:0@lo:400:kworker.0 00000100:00100000:0.0:1783134986.373424:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384415616 00000100:00100000:1.0:1783134986.373471:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783134986.373484:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384415744 00000100:00100000:0.0:1783134986.373489:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384415744 00000100:00100000:1.0:1783134986.373500:0:3286:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9f68f7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1869752384416128:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1783134986.373539:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783134986.373580:0:6579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384416128 00000100:00100000:1.0:1783134986.373584:0:6579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384416128 00000100:00100000:1.0:1783134986.373612:0:6579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1783134986.373628:0:6579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fe90c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1869752384416128:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1783134986.373657:0:6579:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1783134986.373696:0:6579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fe90c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1869752384416128:12345-0@lo:13:osp-pre-1-0.0 Request processed in 70us (156us total) trans 0 rc 0/0 00000100:00100000:1.0:1783134986.373703:0:6579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1783134986.373727:0:3289:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9f6896a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:88a2002e-2ea7-4f07-912a-8d001832cfc0:3289:1869752384415488:0@lo:400:kworker.0 00000100:00100000:1.0:1783134986.373756:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783134986.373779:0:3289:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9f6896300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1869752384416000:0@lo:400:kworker.0 00000100:00100000:1.0:1783134986.373799:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783134986.373816:0:3289:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1783134986.373821:0:3289:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9f6895880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3289:1869752384415872:0@lo:400:kworker.0 00000100:00100000:1.0:1783134986.373841:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783134986.374754:0:5765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384415488 00000100:00100000:1.0:1783134986.374759:0:5765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384415488 00000100:00100000:1.0:1783134986.374786:0:5765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 270 00000100:00100000:1.0:1783134986.374795:0:5765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9d1656850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88a2002e-2ea7-4f07-912a-8d001832cfc0+19:3289:x1869752384415488:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783134986.374837:0:5765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9d1656850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88a2002e-2ea7-4f07-912a-8d001832cfc0+19:3289:x1869752384415488:12345-0@lo:400:kworker.0 Request processed in 43us (1079us total) trans 0 rc 0/0 00000100:00100000:1.0:1783134986.374845:0:5765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 270 00000100:00100000:1.0:1783134986.374873:0:7676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384416000 00000100:00100000:1.0:1783134986.374877:0:7676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384416000 00000100:00100000:1.0:1783134986.374913:0:7676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1783134986.374920:0:7676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fe90ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3289:x1869752384416000:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783134986.374950:0:7676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fe90ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3289:x1869752384416000:12345-0@lo:400:kworker.0 Request processed in 31us (1150us total) trans 0 rc 0/0 00000100:00100000:1.0:1783134986.374957:0:7676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00080000:1.0:1783134986.374982:0:5766:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1783134986.374987:0:5766:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1783134986.375013:0:3286:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967312 gen 2 00000004:00080000:1.0:1783134986.375019:0:3286:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967312 committed transno 4294967312 00000100:00100000:1.0:1783134986.375041:0:3286:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9f68f7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1869752384416128:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1783134986.375061:0:3289:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9f6896a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:88a2002e-2ea7-4f07-912a-8d001832cfc0:3289:1869752384415488:0@lo:400:kworker.0 00000100:00100000:1.0:1783134986.375070:0:3289:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9f6896300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1869752384416000:0@lo:400:kworker.0 00000100:00100000:2.0:1783134986.376842:0:5769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384415872 00000100:00100000:2.0:1783134986.376861:0:5769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384415872 00000100:00100000:0.0:1783134986.376864:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1783134986.376879:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fe7d0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3286:x1869752384415616:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783134986.376913:0:5769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1783134986.376923:0:5769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fe7d1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3286:x1869752384415744:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783134986.376939:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fe7d0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3286:x1869752384415616:12345-0@lo:400:kworker.0 Request processed in 65us (3567us total) trans 0 rc 0/0 00000100:00100000:0.0:1783134986.376945:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1783134986.376959:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1783134986.376964:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fe90ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3289:x1869752384415872:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783134986.376992:0:5769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fe7d1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3286:x1869752384415744:12345-0@lo:400:kworker.0 Request processed in 70us (3521us total) trans 0 rc 0/0 00000100:00100000:2.0:1783134986.377004:0:5769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1783134986.377011:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fe90ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3289:x1869752384415872:12345-0@lo:400:kworker.0 Request processed in 46us (3168us total) trans 0 rc 0/0 00000100:00100000:0.0:1783134986.377018:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00080000:2.0:1783134986.377027:0:5766:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1783134986.377236:0:3286:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9f6895c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3286:1869752384415744:0@lo:400:kworker.0 00000100:00100000:1.0:1783134986.377251:0:3286:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9f6895500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3286:1869752384415616:0@lo:400:kworker.0 00000100:00100000:1.0:1783134986.377305:0:3289:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9f6895880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3289:1869752384415872:0@lo:400:kworker.0 00000100:00100000:3.0:1783134986.398119:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:2.0:1783134986.398206:0:5769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373932160 00000100:00100000:2.0:1783134986.398215:0:5769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373932160 00000100:00100000:2.0:1783134986.398962:0:5769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 139 00000100:00100000:2.0:1783134986.398973:0:5769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9f6fc1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+14:11316:x1869752373932160:12345-192.168.201.41@tcp:101:lfs.0 00010000:00010000:2.0:1783134986.398990:0:5769:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783134986.399009:0:5769:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829600/0xd6c4b8f05867ef2f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4428da03f5eb738b expref: -99 pid: 5769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134986.399069:0:5769:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829400/0xd6c4b8f05867ef36 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134986.399083:0:5769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829400/0xd6c4b8f05867ef36 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134986.399096:0:5769:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829400/0xd6c4b8f05867ef36 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134986.399108:0:5769:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829a00/0xd6c4b8f05867ef3d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134986.399116:0:5769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829a00/0xd6c4b8f05867ef3d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134986.399123:0:5769:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829a00/0xd6c4b8f05867ef3d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134986.399391:0:5769:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829400/0xd6c4b8f05867ef36 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134986.399399:0:5769:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829400/0xd6c4b8f05867ef36 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134986.399406:0:5769:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829400/0xd6c4b8f05867ef36 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134986.399413:0:5769:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe9c7829400 already unused, calling callback (ffffffffc1f634f0) 00010000:00010000:2.0:1783134986.399417:0:5769:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829400/0xd6c4b8f05867ef36 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134986.399424:0:5769:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829400/0xd6c4b8f05867ef36 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134986.399445:0:5769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fe9e1c2b500) 00010000:00010000:2.0:1783134986.399449:0:5769:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783134986.399453:0:5769:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829400/0xd6c4b8f05867ef36 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134986.399459:0:5769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829400/0xd6c4b8f05867ef36 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134986.399470:0:5769:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829a00/0xd6c4b8f05867ef3d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134986.399476:0:5769:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829a00/0xd6c4b8f05867ef3d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134986.399482:0:5769:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829a00/0xd6c4b8f05867ef3d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134986.399492:0:5769:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe9c7829a00 already unused, calling callback (ffffffffc1f634f0) 00010000:00010000:2.0:1783134986.399495:0:5769:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829a00/0xd6c4b8f05867ef3d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134986.399501:0:5769:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829a00/0xd6c4b8f05867ef3d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134986.399508:0:5769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff9fe9cc3c1400) 00010000:00010000:2.0:1783134986.399510:0:5769:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783134986.399513:0:5769:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829a00/0xd6c4b8f05867ef3d lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134986.399518:0:5769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829a00/0xd6c4b8f05867ef3d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134986.399544:0:5769:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829600/0xd6c4b8f05867ef2f lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb738b expref: 15 pid: 5769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134986.399555:0:5769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fe9e1c2b500) 00010000:00010000:2.0:1783134986.399557:0:5769:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783134986.399561:0:5769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829600/0xd6c4b8f05867ef2f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb738b expref: 15 pid: 5769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134986.399569:0:5769:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fe9c7829600, rc 0) 00000100:00100000:2.0:1783134986.399625:0:5769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9f6fc1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+14:11316:x1869752373932160:12345-192.168.201.41@tcp:101:lfs.0 Request processed in 654us (1515us total) trans 0 rc 301/301 00000100:00100000:2.0:1783134986.399633:0:5769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 139 00000100:00100000:3.0:1783134986.403424:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:0.0:1783134986.403510:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373932416 00000100:00100000:0.0:1783134986.403519:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373932416 00000100:00100000:0.0:1783134986.403566:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 140 00000100:00100000:0.0:1783134986.403582:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9f6fc1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+14:11316:x1869752373932416:12345-192.168.201.41@tcp:36:lfs.0 00010000:00010000:0.0:1783134986.403636:0:5771:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783134986.403659:0:5771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43fc00/0xd6c4b8f05867e8a6 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb71bd expref: 14 pid: 8031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134986.403676:0:5771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fe9e1c2b500) 00010000:00010000:0.0:1783134986.403681:0:5771:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1783134986.403989:0:5771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ac000/0xd6c4b8f05867ef44 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134986.404000:0:5771:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43e400/0xd6c4b8f05867ef05 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb737d expref: 5 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134986.404006:0:5771:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ac000/0xd6c4b8f05867ef44 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134986.404028:0:5771:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43e400/0xd6c4b8f05867ef05 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb737d expref: 5 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134986.404038:0:5771:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43e400/0xd6c4b8f05867ef05 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb737d expref: 5 pid: 5771 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783134986.404051:0:5771:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9f6895f80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5771:1869752384416256:192.168.201.41@tcp:104: 00000100:00100000:0.0:1783134986.404135:0:5771:0:(client.c:2701:ptlrpc_set_wait()) set ffff9fe9ea79c600 going to sleep for 11 seconds 00000100:00100000:2.0:1783134986.405759:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:3.0:1783134986.405873:0:5754:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373932544 00000100:00100000:3.0:1783134986.405882:0:5754:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373932544 00010000:00010000:3.0:1783134986.405930:0:5754:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43e400/0xd6c4b8f05867ef05 lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb737d expref: 6 pid: 5771 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783134986.405962:0:5754:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 62 00000100:00100000:3.0:1783134986.405971:0:5754:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9f68f7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c936801d-68e8-41a4-8fbc-6becd5e1be74+6:2370:x1869752373932544:12345-192.168.201.41@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783134986.405984:0:5754:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783134986.405990:0:5754:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43e400/0xd6c4b8f05867ef05 lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb737d expref: 6 pid: 5771 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134986.406002:0:5754:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43e400/0xd6c4b8f05867ef05 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb737d expref: 6 pid: 5771 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134986.406018:0:5754:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fe9e1c2b500) 00010000:00010000:3.0:1783134986.406023:0:5754:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ac000/0xd6c4b8f05867ef44 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134986.406030:0:5754:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ac000/0xd6c4b8f05867ef44 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134986.406046:0:5754:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ac000/0xd6c4b8f05867ef44 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134986.406063:0:5754:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783134986.406101:0:5754:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9f68f7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c936801d-68e8-41a4-8fbc-6becd5e1be74+6:2370:x1869752373932544:12345-192.168.201.41@tcp:103:ldlm_bl.0 Request processed in 131us (357us total) trans 0 rc 0/0 00000100:00100000:3.0:1783134986.406108:0:5754:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 62 00000100:00080000:2.0:1783134986.406212:0:5766:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1783134986.406535:0:5771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43e400/0xd6c4b8f05867ef05 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb737d expref: 5 pid: 5771 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783134986.406550:0:5771:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9f6895f80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5771:1869752384416256:192.168.201.41@tcp:104: 00010000:00010000:0.0:1783134986.406574:0:5771:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ac000/0xd6c4b8f05867ef44 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134986.406583:0:5771:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ac000/0xd6c4b8f05867ef44 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134986.406590:0:5771:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ac000/0xd6c4b8f05867ef44 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134986.406608:0:5771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ac200/0xd6c4b8f05867ef4b lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134986.406617:0:5771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ac200/0xd6c4b8f05867ef4b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134986.406625:0:5771:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ac200/0xd6c4b8f05867ef4b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783134986.407970:0:5771:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00010000:00010000:0.0:1783134986.407984:0:5771:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ac000/0xd6c4b8f05867ef44 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134986.407992:0:5771:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ac000/0xd6c4b8f05867ef44 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134986.407999:0:5771:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ac000/0xd6c4b8f05867ef44 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134986.408005:0:5771:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe9f68ac000 already unused, calling callback (ffffffffc1f634f0) 00010000:00010000:0.0:1783134986.408009:0:5771:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ac000/0xd6c4b8f05867ef44 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134986.408015:0:5771:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ac000/0xd6c4b8f05867ef44 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134986.408035:0:5771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fe9e1c2b500) 00010000:00010000:0.0:1783134986.408038:0:5771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783134986.408042:0:5771:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ac000/0xd6c4b8f05867ef44 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134986.408048:0:5771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ac000/0xd6c4b8f05867ef44 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1783134986.408063:0:5771:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000007bab993e reply state 00000000192f6fd6 transno 4294967416 ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ac200/0xd6c4b8f05867ef4b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783134986.408073:0:5771:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1783134986.408159:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9f6fc1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+15:11316:x1869752373932416:12345-192.168.201.41@tcp:36:lfs.0 Request processed in 4577us (4742us total) trans 4294967416 rc 0/0 00000100:00100000:0.0:1783134986.408167:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 140 00010000:00010000:3.0:1783134986.409161:0:3272:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ac200/0xd6c4b8f05867ef4b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134986.409172:0:3272:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ac200/0xd6c4b8f05867ef4b lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134986.409178:0:3272:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ac200/0xd6c4b8f05867ef4b lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134986.409182:0:3272:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe9f68ac200 already unused, calling callback (ffffffffc1f634f0) 00010000:00010000:3.0:1783134986.409186:0:3272:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ac200/0xd6c4b8f05867ef4b lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134986.409191:0:3272:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ac200/0xd6c4b8f05867ef4b lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134986.409201:0:3272:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff9fe9c8301e00) 00010000:00010000:3.0:1783134986.409203:0:3272:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783134986.409206:0:3272:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ac200/0xd6c4b8f05867ef4b lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134986.409211:0:3272:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ac200/0xd6c4b8f05867ef4b lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783134986.444857:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:1.0:1783134986.444995:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373932672 00000100:00100000:1.0:1783134986.445004:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373932672 00000100:00100000:1.0:1783134986.445059:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 141 00000100:00100000:1.0:1783134986.445070:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9f6fc1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+14:11324:x1869752373932672:12345-192.168.201.41@tcp:101:lctl.0 00010000:00010000:1.0:1783134986.445093:0:5770:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783134986.445118:0:5770:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43e400/0xd6c4b8f05867ef52 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4428da03f5eb7392 expref: -99 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134986.445184:0:5770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43fc00/0xd6c4b8f05867ef59 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134986.445198:0:5770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43fc00/0xd6c4b8f05867ef59 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134986.445209:0:5770:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43fc00/0xd6c4b8f05867ef59 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783134986.445669:0:5770:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:1.0:1783134986.445674:0:5770:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:1.0:1783134986.445708:0:5770:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43fc00/0xd6c4b8f05867ef59 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134986.445735:0:5770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43e400/0xd6c4b8f05867ef52 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb7392 expref: 16 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134986.445754:0:5770:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43fc00/0xd6c4b8f05867ef59 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb7392 expref: 15 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134986.445763:0:5770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fe9e1c2b400) 00010000:00010000:1.0:1783134986.445766:0:5770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1783134986.445770:0:5770:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fe9fe43fc00, rc 0) 00000100:00100000:1.0:1783134986.445841:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9f6fc1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+15:11324:x1869752373932672:12345-192.168.201.41@tcp:101:lctl.0 Request processed in 767us (986us total) trans 0 rc 0/0 00000100:00100000:1.0:1783134986.445851:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 141 00000100:00100000:2.0:1783134986.480773:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:1.0:1783134986.480834:0:8031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373932800 00000100:00100000:1.0:1783134986.480842:0:8031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373932800 00000100:00100000:1.0:1783134986.480888:0:8031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 142 00000100:00100000:1.0:1783134986.480895:0:8031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9f68f7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+15:11330:x1869752373932800:12345-192.168.201.41@tcp:101:bash.0 00010000:00010000:1.0:1783134986.480912:0:8031:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783134986.480927:0:8031:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43e400/0xd6c4b8f05867ef60 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4428da03f5eb7399 expref: -99 pid: 8031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134986.480977:0:8031:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43f600/0xd6c4b8f05867ef67 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134986.481000:0:8031:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43f600/0xd6c4b8f05867ef67 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134986.481008:0:8031:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43f600/0xd6c4b8f05867ef67 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134986.481017:0:8031:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43fa00/0xd6c4b8f05867ef6e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134986.481022:0:8031:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43fa00/0xd6c4b8f05867ef6e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134986.481025:0:8031:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43fa00/0xd6c4b8f05867ef6e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134986.481105:0:8031:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43f000/0xd6c4b8f05867ef75 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134986.481111:0:8031:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43f000/0xd6c4b8f05867ef75 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134986.481118:0:8031:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43f000/0xd6c4b8f05867ef75 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783134986.481149:0:8031:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00000004:00200000:1.0:1783134986.481152:0:8031:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1783134986.481173:0:8031:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43f000/0xd6c4b8f05867ef75 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134986.481182:0:8031:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43f600/0xd6c4b8f05867ef67 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134986.481193:0:8031:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43f600/0xd6c4b8f05867ef67 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134986.481198:0:8031:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43f600/0xd6c4b8f05867ef67 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134986.481202:0:8031:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe9fe43f600 already unused, calling callback (ffffffffc1f634f0) 00010000:00010000:1.0:1783134986.481205:0:8031:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43f600/0xd6c4b8f05867ef67 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134986.481210:0:8031:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43f600/0xd6c4b8f05867ef67 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134986.481220:0:8031:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fe9e1c2b400) 00010000:00010000:1.0:1783134986.481222:0:8031:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783134986.481225:0:8031:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43f600/0xd6c4b8f05867ef67 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134986.481229:0:8031:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43f600/0xd6c4b8f05867ef67 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134986.481237:0:8031:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43fa00/0xd6c4b8f05867ef6e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134986.481240:0:8031:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43fa00/0xd6c4b8f05867ef6e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134986.481243:0:8031:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43fa00/0xd6c4b8f05867ef6e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134986.481246:0:8031:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe9fe43fa00 already unused, calling callback (ffffffffc1f634f0) 00010000:00010000:1.0:1783134986.481251:0:8031:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43fa00/0xd6c4b8f05867ef6e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134986.481255:0:8031:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43fa00/0xd6c4b8f05867ef6e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134986.481268:0:8031:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff9fe9e1c2b000) 00010000:00010000:1.0:1783134986.481271:0:8031:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783134986.481273:0:8031:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43fa00/0xd6c4b8f05867ef6e lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134986.481320:0:8031:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43fa00/0xd6c4b8f05867ef6e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134986.481347:0:8031:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43e400/0xd6c4b8f05867ef60 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb7399 expref: 17 pid: 8031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134986.481357:0:8031:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43f000/0xd6c4b8f05867ef75 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb7399 expref: 16 pid: 8031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134986.481362:0:8031:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9fe9e1c2b700) 00010000:00010000:1.0:1783134986.481364:0:8031:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1783134986.481367:0:8031:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fe9fe43f000, rc 0) 00000100:00100000:1.0:1783134986.481422:0:8031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9f68f7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+16:11330:x1869752373932800:12345-192.168.201.41@tcp:101:bash.0 Request processed in 527us (656us total) trans 0 rc 0/0 00000100:00100000:1.0:1783134986.481427:0:8031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 142 00000100:00100000:3.0:1783134986.483959:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:2.0:1783134986.484228:0:5769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373933056 00000100:00100000:2.0:1783134986.484238:0:5769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373933056 00000100:00100000:2.0:1783134986.484479:0:5769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 143 00000100:00100000:2.0:1783134986.484490:0:5769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9f6fc2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+16:11330:x1869752373933056:12345-192.168.201.41@tcp:101:bash.0 00010000:00010000:2.0:1783134986.484509:0:5769:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783134986.484529:0:5769:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829600/0xd6c4b8f05867ef7c lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4428da03f5eb73a0 expref: -99 pid: 5769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134986.484649:0:5769:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829a00/0xd6c4b8f05867ef83 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134986.484664:0:5769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829a00/0xd6c4b8f05867ef83 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134986.484675:0:5769:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829a00/0xd6c4b8f05867ef83 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134986.484725:0:5769:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829400/0xd6c4b8f05867ef8a lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134986.484733:0:5769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829400/0xd6c4b8f05867ef8a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134986.484739:0:5769:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829400/0xd6c4b8f05867ef8a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1783134986.485616:0:5769:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x4:0x0], index 0: 0 00010000:00010000:2.0:1783134986.485770:0:5769:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829200/0xd6c4b8f05867ef91 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134986.485792:0:5769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829200/0xd6c4b8f05867ef91 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134986.485799:0:5769:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829200/0xd6c4b8f05867ef91 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134986.485834:0:5769:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829a00/0xd6c4b8f05867ef83 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134986.485841:0:5769:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829a00/0xd6c4b8f05867ef83 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134986.485848:0:5769:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829a00/0xd6c4b8f05867ef83 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134986.485854:0:5769:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe9c7829a00 already unused, calling callback (ffffffffc1f634f0) 00010000:00010000:2.0:1783134986.485858:0:5769:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829a00/0xd6c4b8f05867ef83 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134986.485865:0:5769:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829a00/0xd6c4b8f05867ef83 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134986.485875:0:5769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9fe9e1c2b700) 00010000:00010000:2.0:1783134986.485878:0:5769:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783134986.485882:0:5769:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829a00/0xd6c4b8f05867ef83 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134986.485887:0:5769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829a00/0xd6c4b8f05867ef83 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1783134986.485898:0:5769:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000000603f3a9 reply state 000000000602e64b transno 4294967417 ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829400/0xd6c4b8f05867ef8a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783134986.485911:0:5769:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1783134986.485940:0:5769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829600/0xd6c4b8f05867ef7c lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb73a0 expref: 19 pid: 5769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134986.485954:0:5769:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829200/0xd6c4b8f05867ef91 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb73a0 expref: 18 pid: 5769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134986.485960:0:5769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9fe9cc3c1a00) 00010000:00010000:2.0:1783134986.485962:0:5769:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1783134986.485964:0:5769:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fe9c7829200, rc 0) 00000100:00100000:2.0:1783134986.486068:0:5769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9f6fc2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+19:11330:x1869752373933056:12345-192.168.201.41@tcp:101:bash.0 Request processed in 1581us (2117us total) trans 4294967417 rc 0/0 00000100:00100000:2.0:1783134986.486075:0:5769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 143 00010000:00010000:1.0:1783134986.489144:0:3273:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829400/0xd6c4b8f05867ef8a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134986.489156:0:3273:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829400/0xd6c4b8f05867ef8a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134986.489174:0:3273:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829400/0xd6c4b8f05867ef8a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134986.489178:0:3273:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe9c7829400 already unused, calling callback (ffffffffc1f634f0) 00010000:00010000:1.0:1783134986.489181:0:3273:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829400/0xd6c4b8f05867ef8a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134986.489186:0:3273:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829400/0xd6c4b8f05867ef8a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134986.489199:0:3273:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9fe9cc3c1400) 00010000:00010000:1.0:1783134986.489202:0:3273:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783134986.489205:0:3273:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829400/0xd6c4b8f05867ef8a lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134986.489208:0:3273:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829400/0xd6c4b8f05867ef8a lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783134986.491535:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:0.0:1783134986.491606:0:6576:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373933184 00000100:00100000:0.0:1783134986.491615:0:6576:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373933184 00000100:00100000:0.0:1783134986.491698:0:6576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 47 00000100:00100000:0.0:1783134986.491706:0:6576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9f6fc1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+5:2369:x1869752373933184:12345-192.168.201.41@tcp:101:bash.0 00010000:00010000:0.0:1783134986.491722:0:6576:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783134986.491737:0:6576:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d6a83bdc/0xd6c4b8f05867ef9f lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4428da03f5eb73a7 expref: -99 pid: 6576 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1783134986.491760:0:6576:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1783134986.491775:0:6576:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=268s v=(0 0) 00010000:00010000:0.0:1783134986.491778:0:6576:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783134986.491785:0:6576:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d6a83bdc/0xd6c4b8f05867ef9f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb73a7 expref: 6 pid: 6576 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134986.491812:0:6576:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000d6a83bdc/0xd6c4b8f05867ef9f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb73a7 expref: 6 pid: 6576 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134986.491821:0:6576:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fe9f68ad800, rc 0) 00000100:00100000:0.0:1783134986.491873:0:6576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9f6fc1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+6:2369:x1869752373933184:12345-192.168.201.41@tcp:101:bash.0 Request processed in 167us (345us total) trans 0 rc 0/0 00000100:00100000:0.0:1783134986.491878:0:6576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 47 00000100:00080000:2.0:1783134986.492107:0:5766:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1783134986.493778:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:1.0:1783134986.493852:0:7676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373933312 00000100:00100000:1.0:1783134986.493861:0:7676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373933312 00000100:00100000:1.0:1783134986.493935:0:7676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 48 00000100:00100000:1.0:1783134986.493943:0:7676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9f6fc3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+6:11330:x1869752373933312:12345-192.168.201.41@tcp:101:bash.0 00010000:00010000:1.0:1783134986.493957:0:7676:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783134986.493971:0:7676:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e08b3987/0xd6c4b8f05867efa6 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4428da03f5eb73ae expref: -99 pid: 7676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134986.493998:0:7676:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000d6a83bdc/0xd6c4b8f05867ef9f lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb73a7 expref: 7 pid: 6576 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134986.494018:0:7676:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783134986.494020:0:7676:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783134986.494024:0:7676:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e08b3987/0xd6c4b8f05867efa6 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb73ae expref: 7 pid: 7676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134986.494048:0:7676:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000d6a83bdc/0xd6c4b8f05867ef9f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb73a7 expref: 7 pid: 6576 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134986.494058:0:7676:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000d6a83bdc/0xd6c4b8f05867ef9f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb73a7 expref: 7 pid: 6576 timeout: 368 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783134986.494068:0:7676:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9fe90c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:7676:1869752384416384:192.168.201.41@tcp:104: 00000100:00100000:1.0:1783134986.494139:0:7676:0:(client.c:2701:ptlrpc_set_wait()) set ffff9fe9e0328d80 going to sleep for 11 seconds 00000100:00100000:1.0:1783134986.495877:0:7676:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9fe90c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:7676:1869752384416384:192.168.201.41@tcp:104: 00010000:00010000:1.0:1783134986.495907:0:7676:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000e08b3987/0xd6c4b8f05867efa6 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb73ae expref: 7 pid: 7676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134986.495926:0:7676:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fe9fe43e400, rc 0) 00000100:00100000:1.0:1783134986.496007:0:7676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9f6fc3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+7:11330:x1869752373933312:12345-192.168.201.41@tcp:101:bash.0 Request processed in 2063us (2231us total) trans 0 rc 0/0 00000100:00100000:1.0:1783134986.496015:0:7676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 48 00000100:00100000:1.0:1783134986.496221:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:2.0:1783134986.496401:0:5755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373933440 00000100:00100000:2.0:1783134986.496407:0:5755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373933440 00010000:00010000:2.0:1783134986.496444:0:5755:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000d6a83bdc/0xd6c4b8f05867ef9f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb73a7 expref: 7 pid: 6576 timeout: 368 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783134986.496477:0:5755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 63 00000100:00100000:2.0:1783134986.496485:0:5755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fe90c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+7:2369:x1869752373933440:12345-192.168.201.41@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783134986.496497:0:5755:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783134986.496516:0:5755:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000d6a83bdc/0xd6c4b8f05867ef9f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb73a7 expref: 7 pid: 6576 timeout: 368 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134986.496527:0:5755:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000d6a83bdc/0xd6c4b8f05867ef9f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb73a7 expref: 7 pid: 6576 timeout: 368 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134986.496559:0:5755:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d6a83bdc/0xd6c4b8f05867ef9f lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb73a7 expref: 7 pid: 6576 timeout: 368 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134986.496573:0:5755:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783134986.496577:0:5755:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783134986.496585:0:5755:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000e08b3987/0xd6c4b8f05867efa6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb73ae expref: 6 pid: 7676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134986.496595:0:5755:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e08b3987/0xd6c4b8f05867efa6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb73ae expref: 6 pid: 7676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134986.496625:0:5755:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000e08b3987/0xd6c4b8f05867efa6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb73ae expref: 6 pid: 7676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783134986.496639:0:5755:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9f68f5180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5755:1869752384416512:192.168.201.41@tcp:105: 00000100:00100000:2.0:1783134986.496736:0:5755:0:(client.c:2701:ptlrpc_set_wait()) set ffff9fe9fe46ccc0 going to sleep for 11 seconds 00010000:00010000:0.0:1783134986.501629:0:10987:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783134986.501890:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:0.0:1783134986.502171:0:5772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373933696 00000100:00100000:0.0:1783134986.502180:0:5772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373933696 00000100:00100000:0.0:1783134986.502235:0:5772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 36 00000100:00100000:0.0:1783134986.502246:0:5772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fe90e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+18:11330:x1869752373933696:12345-192.168.201.41@tcp:35:bash.0 00000100:00100000:0.0:1783134986.502626:0:5772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fe90e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+19:11330:x1869752373933696:12345-192.168.201.41@tcp:35:bash.0 Request processed in 380us (741us total) trans 4294967418 rc 0/0 00000100:00100000:0.0:1783134986.502635:0:5772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 36 00000100:00100000:2.0:1783134986.503194:0:5755:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9f68f5180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5755:1869752384416512:192.168.201.41@tcp:105: 00010000:00010000:2.0:1783134986.503215:0:5755:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783134986.503300:0:5755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fe90c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+6:2369:x1869752373933440:12345-192.168.201.41@tcp:103:ldlm_bl.0 Request processed in 6815us (7080us total) trans 0 rc 0/0 00000100:00100000:2.0:1783134986.503308:0:5755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 63 00000100:00100000:1.0:1783134986.563011:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:2.0:1783134986.563083:0:8031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373933952 00000100:00100000:2.0:1783134986.563093:0:8031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373933952 00000100:00100000:2.0:1783134986.563166:0:8031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 144 00000100:00100000:2.0:1783134986.563188:0:8031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fe90c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+19:11340:x1869752373933952:12345-192.168.201.41@tcp:101:lfs.0 00010000:00010000:2.0:1783134986.563212:0:8031:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783134986.563235:0:8031:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829600/0xd6c4b8f05867efad lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4428da03f5eb73b5 expref: -99 pid: 8031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783134986.563628:0:8031:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00010000:00010000:3.0:1783134986.563747:0:8031:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829600/0xd6c4b8f05867efad lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb73b5 expref: 21 pid: 8031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134986.563761:0:8031:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fe9e1c2b400) 00010000:00010000:3.0:1783134986.563764:0:8031:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1783134986.563770:0:8031:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829600/0xd6c4b8f05867efad lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb73b5 expref: 21 pid: 8031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134986.563787:0:8031:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fe9c7829600, rc 0) 00000100:00100000:3.0:1783134986.563865:0:8031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fe90c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+20:11340:x1869752373933952:12345-192.168.201.41@tcp:101:lfs.0 Request processed in 679us (863us total) trans 4294967419 rc 301/301 00000100:00100000:3.0:1783134986.563873:0:8031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 144 00000100:00100000:0.0:1783134986.567412:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:2.0:1783134986.567652:0:5772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373934208 00000100:00100000:2.0:1783134986.567662:0:5772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373934208 00000100:00100000:2.0:1783134986.567772:0:5772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 37 00000100:00100000:2.0:1783134986.567783:0:5772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9f6895f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+20:11340:x1869752373934208:12345-192.168.201.41@tcp:35:lfs.0 00000100:00100000:2.0:1783134986.568021:0:5772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9f6895f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+21:11340:x1869752373934208:12345-192.168.201.41@tcp:35:lfs.0 Request processed in 240us (622us total) trans 4294967420 rc 0/0 00000100:00100000:2.0:1783134986.568030:0:5772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 37 00000100:00100000:0.0:1783134986.621515:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:1.0:1783134986.621607:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373934336 00000100:00100000:1.0:1783134986.621616:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373934336 00000100:00100000:1.0:1783134986.621665:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 145 00000100:00100000:1.0:1783134986.621673:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9f6897480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+21:11346:x1869752373934336:12345-192.168.201.41@tcp:101:lfs.0 00010000:00010000:1.0:1783134986.621693:0:5770:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783134986.621709:0:5770:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43f600/0xd6c4b8f05867efbb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4428da03f5eb73bc expref: -99 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134986.621763:0:5770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43f800/0xd6c4b8f05867efc2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134986.621773:0:5770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43f800/0xd6c4b8f05867efc2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134986.621781:0:5770:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43f800/0xd6c4b8f05867efc2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783134986.621827:0:5770:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00000004:00200000:1.0:1783134986.621830:0:5770:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:1.0:1783134986.621844:0:5770:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43f800/0xd6c4b8f05867efc2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134986.621861:0:5770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43f600/0xd6c4b8f05867efbb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb73bc expref: 23 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134986.621873:0:5770:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43f800/0xd6c4b8f05867efc2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb73bc expref: 22 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134986.621879:0:5770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9fe9e1c2b700) 00010000:00010000:1.0:1783134986.621881:0:5770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1783134986.621894:0:5770:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fe9fe43f800, rc 0) 00000100:00100000:1.0:1783134986.621946:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9f6897480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+22:11346:x1869752373934336:12345-192.168.201.41@tcp:101:lfs.0 Request processed in 273us (441us total) trans 0 rc 0/0 00000100:00100000:1.0:1783134986.621952:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 145 00000100:00100000:3.0:1783134986.624674:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:0.0:1783134986.624760:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373934592 00000100:00100000:0.0:1783134986.624768:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373934592 00000100:00100000:0.0:1783134986.624886:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 146 00000100:00100000:0.0:1783134986.624895:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9f6fc0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+22:11346:x1869752373934592:12345-192.168.201.41@tcp:101:lfs.0 00010000:00010000:0.0:1783134986.624912:0:5771:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783134986.624930:0:5771:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ad200/0xd6c4b8f05867efc9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4428da03f5eb73c3 expref: -99 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134986.625034:0:5771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ace00/0xd6c4b8f05867efd0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134986.625047:0:5771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ace00/0xd6c4b8f05867efd0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134986.625057:0:5771:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ace00/0xd6c4b8f05867efd0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783134986.625067:0:5771:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:0.0:1783134986.625182:0:5771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ad200/0xd6c4b8f05867efc9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb73c3 expref: 25 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134986.625194:0:5771:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ace00/0xd6c4b8f05867efd0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb73c3 expref: 24 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134986.625200:0:5771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9fe9cc3c1a00) 00010000:00010000:0.0:1783134986.625203:0:5771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1783134986.625205:0:5771:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fe9f68ace00, rc 0) 00000100:00100000:0.0:1783134986.625255:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9f6fc0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+24:11346:x1869752373934592:12345-192.168.201.41@tcp:101:lfs.0 Request processed in 363us (589us total) trans 4294967421 rc 0/0 00000100:00100000:0.0:1783134986.625260:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 146 00000100:00100000:0.0:1783134986.632117:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:3.0:1783134986.632178:0:5754:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373934720 00000100:00100000:3.0:1783134986.632188:0:5754:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373934720 00000100:00100000:0.0:1783134986.632225:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:3.0:1783134986.632252:0:5754:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 10 00000100:00100000:1.0:1783134986.632297:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373934976 00000100:00100000:1.0:1783134986.632301:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373934976 00000100:00100000:1.0:1783134986.632331:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 147 00000100:00100000:1.0:1783134986.632340:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9f6894e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+25:11346:x1869752373934976:12345-192.168.201.41@tcp:101:lfs.0 00010000:00010000:1.0:1783134986.632361:0:5770:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783134986.632380:0:5770:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43f600/0xd6c4b8f05867efde lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4428da03f5eb73ca expref: -99 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134986.632493:0:5770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43f200/0xd6c4b8f05867efe5 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134986.632507:0:5770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43f200/0xd6c4b8f05867efe5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134986.632517:0:5770:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43f200/0xd6c4b8f05867efe5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783134986.632528:0:5770:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:1.0:1783134986.632644:0:5770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43f600/0xd6c4b8f05867efde lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb73ca expref: 28 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134986.632662:0:5770:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43f200/0xd6c4b8f05867efe5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb73ca expref: 27 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134986.632671:0:5770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9fe9cc3c1a00) 00010000:00010000:1.0:1783134986.632682:0:5770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1783134986.632686:0:5770:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fe9fe43f200, rc 0) 00000100:00100000:1.0:1783134986.632738:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9f6894e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+27:11346:x1869752373934976:12345-192.168.201.41@tcp:101:lfs.0 Request processed in 399us (512us total) trans 4294967422 rc 0/0 00000100:00100000:1.0:1783134986.632744:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 147 00000100:00100000:3.0:1783134986.634205:0:5754:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9f6897100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+26:2369:x1869752373934720:12345-192.168.201.41@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783134986.634221:0:5754:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783134986.634242:0:5754:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ace00/0xd6c4b8f05867efd0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb73c3 expref: 26 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134986.634852:0:5754:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9fe9cc3c1a00) 00010000:00010000:3.0:1783134986.634856:0:5754:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783134986.634907:0:5754:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9f6897100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+25:2369:x1869752373934720:12345-192.168.201.41@tcp:103:ldlm_bl.0 Request processed in 712us (2796us total) trans 0 rc 0/0 00000100:00100000:3.0:1783134986.634916:0:5754:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 10 00000100:00100000:0.0:1783134986.637755:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:3.0:1783134986.637874:0:6576:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373935104 00000100:00100000:3.0:1783134986.637883:0:6576:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373935104 00000100:00100000:3.0:1783134986.637933:0:6576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 49 00000100:00100000:3.0:1783134986.637944:0:6576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9f643f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+6:2370:x1869752373935104:12345-192.168.201.41@tcp:1:lfs.0 00010000:00010000:3.0:1783134986.637998:0:6576:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e4e233eb/0xd6c4b8f05867eff3 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6576 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134986.638019:0:6576:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000e08b3987/0xd6c4b8f05867efa6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb73ae expref: 6 pid: 7676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134986.638028:0:6576:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x4:0x0].0x0 since=1s v=(0 0) 00010000:00010000:3.0:1783134986.638033:0:6576:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1783134986.638038:0:6576:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e4e233eb/0xd6c4b8f05867eff3 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6576 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134986.638073:0:6576:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000e08b3987/0xd6c4b8f05867efa6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb73ae expref: 6 pid: 7676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134986.638087:0:6576:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000e08b3987/0xd6c4b8f05867efa6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb73ae expref: 6 pid: 7676 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783134986.638120:0:6576:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9f6fc3100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6576:1869752384416640:192.168.201.41@tcp:104: 00000100:00100000:3.0:1783134986.638222:0:6576:0:(client.c:2701:ptlrpc_set_wait()) set ffff9fe9ca8aed80 going to sleep for 11 seconds 00000100:00100000:1.0:1783134986.642466:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:3.0:1783134986.642495:0:6576:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9f6fc3100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6576:1869752384416640:192.168.201.41@tcp:104: 00010000:00010000:3.0:1783134986.642522:0:6576:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000e4e233eb/0xd6c4b8f05867eff3 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6576 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783134986.642553:0:6580:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373935232 00000100:00100000:2.0:1783134986.642560:0:6580:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373935232 00002000:00100000:2.0:1783134986.642608:0:6580:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x4:0x0] (0->12) req@ffff9fe9fe90fb80 x1869752373935232/t0(0) o4->28f4ba61-cfae-499e-ab3d-81cb8215f7bb@192.168.201.41@tcp:157/0 lens 504/0 e 0 to 0 dl 1783134997 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1783134986.642619:0:6580:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9fe9fe90fb80 with x1869752373935232 ext(0->12) 00010000:00010000:2.0:1783134986.642626:0:6580:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000e08b3987/0xd6c4b8f05867efa6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb73ae expref: 7 pid: 7676 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134986.642641:0:6580:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000e08b3987/0xd6c4b8f05867efa6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb73ae expref: 7 pid: 7676 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1783134986.642649:0:6580:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9fe9fe90fb80 00000100:00100000:2.0:1783134986.642683:0:6580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 2 00000100:00100000:2.0:1783134986.642693:0:6580:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fe90fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+7:2370:x1869752373935232:12345-192.168.201.41@tcp:4:lfs.0 00000100:00100000:2.0:1783134986.643110:0:6580:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fe90fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+9:2370:x1869752373935232:12345-192.168.201.41@tcp:4:lfs.0 Request processed in 418us (661us total) trans 4294967305 rc 0/0 00000100:00100000:2.0:1783134986.643116:0:6580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 2 00002000:00100000:2.0:1783134986.643120:0:6580:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x4:0x0] (0->12) req@ffff9fe9fe90fb80 x1869752373935232/t4294967305(0) o4->28f4ba61-cfae-499e-ab3d-81cb8215f7bb@192.168.201.41@tcp:157/0 lens 504/448 e 0 to 0 dl 1783134997 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1783134986.643126:0:6580:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9fe9fe90fb80 with x1869752373935232 ext(0->12) 00010000:00010000:2.0:1783134986.643130:0:6580:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000e08b3987/0xd6c4b8f05867efa6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb73ae expref: 9 pid: 7676 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134986.643138:0:6580:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000e08b3987/0xd6c4b8f05867efa6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb73ae expref: 9 pid: 7676 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1783134986.643143:0:6580:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9fe9fe90fb80 00000100:00100000:1.0:1783134986.646087:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:0.0:1783134986.646185:0:5756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373935360 00000100:00100000:0.0:1783134986.646195:0:5756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373935360 00010000:00010000:0.0:1783134986.646230:0:5756:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000e08b3987/0xd6c4b8f05867efa6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb73ae expref: 9 pid: 7676 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783134986.646311:0:5756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 64 00000100:00100000:0.0:1783134986.646321:0:5756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fe90d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+9:2367:x1869752373935360:12345-192.168.201.41@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783134986.646338:0:5756:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1783134986.646355:0:5756:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:0.0:1783134986.646358:0:5756:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb mtime from disk: 0 -> 1783134986 00002000:00010000:0.0:1783134986.646360:0:5756:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb atime from disk: 0 -> 1783134986 00002000:00010000:0.0:1783134986.646362:0:5756:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb ctime from disk: 0 -> 1783134986 00010000:00010000:0.0:1783134986.646367:0:5756:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000e08b3987/0xd6c4b8f05867efa6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb73ae expref: 9 pid: 7676 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134986.646381:0:5756:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000e08b3987/0xd6c4b8f05867efa6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb73ae expref: 9 pid: 7676 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134986.646404:0:5756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e08b3987/0xd6c4b8f05867efa6 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb73ae expref: 9 pid: 7676 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134986.646420:0:5756:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1783134986.646424:0:5756:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1783134986.646439:0:5756:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000e4e233eb/0xd6c4b8f05867eff3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6576 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134986.646557:0:5756:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e4e233eb/0xd6c4b8f05867eff3 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6576 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134986.646591:0:5756:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783134986.646641:0:5756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fe90d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+8:2367:x1869752373935360:12345-192.168.201.41@tcp:103:ldlm_bl.0 Request processed in 321us (563us total) trans 0 rc 0/0 00000100:00100000:0.0:1783134986.646648:0:5756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 64 00010000:00010000:3.0:1783134986.646746:0:6576:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000e4e233eb/0xd6c4b8f05867eff3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6576 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134986.646757:0:6576:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e4e233eb/0xd6c4b8f05867eff3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6576 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134986.646782:0:6576:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e4e233eb/0xd6c4b8f05867eff3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6576 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134986.646791:0:6576:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e4e233eb/0xd6c4b8f05867eff3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6576 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134986.646799:0:6576:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e4e233eb/0xd6c4b8f05867eff3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6576 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134986.646806:0:6576:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe9d2b74e00 already unused, calling callback (ffffffffc1527ce0) 00010000:00010000:3.0:1783134986.646810:0:6576:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e4e233eb/0xd6c4b8f05867eff3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6576 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134986.646829:0:6576:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e4e233eb/0xd6c4b8f05867eff3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6576 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134986.646843:0:6576:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e4e233eb/0xd6c4b8f05867eff3 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6576 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134986.646851:0:6576:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e4e233eb/0xd6c4b8f05867eff3 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6576 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783134986.646967:0:6576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9f643f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+7:2370:x1869752373935104:12345-192.168.201.41@tcp:1:lfs.0 Request processed in 9024us (9219us total) trans 0 rc 0/0 00000100:00100000:3.0:1783134986.646977:0:6576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 49 00000100:00100000:1.0:1783134986.650071:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:2.0:1783134986.650143:0:5773:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373935616 00000100:00100000:2.0:1783134986.650157:0:5773:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373935616 00000100:00100000:2.0:1783134986.650198:0:5773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 38 00000100:00100000:2.0:1783134986.650205:0:5773:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9e0bf4450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+25:11346:x1869752373935616:12345-192.168.201.41@tcp:35:lfs.0 00000004:00010000:2.0:1783134986.650253:0:5773:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0xb:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43f200/0xd6c4b8f05867efe5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb73ca expref: 25 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1783134986.650613:0:5773:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967423 00000001:00080000:2.0:1783134986.650640:0:5773:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967424 00000001:00080000:2.0:1783134986.651062:0:5773:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967425 00010000:00010000:2.0:1783134986.651101:0:5773:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829a00/0xd6c4b8f05867effa lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134986.651112:0:5773:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829200/0xd6c4b8f05867ef91 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb73a0 expref: 29 pid: 5769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134986.651123:0:5773:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829a00/0xd6c4b8f05867effa lrc: 4/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134986.651518:0:5773:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829200/0xd6c4b8f05867ef91 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb73a0 expref: 29 pid: 5769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134986.651533:0:5773:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829200/0xd6c4b8f05867ef91 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb73a0 expref: 29 pid: 5769 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783134986.651550:0:5773:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9f68f5180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5773:1869752384416768:192.168.201.41@tcp:104: 00000100:00100000:2.0:1783134986.651680:0:5773:0:(client.c:2701:ptlrpc_set_wait()) set ffff9fe9fe46c300 going to sleep for 11 seconds 00000100:00100000:2.0:1783134986.669068:0:5773:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9f68f5180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5773:1869752384416768:192.168.201.41@tcp:104: 00010000:00010000:2.0:1783134986.669108:0:5773:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829a00/0xd6c4b8f05867effa lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5773 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783134986.670236:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:0.0:1783134986.671542:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373935744 00000100:00100000:0.0:1783134986.671553:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373935744 00010000:00010000:0.0:1783134986.671614:0:6592:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829200/0xd6c4b8f05867ef91 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb73a0 expref: 30 pid: 5769 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783134986.671658:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 65 00000100:00100000:0.0:1783134986.671668:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9d1623c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+30:2369:x1869752373935744:12345-192.168.201.41@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783134986.671684:0:6592:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783134986.671691:0:6592:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829200/0xd6c4b8f05867ef91 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb73a0 expref: 30 pid: 5769 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134986.671703:0:6592:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829200/0xd6c4b8f05867ef91 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb73a0 expref: 30 pid: 5769 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134986.671723:0:6592:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829200/0xd6c4b8f05867ef91 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb73a0 expref: 30 pid: 5769 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134986.671741:0:6592:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9fe9cc3c1a00) 00010000:00010000:0.0:1783134986.671747:0:6592:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829a00/0xd6c4b8f05867effa lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134986.671756:0:6592:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829a00/0xd6c4b8f05867effa lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134986.671764:0:6592:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829a00/0xd6c4b8f05867effa lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134986.671807:0:6592:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1783134986.671842:0:5773:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829a00/0xd6c4b8f05867effa lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134986.671850:0:5773:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829a00/0xd6c4b8f05867effa lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5773 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783134986.671867:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9d1623c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+29:2369:x1869752373935744:12345-192.168.201.41@tcp:103:ldlm_bl.0 Request processed in 198us (1633us total) trans 0 rc 0/0 00000100:00100000:0.0:1783134986.671876:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 65 00000001:00080000:2.0:1783134986.671950:0:5773:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967426 00000001:00080000:2.0:1783134986.672090:0:5773:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967427 00000100:00100000:2.0:1783134986.672174:0:5773:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9f68f5180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5773:1869752384416896:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1783134986.672212:0:5773:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783134986.672237:0:5773:0:(client.c:2701:ptlrpc_set_wait()) set ffff9fe9fe46ccc0 going to sleep for 11 seconds 00000100:00100000:0.0:1783134986.672347:0:5775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384416896 00000100:00100000:0.0:1783134986.672352:0:5775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384416896 00000100:00100000:0.0:1783134986.672391:0:5775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1783134986.672399:0:5775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9f68f7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5773:x1869752384416896:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1783134986.672569:0:5775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9f68f7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5773:x1869752384416896:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 170us (355us total) trans 0 rc 0/0 00000100:00100000:0.0:1783134986.672577:0:5775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1783134986.672831:0:5773:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9f68f5180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5773:1869752384416896:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:2.0:1783134986.673369:0:5773:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967428 00000100:00100000:2.0:1783134986.673459:0:5773:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9f68f5180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5773:1869752384417024:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1783134986.673502:0:5773:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783134986.673534:0:5773:0:(client.c:2701:ptlrpc_set_wait()) set ffff9fe9fe46c300 going to sleep for 11 seconds 00000100:00100000:3.0:1783134986.673574:0:5774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384417024 00000100:00100000:3.0:1783134986.673580:0:5774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384417024 00000100:00100000:3.0:1783134986.673617:0:5774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1783134986.673625:0:5774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9f68f4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5773:x1869752384417024:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1783134986.673835:0:5774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9f68f4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5773:x1869752384417024:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 211us (332us total) trans 4294967306 rc 0/0 00000100:00100000:3.0:1783134986.673842:0:5774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1783134986.673862:0:5773:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9f68f5180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5773:1869752384417024:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:2.0:1783134986.673899:0:5773:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967429 00010000:00010000:2.0:1783134986.673927:0:5773:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829a00/0xd6c4b8f05867effa lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134986.673936:0:5773:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829a00/0xd6c4b8f05867effa lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134986.673942:0:5773:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829a00/0xd6c4b8f05867effa lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134986.673948:0:5773:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe9c7829a00 already unused, calling callback (ffffffffc1f634f0) 00010000:00010000:2.0:1783134986.673952:0:5773:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829a00/0xd6c4b8f05867effa lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134986.673961:0:5773:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829a00/0xd6c4b8f05867effa lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134986.673974:0:5773:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9fe9cc3c1a00) 00010000:00010000:2.0:1783134986.673976:0:5773:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1783134986.673981:0:5773:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829a00/0xd6c4b8f05867effa lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5773 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134986.673985:0:5773:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829a00/0xd6c4b8f05867effa lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5773 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1783134986.674186:0:5773:0:(mdd_object.c:4010:mdd_close()) Object [0x200000401:0xc:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1783134986.675479:0:5773:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].4, 64 off8448 00000004:00080000:2.0:1783134986.675493:0:5773:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 269071212921ns, next at 270071210005ns, rc = 0 00000001:00080000:2.0:1783134986.675815:0:5773:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967430 00010000:00010000:2.0:1783134986.675870:0:5773:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9fe9cc3c1a00) 00010000:00010000:2.0:1783134986.675875:0:5773:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1783134986.675885:0:5773:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43f200/0xd6c4b8f05867efe5 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb73ca expref: 33 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783134986.676039:0:5773:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9e0bf4450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+32:11346:x1869752373935616:12345-192.168.201.41@tcp:35:lfs.0 Request processed in 25832us (25972us total) trans 4294967431 rc 0/0 00000100:00100000:2.0:1783134986.676048:0:5773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 38 00000020:00080000:2.0:1783134986.676053:0:5773:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:1.0:1783134986.682132:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:3.0:1783134986.684000:0:8031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373935872 00000100:00100000:3.0:1783134986.684013:0:8031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373935872 00000100:00100000:3.0:1783134986.684086:0:8031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 148 00000100:00100000:3.0:1783134986.684097:0:8031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fe90ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+32:11346:x1869752373935872:12345-192.168.201.41@tcp:101:lfs.0 00010000:00010000:3.0:1783134986.684123:0:8031:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783134986.684264:0:8031:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b74e00/0xd6c4b8f05867f001 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4428da03f5eb73d1 expref: -99 pid: 8031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134986.684412:0:8031:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b74e00/0xd6c4b8f05867f001 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb73d1 expref: 33 pid: 8031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134986.684437:0:8031:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b74e00/0xd6c4b8f05867f001 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb73d1 expref: 33 pid: 8031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134986.684458:0:8031:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9fe9cb8f4a00) 00010000:00010000:3.0:1783134986.684462:0:8031:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1783134986.684465:0:8031:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fe9d2b74e00, rc 0) 00000100:00100000:3.0:1783134986.684537:0:8031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fe90ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+33:11346:x1869752373935872:12345-192.168.201.41@tcp:101:lfs.0 Request processed in 441us (2414us total) trans 0 rc 0/0 00000100:00100000:3.0:1783134986.684545:0:8031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 148 00000100:00100000:0.0:1783134986.690070:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:2.0:1783134986.690326:0:5772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373936128 00000100:00100000:2.0:1783134986.690336:0:5772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373936128 00000100:00100000:2.0:1783134986.690392:0:5772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 39 00000100:00100000:2.0:1783134986.690403:0:5772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9f6897100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+33:11346:x1869752373936128:12345-192.168.201.41@tcp:35:lfs.0 00000100:00100000:2.0:1783134986.690648:0:5772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9f6897100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+34:11346:x1869752373936128:12345-192.168.201.41@tcp:35:lfs.0 Request processed in 246us (587us total) trans 4294967432 rc 0/0 00000100:00100000:2.0:1783134986.690657:0:5772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 39 00000100:00100000:1.0:1783134986.742876:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:0.0:1783134986.742984:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373936384 00000100:00100000:0.0:1783134986.742994:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373936384 00000100:00100000:0.0:1783134986.743094:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 149 00000100:00100000:0.0:1783134986.743104:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fe90d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+34:11356:x1869752373936384:12345-192.168.201.41@tcp:101:lfs.0 00010000:00010000:0.0:1783134986.743128:0:5770:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783134986.743149:0:5770:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ade00/0xd6c4b8f05867f008 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4428da03f5eb73d8 expref: -99 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783134986.743258:0:5770:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00010000:00010000:0.0:1783134986.743421:0:5770:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ade00/0xd6c4b8f05867f008 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb73d8 expref: 36 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134986.743447:0:5770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fe9e1c2b400) 00010000:00010000:0.0:1783134986.743451:0:5770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1783134986.743470:0:5770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ade00/0xd6c4b8f05867f008 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb73d8 expref: 36 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134986.743485:0:5770:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fe9f68ade00, rc 0) 00000100:00100000:0.0:1783134986.743548:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fe90d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+35:11356:x1869752373936384:12345-192.168.201.41@tcp:101:lfs.0 Request processed in 445us (682us total) trans 4294967433 rc 301/301 00000100:00100000:0.0:1783134986.743555:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 149 00000100:00100000:3.0:1783134986.745455:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:1.0:1783134986.749827:0:5769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373936512 00000100:00100000:1.0:1783134986.749842:0:5769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373936512 00000100:00100000:1.0:1783134986.749907:0:5769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 150 00000100:00100000:1.0:1783134986.749921:0:5769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9f6fc0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+35:11356:x1869752373936512:12345-192.168.201.41@tcp:34:lfs.0 00010000:00010000:1.0:1783134986.749996:0:5769:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43f400/0xd6c4b8f05867f016 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134986.750012:0:5769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43f400/0xd6c4b8f05867f016 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134986.750023:0:5769:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43f400/0xd6c4b8f05867f016 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134986.750037:0:5769:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43ec00/0xd6c4b8f05867f01d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134986.750044:0:5769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43ec00/0xd6c4b8f05867f01d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134986.750068:0:5769:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43ec00/0xd6c4b8f05867f01d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134986.750169:0:5769:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43fa00/0xd6c4b8f05867f024 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134986.750177:0:5769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43fa00/0xd6c4b8f05867f024 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134986.750184:0:5769:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43fa00/0xd6c4b8f05867f024 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1783134986.750225:0:5769:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43fa00/0xd6c4b8f05867f024 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134986.750238:0:5769:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43f400/0xd6c4b8f05867f016 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134986.750245:0:5769:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43f400/0xd6c4b8f05867f016 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134986.750252:0:5769:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43f400/0xd6c4b8f05867f016 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134986.750259:0:5769:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe9fe43f400 already unused, calling callback (ffffffffc1f634f0) 00010000:00010000:1.0:1783134986.750263:0:5769:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43f400/0xd6c4b8f05867f016 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134986.750270:0:5769:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43f400/0xd6c4b8f05867f016 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134986.750405:0:5769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9fe9e1c2b700) 00010000:00010000:1.0:1783134986.750414:0:5769:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783134986.750419:0:5769:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43f400/0xd6c4b8f05867f016 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134986.750435:0:5769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43f400/0xd6c4b8f05867f016 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134986.750451:0:5769:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43ec00/0xd6c4b8f05867f01d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134986.750457:0:5769:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43ec00/0xd6c4b8f05867f01d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134986.750463:0:5769:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43ec00/0xd6c4b8f05867f01d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134986.750468:0:5769:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe9fe43ec00 already unused, calling callback (ffffffffc1f634f0) 00010000:00010000:1.0:1783134986.750470:0:5769:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43ec00/0xd6c4b8f05867f01d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134986.750476:0:5769:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43ec00/0xd6c4b8f05867f01d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134986.750493:0:5769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9fe9e1c2b000) 00010000:00010000:1.0:1783134986.750496:0:5769:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783134986.750499:0:5769:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43ec00/0xd6c4b8f05867f01d lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134986.750504:0:5769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43ec00/0xd6c4b8f05867f01d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134986.750518:0:5769:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43fa00/0xd6c4b8f05867f024 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134986.750529:0:5769:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43fa00/0xd6c4b8f05867f024 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134986.750534:0:5769:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43fa00/0xd6c4b8f05867f024 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134986.750538:0:5769:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe9fe43fa00 already unused, calling callback (ffffffffc1f634f0) 00010000:00010000:1.0:1783134986.750541:0:5769:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43fa00/0xd6c4b8f05867f024 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134986.750545:0:5769:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43fa00/0xd6c4b8f05867f024 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134986.750553:0:5769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9fe9cb8f4a00) 00010000:00010000:1.0:1783134986.750555:0:5769:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783134986.750558:0:5769:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43fa00/0xd6c4b8f05867f024 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134986.750563:0:5769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43fa00/0xd6c4b8f05867f024 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783134986.750721:0:5769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9f6fc0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+35:11356:x1869752373936512:12345-192.168.201.41@tcp:34:lfs.0 Request processed in 793us (5268us total) trans 0 rc 0/0 00000100:00100000:1.0:1783134986.750729:0:5769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 150 00000100:00100000:0.0:1783134986.752747:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:2.0:1783134986.752857:0:5772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373936768 00000100:00100000:2.0:1783134986.752867:0:5772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373936768 00000100:00100000:2.0:1783134986.752924:0:5772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 40 00000100:00100000:2.0:1783134986.752932:0:5772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9f6897b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+35:11356:x1869752373936768:12345-192.168.201.41@tcp:35:lfs.0 00000100:00100000:2.0:1783134986.753255:0:5772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9f6897b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+36:11356:x1869752373936768:12345-192.168.201.41@tcp:35:lfs.0 Request processed in 322us (518us total) trans 4294967434 rc 0/0 00000100:00100000:2.0:1783134986.753261:0:5772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 40 00000100:00100000:3.0:1783134986.776834:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:1.0:1783134986.776935:0:8031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373937024 00000100:00100000:1.0:1783134986.776945:0:8031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373937024 00000100:00100000:1.0:1783134986.777011:0:8031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 151 00000100:00100000:1.0:1783134986.777020:0:8031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9f6fc3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+36:11359:x1869752373937024:12345-192.168.201.41@tcp:101:lfs.0 00010000:00010000:1.0:1783134986.777349:0:8031:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783134986.777390:0:8031:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43fa00/0xd6c4b8f05867f02b lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4428da03f5eb73df expref: -99 pid: 8031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134986.777500:0:8031:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43ec00/0xd6c4b8f05867f032 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134986.777515:0:8031:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43ec00/0xd6c4b8f05867f032 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134986.777526:0:8031:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43ec00/0xd6c4b8f05867f032 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134986.777539:0:8031:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43f400/0xd6c4b8f05867f039 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134986.777544:0:8031:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43f400/0xd6c4b8f05867f039 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134986.777548:0:8031:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43f400/0xd6c4b8f05867f039 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134986.777689:0:8031:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43e200/0xd6c4b8f05867f040 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134986.777694:0:8031:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43e200/0xd6c4b8f05867f040 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134986.777698:0:8031:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43e200/0xd6c4b8f05867f040 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783134986.777706:0:8031:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:1.0:1783134986.777805:0:8031:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43ec00/0xd6c4b8f05867f032 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134986.777817:0:8031:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43ec00/0xd6c4b8f05867f032 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134986.777822:0:8031:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43ec00/0xd6c4b8f05867f032 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134986.777826:0:8031:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe9fe43ec00 already unused, calling callback (ffffffffc1f634f0) 00010000:00010000:1.0:1783134986.777830:0:8031:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43ec00/0xd6c4b8f05867f032 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134986.777836:0:8031:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43ec00/0xd6c4b8f05867f032 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134986.777846:0:8031:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9fe9e1c2b700) 00010000:00010000:1.0:1783134986.777848:0:8031:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783134986.777853:0:8031:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43ec00/0xd6c4b8f05867f032 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134986.777857:0:8031:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43ec00/0xd6c4b8f05867f032 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134986.777866:0:8031:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43f400/0xd6c4b8f05867f039 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134986.777870:0:8031:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43f400/0xd6c4b8f05867f039 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134986.777874:0:8031:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43f400/0xd6c4b8f05867f039 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134986.777877:0:8031:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe9fe43f400 already unused, calling callback (ffffffffc1f634f0) 00010000:00010000:1.0:1783134986.777881:0:8031:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43f400/0xd6c4b8f05867f039 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134986.777885:0:8031:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43f400/0xd6c4b8f05867f039 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134986.777890:0:8031:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9fe9e1c2b000) 00010000:00010000:1.0:1783134986.777891:0:8031:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783134986.777892:0:8031:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43f400/0xd6c4b8f05867f039 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134986.777895:0:8031:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43f400/0xd6c4b8f05867f039 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134986.777931:0:8031:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43fa00/0xd6c4b8f05867f02b lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb73df expref: 39 pid: 8031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134986.777940:0:8031:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43e200/0xd6c4b8f05867f040 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb73df expref: 38 pid: 8031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134986.777944:0:8031:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9fe9cb8f4a00) 00010000:00010000:1.0:1783134986.777946:0:8031:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1783134986.777947:0:8031:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fe9fe43e200, rc 0) 00000100:00100000:1.0:1783134986.778227:0:8031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9f6fc3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+38:11359:x1869752373937024:12345-192.168.201.41@tcp:101:lfs.0 Request processed in 1206us (1403us total) trans 4294967435 rc 0/0 00000100:00100000:1.0:1783134986.778237:0:8031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 151 00000100:00100000:3.0:1783134986.780087:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:0.0:1783134986.780240:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373937152 00000100:00100000:0.0:1783134986.780252:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373937152 00000100:00100000:0.0:1783134986.780326:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 152 00000100:00100000:0.0:1783134986.780334:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9f6fc0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+38:11359:x1869752373937152:12345-192.168.201.41@tcp:54:lfs.0 00010000:00010000:0.0:1783134986.780402:0:5770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ad200/0xd6c4b8f05867f04e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134986.780417:0:5770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ad200/0xd6c4b8f05867f04e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134986.780424:0:5770:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ad200/0xd6c4b8f05867f04e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134986.780465:0:5770:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ad200/0xd6c4b8f05867f04e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134986.780472:0:5770:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ad200/0xd6c4b8f05867f04e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134986.780479:0:5770:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ad200/0xd6c4b8f05867f04e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134986.780486:0:5770:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe9f68ad200 already unused, calling callback (ffffffffc1f634f0) 00010000:00010000:0.0:1783134986.780506:0:5770:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ad200/0xd6c4b8f05867f04e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134986.780520:0:5770:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ad200/0xd6c4b8f05867f04e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134986.780535:0:5770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9fe9cb8f4a00) 00010000:00010000:0.0:1783134986.780538:0:5770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1783134986.780543:0:5770:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ad200/0xd6c4b8f05867f04e lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134986.780551:0:5770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ad200/0xd6c4b8f05867f04e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783134986.780621:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9f6fc0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+38:11359:x1869752373937152:12345-192.168.201.41@tcp:54:lfs.0 Request processed in 286us (543us total) trans 0 rc 0/0 00000100:00100000:0.0:1783134986.780628:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 152 00000100:00100000:0.0:1783134986.782048:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:2.0:1783134986.782224:0:5772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373937408 00000100:00100000:2.0:1783134986.782242:0:5772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373937408 00000100:00100000:2.0:1783134986.782319:0:5772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 41 00000100:00100000:2.0:1783134986.782330:0:5772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9f6895f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+38:11359:x1869752373937408:12345-192.168.201.41@tcp:35:lfs.0 00000100:00100000:2.0:1783134986.782588:0:5772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9f6895f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+39:11359:x1869752373937408:12345-192.168.201.41@tcp:35:lfs.0 Request processed in 260us (545us total) trans 4294967436 rc 0/0 00000100:00100000:2.0:1783134986.782596:0:5772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 41 00000100:00100000:3.0:1783134986.915741:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:2.0:1783134986.915819:0:5769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373937664 00000100:00100000:2.0:1783134986.915833:0:5769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373937664 00000100:00100000:2.0:1783134986.916226:0:5769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 153 00000100:00100000:2.0:1783134986.916237:0:5769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9f6fc1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+39:11390:x1869752373937664:12345-192.168.201.41@tcp:101:cat.0 00010000:00010000:2.0:1783134986.916266:0:5769:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783134986.916356:0:5769:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829a00/0xd6c4b8f05867f055 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4428da03f5eb73e6 expref: -99 pid: 5769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134986.916497:0:5769:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829e00/0xd6c4b8f05867f05c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134986.916516:0:5769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829e00/0xd6c4b8f05867f05c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134986.916529:0:5769:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829e00/0xd6c4b8f05867f05c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783134986.916542:0:5769:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:2.0:1783134986.916704:0:5769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829a00/0xd6c4b8f05867f055 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb73e6 expref: 42 pid: 5769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134986.916721:0:5769:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829e00/0xd6c4b8f05867f05c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb73e6 expref: 41 pid: 5769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134986.916742:0:5769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9fe9cb8f4a00) 00010000:00010000:2.0:1783134986.916744:0:5769:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1783134986.916747:0:5769:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fe9c7829e00, rc 0) 00000100:00100000:2.0:1783134986.916812:0:5769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9f6fc1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+41:11390:x1869752373937664:12345-192.168.201.41@tcp:101:cat.0 Request processed in 576us (1084us total) trans 4294967437 rc 0/0 00000100:00100000:2.0:1783134986.916819:0:5769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 153 00000100:00100000:3.0:1783134986.920856:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:3.0:1783134986.920972:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:0.0:1783134986.921020:0:5756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373938048 00000100:00100000:0.0:1783134986.921033:0:5756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373938048 00000100:00100000:1.0:1783134986.921110:0:5773:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373937920 00000100:00100000:0.0:1783134986.921112:0:5756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 11 00000100:00100000:1.0:1783134986.921114:0:5773:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373937920 00000100:00100000:0.0:1783134986.921124:0:5756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9f6fc3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+42:2367:x1869752373938048:12345-192.168.201.41@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783134986.921143:0:5756:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1783134986.921158:0:5773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 42 00000100:00100000:1.0:1783134986.921165:0:5773:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9f6fc3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+42:11390:x1869752373937920:12345-192.168.201.41@tcp:35:cat.0 00010000:00010000:0.0:1783134986.921174:0:5756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829e00/0xd6c4b8f05867f05c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb73e6 expref: 42 pid: 5769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134986.921199:0:5756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9fe9cb8f4a00) 00010000:00010000:0.0:1783134986.921205:0:5756:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783134986.921313:0:5756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9f6fc3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+41:2367:x1869752373938048:12345-192.168.201.41@tcp:103:ldlm_bl.0 Request processed in 158us (306us total) trans 0 rc 0/0 00000100:00100000:0.0:1783134986.921335:0:5756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 11 00000100:00100000:1.0:1783134986.921768:0:5773:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9f6fc3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+41:11390:x1869752373937920:12345-192.168.201.41@tcp:35:cat.0 Request processed in 602us (927us total) trans 4294967438 rc 0/0 00000100:00100000:1.0:1783134986.921775:0:5773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 42 00000100:00100000:3.0:1783134986.961969:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:2.0:1783134986.962355:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373938304 00000100:00100000:2.0:1783134986.962367:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373938304 00000100:00100000:2.0:1783134986.962542:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 154 00000100:00100000:2.0:1783134986.962556:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9f6fc1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+41:11396:x1869752373938304:12345-192.168.201.41@tcp:101:dd.0 00010000:00010000:2.0:1783134986.962589:0:5771:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783134986.962593:0:5771:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1783134986.962627:0:5771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43f800/0xd6c4b8f05867efc2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb73bc expref: 41 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134986.962652:0:5771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9fe9e1c2b700) 00010000:00010000:2.0:1783134986.962659:0:5771:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1783134986.962675:0:5771:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829a00/0xd6c4b8f05867f06a lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4428da03f5eb73ed expref: -99 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134986.962805:0:5771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828800/0xd6c4b8f05867f071 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134986.962820:0:5771:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43e200/0xd6c4b8f05867f040 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb73df expref: 41 pid: 8031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134986.962855:0:5771:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828800/0xd6c4b8f05867f071 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134986.963116:0:5771:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43e200/0xd6c4b8f05867f040 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb73df expref: 41 pid: 8031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134986.963132:0:5771:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43e200/0xd6c4b8f05867f040 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb73df expref: 41 pid: 8031 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783134986.963149:0:5771:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9f68f5f80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5771:1869752384417152:192.168.201.41@tcp:104: 00000100:00100000:2.0:1783134986.963670:0:5771:0:(client.c:2701:ptlrpc_set_wait()) set ffff9fe9fe46c780 going to sleep for 11 seconds 00000100:00100000:0.0:1783134986.965571:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:3.0:1783134986.965642:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373938432 00000100:00100000:3.0:1783134986.965651:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373938432 00010000:00010000:3.0:1783134986.965694:0:6592:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43e200/0xd6c4b8f05867f040 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb73df expref: 42 pid: 8031 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783134986.965733:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 66 00000100:00100000:3.0:1783134986.965742:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9f6895880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+42:2369:x1869752373938432:12345-192.168.201.41@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783134986.965770:0:6592:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783134986.965776:0:6592:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43e200/0xd6c4b8f05867f040 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb73df expref: 42 pid: 8031 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134986.965790:0:6592:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43e200/0xd6c4b8f05867f040 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb73df expref: 42 pid: 8031 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134986.965813:0:6592:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9fe9cb8f4a00) 00010000:00010000:3.0:1783134986.965819:0:6592:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828800/0xd6c4b8f05867f071 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134986.965830:0:6592:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828800/0xd6c4b8f05867f071 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134986.965838:0:6592:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828800/0xd6c4b8f05867f071 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134986.965857:0:6592:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783134986.965936:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9f6895880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+42:2369:x1869752373938432:12345-192.168.201.41@tcp:103:ldlm_bl.0 Request processed in 194us (370us total) trans 0 rc 0/0 00000100:00100000:3.0:1783134986.965945:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 66 00010000:00010000:2.0:1783134986.966592:0:5771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43e200/0xd6c4b8f05867f040 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb73df expref: 41 pid: 8031 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783134986.966611:0:5771:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9f68f5f80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5771:1869752384417152:192.168.201.41@tcp:104: 00010000:00010000:2.0:1783134986.966637:0:5771:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828800/0xd6c4b8f05867f071 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134986.966647:0:5771:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828800/0xd6c4b8f05867f071 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134986.966653:0:5771:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828800/0xd6c4b8f05867f071 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783134986.966673:0:5771:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:2.0:1783134986.967031:0:5771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829a00/0xd6c4b8f05867f06a lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb73ed expref: 42 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134986.967068:0:5771:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828800/0xd6c4b8f05867f071 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb73ed expref: 41 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134986.967077:0:5771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9fe9cb8f4a00) 00010000:00010000:2.0:1783134986.967080:0:5771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1783134986.967083:0:5771:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fe9c7828800, rc 0) 00000100:00100000:2.0:1783134986.967178:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9f6fc1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+41:11396:x1869752373938304:12345-192.168.201.41@tcp:101:dd.0 Request processed in 4625us (5755us total) trans 4294967439 rc 0/0 00000100:00100000:2.0:1783134986.967187:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 154 00000100:00100000:0.0:1783134986.980502:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:3.0:1783134986.980907:0:8031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373938688 00000100:00100000:3.0:1783134986.980921:0:8031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373938688 00000100:00100000:3.0:1783134986.981059:0:8031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 155 00000100:00100000:3.0:1783134986.981072:0:8031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9f6895500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+41:11396:x1869752373938688:12345-192.168.201.41@tcp:36:dd.0 00010000:00010000:3.0:1783134986.981519:0:8031:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b75a00/0xd6c4b8f05867f07f lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134986.981541:0:8031:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b75a00/0xd6c4b8f05867f07f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134986.981573:0:8031:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b75a00/0xd6c4b8f05867f07f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1783134986.981631:0:8031:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967440 00000004:00010000:3.0:1783134986.981654:0:8031:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000ba703ebd reply state 0000000048afb468 transno 4294967441 ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b75a00/0xd6c4b8f05867f07f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783134986.981664:0:8031:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1783134986.981784:0:8031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9f6895500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+44:11396:x1869752373938688:12345-192.168.201.41@tcp:36:dd.0 Request processed in 714us (1365us total) trans 4294967441 rc 0/0 00000100:00100000:3.0:1783134986.981791:0:8031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 155 00000020:00080000:3.0:1783134986.981796:0:8031:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1783134986.986232:0:3272:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b75a00/0xd6c4b8f05867f07f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134986.986256:0:3272:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b75a00/0xd6c4b8f05867f07f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134986.986265:0:3272:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b75a00/0xd6c4b8f05867f07f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134986.986273:0:3272:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe9d2b75a00 already unused, calling callback (ffffffffc1f634f0) 00010000:00010000:0.0:1783134986.986339:0:3272:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b75a00/0xd6c4b8f05867f07f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134986.986351:0:3272:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b75a00/0xd6c4b8f05867f07f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134986.986373:0:3272:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9fe9cb8f4a00) 00010000:00010000:0.0:1783134986.986377:0:3272:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783134986.986383:0:3272:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b75a00/0xd6c4b8f05867f07f lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134986.986390:0:3272:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b75a00/0xd6c4b8f05867f07f lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783134987.169611:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:1.0:1783134987.169755:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373938816 00000100:00100000:1.0:1783134987.169770:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373938816 00000100:00100000:1.0:1783134987.169889:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 156 00000100:00100000:1.0:1783134987.169903:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9f6895c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+43:11410:x1869752373938816:12345-192.168.201.41@tcp:101:stat.0 00010000:00010000:1.0:1783134987.169942:0:5770:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783134987.169970:0:5770:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43f400/0xd6c4b8f05867f086 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4428da03f5eb73f4 expref: -99 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134987.170107:0:5770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43ec00/0xd6c4b8f05867f08d lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134987.170124:0:5770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43ec00/0xd6c4b8f05867f08d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134987.170137:0:5770:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43ec00/0xd6c4b8f05867f08d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134987.170154:0:5770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43f200/0xd6c4b8f05867f094 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134987.170161:0:5770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43f200/0xd6c4b8f05867f094 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134987.170170:0:5770:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43f200/0xd6c4b8f05867f094 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134987.170346:0:5770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43fe00/0xd6c4b8f05867f09b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134987.170368:0:5770:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828800/0xd6c4b8f05867f071 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb73ed expref: 44 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134987.170379:0:5770:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43fe00/0xd6c4b8f05867f09b lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134987.170439:0:5770:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828800/0xd6c4b8f05867f071 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb73ed expref: 44 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134987.170455:0:5770:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828800/0xd6c4b8f05867f071 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb73ed expref: 44 pid: 5771 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783134987.170474:0:5770:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9fe90dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5770:1869752384417280:192.168.201.41@tcp:104: 00000100:00100000:1.0:1783134987.170612:0:5770:0:(client.c:2701:ptlrpc_set_wait()) set ffff9fe9e0328d80 going to sleep for 11 seconds 00000100:00080000:2.0:1783134987.170837:0:5766:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1783134987.175124:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:1.0:1783134987.175340:0:5770:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9fe90dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5770:1869752384417280:192.168.201.41@tcp:104: 00010000:00010000:1.0:1783134987.175377:0:5770:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43fe00/0xd6c4b8f05867f09b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783134987.177813:0:5772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373939072 00000100:00100000:2.0:1783134987.177834:0:5772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373939072 00000100:00100000:2.0:1783134987.177927:0:5772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 43 00000100:00100000:2.0:1783134987.177941:0:5772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9f5ce1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+45:5572:x1869752373939072:12345-192.168.201.41@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1783134987.179953:0:5772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9f5ce1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+46:5572:x1869752373939072:12345-192.168.201.41@tcp:35:ldlm_bl.0 Request processed in 2002us (4832us total) trans 4294967442 rc 0/0 00000100:00100000:2.0:1783134987.179971:0:5772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 43 00000100:00100000:3.0:1783134987.184132:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:2.0:1783134987.184511:0:5755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373939200 00000100:00100000:2.0:1783134987.184525:0:5755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373939200 00010000:00010000:2.0:1783134987.184586:0:5755:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828800/0xd6c4b8f05867f071 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb73ed expref: 46 pid: 5771 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783134987.184637:0:5755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 67 00000100:00100000:2.0:1783134987.184650:0:5755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9f5ce2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+46:2369:x1869752373939200:12345-192.168.201.41@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783134987.184676:0:5755:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783134987.184703:0:5755:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828800/0xd6c4b8f05867f071 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb73ed expref: 46 pid: 5771 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134987.184829:0:5755:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828800/0xd6c4b8f05867f071 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb73ed expref: 46 pid: 5771 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134987.184859:0:5755:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828800/0xd6c4b8f05867f071 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb73ed expref: 46 pid: 5771 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134987.184884:0:5755:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9fe9cb8f4a00) 00010000:00010000:2.0:1783134987.184891:0:5755:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43fe00/0xd6c4b8f05867f09b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134987.184901:0:5755:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43fe00/0xd6c4b8f05867f09b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134987.184910:0:5755:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43fe00/0xd6c4b8f05867f09b lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134987.185006:0:5755:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783134987.185090:0:5755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9f5ce2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+45:2369:x1869752373939200:12345-192.168.201.41@tcp:103:ldlm_bl.0 Request processed in 441us (972us total) trans 0 rc 0/0 00000100:00100000:2.0:1783134987.185099:0:5755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 67 00010000:00010000:1.0:1783134987.186173:0:5770:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43fe00/0xd6c4b8f05867f09b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134987.186187:0:5770:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43fe00/0xd6c4b8f05867f09b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783134987.187785:0:5770:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:1.0:1783134987.187796:0:5770:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1783134987.187839:0:5770:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43fe00/0xd6c4b8f05867f09b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134987.187891:0:5770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43fe00/0xd6c4b8f05867f09b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134987.187906:0:5770:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43ec00/0xd6c4b8f05867f08d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134987.187914:0:5770:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43ec00/0xd6c4b8f05867f08d lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134987.187922:0:5770:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43ec00/0xd6c4b8f05867f08d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134987.187929:0:5770:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe9fe43ec00 already unused, calling callback (ffffffffc1f634f0) 00010000:00010000:1.0:1783134987.187935:0:5770:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43ec00/0xd6c4b8f05867f08d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134987.187945:0:5770:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43ec00/0xd6c4b8f05867f08d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134987.187964:0:5770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9fe9e1c2b700) 00010000:00010000:1.0:1783134987.187967:0:5770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783134987.187972:0:5770:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43ec00/0xd6c4b8f05867f08d lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134987.187980:0:5770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43ec00/0xd6c4b8f05867f08d lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134987.188000:0:5770:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43f200/0xd6c4b8f05867f094 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134987.188006:0:5770:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43f200/0xd6c4b8f05867f094 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134987.188021:0:5770:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43f200/0xd6c4b8f05867f094 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134987.188027:0:5770:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe9fe43f200 already unused, calling callback (ffffffffc1f634f0) 00010000:00010000:1.0:1783134987.188030:0:5770:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43f200/0xd6c4b8f05867f094 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134987.188520:0:5770:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43f200/0xd6c4b8f05867f094 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134987.188534:0:5770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9fe9e1c2b000) 00010000:00010000:1.0:1783134987.188537:0:5770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783134987.188541:0:5770:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43f200/0xd6c4b8f05867f094 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134987.188548:0:5770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43f200/0xd6c4b8f05867f094 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134987.188609:0:5770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43f400/0xd6c4b8f05867f086 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb73f4 expref: 45 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134987.188626:0:5770:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43fe00/0xd6c4b8f05867f09b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb73f4 expref: 44 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134987.188635:0:5770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9fe9cb8f4a00) 00010000:00010000:1.0:1783134987.188638:0:5770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1783134987.188641:0:5770:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fe9fe43fe00, rc 0) 00000100:00100000:1.0:1783134987.189791:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9f6895c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+44:11410:x1869752373938816:12345-192.168.201.41@tcp:101:stat.0 Request processed in 19882us (20186us total) trans 0 rc 0/0 00000100:00100000:1.0:1783134987.189824:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 156 00000100:00100000:3.0:1783134987.243990:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:0.0:1783134987.244206:0:5769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373939456 00000100:00100000:0.0:1783134987.244220:0:5769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373939456 00000100:00100000:0.0:1783134987.244310:0:5769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 157 00000100:00100000:0.0:1783134987.244338:0:5769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9f6fb7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+44:11416:x1869752373939456:12345-192.168.201.41@tcp:36:truncate.0 00010000:00010000:0.0:1783134987.244411:0:5769:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783134987.244508:0:5769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43fe00/0xd6c4b8f05867f09b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb73f4 expref: 44 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134987.244533:0:5769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9fe9cb8f4a00) 00010000:00010000:0.0:1783134987.244538:0:5769:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1783134987.244902:0:5769:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ad800/0xd6c4b8f05867f0a2 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134987.244918:0:5769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ad800/0xd6c4b8f05867f0a2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134987.244929:0:5769:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ad800/0xd6c4b8f05867f0a2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1783134987.244978:0:5769:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967443 00000004:00010000:0.0:1783134987.245000:0:5769:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000003e8ccf89 reply state 00000000f8fc8510 transno 4294967444 ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ad800/0xd6c4b8f05867f0a2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783134987.245009:0:5769:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1783134987.245503:0:5769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9f6fb7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+46:11416:x1869752373939456:12345-192.168.201.41@tcp:36:truncate.0 Request processed in 1165us (1526us total) trans 4294967444 rc 0/0 00000100:00100000:0.0:1783134987.245512:0:5769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 157 00000020:00080000:0.0:1783134987.245517:0:5769:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1783134987.246793:0:3273:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ad800/0xd6c4b8f05867f0a2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134987.246808:0:3273:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ad800/0xd6c4b8f05867f0a2 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134987.246816:0:3273:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ad800/0xd6c4b8f05867f0a2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134987.246822:0:3273:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe9f68ad800 already unused, calling callback (ffffffffc1f634f0) 00010000:00010000:1.0:1783134987.246828:0:3273:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ad800/0xd6c4b8f05867f0a2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134987.246837:0:3273:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ad800/0xd6c4b8f05867f0a2 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134987.246853:0:3273:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9fe9cb8f4a00) 00010000:00010000:1.0:1783134987.246856:0:3273:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783134987.246860:0:3273:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ad800/0xd6c4b8f05867f0a2 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134987.246867:0:3273:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ad800/0xd6c4b8f05867f0a2 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783134987.346941:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:0.0:1783134987.349202:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373939584 00000100:00100000:0.0:1783134987.349219:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373939584 00000100:00100000:0.0:1783134987.349324:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 158 00000100:00100000:0.0:1783134987.349338:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9f6fb5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+45:11430:x1869752373939584:12345-192.168.201.41@tcp:101:stat.0 00010000:00010000:0.0:1783134987.349390:0:5771:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783134987.349430:0:5771:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ac000/0xd6c4b8f05867f0a9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4428da03f5eb73fb expref: -99 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134987.349526:0:5771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ac200/0xd6c4b8f05867f0b0 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134987.349542:0:5771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ac200/0xd6c4b8f05867f0b0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134987.349554:0:5771:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ac200/0xd6c4b8f05867f0b0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134987.349569:0:5771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68aca00/0xd6c4b8f05867f0b7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134987.349575:0:5771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68aca00/0xd6c4b8f05867f0b7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134987.349582:0:5771:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68aca00/0xd6c4b8f05867f0b7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134987.349707:0:5771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ad400/0xd6c4b8f05867f0be lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134987.349716:0:5771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ad400/0xd6c4b8f05867f0be lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134987.349724:0:5771:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ad400/0xd6c4b8f05867f0be lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783134987.349772:0:5771:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 1234567 00000004:00200000:0.0:1783134987.349784:0:5771:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1783134987.349826:0:5771:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ad400/0xd6c4b8f05867f0be lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134987.349840:0:5771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ad400/0xd6c4b8f05867f0be lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134987.349850:0:5771:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ac200/0xd6c4b8f05867f0b0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134987.349857:0:5771:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ac200/0xd6c4b8f05867f0b0 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134987.349864:0:5771:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ac200/0xd6c4b8f05867f0b0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134987.349872:0:5771:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe9f68ac200 already unused, calling callback (ffffffffc1f634f0) 00010000:00010000:0.0:1783134987.349877:0:5771:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ac200/0xd6c4b8f05867f0b0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134987.349887:0:5771:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ac200/0xd6c4b8f05867f0b0 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134987.349902:0:5771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9fe9e1c2b700) 00010000:00010000:0.0:1783134987.349906:0:5771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783134987.349912:0:5771:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ac200/0xd6c4b8f05867f0b0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134987.349919:0:5771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ac200/0xd6c4b8f05867f0b0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134987.349936:0:5771:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68aca00/0xd6c4b8f05867f0b7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134987.349953:0:5771:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68aca00/0xd6c4b8f05867f0b7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134987.349959:0:5771:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68aca00/0xd6c4b8f05867f0b7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134987.349965:0:5771:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe9f68aca00 already unused, calling callback (ffffffffc1f634f0) 00010000:00010000:0.0:1783134987.349968:0:5771:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68aca00/0xd6c4b8f05867f0b7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134987.349976:0:5771:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68aca00/0xd6c4b8f05867f0b7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134987.350158:0:5771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9fe9c8301500) 00010000:00010000:0.0:1783134987.350161:0:5771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783134987.350164:0:5771:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68aca00/0xd6c4b8f05867f0b7 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134987.350171:0:5771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68aca00/0xd6c4b8f05867f0b7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134987.350209:0:5771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ac000/0xd6c4b8f05867f0a9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb73fb expref: 47 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134987.350223:0:5771:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ad400/0xd6c4b8f05867f0be lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb73fb expref: 46 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134987.350231:0:5771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9fe9cb8f4a00) 00010000:00010000:0.0:1783134987.350233:0:5771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1783134987.350241:0:5771:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fe9f68ad400, rc 0) 00000100:00100000:0.0:1783134987.350545:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9f6fb5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+46:11430:x1869752373939584:12345-192.168.201.41@tcp:101:stat.0 Request processed in 1208us (3615us total) trans 0 rc 0/0 00000100:00100000:0.0:1783134987.350554:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 158 00000100:00100000:0.0:1783134987.392590:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:3.0:1783134987.392703:0:8031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373939840 00000100:00100000:3.0:1783134987.392717:0:8031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373939840 00000100:00100000:3.0:1783134987.392790:0:8031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 159 00000100:00100000:3.0:1783134987.392804:0:8031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9f6896300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+46:11440:x1869752373939840:12345-192.168.201.41@tcp:101:lfs.0 00010000:00010000:3.0:1783134987.392831:0:8031:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783134987.392857:0:8031:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b74c00/0xd6c4b8f05867f0c5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4428da03f5eb7402 expref: -99 pid: 8031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783134987.393576:0:8031:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00010000:00010000:3.0:1783134987.393745:0:8031:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b74c00/0xd6c4b8f05867f0c5 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb7402 expref: 48 pid: 8031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134987.393784:0:8031:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fe9e1c2b400) 00010000:00010000:3.0:1783134987.393787:0:8031:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1783134987.393793:0:8031:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b74c00/0xd6c4b8f05867f0c5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb7402 expref: 48 pid: 8031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134987.393809:0:8031:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fe9d2b74c00, rc 0) 00000100:00100000:3.0:1783134987.393903:0:8031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9f6896300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+47:11440:x1869752373939840:12345-192.168.201.41@tcp:101:lfs.0 Request processed in 1102us (1328us total) trans 4294967445 rc 301/301 00000100:00100000:3.0:1783134987.393911:0:8031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 159 00000100:00100000:3.0:1783134987.397667:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:1.0:1783134987.397748:0:5773:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373940096 00000100:00100000:1.0:1783134987.397761:0:5773:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373940096 00000100:00100000:1.0:1783134987.397832:0:5773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 44 00000100:00100000:1.0:1783134987.397845:0:5773:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9e0bf6450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+47:11440:x1869752373940096:12345-192.168.201.41@tcp:35:lfs.0 00000100:00100000:1.0:1783134987.398182:0:5773:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9e0bf6450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+48:11440:x1869752373940096:12345-192.168.201.41@tcp:35:lfs.0 Request processed in 338us (524us total) trans 4294967446 rc 0/0 00000100:00100000:1.0:1783134987.398202:0:5773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 44 00000100:00100000:0.0:1783134987.443262:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:2.0:1783134987.443389:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373940352 00000100:00100000:2.0:1783134987.443399:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373940352 00000100:00100000:2.0:1783134987.443489:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 160 00000100:00100000:2.0:1783134987.443501:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9f6896a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+48:11446:x1869752373940352:12345-192.168.201.41@tcp:101:bash.0 00010000:00010000:2.0:1783134987.443535:0:5771:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783134987.443561:0:5771:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828800/0xd6c4b8f05867f0d3 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4428da03f5eb7409 expref: -99 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134987.443726:0:5771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829a00/0xd6c4b8f05867f0da lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134987.443745:0:5771:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ad400/0xd6c4b8f05867f0be lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb73fb expref: 49 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134987.443756:0:5771:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829a00/0xd6c4b8f05867f0da lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134987.443805:0:5771:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ad400/0xd6c4b8f05867f0be lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb73fb expref: 49 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134987.443821:0:5771:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ad400/0xd6c4b8f05867f0be lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb73fb expref: 49 pid: 5771 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783134987.443840:0:5771:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9f68f5f80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5771:1869752384417408:192.168.201.41@tcp:104: 00000100:00100000:2.0:1783134987.444124:0:5771:0:(client.c:2701:ptlrpc_set_wait()) set ffff9fe9fe46c780 going to sleep for 11 seconds 00000100:00100000:0.0:1783134987.446530:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:3.0:1783134987.446749:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373940480 00000100:00100000:3.0:1783134987.446759:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373940480 00010000:00010000:3.0:1783134987.446807:0:6592:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ad400/0xd6c4b8f05867f0be lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb73fb expref: 50 pid: 5771 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783134987.446853:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 68 00000100:00100000:3.0:1783134987.446864:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9f6894a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+50:2369:x1869752373940480:12345-192.168.201.41@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783134987.446884:0:6592:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783134987.446892:0:6592:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ad400/0xd6c4b8f05867f0be lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb73fb expref: 50 pid: 5771 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134987.446906:0:6592:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ad400/0xd6c4b8f05867f0be lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb73fb expref: 50 pid: 5771 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134987.446935:0:6592:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9fe9cb8f4a00) 00010000:00010000:3.0:1783134987.446953:0:6592:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829a00/0xd6c4b8f05867f0da lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134987.446964:0:6592:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829a00/0xd6c4b8f05867f0da lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134987.446973:0:6592:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829a00/0xd6c4b8f05867f0da lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134987.446997:0:6592:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783134987.447084:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9f6894a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+50:2369:x1869752373940480:12345-192.168.201.41@tcp:103:ldlm_bl.0 Request processed in 213us (557us total) trans 0 rc 0/0 00000100:00100000:3.0:1783134987.447093:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 68 00010000:00010000:2.0:1783134987.449718:0:5771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ad400/0xd6c4b8f05867f0be lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb73fb expref: 49 pid: 5771 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783134987.449751:0:5771:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9f68f5f80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5771:1869752384417408:192.168.201.41@tcp:104: 00010000:00010000:2.0:1783134987.449785:0:5771:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829a00/0xd6c4b8f05867f0da lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134987.449796:0:5771:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829a00/0xd6c4b8f05867f0da lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134987.449826:0:5771:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829a00/0xd6c4b8f05867f0da lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783134987.449854:0:5771:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 1234567 00010000:00010000:2.0:1783134987.450069:0:5771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828800/0xd6c4b8f05867f0d3 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb7409 expref: 50 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134987.450737:0:5771:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829a00/0xd6c4b8f05867f0da lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb7409 expref: 49 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134987.450748:0:5771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9fe9cb8f4a00) 00010000:00010000:2.0:1783134987.450751:0:5771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1783134987.450755:0:5771:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fe9c7829a00, rc 0) 00000100:00100000:2.0:1783134987.450841:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9f6896a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+49:11446:x1869752373940352:12345-192.168.201.41@tcp:101:bash.0 Request processed in 7341us (7590us total) trans 4294967447 rc 0/0 00000100:00100000:2.0:1783134987.450852:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 160 00000100:00100000:0.0:1783134987.455408:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:2.0:1783134987.455544:0:5769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373940736 00000100:00100000:2.0:1783134987.455557:0:5769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373940736 00000100:00100000:2.0:1783134987.455785:0:5769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 161 00000100:00100000:2.0:1783134987.455799:0:5769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9f6894380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+49:11446:x1869752373940736:12345-192.168.201.41@tcp:36:bash.0 00010000:00010000:2.0:1783134987.456430:0:5769:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828200/0xd6c4b8f05867f0e8 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134987.456453:0:5769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828200/0xd6c4b8f05867f0e8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134987.456468:0:5769:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828200/0xd6c4b8f05867f0e8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1783134987.456541:0:5769:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967448 00000004:00010000:2.0:1783134987.456569:0:5769:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000261dba12 reply state 00000000cce98f06 transno 4294967449 ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828200/0xd6c4b8f05867f0e8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783134987.456580:0:5769:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1783134987.456869:0:5769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9f6894380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+52:11446:x1869752373940736:12345-192.168.201.41@tcp:36:bash.0 Request processed in 1072us (1475us total) trans 4294967449 rc 0/0 00000100:00100000:2.0:1783134987.456875:0:5769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 161 00000020:00080000:2.0:1783134987.456880:0:5769:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1783134987.458246:0:3272:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828200/0xd6c4b8f05867f0e8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134987.458260:0:3272:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828200/0xd6c4b8f05867f0e8 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134987.458269:0:3272:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828200/0xd6c4b8f05867f0e8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134987.458276:0:3272:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe9c7828200 already unused, calling callback (ffffffffc1f634f0) 00010000:00010000:3.0:1783134987.458309:0:3272:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828200/0xd6c4b8f05867f0e8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134987.458318:0:3272:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828200/0xd6c4b8f05867f0e8 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134987.458337:0:3272:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9fe9cb8f4a00) 00010000:00010000:3.0:1783134987.458339:0:3272:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783134987.458344:0:3272:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828200/0xd6c4b8f05867f0e8 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134987.458360:0:3272:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828200/0xd6c4b8f05867f0e8 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783134987.463141:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:1.0:1783134987.463332:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373940864 00000100:00100000:1.0:1783134987.463345:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373940864 00000100:00100000:1.0:1783134987.463435:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 162 00000100:00100000:1.0:1783134987.463449:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9f6897100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+51:11446:x1869752373940864:12345-192.168.201.41@tcp:101:bash.0 00010000:00010000:1.0:1783134987.463484:0:5770:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783134987.463512:0:5770:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43ec00/0xd6c4b8f05867f0ef lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4428da03f5eb7410 expref: -99 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134987.463628:0:5770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43f600/0xd6c4b8f05867f0f6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134987.463647:0:5770:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829a00/0xd6c4b8f05867f0da lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb7409 expref: 52 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134987.463657:0:5770:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43f600/0xd6c4b8f05867f0f6 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134987.463705:0:5770:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829a00/0xd6c4b8f05867f0da lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb7409 expref: 52 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134987.463735:0:5770:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829a00/0xd6c4b8f05867f0da lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb7409 expref: 52 pid: 5771 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783134987.463753:0:5770:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9fe90dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5770:1869752384417536:192.168.201.41@tcp:104: 00000100:00100000:1.0:1783134987.463859:0:5770:0:(client.c:2701:ptlrpc_set_wait()) set ffff9fe9e0328900 going to sleep for 11 seconds 00000100:00100000:0.0:1783134987.465824:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:1.0:1783134987.465875:0:5770:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9fe90dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5770:1869752384417536:192.168.201.41@tcp:104: 00010000:00010000:1.0:1783134987.465928:0:5770:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43f600/0xd6c4b8f05867f0f6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783134987.465960:0:5756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373940992 00000100:00100000:3.0:1783134987.465968:0:5756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373940992 00010000:00010000:3.0:1783134987.466006:0:5756:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829a00/0xd6c4b8f05867f0da lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb7409 expref: 53 pid: 5771 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783134987.466047:0:5756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 69 00000100:00100000:3.0:1783134987.466055:0:5756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9f6897b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+53:2369:x1869752373940992:12345-192.168.201.41@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783134987.466069:0:5756:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783134987.466082:0:5756:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829a00/0xd6c4b8f05867f0da lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb7409 expref: 53 pid: 5771 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134987.466092:0:5756:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829a00/0xd6c4b8f05867f0da lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb7409 expref: 53 pid: 5771 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134987.466112:0:5756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829a00/0xd6c4b8f05867f0da lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb7409 expref: 53 pid: 5771 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134987.466128:0:5756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9fe9cb8f4a00) 00010000:00010000:3.0:1783134987.466132:0:5756:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43f600/0xd6c4b8f05867f0f6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134987.466139:0:5756:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43f600/0xd6c4b8f05867f0f6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134987.466144:0:5756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43f600/0xd6c4b8f05867f0f6 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134987.466170:0:5756:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1783134987.466202:0:5770:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43f600/0xd6c4b8f05867f0f6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134987.466212:0:5770:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43f600/0xd6c4b8f05867f0f6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783134987.466253:0:5756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9f6897b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+52:2369:x1869752373940992:12345-192.168.201.41@tcp:103:ldlm_bl.0 Request processed in 196us (435us total) trans 0 rc 0/0 00000100:00100000:3.0:1783134987.466262:0:5756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 69 00000004:00200000:1.0:1783134987.466272:0:5770:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:1.0:1783134987.466304:0:5770:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1783134987.466333:0:5770:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43f600/0xd6c4b8f05867f0f6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134987.466368:0:5770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43ec00/0xd6c4b8f05867f0ef lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb7410 expref: 52 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134987.466385:0:5770:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43f600/0xd6c4b8f05867f0f6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb7410 expref: 51 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134987.466393:0:5770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9fe9cb8f4a00) 00010000:00010000:1.0:1783134987.466396:0:5770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1783134987.466399:0:5770:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fe9fe43f600, rc 0) 00000100:00100000:1.0:1783134987.466510:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9f6897100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+51:11446:x1869752373940864:12345-192.168.201.41@tcp:101:bash.0 Request processed in 3063us (3380us total) trans 0 rc 0/0 00000100:00100000:1.0:1783134987.466518:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 162 00000100:00100000:3.0:1783134987.472754:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:1.0:1783134987.472829:0:5773:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373941248 00000100:00100000:1.0:1783134987.472841:0:5773:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373941248 00000100:00100000:1.0:1783134987.472917:0:5773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 45 00000100:00100000:1.0:1783134987.472931:0:5773:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9f6fb6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+51:11446:x1869752373941248:12345-192.168.201.41@tcp:35:bash.0 00000100:00100000:1.0:1783134987.473268:0:5773:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9f6fb6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+52:11446:x1869752373941248:12345-192.168.201.41@tcp:35:bash.0 Request processed in 339us (527us total) trans 4294967450 rc 0/0 00000100:00100000:1.0:1783134987.473276:0:5773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 45 00010000:00010000:0.0:1783134987.524370:0:5758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783134987.536962:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:3.0:1783134987.537276:0:8031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373941504 00000100:00100000:3.0:1783134987.537379:0:8031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373941504 00000100:00100000:3.0:1783134987.537490:0:8031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 163 00000100:00100000:3.0:1783134987.537505:0:8031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9f6895f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+52:11456:x1869752373941504:12345-192.168.201.41@tcp:101:lfs.0 00010000:00010000:3.0:1783134987.537536:0:8031:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783134987.537562:0:8031:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b74c00/0xd6c4b8f05867f0fd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4428da03f5eb7417 expref: -99 pid: 8031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783134987.537717:0:8031:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00010000:00010000:3.0:1783134987.537876:0:8031:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b74c00/0xd6c4b8f05867f0fd lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb7417 expref: 54 pid: 8031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134987.537895:0:8031:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fe9e1c2b400) 00010000:00010000:3.0:1783134987.537898:0:8031:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1783134987.537905:0:8031:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b74c00/0xd6c4b8f05867f0fd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb7417 expref: 54 pid: 8031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134987.537922:0:8031:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fe9d2b74c00, rc 0) 00000100:00100000:3.0:1783134987.538206:0:8031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9f6895f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+53:11456:x1869752373941504:12345-192.168.201.41@tcp:101:lfs.0 Request processed in 704us (1257us total) trans 4294967451 rc 301/301 00000100:00100000:3.0:1783134987.538214:0:8031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 163 00000100:00100000:0.0:1783134987.540622:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:2.0:1783134987.540693:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373941632 00000100:00100000:2.0:1783134987.540706:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373941632 00000100:00100000:2.0:1783134987.540865:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 164 00000100:00100000:2.0:1783134987.540876:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9f6fe6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+53:11456:x1869752373941632:12345-192.168.201.41@tcp:34:lfs.0 00010000:00010000:2.0:1783134987.540975:0:5771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828800/0xd6c4b8f05867f10b lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134987.540997:0:5771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828800/0xd6c4b8f05867f10b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134987.541011:0:5771:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828800/0xd6c4b8f05867f10b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134987.541030:0:5771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829a00/0xd6c4b8f05867f112 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134987.541037:0:5771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829a00/0xd6c4b8f05867f112 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134987.541044:0:5771:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829a00/0xd6c4b8f05867f112 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134987.541404:0:5771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828200/0xd6c4b8f05867f119 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134987.541426:0:5771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828200/0xd6c4b8f05867f119 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134987.541434:0:5771:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828200/0xd6c4b8f05867f119 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1783134987.541485:0:5771:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828200/0xd6c4b8f05867f119 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134987.541499:0:5771:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828800/0xd6c4b8f05867f10b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134987.541577:0:5771:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828800/0xd6c4b8f05867f10b lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134987.541586:0:5771:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828800/0xd6c4b8f05867f10b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134987.541593:0:5771:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe9c7828800 already unused, calling callback (ffffffffc1f634f0) 00010000:00010000:2.0:1783134987.541598:0:5771:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828800/0xd6c4b8f05867f10b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134987.541606:0:5771:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828800/0xd6c4b8f05867f10b lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134987.541621:0:5771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9fe9e1c2b700) 00010000:00010000:2.0:1783134987.541624:0:5771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783134987.541629:0:5771:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828800/0xd6c4b8f05867f10b lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134987.541643:0:5771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828800/0xd6c4b8f05867f10b lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134987.541661:0:5771:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829a00/0xd6c4b8f05867f112 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134987.541668:0:5771:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829a00/0xd6c4b8f05867f112 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134987.541674:0:5771:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829a00/0xd6c4b8f05867f112 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134987.541961:0:5771:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe9c7829a00 already unused, calling callback (ffffffffc1f634f0) 00010000:00010000:2.0:1783134987.541964:0:5771:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829a00/0xd6c4b8f05867f112 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134987.541971:0:5771:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829a00/0xd6c4b8f05867f112 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134987.541979:0:5771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9fe9cc3c1a00) 00010000:00010000:2.0:1783134987.541982:0:5771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783134987.541985:0:5771:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829a00/0xd6c4b8f05867f112 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134987.541991:0:5771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829a00/0xd6c4b8f05867f112 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134987.542007:0:5771:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828200/0xd6c4b8f05867f119 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134987.542013:0:5771:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828200/0xd6c4b8f05867f119 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134987.542024:0:5771:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828200/0xd6c4b8f05867f119 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134987.542029:0:5771:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe9c7828200 already unused, calling callback (ffffffffc1f634f0) 00010000:00010000:2.0:1783134987.542031:0:5771:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828200/0xd6c4b8f05867f119 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134987.542037:0:5771:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828200/0xd6c4b8f05867f119 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134987.542044:0:5771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9fe9cb8f4a00) 00010000:00010000:2.0:1783134987.542047:0:5771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783134987.542050:0:5771:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828200/0xd6c4b8f05867f119 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134987.542056:0:5771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828200/0xd6c4b8f05867f119 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783134987.542262:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9f6fe6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+53:11456:x1869752373941632:12345-192.168.201.41@tcp:34:lfs.0 Request processed in 1385us (1647us total) trans 0 rc 0/0 00000100:00100000:2.0:1783134987.542271:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 164 00000100:00100000:1.0:1783134987.545769:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:2.0:1783134987.545953:0:5772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373941888 00000100:00100000:2.0:1783134987.545966:0:5772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373941888 00000100:00100000:2.0:1783134987.546037:0:5772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 46 00000100:00100000:2.0:1783134987.546048:0:5772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fe90dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+53:11456:x1869752373941888:12345-192.168.201.41@tcp:35:lfs.0 00000100:00100000:2.0:1783134987.546428:0:5772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fe90dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+54:11456:x1869752373941888:12345-192.168.201.41@tcp:35:lfs.0 Request processed in 369us (660us total) trans 4294967452 rc 0/0 00000100:00100000:2.0:1783134987.546435:0:5772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 46 00000100:00100000:0.0:1783134987.575610:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:2.0:1783134987.575714:0:5769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373942144 00000100:00100000:2.0:1783134987.575727:0:5769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373942144 00000100:00100000:2.0:1783134987.575798:0:5769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 165 00000100:00100000:2.0:1783134987.575808:0:5769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9f6fe7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+54:11459:x1869752373942144:12345-192.168.201.41@tcp:101:lfs.0 00010000:00010000:2.0:1783134987.575837:0:5769:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783134987.575859:0:5769:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828200/0xd6c4b8f05867f120 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4428da03f5eb741e expref: -99 pid: 5769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134987.575965:0:5769:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829a00/0xd6c4b8f05867f127 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134987.575979:0:5769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829a00/0xd6c4b8f05867f127 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134987.575989:0:5769:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829a00/0xd6c4b8f05867f127 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134987.575999:0:5769:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828800/0xd6c4b8f05867f12e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134987.576004:0:5769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828800/0xd6c4b8f05867f12e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134987.576008:0:5769:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828800/0xd6c4b8f05867f12e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134987.576166:0:5769:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829e00/0xd6c4b8f05867f135 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134987.576175:0:5769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829e00/0xd6c4b8f05867f135 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134987.576193:0:5769:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829e00/0xd6c4b8f05867f135 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783134987.576203:0:5769:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:2.0:1783134987.576328:0:5769:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829a00/0xd6c4b8f05867f127 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134987.576334:0:5769:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829a00/0xd6c4b8f05867f127 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134987.576339:0:5769:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829a00/0xd6c4b8f05867f127 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134987.576343:0:5769:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe9c7829a00 already unused, calling callback (ffffffffc1f634f0) 00010000:00010000:2.0:1783134987.576347:0:5769:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829a00/0xd6c4b8f05867f127 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134987.576352:0:5769:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829a00/0xd6c4b8f05867f127 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134987.576362:0:5769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9fe9e1c2b700) 00010000:00010000:2.0:1783134987.576365:0:5769:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783134987.576368:0:5769:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829a00/0xd6c4b8f05867f127 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134987.576371:0:5769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829a00/0xd6c4b8f05867f127 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134987.576382:0:5769:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828800/0xd6c4b8f05867f12e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134987.576386:0:5769:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828800/0xd6c4b8f05867f12e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134987.576394:0:5769:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828800/0xd6c4b8f05867f12e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134987.576397:0:5769:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe9c7828800 already unused, calling callback (ffffffffc1f634f0) 00010000:00010000:2.0:1783134987.576399:0:5769:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828800/0xd6c4b8f05867f12e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134987.576402:0:5769:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828800/0xd6c4b8f05867f12e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134987.576406:0:5769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9fe9cc3c1a00) 00010000:00010000:2.0:1783134987.576407:0:5769:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783134987.576409:0:5769:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828800/0xd6c4b8f05867f12e lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134987.576423:0:5769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828800/0xd6c4b8f05867f12e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134987.576460:0:5769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828200/0xd6c4b8f05867f120 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb741e expref: 57 pid: 5769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134987.576470:0:5769:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829e00/0xd6c4b8f05867f135 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb741e expref: 56 pid: 5769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134987.576475:0:5769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9fe9cb8f4a00) 00010000:00010000:2.0:1783134987.576476:0:5769:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1783134987.576478:0:5769:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fe9c7829e00, rc 0) 00000100:00100000:2.0:1783134987.576539:0:5769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9f6fe7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+56:11459:x1869752373942144:12345-192.168.201.41@tcp:101:lfs.0 Request processed in 733us (945us total) trans 4294967453 rc 0/0 00000100:00100000:2.0:1783134987.576552:0:5769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 165 00000100:00100000:0.0:1783134987.579522:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:0.0:1783134987.579563:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:1.0:1783134987.579618:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373942272 00000100:00100000:1.0:1783134987.579628:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373942272 00000100:00100000:1.0:1783134987.579684:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 166 00000100:00100000:1.0:1783134987.579692:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9f6fe5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+56:11459:x1869752373942272:12345-192.168.201.41@tcp:54:lfs.0 00010000:00010000:1.0:1783134987.579760:0:5770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43e400/0xd6c4b8f05867f143 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134987.579776:0:5770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43e400/0xd6c4b8f05867f143 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134987.579785:0:5770:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43e400/0xd6c4b8f05867f143 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134987.579808:0:5770:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43e400/0xd6c4b8f05867f143 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134987.579813:0:5770:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43e400/0xd6c4b8f05867f143 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134987.579818:0:5770:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43e400/0xd6c4b8f05867f143 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134987.579822:0:5770:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe9fe43e400 already unused, calling callback (ffffffffc1f634f0) 00010000:00010000:1.0:1783134987.579825:0:5770:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43e400/0xd6c4b8f05867f143 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134987.579846:0:5770:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43e400/0xd6c4b8f05867f143 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134987.579857:0:5770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9fe9cb8f4a00) 00010000:00010000:1.0:1783134987.579859:0:5770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1783134987.579862:0:5770:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43e400/0xd6c4b8f05867f143 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134987.579867:0:5770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43e400/0xd6c4b8f05867f143 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783134987.579942:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9f6fe5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+56:11459:x1869752373942272:12345-192.168.201.41@tcp:54:lfs.0 Request processed in 251us (432us total) trans 0 rc 0/0 00000100:00100000:1.0:1783134987.579947:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 166 00000100:00100000:3.0:1783134987.580116:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373942400 00000100:00100000:3.0:1783134987.580121:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373942400 00000100:00100000:3.0:1783134987.580165:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 12 00000100:00100000:3.0:1783134987.580173:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9f6fe6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+56:2370:x1869752373942400:12345-192.168.201.41@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783134987.580185:0:6592:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783134987.580201:0:6592:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829e00/0xd6c4b8f05867f135 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb741e expref: 56 pid: 5769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134987.580215:0:6592:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9fe9cb8f4a00) 00010000:00010000:3.0:1783134987.580219:0:6592:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783134987.580249:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9f6fe6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+55:2370:x1869752373942400:12345-192.168.201.41@tcp:103:ldlm_bl.0 Request processed in 77us (685us total) trans 0 rc 0/0 00000100:00100000:3.0:1783134987.580256:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 12 00000100:00100000:0.0:1783134987.581870:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:1.0:1783134987.582022:0:5773:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373942656 00000100:00100000:1.0:1783134987.582032:0:5773:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373942656 00000100:00100000:1.0:1783134987.582132:0:5773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 47 00000100:00100000:1.0:1783134987.582142:0:5773:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9f6883480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+55:11459:x1869752373942656:12345-192.168.201.41@tcp:35:lfs.0 00000100:00100000:1.0:1783134987.582637:0:5773:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9f6883480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+56:11459:x1869752373942656:12345-192.168.201.41@tcp:35:lfs.0 Request processed in 496us (772us total) trans 4294967454 rc 0/0 00000100:00100000:1.0:1783134987.582643:0:5773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 47 00000100:00100000:1.0:1783134987.682712:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:3.0:1783134987.682837:0:8031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373942912 00000100:00100000:3.0:1783134987.682848:0:8031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373942912 00000100:00100000:3.0:1783134987.682908:0:8031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 167 00000100:00100000:3.0:1783134987.682917:0:8031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fe90d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+56:11477:x1869752373942912:12345-192.168.201.41@tcp:101:cat.0 00010000:00010000:3.0:1783134987.682943:0:8031:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783134987.682964:0:8031:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b74c00/0xd6c4b8f05867f14a lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4428da03f5eb7425 expref: -99 pid: 8031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134987.683091:0:8031:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b75000/0xd6c4b8f05867f151 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134987.683106:0:8031:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b75000/0xd6c4b8f05867f151 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134987.683118:0:8031:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b75000/0xd6c4b8f05867f151 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783134987.683143:0:8031:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:3.0:1783134987.683325:0:8031:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b74c00/0xd6c4b8f05867f14a lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb7425 expref: 59 pid: 8031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134987.683346:0:8031:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b75000/0xd6c4b8f05867f151 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb7425 expref: 58 pid: 8031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134987.683356:0:8031:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9fe9cb8f4a00) 00010000:00010000:3.0:1783134987.683358:0:8031:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1783134987.683362:0:8031:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fe9d2b75000, rc 0) 00000100:00100000:3.0:1783134987.683439:0:8031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fe90d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+58:11477:x1869752373942912:12345-192.168.201.41@tcp:101:cat.0 Request processed in 522us (737us total) trans 4294967455 rc 0/0 00000100:00100000:3.0:1783134987.683451:0:8031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 167 00000100:00100000:0.0:1783134987.713147:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:2.0:1783134987.713554:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373943040 00000100:00100000:2.0:1783134987.713567:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373943040 00000100:00100000:2.0:1783134987.713716:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 168 00000100:00100000:2.0:1783134987.713730:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9f6883100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+58:11478:x1869752373943040:12345-192.168.201.41@tcp:101:lfs.0 00010000:00010000:2.0:1783134987.713772:0:5771:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783134987.713799:0:5771:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828200/0xd6c4b8f05867f15f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4428da03f5eb742c expref: -99 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134987.713887:0:5771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828800/0xd6c4b8f05867f166 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134987.713904:0:5771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828800/0xd6c4b8f05867f166 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134987.713916:0:5771:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828800/0xd6c4b8f05867f166 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783134987.713993:0:5771:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00000004:00200000:2.0:1783134987.713998:0:5771:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:2.0:1783134987.714028:0:5771:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828800/0xd6c4b8f05867f166 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134987.714196:0:5771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828200/0xd6c4b8f05867f15f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb742c expref: 60 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134987.714222:0:5771:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828800/0xd6c4b8f05867f166 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb742c expref: 59 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134987.714250:0:5771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9fe9e1c2b700) 00010000:00010000:2.0:1783134987.714253:0:5771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1783134987.714257:0:5771:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fe9c7828800, rc 0) 00000100:00100000:2.0:1783134987.714396:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9f6883100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+59:11478:x1869752373943040:12345-192.168.201.41@tcp:101:lfs.0 Request processed in 669us (1264us total) trans 0 rc 0/0 00000100:00100000:2.0:1783134987.714404:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 168 00000100:00100000:0.0:1783134987.719663:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:3.0:1783134987.719987:0:5772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373943424 00000100:00100000:3.0:1783134987.720000:0:5772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373943424 00000100:00100000:3.0:1783134987.720084:0:5772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 48 00000100:00100000:3.0:1783134987.720094:0:5772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9f6880e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+59:11478:x1869752373943424:12345-192.168.201.41@tcp:35:lfs.0 00000100:00100000:3.0:1783134987.720723:0:5772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9f6880e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+60:11478:x1869752373943424:12345-192.168.201.41@tcp:35:lfs.0 Request processed in 627us (1074us total) trans 4294967456 rc 0/0 00000100:00100000:3.0:1783134987.720732:0:5772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 48 00000100:00100000:0.0:1783134987.723646:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:3.0:1783134987.723862:0:5756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373943552 00000100:00100000:3.0:1783134987.723874:0:5756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373943552 00000100:00100000:3.0:1783134987.723997:0:5756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 13 00000100:00100000:3.0:1783134987.724010:0:5756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9d1621c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+60:11478:x1869752373943552:12345-192.168.201.41@tcp:103:lfs.0 00010000:00010000:3.0:1783134987.724032:0:5756:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1783134987.724142:0:5756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43f600/0xd6c4b8f05867f0f6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb7410 expref: 60 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134987.724167:0:5756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b75000/0xd6c4b8f05867f151 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb7425 expref: 59 pid: 8031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134987.724181:0:5756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b74e00/0xd6c4b8f05867f001 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb73d1 expref: 58 pid: 8031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134987.724191:0:5756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9fe9cb8f4a00) 00010000:00010000:3.0:1783134987.724206:0:5756:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783134987.724586:0:5756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9d1621c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+57:11478:x1869752373943552:12345-192.168.201.41@tcp:103:lfs.0 Request processed in 575us (950us total) trans 0 rc 0/0 00000100:00100000:3.0:1783134987.724595:0:5756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 13 00000100:00100000:0.0:1783134987.726872:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:2.0:1783134987.726986:0:5769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373943680 00000100:00100000:2.0:1783134987.726998:0:5769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373943680 00000100:00100000:2.0:1783134987.727158:0:5769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 169 00000100:00100000:2.0:1783134987.727170:0:5769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9f6883800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+57:11478:x1869752373943680:12345-192.168.201.41@tcp:58:lfs.0 00010000:00010000:2.0:1783134987.727334:0:5769:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828200/0xd6c4b8f05867f16d lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134987.727355:0:5769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828200/0xd6c4b8f05867f16d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134987.727370:0:5769:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828200/0xd6c4b8f05867f16d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1783134987.727844:0:5769:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].4, 136 off8736 00000100:00100000:2.0:1783134987.728013:0:5769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9f6883800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+57:11478:x1869752373943680:12345-192.168.201.41@tcp:58:lfs.0 Request processed in 844us (1151us total) trans 0 rc 0/0 00000100:00100000:2.0:1783134987.728022:0:5769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 169 00000100:00100000:0.0:1783134987.753830:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:1.0:1783134987.754002:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373943808 00000100:00100000:1.0:1783134987.754014:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373943808 00000100:00100000:1.0:1783134987.754082:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 170 00000100:00100000:1.0:1783134987.754091:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9f6880380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+57:11480:x1869752373943808:12345-192.168.201.41@tcp:101:lfs.0 00010000:00010000:1.0:1783134987.754113:0:5770:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783134987.754152:0:5770:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43e400/0xd6c4b8f05867f174 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4428da03f5eb7433 expref: -99 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134987.754223:0:5770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43f200/0xd6c4b8f05867f17b lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134987.754236:0:5770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43f200/0xd6c4b8f05867f17b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134987.754245:0:5770:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43f200/0xd6c4b8f05867f17b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134987.754256:0:5770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43f400/0xd6c4b8f05867f182 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134987.754260:0:5770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43f400/0xd6c4b8f05867f182 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134987.754263:0:5770:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43f400/0xd6c4b8f05867f182 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134987.754402:0:5770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43fe00/0xd6c4b8f05867f189 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134987.754408:0:5770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43fe00/0xd6c4b8f05867f189 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134987.754424:0:5770:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43fe00/0xd6c4b8f05867f189 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783134987.754488:0:5770:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:1.0:1783134987.754494:0:5770:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1783134987.754518:0:5770:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43fe00/0xd6c4b8f05867f189 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134987.754540:0:5770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43fe00/0xd6c4b8f05867f189 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134987.754549:0:5770:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43f200/0xd6c4b8f05867f17b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134987.754555:0:5770:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43f200/0xd6c4b8f05867f17b lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134987.754561:0:5770:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43f200/0xd6c4b8f05867f17b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134987.754568:0:5770:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe9fe43f200 already unused, calling callback (ffffffffc1f634f0) 00010000:00010000:1.0:1783134987.754572:0:5770:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43f200/0xd6c4b8f05867f17b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134987.754580:0:5770:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43f200/0xd6c4b8f05867f17b lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134987.754600:0:5770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9fe9e1c2b700) 00010000:00010000:1.0:1783134987.754604:0:5770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783134987.754610:0:5770:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43f200/0xd6c4b8f05867f17b lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134987.754616:0:5770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43f200/0xd6c4b8f05867f17b lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134987.754632:0:5770:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43f400/0xd6c4b8f05867f182 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134987.754638:0:5770:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43f400/0xd6c4b8f05867f182 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134987.754650:0:5770:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43f400/0xd6c4b8f05867f182 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134987.754655:0:5770:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe9fe43f400 already unused, calling callback (ffffffffc1f634f0) 00010000:00010000:1.0:1783134987.754658:0:5770:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43f400/0xd6c4b8f05867f182 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134987.754664:0:5770:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43f400/0xd6c4b8f05867f182 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134987.754672:0:5770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9fe9e1c2b000) 00010000:00010000:1.0:1783134987.754675:0:5770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783134987.754677:0:5770:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43f400/0xd6c4b8f05867f182 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134987.754683:0:5770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43f400/0xd6c4b8f05867f182 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134987.754721:0:5770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43e400/0xd6c4b8f05867f174 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb7433 expref: 59 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134987.754747:0:5770:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43fe00/0xd6c4b8f05867f189 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb7433 expref: 58 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134987.754755:0:5770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9fe9cc3c1a00) 00010000:00010000:1.0:1783134987.754757:0:5770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1783134987.754760:0:5770:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fe9fe43fe00, rc 0) 00000100:00100000:1.0:1783134987.754833:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9f6880380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+58:11480:x1869752373943808:12345-192.168.201.41@tcp:101:lfs.0 Request processed in 742us (1018us total) trans 0 rc 0/0 00000100:00100000:1.0:1783134987.754850:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 170 00000040:00080000:0.0:1783134988.292566:0:11499:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1783134988.292582:0:11499:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1783134988.292634:0:11499:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 5 00000040:00080000:0.0:1783134988.292643:0:11499:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1783134988.292811:0:11499:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9f6882d80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11499:1869752384417664:192.168.201.41@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1783134988.292952:0:11499:0:(client.c:2701:ptlrpc_set_wait()) set ffff9fe9ea79c6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783134988.299053:0:11499:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9f6882d80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11499:1869752384417664:192.168.201.41@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1783134988.308351:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:3.0:1783134988.308445:0:8031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373943936 00000100:00100000:3.0:1783134988.308459:0:8031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373943936 00000100:00100000:3.0:1783134988.308587:0:8031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 171 00000100:00100000:3.0:1783134988.308599:0:8031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9f6880a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+58:11491:x1869752373943936:12345-192.168.201.41@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1783134988.308645:0:8031:0:(mdt_handler.c:7960:mdt_fid2path()) path get [0x200000401:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1783134988.308798:0:8031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9f6880a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+58:11491:x1869752373943936:12345-192.168.201.41@tcp:53:lhsmtool_posix.0 Request processed in 200us (461us total) trans 0 rc 0/0 00000100:00100000:3.0:1783134988.308864:0:8031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 171 00000100:00100000:3.0:1783134988.317884:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:2.0:1783134988.318070:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373944064 00000100:00100000:2.0:1783134988.318085:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373944064 00000100:00100000:2.0:1783134988.318301:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 172 00000100:00100000:2.0:1783134988.318315:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9f6fb4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+58:11491:x1869752373944064:12345-192.168.201.41@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1783134988.318448:0:5771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828e00/0xd6c4b8f05867f190 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134988.318471:0:5771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828e00/0xd6c4b8f05867f190 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134988.318485:0:5771:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828e00/0xd6c4b8f05867f190 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134988.318502:0:5771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829200/0xd6c4b8f05867f197 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134988.318510:0:5771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829200/0xd6c4b8f05867f197 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134988.318516:0:5771:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829200/0xd6c4b8f05867f197 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134988.318549:0:5771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829600/0xd6c4b8f05867f19e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134988.318557:0:5771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829600/0xd6c4b8f05867f19e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134988.318563:0:5771:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829600/0xd6c4b8f05867f19e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783134988.318611:0:5771:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:2.0:1783134988.318616:0:5771:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1783134988.318630:0:5771:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829600/0xd6c4b8f05867f19e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134988.318642:0:5771:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828e00/0xd6c4b8f05867f190 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134988.318654:0:5771:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828e00/0xd6c4b8f05867f190 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134988.318662:0:5771:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828e00/0xd6c4b8f05867f190 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134988.318669:0:5771:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe9c7828e00 already unused, calling callback (ffffffffc1f634f0) 00010000:00010000:2.0:1783134988.318674:0:5771:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828e00/0xd6c4b8f05867f190 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134988.318682:0:5771:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828e00/0xd6c4b8f05867f190 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134988.318698:0:5771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9fe9e1c2b600) 00010000:00010000:2.0:1783134988.318701:0:5771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783134988.318708:0:5771:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828e00/0xd6c4b8f05867f190 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134988.318715:0:5771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828e00/0xd6c4b8f05867f190 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134988.318747:0:5771:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829200/0xd6c4b8f05867f197 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134988.318754:0:5771:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829200/0xd6c4b8f05867f197 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134988.318759:0:5771:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829200/0xd6c4b8f05867f197 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134988.318765:0:5771:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe9c7829200 already unused, calling callback (ffffffffc1f634f0) 00010000:00010000:2.0:1783134988.318773:0:5771:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829200/0xd6c4b8f05867f197 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134988.318780:0:5771:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829200/0xd6c4b8f05867f197 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134988.318789:0:5771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x19697575 (ffff9fe9cc3c1400) 00010000:00010000:2.0:1783134988.318792:0:5771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783134988.318795:0:5771:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829200/0xd6c4b8f05867f197 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134988.318801:0:5771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829200/0xd6c4b8f05867f197 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134988.318817:0:5771:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829600/0xd6c4b8f05867f19e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134988.318824:0:5771:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829600/0xd6c4b8f05867f19e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134988.318830:0:5771:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829600/0xd6c4b8f05867f19e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134988.318835:0:5771:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe9c7829600 already unused, calling callback (ffffffffc1f634f0) 00010000:00010000:2.0:1783134988.318838:0:5771:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829600/0xd6c4b8f05867f19e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134988.318844:0:5771:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829600/0xd6c4b8f05867f19e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134988.318850:0:5771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9fe9cc3c1a00) 00010000:00010000:2.0:1783134988.318852:0:5771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783134988.318861:0:5771:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829600/0xd6c4b8f05867f19e lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134988.318867:0:5771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829600/0xd6c4b8f05867f19e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783134988.318972:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9f6fb4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+58:11491:x1869752373944064:12345-192.168.201.41@tcp:34:lhsmtool_posix.0 Request processed in 659us (1102us total) trans 0 rc 0/0 00000100:00100000:2.0:1783134988.318981:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 172 00000100:00100000:3.0:1783134988.337638:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:2.0:1783134988.337737:0:5769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373944320 00000100:00100000:2.0:1783134988.337750:0:5769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373944320 00000100:00100000:2.0:1783134988.337866:0:5769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 173 00000100:00100000:2.0:1783134988.337880:0:5769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9f6895880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+58:11491:x1869752373944320:12345-192.168.201.41@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1783134988.337907:0:5769:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783134988.337932:0:5769:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829600/0xd6c4b8f05867f1a5 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4428da03f5eb743a expref: -99 pid: 5769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134988.338058:0:5769:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829200/0xd6c4b8f05867f1ac lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134988.338077:0:5769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829200/0xd6c4b8f05867f1ac lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134988.338091:0:5769:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829200/0xd6c4b8f05867f1ac lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783134988.338104:0:5769:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:2.0:1783134988.338230:0:5769:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829200/0xd6c4b8f05867f1ac lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134988.338239:0:5769:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829200/0xd6c4b8f05867f1ac lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134988.338252:0:5769:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829200/0xd6c4b8f05867f1ac lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134988.338259:0:5769:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe9c7829200 already unused, calling callback (ffffffffc1f634f0) 00010000:00010000:2.0:1783134988.338264:0:5769:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829200/0xd6c4b8f05867f1ac lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134988.338273:0:5769:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829200/0xd6c4b8f05867f1ac lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134988.338316:0:5769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9fe9cc3c1a00) 00010000:00010000:2.0:1783134988.338320:0:5769:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1783134988.338325:0:5769:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829200/0xd6c4b8f05867f1ac lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134988.338332:0:5769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829200/0xd6c4b8f05867f1ac lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134988.338380:0:5769:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829600/0xd6c4b8f05867f1a5 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb743a expref: 60 pid: 5769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134988.338391:0:5769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9fe9e1c2b600) 00010000:00010000:2.0:1783134988.338394:0:5769:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1783134988.338398:0:5769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829600/0xd6c4b8f05867f1a5 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb743a expref: 60 pid: 5769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134988.338419:0:5769:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fe9c7829600, rc 0) 00000100:00100000:2.0:1783134988.338495:0:5769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9f6895880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+59:11491:x1869752373944320:12345-192.168.201.41@tcp:101:lhsmtool_posix.0 Request processed in 618us (871us total) trans 4294967457 rc 301/301 00000100:00100000:2.0:1783134988.338511:0:5769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 173 00000100:00100000:3.0:1783134988.344261:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:3.0:1783134988.344333:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373944448 00000100:00100000:3.0:1783134988.344344:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373944448 00000100:00100000:3.0:1783134988.344429:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 174 00000100:00100000:3.0:1783134988.344443:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9f6894a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+59:11491:x1869752373944448:12345-192.168.201.41@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1783134988.344499:0:5770:0:(mdt_handler.c:7960:mdt_fid2path()) path get [0x200000401:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1783134988.344642:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9f6894a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+59:11491:x1869752373944448:12345-192.168.201.41@tcp:53:lhsmtool_posix.0 Request processed in 202us (397us total) trans 0 rc 0/0 00000100:00100000:3.0:1783134988.344651:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 174 00000040:00080000:2.0:1783134988.347268:0:12317:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1783134988.347305:0:12317:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1783134988.347361:0:12317:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 5 00000040:00080000:2.0:1783134988.347368:0:12317:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1783134988.360950:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:0.0:1783134988.361075:0:8031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373944704 00000100:00100000:0.0:1783134988.361088:0:8031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373944704 00000100:00100000:0.0:1783134988.361169:0:8031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 175 00000100:00100000:0.0:1783134988.361184:0:8031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9f6897b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+59:11491:x1869752373944704:12345-192.168.201.41@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1783134988.361214:0:8031:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783134988.361219:0:8031:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1783134988.361257:0:8031:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828800/0xd6c4b8f05867f166 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb742c expref: 59 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134988.361410:0:8031:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9fe9e1c2b700) 00010000:00010000:0.0:1783134988.361418:0:8031:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1783134988.361438:0:8031:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ad600/0xd6c4b8f05867f1ba lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4428da03f5eb7441 expref: -99 pid: 8031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1783134988.362181:0:8031:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x5:0x0], index 1: 0 00010000:00010000:0.0:1783134988.362630:0:8031:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ad000/0xd6c4b8f05867f1c1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134988.362648:0:8031:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ad000/0xd6c4b8f05867f1c1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134988.362660:0:8031:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ad000/0xd6c4b8f05867f1c1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134988.362732:0:8031:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ad600/0xd6c4b8f05867f1ba lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb7441 expref: 61 pid: 8031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134988.362751:0:8031:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ad000/0xd6c4b8f05867f1c1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb7441 expref: 60 pid: 8031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134988.362768:0:8031:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9fe9c8301500) 00010000:00010000:0.0:1783134988.362772:0:8031:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1783134988.362775:0:8031:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fe9f68ad000, rc 0) 00000100:00100000:0.0:1783134988.362865:0:8031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9f6897b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+60:11491:x1869752373944704:12345-192.168.201.41@tcp:101:lhsmtool_posix.0 Request processed in 1685us (1924us total) trans 4294967458 rc 0/0 00000100:00100000:0.0:1783134988.362876:0:8031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 175 00000100:00100000:0.0:1783134988.371080:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:3.0:1783134988.372639:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373944960 00000100:00100000:3.0:1783134988.372668:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373944960 00000100:00100000:3.0:1783134988.372788:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 176 00000100:00100000:3.0:1783134988.372803:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9f6880000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+60:11491:x1869752373944960:12345-192.168.201.41@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1783134988.372894:0:5770:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783134988.372931:0:5770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ad000/0xd6c4b8f05867f1c1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb7441 expref: 60 pid: 8031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134988.372950:0:5770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9fe9c8301500) 00010000:00010000:3.0:1783134988.372963:0:5770:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1783134988.372993:0:5770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b74e00/0xd6c4b8f05867f1cf lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134988.373010:0:5770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b74e00/0xd6c4b8f05867f1cf lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134988.373022:0:5770:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b74e00/0xd6c4b8f05867f1cf lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134988.373037:0:5770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b75000/0xd6c4b8f05867f1d6 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x1e7ae527 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134988.373054:0:5770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b75000/0xd6c4b8f05867f1d6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x1e7ae527 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134988.373060:0:5770:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b75000/0xd6c4b8f05867f1d6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x1e7ae527 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134988.373159:0:5770:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b74e00/0xd6c4b8f05867f1cf lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134988.373167:0:5770:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b74e00/0xd6c4b8f05867f1cf lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134988.373174:0:5770:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b74e00/0xd6c4b8f05867f1cf lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134988.373180:0:5770:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe9d2b74e00 already unused, calling callback (ffffffffc1f634f0) 00010000:00010000:3.0:1783134988.373185:0:5770:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b74e00/0xd6c4b8f05867f1cf lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134988.373194:0:5770:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b74e00/0xd6c4b8f05867f1cf lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134988.373204:0:5770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9fe9e1c2b700) 00010000:00010000:3.0:1783134988.373207:0:5770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783134988.373212:0:5770:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b74e00/0xd6c4b8f05867f1cf lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134988.373219:0:5770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b74e00/0xd6c4b8f05867f1cf lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134988.373228:0:5770:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b75000/0xd6c4b8f05867f1d6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x1e7ae527 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134988.373240:0:5770:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b75000/0xd6c4b8f05867f1d6 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x1e7ae527 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134988.373246:0:5770:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b75000/0xd6c4b8f05867f1d6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x1e7ae527 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134988.373252:0:5770:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe9d2b75000 already unused, calling callback (ffffffffc1f634f0) 00010000:00010000:3.0:1783134988.373256:0:5770:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b75000/0xd6c4b8f05867f1d6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x1e7ae527 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134988.373262:0:5770:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b75000/0xd6c4b8f05867f1d6 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x1e7ae527 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134988.373270:0:5770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x1e7ae527 (ffff9fe9cb8f4a00) 00010000:00010000:3.0:1783134988.373274:0:5770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783134988.373302:0:5770:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b75000/0xd6c4b8f05867f1d6 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x1e7ae527 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134988.373309:0:5770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b75000/0xd6c4b8f05867f1d6 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x1e7ae527 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783134988.373458:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9f6880000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+59:11491:x1869752373944960:12345-192.168.201.41@tcp:36:lhsmtool_posix.0 Request processed in 656us (2388us total) trans 0 rc -2/-2 00000100:00100000:3.0:1783134988.373467:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 176 00000100:00100000:0.0:1783134988.376802:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:3.0:1783134988.376870:0:5769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373945088 00000100:00100000:3.0:1783134988.376882:0:5769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373945088 00000100:00100000:3.0:1783134988.376941:0:5769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 177 00000100:00100000:3.0:1783134988.376954:0:5769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9f6882680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+59:11491:x1869752373945088:12345-192.168.201.41@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1783134988.376982:0:5769:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783134988.377021:0:5769:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b74c00/0xd6c4b8f05867f1dd lrc: 2/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4428da03f5eb7448 expref: -99 pid: 5769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134988.377165:0:5769:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b75800/0xd6c4b8f05867f1e4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134988.377183:0:5769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b75800/0xd6c4b8f05867f1e4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134988.377197:0:5769:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b75800/0xd6c4b8f05867f1e4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134988.377336:0:5769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b74c00/0xd6c4b8f05867f1dd lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb7448 expref: 61 pid: 5769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134988.377353:0:5769:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b75800/0xd6c4b8f05867f1e4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb7448 expref: 60 pid: 5769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134988.377362:0:5769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9fe9cb8f4000) 00010000:00010000:3.0:1783134988.377366:0:5769:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1783134988.377370:0:5769:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fe9d2b75800, rc 0) 00000100:00100000:3.0:1783134988.377456:0:5769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9f6882680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+60:11491:x1869752373945088:12345-192.168.201.41@tcp:101:lhsmtool_posix.0 Request processed in 504us (672us total) trans 0 rc 0/0 00000100:00100000:3.0:1783134988.377465:0:5769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 177 00000100:00100000:0.0:1783134988.380878:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:3.0:1783134988.380940:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373945344 00000100:00100000:3.0:1783134988.380953:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373945344 00000100:00100000:3.0:1783134988.381028:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 178 00000100:00100000:3.0:1783134988.381041:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9f6880700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+60:11491:x1869752373945344:12345-192.168.201.41@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1783134988.381150:0:5771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b74000/0xd6c4b8f05867f1eb lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134988.381186:0:5771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b74000/0xd6c4b8f05867f1eb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134988.381202:0:5771:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b74000/0xd6c4b8f05867f1eb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1783134988.381735:0:5771:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].6, 88 off8648 00000004:00080000:3.0:1783134988.381751:0:5771:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 270777469976ns, next at 271777466252ns, rc = 0 00000004:00010000:3.0:1783134988.381871:0:5771:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000236db67d reply state 000000002191fddd transno 4294967459 ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b74000/0xd6c4b8f05867f1eb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783134988.381884:0:5771:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1783134988.382036:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9f6880700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+62:11491:x1869752373945344:12345-192.168.201.41@tcp:36:lhsmtool_posix.0 Request processed in 994us (1170us total) trans 4294967459 rc 0/0 00000100:00100000:3.0:1783134988.382046:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 178 00000100:00100000:1.0:1783134988.389868:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00010000:00010000:1.0:1783134988.389910:0:3273:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b74000/0xd6c4b8f05867f1eb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134988.389924:0:3273:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b74000/0xd6c4b8f05867f1eb lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134988.389933:0:3273:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b74000/0xd6c4b8f05867f1eb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134988.389941:0:3273:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe9d2b74000 already unused, calling callback (ffffffffc1f634f0) 00010000:00010000:1.0:1783134988.389947:0:3273:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b74000/0xd6c4b8f05867f1eb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134988.389956:0:3273:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b74000/0xd6c4b8f05867f1eb lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134988.389980:0:3273:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9fe9cb8f4000) 00010000:00010000:1.0:1783134988.389984:0:3273:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1783134988.389989:0:3273:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b74000/0xd6c4b8f05867f1eb lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134988.389996:0:3273:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b74000/0xd6c4b8f05867f1eb lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783134988.390036:0:8031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373945472 00000100:00100000:1.0:1783134988.390048:0:8031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373945472 00000100:00100000:1.0:1783134988.390113:0:8031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 179 00000100:00100000:1.0:1783134988.390134:0:8031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fe90e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+61:11491:x1869752373945472:12345-192.168.201.41@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1783134988.390181:0:8031:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783134988.390205:0:8031:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43f800/0xd6c4b8f05867f1f2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4428da03f5eb744f expref: -99 pid: 8031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134988.390307:0:8031:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43f800/0xd6c4b8f05867f1f2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb744f expref: 62 pid: 8031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134988.390325:0:8031:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43f800/0xd6c4b8f05867f1f2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb744f expref: 62 pid: 8031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134988.390348:0:8031:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9fe9cb8f4000) 00010000:00010000:1.0:1783134988.390351:0:8031:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1783134988.390353:0:8031:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fe9fe43f800, rc 0) 00000100:00100000:1.0:1783134988.390436:0:8031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fe90e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+62:11491:x1869752373945472:12345-192.168.201.41@tcp:101:lhsmtool_posix.0 Request processed in 304us (579us total) trans 0 rc 0/0 00000100:00100000:1.0:1783134988.390444:0:8031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 179 00000100:00100000:1.0:1783134988.396390:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:1.0:1783134988.396456:0:6577:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373945600 00000100:00100000:1.0:1783134988.396469:0:6577:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373945600 00000100:00100000:1.0:1783134988.396555:0:6577:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 50 00000100:00100000:1.0:1783134988.396569:0:6577:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fe90df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+6:2370:x1869752373945600:12345-192.168.201.41@tcp:2:lhsmtool_posix.0 00000100:00080000:2.0:1783134988.396957:0:5766:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1783134988.397009:0:6577:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fe90df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+7:2370:x1869752373945600:12345-192.168.201.41@tcp:2:lhsmtool_posix.0 Request processed in 443us (634us total) trans 4294967313 rc 0/0 00000100:00100000:1.0:1783134988.397018:0:6577:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 50 00000100:00100000:3.0:1783134988.402743:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:2.0:1783134988.402861:0:5773:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373945856 00000100:00100000:2.0:1783134988.402873:0:5773:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373945856 00000100:00100000:2.0:1783134988.402988:0:5773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 49 00000100:00100000:2.0:1783134988.403002:0:5773:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9f6fe6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+62:11491:x1869752373945856:12345-192.168.201.41@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1783134988.403337:0:5773:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9f6fe6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+63:11491:x1869752373945856:12345-192.168.201.41@tcp:35:lhsmtool_posix.0 Request processed in 337us (607us total) trans 4294967460 rc 0/0 00000100:00100000:2.0:1783134988.403346:0:5773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 49 00000100:00100000:1.0:1783134988.412769:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:0.0:1783134988.415078:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373946112 00000100:00100000:0.0:1783134988.415098:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373946112 00000100:00100000:0.0:1783134988.415182:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 180 00000100:00100000:0.0:1783134988.415193:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fe90f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+63:11491:x1869752373946112:12345-192.168.201.41@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1783134988.415361:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fe90f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+63:11491:x1869752373946112:12345-192.168.201.41@tcp:57:lhsmtool_posix.0 Request processed in 169us (2604us total) trans 0 rc 0/0 00000100:00100000:0.0:1783134988.415367:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 180 00000100:00100000:3.0:1783134988.427451:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:0.0:1783134988.427762:0:8031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373946240 00000100:00100000:0.0:1783134988.427778:0:8031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373946240 00000100:00100000:0.0:1783134988.427866:0:8031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 181 00000100:00100000:0.0:1783134988.427884:0:8031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fea00bcd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+63:11491:x1869752373946240:12345-192.168.201.41@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1783134988.428722:0:8031:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783134988.428755:0:8031:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ac400/0xd6c4b8f05867f1f9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4428da03f5eb7456 expref: -99 pid: 8031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134988.428854:0:8031:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ad800/0xd6c4b8f05867f200 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134988.428881:0:8031:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ad800/0xd6c4b8f05867f200 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134988.429028:0:8031:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ad800/0xd6c4b8f05867f200 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783134988.431877:0:8031:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1783134988.431921:0:8031:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ad800/0xd6c4b8f05867f200 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134988.431968:0:8031:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ac400/0xd6c4b8f05867f1f9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb7456 expref: 65 pid: 8031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134988.431993:0:8031:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ad800/0xd6c4b8f05867f200 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb7456 expref: 64 pid: 8031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134988.432004:0:8031:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9fe9cb8f4000) 00010000:00010000:1.0:1783134988.432007:0:8031:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1783134988.432010:0:8031:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fe9f68ad800, rc 0) 00000100:00100000:1.0:1783134988.432081:0:8031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fea00bcd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+64:11491:x1869752373946240:12345-192.168.201.41@tcp:101:lhsmtool_posix.0 Request processed in 4201us (4641us total) trans 0 rc 0/0 00000100:00100000:1.0:1783134988.432091:0:8031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 181 00000100:00100000:3.0:1783134988.439645:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:1.0:1783134988.442617:0:6574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373946368 00000100:00100000:1.0:1783134988.442631:0:6574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373946368 00000100:00100000:1.0:1783134988.442687:0:6574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 51 00000100:00100000:1.0:1783134988.442703:0:6574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fe9fa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+7:2369:x1869752373946368:12345-192.168.201.41@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1783134988.442721:0:6574:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783134988.442748:0:6574:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f09dd1ad/0xd6c4b8f05867f207 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4428da03f5eb745d expref: -99 pid: 6574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1783134988.442778:0:6574:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a487b0c, blocks: 0x1 00010000:00010000:1.0:1783134988.442797:0:6574:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=270s v=(0 0) 00010000:00010000:1.0:1783134988.442802:0:6574:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783134988.442811:0:6574:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f09dd1ad/0xd6c4b8f05867f207 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb745d expref: 8 pid: 6574 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134988.442840:0:6574:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000f09dd1ad/0xd6c4b8f05867f207 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb745d expref: 8 pid: 6574 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134988.442852:0:6574:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fe9fe43f200, rc 0) 00000100:00100000:1.0:1783134988.442922:0:6574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fe9fa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+8:2369:x1869752373946368:12345-192.168.201.41@tcp:101:lhsmtool_posix.0 Request processed in 225us (3283us total) trans 0 rc 0/0 00000100:00100000:1.0:1783134988.442930:0:6574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 51 00000100:00100000:1.0:1783134988.448182:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:1.0:1783134988.448239:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373946624 00000100:00100000:1.0:1783134988.448249:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373946624 00000100:00100000:1.0:1783134988.448371:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 182 00000100:00100000:1.0:1783134988.448388:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fe90f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+64:11491:x1869752373946624:12345-192.168.201.41@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1783134988.449686:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fe90f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+64:11491:x1869752373946624:12345-192.168.201.41@tcp:57:lhsmtool_posix.0 Request processed in 1300us (1509us total) trans 0 rc 0/0 00000100:00100000:1.0:1783134988.449699:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 182 00000100:00100000:1.0:1783134988.456567:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:1.0:1783134988.456637:0:6577:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373946752 00000100:00100000:1.0:1783134988.456649:0:6577:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373946752 00000100:00100000:1.0:1783134988.456721:0:6577:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 52 00000100:00100000:1.0:1783134988.456735:0:6577:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fe90ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+8:11491:x1869752373946752:12345-192.168.201.41@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1783134988.456758:0:6577:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783134988.456785:0:6577:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e6e89c8f/0xd6c4b8f05867f20e lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4428da03f5eb7464 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134988.456843:0:6577:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000f09dd1ad/0xd6c4b8f05867f207 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb745d expref: 9 pid: 6574 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134988.456854:0:6577:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783134988.456860:0:6577:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783134988.456867:0:6577:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e6e89c8f/0xd6c4b8f05867f20e lrc: 4/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb7464 expref: 9 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134988.456911:0:6577:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000f09dd1ad/0xd6c4b8f05867f207 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb745d expref: 9 pid: 6574 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134988.456928:0:6577:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000f09dd1ad/0xd6c4b8f05867f207 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb745d expref: 9 pid: 6574 timeout: 370 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783134988.456948:0:6577:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9fe90f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6577:1869752384417792:192.168.201.41@tcp:104: 00000100:00100000:1.0:1783134988.457060:0:6577:0:(client.c:2701:ptlrpc_set_wait()) set ffff9fe9e9d82780 going to sleep for 11 seconds 00000100:00100000:1.0:1783134988.463637:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:1.0:1783134988.463714:0:6577:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9fe90f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6577:1869752384417792:192.168.201.41@tcp:104: 00010000:00010000:1.0:1783134988.463755:0:6577:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000e6e89c8f/0xd6c4b8f05867f20e lrc: 3/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb7464 expref: 9 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134988.463785:0:6577:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fe9fe43ec00, rc 0) 00000100:00100000:3.0:1783134988.463818:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373946880 00000100:00100000:3.0:1783134988.463833:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373946880 00000100:00100000:1.0:1783134988.463857:0:6577:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fe90ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+10:11491:x1869752373946752:12345-192.168.201.41@tcp:101:lhsmtool_posix.0 Request processed in 7124us (7305us total) trans 0 rc 0/0 00000100:00100000:1.0:1783134988.463882:0:6577:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 52 00010000:00010000:3.0:1783134988.463920:0:6592:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000f09dd1ad/0xd6c4b8f05867f207 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb745d expref: 9 pid: 6574 timeout: 370 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783134988.463967:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 70 00000100:00100000:3.0:1783134988.463979:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fe90e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+9:2369:x1869752373946880:12345-192.168.201.41@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783134988.463994:0:6592:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783134988.464016:0:6592:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000f09dd1ad/0xd6c4b8f05867f207 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb745d expref: 9 pid: 6574 timeout: 370 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134988.464144:0:6592:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000f09dd1ad/0xd6c4b8f05867f207 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb745d expref: 9 pid: 6574 timeout: 370 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134988.464172:0:6592:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f09dd1ad/0xd6c4b8f05867f207 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb745d expref: 9 pid: 6574 timeout: 370 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134988.464192:0:6592:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783134988.464197:0:6592:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783134988.464208:0:6592:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000e6e89c8f/0xd6c4b8f05867f20e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb7464 expref: 8 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134988.464219:0:6592:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e6e89c8f/0xd6c4b8f05867f20e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb7464 expref: 8 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134988.464264:0:6592:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000e6e89c8f/0xd6c4b8f05867f20e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb7464 expref: 8 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783134988.464372:0:6592:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9fe9f9180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:6592:1869752384417920:192.168.201.41@tcp:105: 00000100:00100000:3.0:1783134988.464515:0:6592:0:(client.c:2701:ptlrpc_set_wait()) set ffff9fea01d52c00 going to sleep for 11 seconds 00000001:00080000:1.0:1783134988.465834:0:6602:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967305 is committed 00000001:00080000:1.0:1783134988.465858:0:6602:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967306 is committed 00000001:00080000:3.0:1783134988.468753:0:7470:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967313 is committed 00000100:00100000:3.0:1783134988.472525:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:3.0:1783134988.472595:0:6592:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9fe9f9180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:6592:1869752384417920:192.168.201.41@tcp:105: 00010000:00010000:3.0:1783134988.472619:0:6592:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783134988.472630:0:6582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373947008 00000100:00100000:1.0:1783134988.472644:0:6582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373947008 00000100:00100000:3.0:1783134988.472675:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fe90e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+8:2369:x1869752373946880:12345-192.168.201.41@tcp:103:ldlm_bl.0 Request processed in 8696us (9053us total) trans 0 rc 0/0 00002000:00100000:1.0:1783134988.472712:0:6582:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x5:0x0] (0->8) req@ffff9fe9fe9faa00 x1869752373947008/t0(0) o4->28f4ba61-cfae-499e-ab3d-81cb8215f7bb@192.168.201.41@tcp:159/0 lens 504/0 e 0 to 0 dl 1783134999 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1783134988.472725:0:6582:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9fe9fe9faa00 with x1869752373947008 ext(0->8) 00002000:00010000:1.0:1783134988.472732:0:6582:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9fe9fe9faa00 00000100:00100000:1.0:1783134988.472763:0:6582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 4 00000100:00100000:1.0:1783134988.472773:0:6582:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fe9faa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+8:2369:x1869752373947008:12345-192.168.201.41@tcp:4:lhsmtool_posix.0 00000100:00100000:3.0:1783134988.472802:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 70 00000100:00100000:1.0:1783134988.473382:0:6582:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fe9faa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+9:2369:x1869752373947008:12345-192.168.201.41@tcp:4:lhsmtool_posix.0 Request processed in 604us (861us total) trans 4294967314 rc 0/0 00000100:00100000:1.0:1783134988.474464:0:6582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 4 00002000:00100000:1.0:1783134988.474485:0:6582:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x5:0x0] (0->8) req@ffff9fe9fe9faa00 x1869752373947008/t4294967314(0) o4->28f4ba61-cfae-499e-ab3d-81cb8215f7bb@192.168.201.41@tcp:159/0 lens 504/448 e 0 to 0 dl 1783134999 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1783134988.474493:0:6582:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9fe9fe9faa00 with x1869752373947008 ext(0->8) 00002000:00010000:1.0:1783134988.474500:0:6582:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9fe9fe9faa00 00000100:00100000:0.0:1783134988.480267:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:1.0:1783134988.480371:0:8031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373947136 00000100:00100000:1.0:1783134988.480385:0:8031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373947136 00000100:00100000:1.0:1783134988.480462:0:8031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 183 00000100:00100000:1.0:1783134988.480474:0:8031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9f6883b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+64:11491:x1869752373947136:12345-192.168.201.41@tcp:44:lhsmtool_posix.0 00000100:00100000:1.0:1783134988.480648:0:8031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9f6883b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+64:11491:x1869752373947136:12345-192.168.201.41@tcp:44:lhsmtool_posix.0 Request processed in 175us (391us total) trans 0 rc 0/0 00000100:00100000:1.0:1783134988.480672:0:8031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 183 00000001:00080000:2.0:1783134988.482437:0:12133:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967458 is committed 00000001:00080000:2.0:1783134988.482511:0:12133:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967460 is committed 00000020:00080000:3.0:1783134988.482556:0:5791:0:(update_trans.c:1341:distribute_txn_batchid_cb()) lustre-MDT0000: 4 batchid updated 00000004:00080000:2.0:1783134988.482585:0:12133:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 4 committed 00000020:00080000:1.0:1783134988.482603:0:5802:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000020:00080000:2.0:1783134988.482615:0:12133:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9fe9fe46ccc0 refcount 2 committed 0 result 0 batchid 5 00000020:00080000:1.0:1783134988.482619:0:5802:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000020:00080000:2.0:1783134988.482623:0:12133:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9fe9ca2bbc00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9fe9fe46c900 00000020:00080000:2.0:1783134988.482628:0:12133:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9fe9ca2bba00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9fe9fe47e400 00000020:00080000:1.0:1783134988.482783:0:5802:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 5 committed batchid 4 00000004:00080000:3.0:1783134988.482789:0:5791:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 7 committed 00000100:00100000:2.0:1783134988.482931:0:3287:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9f6881180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1869752384418048:0@lo:6:osp-syn-0-0.0 00000020:00080000:1.0:1783134988.483002:0:5802:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000100:00100000:2.0:1783134988.483030:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783134988.483136:0:6574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384418048 00000100:00100000:1.0:1783134988.483143:0:6574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384418048 00000100:00100000:1.0:1783134988.483201:0:6574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00080000:0.0:1783134988.483208:0:5766:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1783134988.483210:0:6574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9f68f5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3287:x1869752384418048:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1783134988.483239:0:6574:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:4 count 1 00002000:00010000:1.0:1783134988.483271:0:6574:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 13, mtime: 0x6a487b0a, atime: 0x6a487b0a, ctime: 0x6a487b0a, blocks: 0xb 00010000:00010000:1.0:1783134988.483309:0:6574:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000083f2968d/0xd6c4b8f05867f215 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134988.483327:0:6574:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=270s v=(0 0) 00010000:00010000:1.0:1783134988.483331:0:6574:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783134988.483337:0:6574:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000083f2968d/0xd6c4b8f05867f215 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134988.483352:0:6574:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000083f2968d/0xd6c4b8f05867f215 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134988.483362:0:6574:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000083f2968d/0xd6c4b8f05867f215 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134988.483368:0:6574:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000083f2968d/0xd6c4b8f05867f215 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134988.483412:0:6574:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1783134988.483434:0:5757:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783134988.483444:0:5757:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000083f2968d/0xd6c4b8f05867f215 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134988.483456:0:5757:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe9fe43fa00 already unused, calling callback (ffffffffc1527ce0) 00010000:00010000:0.0:1783134988.483462:0:5757:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000083f2968d/0xd6c4b8f05867f215 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134988.483474:0:5757:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000083f2968d/0xd6c4b8f05867f215 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134988.483500:0:5757:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000083f2968d/0xd6c4b8f05867f215 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134988.483509:0:5757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000083f2968d/0xd6c4b8f05867f215 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134988.483529:0:5757:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783134988.483531:0:5757:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783134988.483537:0:5757:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783134988.483748:0:3288:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9fe9f9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1869752384418176:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1783134988.483797:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783134988.483929:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:3.0:1783134988.483975:0:6577:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384418176 00000100:00100000:3.0:1783134988.483981:0:6577:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384418176 00000100:00100000:3.0:1783134988.484034:0:6577:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373947264 00000100:00100000:3.0:1783134988.484037:0:6577:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373947264 00000100:00100000:3.0:1783134988.484070:0:6577:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1783134988.484086:0:6574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9f68f5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3287:x1869752384418048:12345-0@lo:6:osp-syn-0-0.0 Request processed in 871us (1054us total) trans 4294967307 rc 0/0 00000100:00100000:3.0:1783134988.484087:0:6577:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9f6882a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3288:x1869752384418176:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1783134988.484108:0:6574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1783134988.484130:0:6574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 55 00000100:00100000:1.0:1783134988.484137:0:6574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fe9f8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+9:2370:x1869752373947264:12345-192.168.201.41@tcp:16:lhsmtool_posix.0 00000100:00100000:1.0:1783134988.484204:0:3287:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967306 gen 2 00000004:00080000:1.0:1783134988.484209:0:3287:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967306 committed transno 4294967306 00000100:00100000:1.0:1783134988.484234:0:3287:0:(client.c:3155:ptlrpc_free_committed()) @@@ stopping search req@ffff9fe9f6881180 x1869752384418048/t4294967307(4294967307) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1783135004 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:1.0:1783134988.484245:0:3287:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9fe9f6881180/2, rc 0, transno 4294967307 00000100:00100000:1.0:1783134988.484250:0:3287:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9f6881180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1869752384418048:0@lo:6:osp-syn-0-0.0 00000100:00080000:0.0:1783134988.485346:0:5766:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00010000:3.0:1783134988.485605:0:6577:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:3.0:1783134988.485613:0:6577:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb mtime from disk: 0 -> 1783134988 00002000:00010000:3.0:1783134988.485616:0:6577:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1783134988.485619:0:6577:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb ctime from disk: 1783134988 -> 1783134988 00002000:00010000:3.0:1783134988.485622:0:6577:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1783134988.485729:0:6577:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9f6882a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3288:x1869752384418176:12345-0@lo:2:osp-syn-1-0.0 Request processed in 1643us (1924us total) trans 4294967315 rc 0/0 00000100:00100000:3.0:1783134988.485740:0:6577:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000004:00080000:0.0:1783134988.485762:0:3288:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9fe9fe9f9180/2, rc 0, transno 4294967315 00000100:00100000:0.0:1783134988.485775:0:3288:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9fe9f9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1869752384418176:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1783134988.529111:0:6574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fe9f8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+9:2370:x1869752373947264:12345-192.168.201.41@tcp:16:lhsmtool_posix.0 Request processed in 44907us (45120us total) trans 0 rc 0/0 00000100:00100000:3.0:1783134988.529126:0:6574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 55 00000001:00080000:3.0:1783134988.529183:0:7470:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967314 is committed 00000001:00080000:3.0:1783134988.529206:0:7470:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967315 is committed 00000100:00100000:1.0:1783134988.534389:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:0.0:1783134988.534980:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373947520 00000100:00100000:0.0:1783134988.534993:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373947520 00000100:00100000:0.0:1783134988.535111:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 184 00000100:00100000:0.0:1783134988.535127:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fe90f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+18:11491:x1869752373947520:12345-192.168.201.41@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1783134988.535197:0:5770:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783134988.535233:0:5770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ad800/0xd6c4b8f05867f200 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb7456 expref: 18 pid: 8031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134988.535260:0:5770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9fe9cb8f4000) 00010000:00010000:0.0:1783134988.535267:0:5770:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1783134988.535345:0:5770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68aca00/0xd6c4b8f05867f21c lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134988.535362:0:5770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68aca00/0xd6c4b8f05867f21c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134988.535373:0:5770:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68aca00/0xd6c4b8f05867f21c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1783134988.535717:0:5770:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000012c3b4a8 reply state 000000003e8f188d transno 4294967461 ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68aca00/0xd6c4b8f05867f21c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783134988.535728:0:5770:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1783134988.535868:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fe90f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+19:11491:x1869752373947520:12345-192.168.201.41@tcp:36:lhsmtool_posix.0 Request processed in 745us (1490us total) trans 4294967461 rc 0/0 00000100:00100000:0.0:1783134988.535876:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 184 00010000:00010000:0.0:1783134988.537792:0:3272:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68aca00/0xd6c4b8f05867f21c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134988.537809:0:3272:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68aca00/0xd6c4b8f05867f21c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134988.537817:0:3272:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68aca00/0xd6c4b8f05867f21c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134988.537824:0:3272:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe9f68aca00 already unused, calling callback (ffffffffc1f634f0) 00010000:00010000:0.0:1783134988.537830:0:3272:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68aca00/0xd6c4b8f05867f21c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134988.537839:0:3272:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68aca00/0xd6c4b8f05867f21c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134988.537863:0:3272:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9fe9cb8f4000) 00010000:00010000:0.0:1783134988.537867:0:3272:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783134988.537873:0:3272:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68aca00/0xd6c4b8f05867f21c lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134988.537880:0:3272:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68aca00/0xd6c4b8f05867f21c lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783134988.541169:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:0.0:1783134988.541230:0:7676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373947648 00000100:00100000:0.0:1783134988.541247:0:7676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373947648 00000100:00100000:0.0:1783134988.541356:0:7676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 56 00000100:00100000:0.0:1783134988.541375:0:7676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fe90c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+7:2369:x1869752373947648:12345-192.168.201.41@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1783134988.541942:0:7676:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:0.0:1783134988.541947:0:7676:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb mtime from disk: 1783134988 -> 1783134987 00002000:00010000:0.0:1783134988.541950:0:7676:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb atime from disk: 0 -> 1783134986 00002000:00010000:0.0:1783134988.541953:0:7676:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb ctime from disk: 1783134988 -> 1783134987 00002000:00010000:0.0:1783134988.541955:0:7676:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:0.0:1783134988.542090:0:7676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fe90c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+8:2369:x1869752373947648:12345-192.168.201.41@tcp:2:lhsmtool_posix.0 Request processed in 717us (922us total) trans 4294967316 rc 0/0 00000100:00100000:0.0:1783134988.542102:0:7676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 56 00000100:00100000:1.0:1783134988.544491:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:0.0:1783134988.546860:0:5769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373947904 00000100:00100000:0.0:1783134988.546881:0:5769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373947904 00000100:00100000:0.0:1783134988.547761:0:5769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 185 00000100:00100000:0.0:1783134988.547783:0:5769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fe90d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+18:11491:x1869752373947904:12345-192.168.201.41@tcp:55:lhsmtool_posix.0 00010000:00010000:0.0:1783134988.547873:0:5769:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ad800/0xd6c4b8f05867f223 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134988.547893:0:5769:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b75800/0xd6c4b8f05867f1e4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb7448 expref: 18 pid: 5769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134988.547905:0:5769:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ad800/0xd6c4b8f05867f223 lrc: 4/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134988.547952:0:5769:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b75800/0xd6c4b8f05867f1e4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb7448 expref: 18 pid: 5769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134988.547968:0:5769:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b75800/0xd6c4b8f05867f1e4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb7448 expref: 18 pid: 5769 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134988.548002:0:6591:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783134988.548005:0:5769:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9f6881500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5769:1869752384418304:192.168.201.41@tcp:104: 00000100:00100000:0.0:1783134988.548146:0:5769:0:(client.c:2701:ptlrpc_set_wait()) set ffff9fe9d82e5cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1783134988.551559:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:1.0:1783134988.551750:0:5769:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9f6881500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5769:1869752384418304:192.168.201.41@tcp:104: 00010000:00010000:1.0:1783134988.551784:0:5769:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ad800/0xd6c4b8f05867f223 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783134988.551959:0:5755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373948032 00000100:00100000:2.0:1783134988.551968:0:5755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373948032 00010000:00010000:2.0:1783134988.552014:0:5755:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b75800/0xd6c4b8f05867f1e4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb7448 expref: 19 pid: 5769 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783134988.552084:0:5755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 71 00000100:00100000:2.0:1783134988.552096:0:5755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9f6881c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+19:2370:x1869752373948032:12345-192.168.201.41@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783134988.552116:0:5755:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783134988.552125:0:5755:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b75800/0xd6c4b8f05867f1e4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb7448 expref: 19 pid: 5769 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134988.552138:0:5755:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b75800/0xd6c4b8f05867f1e4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb7448 expref: 19 pid: 5769 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134988.552167:0:5755:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b75800/0xd6c4b8f05867f1e4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb7448 expref: 19 pid: 5769 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134988.552185:0:5755:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9fe9cb8f4000) 00010000:00010000:2.0:1783134988.552191:0:5755:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ad800/0xd6c4b8f05867f223 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134988.552201:0:5755:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ad800/0xd6c4b8f05867f223 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134988.552210:0:5755:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ad800/0xd6c4b8f05867f223 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134988.552318:0:5755:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783134988.552388:0:5755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9f6881c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+18:2370:x1869752373948032:12345-192.168.201.41@tcp:103:ldlm_bl.0 Request processed in 293us (842us total) trans 0 rc 0/0 00000100:00100000:2.0:1783134988.552407:0:5755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 71 00010000:00010000:1.0:1783134988.552899:0:5769:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ad800/0xd6c4b8f05867f223 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134988.552909:0:5769:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ad800/0xd6c4b8f05867f223 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134988.552957:0:5769:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ad800/0xd6c4b8f05867f223 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134988.552965:0:5769:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ad800/0xd6c4b8f05867f223 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134988.552971:0:5769:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ad800/0xd6c4b8f05867f223 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134988.552978:0:5769:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe9f68ad800 already unused, calling callback (ffffffffc1f634f0) 00010000:00010000:1.0:1783134988.552982:0:5769:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ad800/0xd6c4b8f05867f223 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134988.552990:0:5769:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ad800/0xd6c4b8f05867f223 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134988.553001:0:5769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9fe9cb8f4000) 00010000:00010000:1.0:1783134988.553004:0:5769:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:1.0:1783134988.553008:0:5769:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ad800/0xd6c4b8f05867f223 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134988.553014:0:5769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ad800/0xd6c4b8f05867f223 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783134988.553081:0:5769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fe90d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+17:11491:x1869752373947904:12345-192.168.201.41@tcp:55:lhsmtool_posix.0 Request processed in 5306us (8597us total) trans 0 rc -22/-22 00000100:00100000:1.0:1783134988.553091:0:5769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 185 00000100:00100000:0.0:1783134988.554736:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:1.0:1783134988.554803:0:6577:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373948160 00000100:00100000:1.0:1783134988.554815:0:6577:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373948160 00000100:00100000:1.0:1783134988.554874:0:6577:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 57 00000100:00100000:1.0:1783134988.554897:0:6577:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9f6881880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+8:2370:x1869752373948160:12345-192.168.201.41@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1783134988.554952:0:6577:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000c791f1a1/0xd6c4b8f05867f22a lrc: 3/1,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134988.554974:0:6577:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000e6e89c8f/0xd6c4b8f05867f20e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb7464 expref: 8 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134988.554984:0:6577:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783134988.554989:0:6577:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1783134988.554994:0:6577:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c791f1a1/0xd6c4b8f05867f22a lrc: 4/1,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134988.555032:0:6577:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000e6e89c8f/0xd6c4b8f05867f20e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb7464 expref: 8 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134988.555048:0:6577:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000e6e89c8f/0xd6c4b8f05867f20e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb7464 expref: 8 pid: 6577 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783134988.555064:0:6577:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9fe90ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6577:1869752384418432:192.168.201.41@tcp:104: 00000100:00100000:1.0:1783134988.555150:0:6577:0:(client.c:2701:ptlrpc_set_wait()) set ffff9fe9e9d829c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783134988.559111:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:2.0:1783134988.559209:0:5754:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373948288 00000100:00100000:2.0:1783134988.559235:0:5754:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373948288 00010000:00010000:2.0:1783134988.559323:0:5754:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000e6e89c8f/0xd6c4b8f05867f20e lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb7464 expref: 9 pid: 6577 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783134988.559366:0:5754:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 72 00000100:00100000:2.0:1783134988.559377:0:5754:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9f6882300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+9:2370:x1869752373948288:12345-192.168.201.41@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783134988.559406:0:5754:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783134988.559435:0:5754:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000e6e89c8f/0xd6c4b8f05867f20e lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb7464 expref: 9 pid: 6577 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134988.559451:0:5754:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000e6e89c8f/0xd6c4b8f05867f20e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb7464 expref: 9 pid: 6577 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134988.559481:0:5754:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1783134988.559486:0:5754:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1783134988.559493:0:5754:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000c791f1a1/0xd6c4b8f05867f22a lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134988.559504:0:5754:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c791f1a1/0xd6c4b8f05867f22a lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134988.559530:0:5754:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783134988.559593:0:5754:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9f6882300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+9:2370:x1869752373948288:12345-192.168.201.41@tcp:103:ldlm_bl.0 Request processed in 217us (495us total) trans 0 rc 0/0 00000100:00100000:2.0:1783134988.559612:0:5754:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 72 00010000:00010000:1.0:1783134988.561474:0:6577:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e6e89c8f/0xd6c4b8f05867f20e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb7464 expref: 8 pid: 6577 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783134988.561503:0:6577:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9fe90ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6577:1869752384418432:192.168.201.41@tcp:104: 00010000:00010000:1.0:1783134988.561533:0:6577:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000c791f1a1/0xd6c4b8f05867f22a lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134988.561564:0:6577:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000c791f1a1/0xd6c4b8f05867f22a lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134988.561572:0:6577:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c791f1a1/0xd6c4b8f05867f22a lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134988.561685:0:6577:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000c791f1a1/0xd6c4b8f05867f22a lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134988.561695:0:6577:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c791f1a1/0xd6c4b8f05867f22a lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134988.561705:0:6577:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c791f1a1/0xd6c4b8f05867f22a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134988.561713:0:6577:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe9fe43f400 already unused, calling callback (ffffffffc1527ce0) 00010000:00010000:1.0:1783134988.561718:0:6577:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c791f1a1/0xd6c4b8f05867f22a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134988.561728:0:6577:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c791f1a1/0xd6c4b8f05867f22a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134988.561750:0:6577:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c791f1a1/0xd6c4b8f05867f22a lrc: 2/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134988.561772:0:6577:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c791f1a1/0xd6c4b8f05867f22a lrc: 0/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783134988.561977:0:6577:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9f6881880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+7:2370:x1869752373948160:12345-192.168.201.41@tcp:1:lhsmtool_posix.0 Request processed in 7080us (7246us total) trans 0 rc 0/0 00000100:00100000:1.0:1783134988.561987:0:6577:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 57 00000100:00100000:0.0:1783134988.563867:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:1.0:1783134988.563967:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373948544 00000100:00100000:1.0:1783134988.563979:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373948544 00000100:00100000:1.0:1783134988.564076:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 186 00000100:00100000:1.0:1783134988.564087:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9f6881f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+17:11491:x1869752373948544:12345-192.168.201.41@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1783134988.564188:0:5771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43e400/0xd6c4b8f05867f231 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134988.564209:0:5771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43e400/0xd6c4b8f05867f231 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134988.564222:0:5771:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43e400/0xd6c4b8f05867f231 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134988.564534:0:5771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43f600/0xd6c4b8f05867f238 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134988.564547:0:5771:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43f800/0xd6c4b8f05867f1f2 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb744f expref: 18 pid: 8031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134988.564556:0:5771:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43f600/0xd6c4b8f05867f238 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134988.564627:0:5771:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43f800/0xd6c4b8f05867f1f2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb744f expref: 18 pid: 8031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134988.564643:0:5771:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43f800/0xd6c4b8f05867f1f2 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb744f expref: 18 pid: 8031 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783134988.564660:0:5771:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9fe90ed80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5771:1869752384418560:192.168.201.41@tcp:104: 00000100:00100000:1.0:1783134988.564768:0:5771:0:(client.c:2701:ptlrpc_set_wait()) set ffff9fe9e9d829c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783134988.568498:0:5771:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9fe90ed80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5771:1869752384418560:192.168.201.41@tcp:104: 00010000:00010000:1.0:1783134988.568534:0:5771:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43f600/0xd6c4b8f05867f238 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783134988.568958:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:3.0:1783134988.569057:0:5756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373948672 00000100:00100000:3.0:1783134988.569067:0:5756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373948672 00010000:00010000:3.0:1783134988.569113:0:5756:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43f800/0xd6c4b8f05867f1f2 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb744f expref: 19 pid: 8031 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783134988.569214:0:5756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 73 00000100:00100000:3.0:1783134988.569266:0:5756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9f6881500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+19:2369:x1869752373948672:12345-192.168.201.41@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783134988.569358:0:5756:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783134988.569368:0:5756:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43f800/0xd6c4b8f05867f1f2 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb744f expref: 19 pid: 8031 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134988.569381:0:5756:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43f800/0xd6c4b8f05867f1f2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb744f expref: 19 pid: 8031 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134988.569419:0:5756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43f800/0xd6c4b8f05867f1f2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb744f expref: 19 pid: 8031 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134988.569439:0:5756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9fe9cb8f4000) 00010000:00010000:3.0:1783134988.569444:0:5756:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43f600/0xd6c4b8f05867f238 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134988.569455:0:5756:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43f600/0xd6c4b8f05867f238 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134988.569463:0:5756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43f600/0xd6c4b8f05867f238 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134988.569487:0:5756:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783134988.569585:0:5756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9f6881500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+18:2369:x1869752373948672:12345-192.168.201.41@tcp:103:ldlm_bl.0 Request processed in 360us (628us total) trans 0 rc 0/0 00000100:00100000:3.0:1783134988.569594:0:5756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 73 00010000:00010000:1.0:1783134988.569658:0:5771:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43f600/0xd6c4b8f05867f238 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134988.569666:0:5771:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43f600/0xd6c4b8f05867f238 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1783134988.569901:0:5771:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967462 00000001:00080000:1.0:1783134988.570065:0:5771:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967463 00000001:00080000:1.0:1783134988.570111:0:5771:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967464 00000100:00100000:1.0:1783134988.570205:0:5771:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9fe90ed80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5771:1869752384418688:0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1783134988.570265:0:5771:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783134988.570331:0:5771:0:(client.c:2701:ptlrpc_set_wait()) set ffff9fe9ca8ae780 going to sleep for 11 seconds 00000100:00100000:0.0:1783134988.570569:0:5775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384418688 00000100:00100000:0.0:1783134988.570576:0:5775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384418688 00000100:00100000:0.0:1783134988.570679:0:5775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1783134988.570689:0:5775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9f6fc3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5771:x1869752384418688:12345-0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1783134988.570776:0:5775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9f6fc3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5771:x1869752384418688:12345-0@lo:1000:mdt00_002.0 Request processed in 89us (509us total) trans 0 rc 0/0 00000100:00100000:0.0:1783134988.570784:0:5775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1783134988.570845:0:5771:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967315 gen 2 00000004:00080000:2.0:1783134988.570853:0:5771:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9fe9fe9f9180, transno 4294967315 00000100:00100000:2.0:1783134988.570887:0:5771:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9fe90ed80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5771:1869752384418688:0@lo:1000:mdt00_002.0 00000001:00080000:2.0:1783134988.571354:0:5771:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967465 00000100:00100000:2.0:1783134988.571429:0:5771:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9f68f6d80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5771:1869752384418816:0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1783134988.571458:0:5771:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783134988.571479:0:5771:0:(client.c:2701:ptlrpc_set_wait()) set ffff9fe9e9d829c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783134988.571490:0:5774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384418816 00000100:00100000:3.0:1783134988.571500:0:5774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384418816 00000100:00100000:3.0:1783134988.571535:0:5774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1783134988.571543:0:5774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9f68f6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5771:x1869752384418816:12345-0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1783134988.571813:0:5774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9f68f6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5771:x1869752384418816:12345-0@lo:1000:mdt00_002.0 Request processed in 271us (353us total) trans 4294967317 rc 0/0 00000100:00100000:3.0:1783134988.571821:0:5774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1783134988.571846:0:5771:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9f68f6d80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5771:1869752384418816:0@lo:1000:mdt00_002.0 00010000:00010000:2.0:1783134988.571876:0:5771:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43f600/0xd6c4b8f05867f238 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134988.571885:0:5771:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43f600/0xd6c4b8f05867f238 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134988.571893:0:5771:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43f600/0xd6c4b8f05867f238 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134988.571898:0:5771:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe9fe43f600 already unused, calling callback (ffffffffc1f634f0) 00010000:00010000:2.0:1783134988.571902:0:5771:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43f600/0xd6c4b8f05867f238 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134988.571908:0:5771:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43f600/0xd6c4b8f05867f238 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134988.571921:0:5771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9fe9cb8f4000) 00010000:00010000:2.0:1783134988.571923:0:5771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1783134988.571926:0:5771:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43f600/0xd6c4b8f05867f238 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134988.571930:0:5771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43f600/0xd6c4b8f05867f238 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134988.571956:0:5771:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828200/0xd6c4b8f05867f16d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134988.571965:0:5771:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828200/0xd6c4b8f05867f16d lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134988.571969:0:5771:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828200/0xd6c4b8f05867f16d lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134988.571972:0:5771:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe9c7828200 already unused, calling callback (ffffffffc1f634f0) 00010000:00010000:2.0:1783134988.571973:0:5771:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828200/0xd6c4b8f05867f16d lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134988.571977:0:5771:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828200/0xd6c4b8f05867f16d lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134988.571981:0:5771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9fe9cc3c1a00) 00010000:00010000:2.0:1783134988.571983:0:5771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1783134988.571985:0:5771:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828200/0xd6c4b8f05867f16d lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134988.571988:0:5771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828200/0xd6c4b8f05867f16d lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134988.572007:0:5771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829000/0xd6c4b8f05867f23f lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134988.572017:0:5771:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43fe00/0xd6c4b8f05867f189 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb7433 expref: 21 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134988.572024:0:5771:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829000/0xd6c4b8f05867f23f lrc: 4/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134988.572042:0:5771:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43fe00/0xd6c4b8f05867f189 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb7433 expref: 21 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134988.572056:0:5771:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43fe00/0xd6c4b8f05867f189 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb7433 expref: 21 pid: 5770 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783134988.572064:0:5771:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9f68f5180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5771:1869752384418944:192.168.201.41@tcp:104: 00000100:00100000:2.0:1783134988.572201:0:5771:0:(client.c:2701:ptlrpc_set_wait()) set ffff9fe9e9d829c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783134988.575762:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:2.0:1783134988.575870:0:5771:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9f68f5180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5771:1869752384418944:192.168.201.41@tcp:104: 00010000:00010000:2.0:1783134988.575904:0:5771:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829000/0xd6c4b8f05867f23f lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783134988.575984:0:5754:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373948800 00000100:00100000:1.0:1783134988.575993:0:5754:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373948800 00010000:00010000:1.0:1783134988.576039:0:5754:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43fe00/0xd6c4b8f05867f189 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb7433 expref: 22 pid: 5770 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783134988.576138:0:5754:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 74 00000100:00100000:1.0:1783134988.576149:0:5754:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9f6882d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+22:2370:x1869752373948800:12345-192.168.201.41@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1783134988.576167:0:5754:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783134988.576175:0:5754:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43fe00/0xd6c4b8f05867f189 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb7433 expref: 22 pid: 5770 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134988.576188:0:5754:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43fe00/0xd6c4b8f05867f189 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb7433 expref: 22 pid: 5770 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134988.576216:0:5754:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43fe00/0xd6c4b8f05867f189 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb7433 expref: 22 pid: 5770 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134988.576234:0:5754:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9fe9cc3c1a00) 00010000:00010000:1.0:1783134988.576240:0:5754:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829000/0xd6c4b8f05867f23f lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134988.576252:0:5754:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829000/0xd6c4b8f05867f23f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134988.576260:0:5754:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829000/0xd6c4b8f05867f23f lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134988.576322:0:5754:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783134988.576377:0:5754:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9f6882d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+21:2370:x1869752373948800:12345-192.168.201.41@tcp:103:ldlm_bl.0 Request processed in 229us (629us total) trans 0 rc 0/0 00000100:00100000:1.0:1783134988.576386:0:5754:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 74 00010000:00010000:2.0:1783134988.576452:0:5771:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829000/0xd6c4b8f05867f23f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134988.576460:0:5771:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829000/0xd6c4b8f05867f23f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134988.576473:0:5771:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829000/0xd6c4b8f05867f23f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134988.576480:0:5771:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829000/0xd6c4b8f05867f23f lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134988.576488:0:5771:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829000/0xd6c4b8f05867f23f lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134988.576495:0:5771:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe9c7829000 already unused, calling callback (ffffffffc1f634f0) 00010000:00010000:2.0:1783134988.576499:0:5771:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829000/0xd6c4b8f05867f23f lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134988.576507:0:5771:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829000/0xd6c4b8f05867f23f lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134988.576523:0:5771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9fe9cc3c1a00) 00010000:00010000:2.0:1783134988.576526:0:5771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783134988.576530:0:5771:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829000/0xd6c4b8f05867f23f lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134988.576536:0:5771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829000/0xd6c4b8f05867f23f lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134988.576548:0:5771:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43e400/0xd6c4b8f05867f231 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134988.576554:0:5771:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43e400/0xd6c4b8f05867f231 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134988.576560:0:5771:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43e400/0xd6c4b8f05867f231 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134988.576565:0:5771:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe9fe43e400 already unused, calling callback (ffffffffc1f634f0) 00010000:00010000:2.0:1783134988.576568:0:5771:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43e400/0xd6c4b8f05867f231 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134988.576573:0:5771:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43e400/0xd6c4b8f05867f231 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134988.576579:0:5771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9fe9cc3c1a00) 00010000:00010000:2.0:1783134988.576581:0:5771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1783134988.576584:0:5771:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43e400/0xd6c4b8f05867f231 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134988.576589:0:5771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43e400/0xd6c4b8f05867f231 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783134988.576831:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9f6881f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+20:11491:x1869752373948544:12345-192.168.201.41@tcp:57:lhsmtool_posix.0 Request processed in 12745us (12978us total) trans 4294967466 rc 0/0 00000100:00100000:2.0:1783134988.576840:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 186 00000020:00080000:2.0:1783134988.576844:0:5771:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:1.0:1783134988.577709:0:11499:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1783134988.577725:0:11499:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1783134988.578528:0:11499:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 5 00000040:00080000:1.0:1783134988.578537:0:11499:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1783134988.579769:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:3.0:1783134988.579856:0:5772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373949056 00000100:00100000:3.0:1783134988.579868:0:5772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373949056 00000100:00100000:3.0:1783134988.579926:0:5772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 50 00000100:00100000:3.0:1783134988.579937:0:5772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9e0bf5450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+20:11491:x1869752373949056:12345-192.168.201.41@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1783134988.580904:0:5772:0:(mdd_object.c:4010:mdd_close()) Object [0x200000401:0xd:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1783134988.581023:0:5772:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967467 00010000:00010000:3.0:1783134988.581079:0:5772:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b74c00/0xd6c4b8f05867f246 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134988.581101:0:5772:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b74c00/0xd6c4b8f05867f246 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134988.581115:0:5772:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b74c00/0xd6c4b8f05867f246 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134988.581126:0:5772:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b74c00/0xd6c4b8f05867f246 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134988.581133:0:5772:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b74c00/0xd6c4b8f05867f246 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134988.581141:0:5772:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b74c00/0xd6c4b8f05867f246 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134988.581221:0:5772:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1783134988.581379:0:5772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9e0bf5450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+22:11491:x1869752373949056:12345-192.168.201.41@tcp:35:lhsmtool_posix.0 Request processed in 1440us (1614us total) trans 4294967468 rc 0/0 00000100:00100000:3.0:1783134988.581390:0:5772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 50 00000020:00080000:3.0:1783134988.581407:0:5772:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1783134988.581745:0:10987:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783134988.581753:0:10987:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b74c00/0xd6c4b8f05867f246 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134988.581761:0:10987:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe9d2b74c00 already unused, calling callback (ffffffffc1527ce0) 00010000:00010000:0.0:1783134988.581766:0:10987:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b74c00/0xd6c4b8f05867f246 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134988.581774:0:10987:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b74c00/0xd6c4b8f05867f246 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134988.581800:0:10987:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9fe9cb8f4a00) 00010000:00010000:0.0:1783134988.581804:0:10987:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1783134988.581809:0:10987:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b74c00/0xd6c4b8f05867f246 lrc: 1/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134988.581815:0:10987:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b74c00/0xd6c4b8f05867f246 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134988.581833:0:10987:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783134988.581835:0:10987:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783134988.581837:0:10987:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783134989.097206:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:0.0:1783134989.097413:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:0.0:1783134989.097450:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:0.0:1783134989.097493:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:3.0:1783134989.097523:0:5762:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373949184 00000100:00100000:0.0:1783134989.097535:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:3.0:1783134989.097542:0:5762:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373949184 00000100:00100000:2.0:1783134989.097610:0:7676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373949568 00000100:00100000:2.0:1783134989.097621:0:7676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373949568 00000100:00100000:3.0:1783134989.097642:0:5762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 271 00000100:00100000:3.0:1783134989.097661:0:5762:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9d1656050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f39b22bc-4faf-4b59-bb00-2a11f91e37c0+13:2369:x1869752373949184:12345-192.168.201.41@tcp:400:kworker.0 00000100:00100000:2.0:1783134989.097679:0:7676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373949440 00000100:00100000:2.0:1783134989.097685:0:7676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373949440 00000100:00100000:2.0:1783134989.097722:0:7676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 48 00000100:00100000:2.0:1783134989.097731:0:7676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9f6880e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+7:2370:x1869752373949568:12345-192.168.201.41@tcp:400:kworker.0 00000100:00100000:3.0:1783134989.097771:0:5762:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9d1656050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f39b22bc-4faf-4b59-bb00-2a11f91e37c0+13:2369:x1869752373949184:12345-192.168.201.41@tcp:400:kworker.0 Request processed in 114us (354us total) trans 0 rc 0/0 00000100:00100000:3.0:1783134989.097782:0:5762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 271 00000100:00100000:2.0:1783134989.097801:0:7676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9f6880e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+7:2370:x1869752373949568:12345-192.168.201.41@tcp:400:kworker.0 Request processed in 66us (346us total) trans 0 rc 0/0 00000100:00100000:2.0:1783134989.097810:0:7676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 48 00000100:00100000:2.0:1783134989.097833:0:7676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 49 00000100:00100000:2.0:1783134989.097840:0:7676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9f6cbf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+5:2369:x1869752373949440:12345-192.168.201.41@tcp:400:kworker.0 00000100:00100000:2.0:1783134989.097867:0:7676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9f6cbf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+5:2369:x1869752373949440:12345-192.168.201.41@tcp:400:kworker.0 Request processed in 27us (374us total) trans 0 rc 0/0 00000100:00100000:2.0:1783134989.097875:0:7676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 49 00000100:00080000:3.0:1783134989.097879:0:5766:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1783134989.100591:0:8031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373949312 00000100:00100000:1.0:1783134989.100605:0:8031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373949312 00000100:00100000:1.0:1783134989.100716:0:8031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373949696 00000100:00100000:1.0:1783134989.100720:0:8031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373949696 00000100:00080000:3.0:1783134989.100787:0:5766:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783134989.100834:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 100 00000100:00100000:0.0:1783134989.100846:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9f6883480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+22:2370:x1869752373949312:12345-192.168.201.41@tcp:400:kworker.0 00000100:00100000:0.0:1783134989.100928:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9f6883480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+22:2370:x1869752373949312:12345-192.168.201.41@tcp:400:kworker.0 Request processed in 85us (3735us total) trans 0 rc 0/0 00000100:00100000:0.0:1783134989.100937:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 100 00000100:00100000:0.0:1783134989.100963:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 101 00000100:00100000:0.0:1783134989.100969:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9f6cbc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c936801d-68e8-41a4-8fbc-6becd5e1be74+5:2369:x1869752373949696:12345-192.168.201.41@tcp:400:kworker.0 00000100:00100000:0.0:1783134989.100992:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9f6cbc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c936801d-68e8-41a4-8fbc-6becd5e1be74+5:2369:x1869752373949696:12345-192.168.201.41@tcp:400:kworker.0 Request processed in 23us (3460us total) trans 0 rc 0/0 00000100:00100000:0.0:1783134989.100998:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 101 00010000:00010000:0.0:1783134989.571850:0:5758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1783134989.833681:0:12370:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1783134989.833688:0:12370:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1783134989.833719:0:12370:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 5 00000040:00080000:0.0:1783134989.833723:0:12370:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1783134989.917162:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:3.0:1783134989.917234:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373949952 00000100:00100000:3.0:1783134989.917244:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373949952 00000100:00100000:3.0:1783134989.917335:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 187 00000100:00100000:3.0:1783134989.917345:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9f68f5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+22:11509:x1869752373949952:12345-192.168.201.41@tcp:101:lfs.0 00010000:00010000:3.0:1783134989.917362:0:5770:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783134989.917389:0:5770:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b74e00/0xd6c4b8f05867f24d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4428da03f5eb746b expref: -99 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134989.917641:0:5770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b75000/0xd6c4b8f05867f254 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134989.917657:0:5770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b75000/0xd6c4b8f05867f254 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134989.917670:0:5770:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b75000/0xd6c4b8f05867f254 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783134989.917688:0:5770:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00010000:00010000:3.0:1783134989.917847:0:5770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b74e00/0xd6c4b8f05867f24d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb746b expref: 25 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134989.917863:0:5770:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b75000/0xd6c4b8f05867f254 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb746b expref: 24 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134989.917870:0:5770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9fe9e1c2b700) 00010000:00010000:3.0:1783134989.917873:0:5770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1783134989.917876:0:5770:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fe9d2b75000, rc 0) 00000100:00100000:3.0:1783134989.917927:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9f68f5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+24:11509:x1869752373949952:12345-192.168.201.41@tcp:101:lfs.0 Request processed in 584us (774us total) trans 4294967469 rc 0/0 00000100:00100000:3.0:1783134989.917934:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 187 00000100:00100000:3.0:1783134989.922868:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:2.0:1783134989.922986:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373950080 00000100:00100000:2.0:1783134989.922995:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373950080 00000100:00100000:2.0:1783134989.923050:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 188 00000100:00100000:2.0:1783134989.923058:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fe9f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+24:11509:x1869752373950080:12345-192.168.201.41@tcp:34:lfs.0 00010000:00010000:2.0:1783134989.923116:0:5771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829800/0xd6c4b8f05867f262 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134989.923136:0:5771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829800/0xd6c4b8f05867f262 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134989.923144:0:5771:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829800/0xd6c4b8f05867f262 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134989.923155:0:5771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828a00/0xd6c4b8f05867f269 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134989.923160:0:5771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828a00/0xd6c4b8f05867f269 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134989.923163:0:5771:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828a00/0xd6c4b8f05867f269 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134989.923464:0:5771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828200/0xd6c4b8f05867f270 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134989.923471:0:5771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828200/0xd6c4b8f05867f270 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134989.923478:0:5771:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828200/0xd6c4b8f05867f270 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1783134989.923517:0:5771:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828200/0xd6c4b8f05867f270 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134989.923531:0:5771:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829800/0xd6c4b8f05867f262 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134989.923538:0:5771:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829800/0xd6c4b8f05867f262 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134989.923554:0:5771:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829800/0xd6c4b8f05867f262 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134989.923560:0:5771:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe9c7829800 already unused, calling callback (ffffffffc1f634f0) 00010000:00010000:2.0:1783134989.923564:0:5771:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829800/0xd6c4b8f05867f262 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134989.923571:0:5771:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829800/0xd6c4b8f05867f262 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134989.923584:0:5771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9fe9e1c2b700) 00010000:00010000:2.0:1783134989.923587:0:5771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783134989.923592:0:5771:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829800/0xd6c4b8f05867f262 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134989.923597:0:5771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829800/0xd6c4b8f05867f262 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134989.923605:0:5771:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828a00/0xd6c4b8f05867f269 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134989.923608:0:5771:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828a00/0xd6c4b8f05867f269 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134989.923612:0:5771:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828a00/0xd6c4b8f05867f269 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134989.923615:0:5771:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe9c7828a00 already unused, calling callback (ffffffffc1f634f0) 00010000:00010000:2.0:1783134989.923616:0:5771:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828a00/0xd6c4b8f05867f269 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134989.923627:0:5771:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828a00/0xd6c4b8f05867f269 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134989.923631:0:5771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9fe9cc3c1a00) 00010000:00010000:2.0:1783134989.923633:0:5771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783134989.923634:0:5771:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828a00/0xd6c4b8f05867f269 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134989.923638:0:5771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828a00/0xd6c4b8f05867f269 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134989.923648:0:5771:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828200/0xd6c4b8f05867f270 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134989.923652:0:5771:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828200/0xd6c4b8f05867f270 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134989.923655:0:5771:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828200/0xd6c4b8f05867f270 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134989.923658:0:5771:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe9c7828200 already unused, calling callback (ffffffffc1f634f0) 00010000:00010000:2.0:1783134989.923660:0:5771:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828200/0xd6c4b8f05867f270 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134989.923663:0:5771:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828200/0xd6c4b8f05867f270 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134989.923666:0:5771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9fe9cc3c1f00) 00010000:00010000:2.0:1783134989.923667:0:5771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783134989.923669:0:5771:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828200/0xd6c4b8f05867f270 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134989.923677:0:5771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828200/0xd6c4b8f05867f270 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783134989.923735:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fe9f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+24:11509:x1869752373950080:12345-192.168.201.41@tcp:34:lfs.0 Request processed in 677us (874us total) trans 0 rc 0/0 00000100:00100000:2.0:1783134989.923743:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 188 00000100:00100000:3.0:1783134989.952045:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:0.0:1783134989.952455:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373950336 00000100:00100000:0.0:1783134989.952465:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373950336 00000100:00100000:0.0:1783134989.952540:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 189 00000100:00100000:0.0:1783134989.952551:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fe9f9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+24:11512:x1869752373950336:12345-192.168.201.41@tcp:101:lfs.0 00010000:00010000:0.0:1783134989.952570:0:5770:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783134989.952604:0:5770:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ad800/0xd6c4b8f05867f277 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4428da03f5eb7472 expref: -99 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134989.952693:0:5770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ac200/0xd6c4b8f05867f27e lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134989.952709:0:5770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ac200/0xd6c4b8f05867f27e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134989.952721:0:5770:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ac200/0xd6c4b8f05867f27e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134989.952736:0:5770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68aca00/0xd6c4b8f05867f285 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134989.952744:0:5770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68aca00/0xd6c4b8f05867f285 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134989.952751:0:5770:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68aca00/0xd6c4b8f05867f285 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134989.953068:0:5770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ac000/0xd6c4b8f05867f28c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134989.953076:0:5770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ac000/0xd6c4b8f05867f28c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134989.953082:0:5770:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ac000/0xd6c4b8f05867f28c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783134989.953091:0:5770:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 9 00010000:00010000:0.0:1783134989.953169:0:5770:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ac200/0xd6c4b8f05867f27e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134989.953176:0:5770:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ac200/0xd6c4b8f05867f27e lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134989.953183:0:5770:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ac200/0xd6c4b8f05867f27e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134989.953188:0:5770:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe9f68ac200 already unused, calling callback (ffffffffc1f634f0) 00010000:00010000:0.0:1783134989.953192:0:5770:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ac200/0xd6c4b8f05867f27e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134989.953199:0:5770:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ac200/0xd6c4b8f05867f27e lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134989.953210:0:5770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9fe9e1c2b700) 00010000:00010000:0.0:1783134989.953213:0:5770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783134989.953217:0:5770:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ac200/0xd6c4b8f05867f27e lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134989.953233:0:5770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ac200/0xd6c4b8f05867f27e lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134989.953246:0:5770:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68aca00/0xd6c4b8f05867f285 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134989.953251:0:5770:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68aca00/0xd6c4b8f05867f285 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134989.953257:0:5770:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68aca00/0xd6c4b8f05867f285 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134989.953262:0:5770:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe9f68aca00 already unused, calling callback (ffffffffc1f634f0) 00010000:00010000:0.0:1783134989.953381:0:5770:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68aca00/0xd6c4b8f05867f285 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134989.953389:0:5770:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68aca00/0xd6c4b8f05867f285 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134989.953399:0:5770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9fe9c8301400) 00010000:00010000:0.0:1783134989.953402:0:5770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783134989.953405:0:5770:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68aca00/0xd6c4b8f05867f285 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134989.953414:0:5770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68aca00/0xd6c4b8f05867f285 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134989.953460:0:5770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ad800/0xd6c4b8f05867f277 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb7472 expref: 27 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134989.953475:0:5770:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ac000/0xd6c4b8f05867f28c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb7472 expref: 26 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134989.953499:0:5770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9fe9c8301900) 00010000:00010000:0.0:1783134989.953501:0:5770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1783134989.953508:0:5770:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fe9f68ac000, rc 0) 00000100:00100000:0.0:1783134989.953574:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fe9f9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+26:11512:x1869752373950336:12345-192.168.201.41@tcp:101:lfs.0 Request processed in 1025us (1537us total) trans 4294967470 rc 0/0 00000100:00100000:0.0:1783134989.953582:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 189 00000100:00100000:3.0:1783134989.956450:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:2.0:1783134989.956506:0:5769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373950464 00000100:00100000:2.0:1783134989.956515:0:5769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373950464 00000100:00100000:2.0:1783134989.956570:0:5769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 190 00000100:00100000:2.0:1783134989.956579:0:5769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9f6fb6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+26:11512:x1869752373950464:12345-192.168.201.41@tcp:54:lfs.0 00010000:00010000:2.0:1783134989.956643:0:5769:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828200/0xd6c4b8f05867f29a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134989.956658:0:5769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828200/0xd6c4b8f05867f29a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134989.956669:0:5769:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828200/0xd6c4b8f05867f29a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134989.956694:0:5769:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828200/0xd6c4b8f05867f29a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134989.956701:0:5769:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828200/0xd6c4b8f05867f29a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134989.956707:0:5769:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828200/0xd6c4b8f05867f29a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134989.956713:0:5769:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe9c7828200 already unused, calling callback (ffffffffc1f634f0) 00010000:00010000:2.0:1783134989.956716:0:5769:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828200/0xd6c4b8f05867f29a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134989.956733:0:5769:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828200/0xd6c4b8f05867f29a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134989.956745:0:5769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9fe9c8301900) 00010000:00010000:2.0:1783134989.956748:0:5769:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1783134989.956753:0:5769:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828200/0xd6c4b8f05867f29a lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134989.956759:0:5769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828200/0xd6c4b8f05867f29a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783134989.956828:0:5769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9f6fb6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+26:11512:x1869752373950464:12345-192.168.201.41@tcp:54:lfs.0 Request processed in 249us (384us total) trans 0 rc 0/0 00000100:00100000:2.0:1783134989.957185:0:5769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 190 00000100:00100000:3.0:1783134989.958128:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:2.0:1783134989.958180:0:5773:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373950720 00000100:00100000:2.0:1783134989.958186:0:5773:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373950720 00000100:00100000:2.0:1783134989.958228:0:5773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 51 00000100:00100000:2.0:1783134989.958238:0:5773:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9f6fe6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+26:11512:x1869752373950720:12345-192.168.201.41@tcp:35:lfs.0 00000100:00100000:2.0:1783134989.958479:0:5773:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9f6fe6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+27:11512:x1869752373950720:12345-192.168.201.41@tcp:35:lfs.0 Request processed in 242us (353us total) trans 4294967471 rc 0/0 00000100:00100000:2.0:1783134989.958487:0:5773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 51 00000100:00100000:3.0:1783134989.980991:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:1.0:1783134989.981399:0:8031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373950976 00000100:00100000:1.0:1783134989.981408:0:8031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373950976 00000100:00100000:1.0:1783134989.981457:0:8031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 191 00000100:00100000:1.0:1783134989.981465:0:8031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fe7d2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+27:11039:x1869752373950976:12345-192.168.201.41@tcp:101:bash.0 00010000:00010000:1.0:1783134989.981485:0:8031:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783134989.981501:0:8031:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43fe00/0xd6c4b8f05867f2a1 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4428da03f5eb7479 expref: -99 pid: 8031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134989.981589:0:8031:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43f400/0xd6c4b8f05867f2a8 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134989.981604:0:8031:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ac000/0xd6c4b8f05867f28c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb7472 expref: 28 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134989.981613:0:8031:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43f400/0xd6c4b8f05867f2a8 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134989.981642:0:8031:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ac000/0xd6c4b8f05867f28c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb7472 expref: 28 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134989.981652:0:8031:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ac000/0xd6c4b8f05867f28c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb7472 expref: 28 pid: 5770 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783134989.981676:0:8031:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9f6fc3480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8031:1869752384419072:192.168.201.41@tcp:104: 00000100:00100000:1.0:1783134989.981767:0:8031:0:(client.c:2701:ptlrpc_set_wait()) set ffff9fe9ca8ae9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783134989.984516:0:8031:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9f6fc3480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8031:1869752384419072:192.168.201.41@tcp:104: 00010000:00010000:1.0:1783134989.984545:0:8031:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43f400/0xd6c4b8f05867f2a8 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783134989.991974:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:2.0:1783134989.992043:0:5755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373951104 00000100:00100000:2.0:1783134989.992053:0:5755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373951104 00010000:00010000:2.0:1783134989.992105:0:5755:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ac000/0xd6c4b8f05867f28c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb7472 expref: 29 pid: 5770 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783134989.992159:0:5755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 75 00000100:00100000:2.0:1783134989.992170:0:5755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fe7d1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+29:2370:x1869752373951104:12345-192.168.201.41@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783134989.992212:0:5755:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783134989.992221:0:5755:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ac000/0xd6c4b8f05867f28c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb7472 expref: 29 pid: 5770 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134989.992236:0:5755:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ac000/0xd6c4b8f05867f28c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb7472 expref: 29 pid: 5770 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134989.992258:0:5755:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ac000/0xd6c4b8f05867f28c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb7472 expref: 29 pid: 5770 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134989.992275:0:5755:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9fe9c8301900) 00010000:00010000:2.0:1783134989.992332:0:5755:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43f400/0xd6c4b8f05867f2a8 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134989.992343:0:5755:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43f400/0xd6c4b8f05867f2a8 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134989.992350:0:5755:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43f400/0xd6c4b8f05867f2a8 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134989.992390:0:5755:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783134989.992447:0:5755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fe7d1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+28:2370:x1869752373951104:12345-192.168.201.41@tcp:103:ldlm_bl.0 Request processed in 279us (481us total) trans 0 rc 0/0 00000100:00100000:2.0:1783134989.992455:0:5755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 75 00010000:00010000:1.0:1783134989.992927:0:8031:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43f400/0xd6c4b8f05867f2a8 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134989.992938:0:8031:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43f400/0xd6c4b8f05867f2a8 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783134989.992958:0:8031:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 9 00010000:00010000:1.0:1783134989.993095:0:8031:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43fe00/0xd6c4b8f05867f2a1 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb7479 expref: 29 pid: 8031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134989.993113:0:8031:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43f400/0xd6c4b8f05867f2a8 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb7479 expref: 28 pid: 8031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134989.993121:0:8031:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9fe9c8301900) 00010000:00010000:1.0:1783134989.993124:0:8031:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1783134989.993127:0:8031:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fe9fe43f400, rc 0) 00000100:00100000:1.0:1783134989.993166:0:8031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fe7d2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+28:11039:x1869752373950976:12345-192.168.201.41@tcp:101:bash.0 Request processed in 11701us (12183us total) trans 4294967472 rc 0/0 00000100:00100000:1.0:1783134989.993173:0:8031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 191 00000100:00100000:3.0:1783134989.999195:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:2.0:1783134990.001461:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373951360 00000100:00100000:2.0:1783134990.001476:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373951360 00000100:00100000:2.0:1783134990.001549:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 192 00000100:00100000:2.0:1783134990.001561:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fe7d0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+28:11039:x1869752373951360:12345-192.168.201.41@tcp:36:bash.0 00010000:00010000:2.0:1783134990.001983:0:5771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828200/0xd6c4b8f05867f2b6 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134990.002001:0:5771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828200/0xd6c4b8f05867f2b6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134990.002025:0:5771:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828200/0xd6c4b8f05867f2b6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1783134990.002079:0:5771:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967473 00000004:00010000:2.0:1783134990.002104:0:5771:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000f5e30cf9 reply state 000000006d6d0713 transno 4294967474 ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828200/0xd6c4b8f05867f2b6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783134990.002113:0:5771:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:2.0:1783134990.002174:0:5771:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967474 00000100:00100000:2.0:1783134990.002333:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fe7d0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+32:11039:x1869752373951360:12345-192.168.201.41@tcp:36:bash.0 Request processed in 773us (3143us total) trans 4294967475 rc 0/0 00000100:00100000:2.0:1783134990.002342:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 192 00000020:00080000:2.0:1783134990.002347:0:5771:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00010000:00010000:1.0:1783134990.004312:0:3273:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828200/0xd6c4b8f05867f2b6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134990.004341:0:3273:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828200/0xd6c4b8f05867f2b6 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134990.004350:0:3273:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828200/0xd6c4b8f05867f2b6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134990.004356:0:3273:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe9c7828200 already unused, calling callback (ffffffffc1f634f0) 00010000:00010000:1.0:1783134990.004361:0:3273:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828200/0xd6c4b8f05867f2b6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134990.004368:0:3273:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828200/0xd6c4b8f05867f2b6 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134990.004395:0:3273:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9fe9c8301900) 00000100:00100000:3.0:1783134990.004399:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00010000:00010000:1.0:1783134990.004400:0:3273:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783134990.004407:0:3273:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828200/0xd6c4b8f05867f2b6 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134990.004414:0:3273:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828200/0xd6c4b8f05867f2b6 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783134990.004518:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373951488 00000100:00100000:0.0:1783134990.004526:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373951488 00000100:00100000:0.0:1783134990.004566:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 193 00000100:00100000:0.0:1783134990.004576:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fe7d2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+31:11039:x1869752373951488:12345-192.168.201.41@tcp:101:bash.0 00010000:00010000:0.0:1783134990.004596:0:5770:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783134990.004611:0:5770:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ad800/0xd6c4b8f05867f2bd lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4428da03f5eb7480 expref: -99 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134990.004659:0:5770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ad800/0xd6c4b8f05867f2bd lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb7480 expref: 32 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134990.004671:0:5770:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ad800/0xd6c4b8f05867f2bd lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb7480 expref: 32 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134990.004689:0:5770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9fe9c8301900) 00010000:00010000:0.0:1783134990.004692:0:5770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1783134990.004694:0:5770:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fe9f68ad800, rc 0) 00000100:00100000:0.0:1783134990.004742:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fe7d2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+32:11039:x1869752373951488:12345-192.168.201.41@tcp:101:bash.0 Request processed in 167us (354us total) trans 0 rc 0/0 00000100:00100000:0.0:1783134990.004757:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 193 00000100:00100000:3.0:1783134990.008251:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:0.0:1783134990.008342:0:6574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373951616 00000100:00100000:0.0:1783134990.008351:0:6574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373951616 00000100:00100000:0.0:1783134990.008414:0:6574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 58 00000100:00100000:0.0:1783134990.008422:0:6574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fe7d1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+7:11039:x1869752373951616:12345-192.168.201.41@tcp:101:bash.0 00010000:00010000:0.0:1783134990.008436:0:6574:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783134990.008454:0:6574:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d97e2b8d/0xd6c4b8f05867f2c4 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4428da03f5eb7487 expref: -99 pid: 6574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1783134990.008482:0:6574:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5:0x0] initial LVB size: 9, mtime: 0x6a487b0b, atime: 0x6a487b0a, ctime: 0x6a487b0b, blocks: 0xb 00010000:00010000:0.0:1783134990.008500:0:6574:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=272s v=(0 0) 00010000:00010000:0.0:1783134990.008504:0:6574:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783134990.008510:0:6574:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d97e2b8d/0xd6c4b8f05867f2c4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb7487 expref: 8 pid: 6574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134990.008525:0:6574:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000d97e2b8d/0xd6c4b8f05867f2c4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb7487 expref: 8 pid: 6574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134990.008537:0:6574:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fe9f68aca00, rc 0) 00000100:00080000:3.0:1783134990.008559:0:5766:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1783134990.008588:0:6574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fe7d1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+8:11039:x1869752373951616:12345-192.168.201.41@tcp:101:bash.0 Request processed in 165us (345us total) trans 0 rc 0/0 00000100:00100000:0.0:1783134990.008595:0:6574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 58 00000100:00100000:3.0:1783134990.011561:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:0.0:1783134990.011626:0:6581:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373951744 00000100:00100000:0.0:1783134990.011636:0:6581:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373951744 00002000:00010000:0.0:1783134990.011741:0:6581:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/5 (0->18446744073709551615) 00002000:00100000:0.0:1783134990.011747:0:6581:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9fe9fe7d2a00 with x1869752373951744 ext(0->18446744073709551615) 00002000:00010000:0.0:1783134990.011770:0:6581:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9fe9fe7d2a00. 00000100:00100000:0.0:1783134990.012075:0:6581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 5 00000100:00100000:0.0:1783134990.012086:0:6581:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fe7d2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+8:2367:x1869752373951744:12345-192.168.201.41@tcp:10:bash.0 00002000:00010000:0.0:1783134990.012400:0:6581:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:0.0:1783134990.012403:0:6581:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb mtime from disk: 1783134987 -> 1783134989 00002000:00010000:0.0:1783134990.012406:0:6581:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb atime from disk: 1783134986 -> 1783134986 00002000:00010000:0.0:1783134990.012409:0:6581:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb ctime from disk: 1783134987 -> 1783134989 00002000:00010000:0.0:1783134990.012411:0:6581:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:0.0:1783134990.012460:0:6581:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fe7d2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+9:2367:x1869752373951744:12345-192.168.201.41@tcp:10:bash.0 Request processed in 376us (907us total) trans 4294967318 rc 0/0 00000100:00100000:0.0:1783134990.012467:0:6581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 5 00002000:00010000:0.0:1783134990.012471:0:6581:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/5 (0->18446744073709551615) 00002000:00100000:0.0:1783134990.012474:0:6581:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9fe9fe7d2a00 with x1869752373951744 ext(0->18446744073709551615) 00002000:00010000:0.0:1783134990.012479:0:6581:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9fe9fe7d2a00. 00000100:00100000:3.0:1783134990.080832:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:2.0:1783134990.080937:0:5769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373951872 00000100:00100000:2.0:1783134990.080947:0:5769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373951872 00000100:00100000:2.0:1783134990.081007:0:5769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 194 00000100:00100000:2.0:1783134990.081017:0:5769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fe7d3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+32:11526:x1869752373951872:12345-192.168.201.41@tcp:34:lfs.0 00010000:00010000:2.0:1783134990.081085:0:5769:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828a00/0xd6c4b8f05867f2cb lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134990.081102:0:5769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828a00/0xd6c4b8f05867f2cb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134990.081113:0:5769:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828a00/0xd6c4b8f05867f2cb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134990.081139:0:5769:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829800/0xd6c4b8f05867f2d2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134990.081146:0:5769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829800/0xd6c4b8f05867f2d2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134990.081153:0:5769:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829800/0xd6c4b8f05867f2d2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134990.081793:0:5769:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b74e00/0xd6c4b8f05867f2d9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134990.081806:0:5769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b74e00/0xd6c4b8f05867f2d9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134990.081812:0:5769:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b74e00/0xd6c4b8f05867f2d9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1783134990.081845:0:5769:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b74e00/0xd6c4b8f05867f2d9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134990.081853:0:5769:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828a00/0xd6c4b8f05867f2cb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134990.081858:0:5769:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828a00/0xd6c4b8f05867f2cb lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134990.081862:0:5769:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828a00/0xd6c4b8f05867f2cb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134990.081865:0:5769:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe9c7828a00 already unused, calling callback (ffffffffc1f634f0) 00010000:00010000:3.0:1783134990.081868:0:5769:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828a00/0xd6c4b8f05867f2cb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134990.081872:0:5769:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828a00/0xd6c4b8f05867f2cb lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134990.081881:0:5769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9fe9e1c2b700) 00010000:00010000:3.0:1783134990.081883:0:5769:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783134990.081886:0:5769:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828a00/0xd6c4b8f05867f2cb lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134990.081892:0:5769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828a00/0xd6c4b8f05867f2cb lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134990.081912:0:5769:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829800/0xd6c4b8f05867f2d2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134990.081918:0:5769:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829800/0xd6c4b8f05867f2d2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134990.081924:0:5769:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829800/0xd6c4b8f05867f2d2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134990.081930:0:5769:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe9c7829800 already unused, calling callback (ffffffffc1f634f0) 00010000:00010000:3.0:1783134990.081933:0:5769:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829800/0xd6c4b8f05867f2d2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134990.081939:0:5769:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829800/0xd6c4b8f05867f2d2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134990.081947:0:5769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9fe9cc3c1f00) 00010000:00010000:3.0:1783134990.081949:0:5769:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783134990.081952:0:5769:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829800/0xd6c4b8f05867f2d2 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134990.081958:0:5769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829800/0xd6c4b8f05867f2d2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134990.081973:0:5769:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b74e00/0xd6c4b8f05867f2d9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134990.081980:0:5769:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b74e00/0xd6c4b8f05867f2d9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134990.081984:0:5769:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b74e00/0xd6c4b8f05867f2d9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134990.081993:0:5769:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe9d2b74e00 already unused, calling callback (ffffffffc1f634f0) 00010000:00010000:3.0:1783134990.081995:0:5769:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b74e00/0xd6c4b8f05867f2d9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134990.081999:0:5769:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b74e00/0xd6c4b8f05867f2d9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134990.082005:0:5769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9fe9c8301900) 00010000:00010000:3.0:1783134990.082006:0:5769:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783134990.082008:0:5769:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b74e00/0xd6c4b8f05867f2d9 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134990.082011:0:5769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b74e00/0xd6c4b8f05867f2d9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783134990.082083:0:5769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fe7d3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+32:11526:x1869752373951872:12345-192.168.201.41@tcp:34:lfs.0 Request processed in 1066us (1256us total) trans 0 rc 0/0 00000100:00100000:3.0:1783134990.082092:0:5769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 194 00000100:00100000:3.0:1783134990.116933:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:3.0:1783134990.117046:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:2.0:1783134990.117224:0:6576:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373952128 00000100:00100000:2.0:1783134990.117234:0:6576:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373952128 00000100:00100000:2.0:1783134990.117321:0:6576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 59 00000100:00100000:2.0:1783134990.117330:0:6576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9f68f1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+9:2369:x1869752373952128:12345-192.168.201.41@tcp:16:kworker.0 00000100:00100000:1.0:1783134990.117604:0:6582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373952000 00000100:00100000:1.0:1783134990.117609:0:6582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373952000 00002000:00100000:1.0:1783134990.117636:0:6582:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x5:0x0] (0->7) req@ffff9fe9f68f2a00 x1869752373952000/t0(0) o4->28f4ba61-cfae-499e-ab3d-81cb8215f7bb@192.168.201.41@tcp:161/0 lens 496/0 e 0 to 0 dl 1783135001 ref 1 fl New:/600/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1783134990.117646:0:6582:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9fe9f68f2a00 with x1869752373952000 ext(0->7) 00002000:00010000:1.0:1783134990.117652:0:6582:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9fe9f68f2a00 00000100:00100000:1.0:1783134990.117737:0:6582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 6 00000100:00100000:1.0:1783134990.117744:0:6582:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9f68f2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+10:2369:x1869752373952000:12345-192.168.201.41@tcp:4:bash.0 00000100:00100000:1.0:1783134990.118550:0:6582:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9f68f2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+12:2369:x1869752373952000:12345-192.168.201.41@tcp:4:bash.0 Request processed in 803us (1623us total) trans 4294967319 rc 0/0 00000100:00100000:1.0:1783134990.118559:0:6582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 6 00002000:00100000:1.0:1783134990.118567:0:6582:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x5:0x0] (0->7) req@ffff9fe9f68f2a00 x1869752373952000/t4294967319(0) o4->28f4ba61-cfae-499e-ab3d-81cb8215f7bb@192.168.201.41@tcp:161/0 lens 496/448 e 0 to 0 dl 1783135001 ref 1 fl Complete:/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1783134990.118575:0:6582:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9fe9f68f2a00 with x1869752373952000 ext(0->7) 00002000:00010000:1.0:1783134990.118580:0:6582:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9fe9f68f2a00 00000100:00100000:3.0:1783134990.119245:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:1.0:1783134990.119298:0:8031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373952384 00000100:00100000:1.0:1783134990.119305:0:8031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373952384 00000100:00100000:1.0:1783134990.119344:0:8031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 195 00000100:00100000:1.0:1783134990.119403:0:8031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9f68f2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+32:11529:x1869752373952384:12345-192.168.201.41@tcp:101:lfs.0 00010000:00010000:1.0:1783134990.119416:0:8031:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783134990.119435:0:8031:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43e400/0xd6c4b8f05867f2e0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4428da03f5eb748e expref: -99 pid: 8031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134990.119542:0:8031:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43f600/0xd6c4b8f05867f2e7 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134990.119557:0:8031:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43f600/0xd6c4b8f05867f2e7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134990.119569:0:8031:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43f600/0xd6c4b8f05867f2e7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134990.119582:0:8031:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43f800/0xd6c4b8f05867f2ee lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134990.119589:0:8031:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43f800/0xd6c4b8f05867f2ee lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134990.119601:0:8031:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43f800/0xd6c4b8f05867f2ee lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134990.119944:0:8031:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43f200/0xd6c4b8f05867f2f5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134990.119962:0:8031:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43f200/0xd6c4b8f05867f2f5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134990.119970:0:8031:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43f200/0xd6c4b8f05867f2f5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783134990.119980:0:8031:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:1.0:1783134990.120052:0:8031:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43f600/0xd6c4b8f05867f2e7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134990.120060:0:8031:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43f600/0xd6c4b8f05867f2e7 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134990.120067:0:8031:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43f600/0xd6c4b8f05867f2e7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134990.120074:0:8031:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe9fe43f600 already unused, calling callback (ffffffffc1f634f0) 00010000:00010000:1.0:1783134990.120079:0:8031:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43f600/0xd6c4b8f05867f2e7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134990.120087:0:8031:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43f600/0xd6c4b8f05867f2e7 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134990.120100:0:8031:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9fe9e1c2b700) 00010000:00010000:1.0:1783134990.120103:0:8031:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783134990.120115:0:8031:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43f600/0xd6c4b8f05867f2e7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134990.120122:0:8031:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43f600/0xd6c4b8f05867f2e7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134990.120134:0:8031:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43f800/0xd6c4b8f05867f2ee lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134990.120140:0:8031:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43f800/0xd6c4b8f05867f2ee lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134990.120146:0:8031:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43f800/0xd6c4b8f05867f2ee lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134990.120151:0:8031:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe9fe43f800 already unused, calling callback (ffffffffc1f634f0) 00010000:00010000:1.0:1783134990.120154:0:8031:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43f800/0xd6c4b8f05867f2ee lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134990.120160:0:8031:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43f800/0xd6c4b8f05867f2ee lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134990.120169:0:8031:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9fe9e1c2b000) 00010000:00010000:1.0:1783134990.120171:0:8031:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783134990.120175:0:8031:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43f800/0xd6c4b8f05867f2ee lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134990.120181:0:8031:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43f800/0xd6c4b8f05867f2ee lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134990.120218:0:8031:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43e400/0xd6c4b8f05867f2e0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb748e expref: 35 pid: 8031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134990.120243:0:8031:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43f200/0xd6c4b8f05867f2f5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb748e expref: 34 pid: 8031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134990.120250:0:8031:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9fe9c8301900) 00010000:00010000:1.0:1783134990.120252:0:8031:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1783134990.120255:0:8031:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fe9fe43f200, rc 0) 00000100:00100000:1.0:1783134990.120335:0:8031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9f68f2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+34:11529:x1869752373952384:12345-192.168.201.41@tcp:101:lfs.0 Request processed in 938us (1092us total) trans 4294967476 rc 0/0 00000100:00100000:1.0:1783134990.120342:0:8031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 195 00000100:00100000:1.0:1783134990.125663:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:1.0:1783134990.125701:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373952512 00000100:00100000:1.0:1783134990.125709:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373952512 00000100:00100000:1.0:1783134990.126446:0:5769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 196 00000100:00100000:1.0:1783134990.126457:0:5769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9f6fc3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+34:11529:x1869752373952512:12345-192.168.201.41@tcp:54:lfs.0 00010000:00010000:1.0:1783134990.126524:0:5769:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43e400/0xd6c4b8f05867f303 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134990.126543:0:5769:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43f400/0xd6c4b8f05867f2a8 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb7479 expref: 34 pid: 8031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134990.126553:0:5769:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43e400/0xd6c4b8f05867f303 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134990.126590:0:5769:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43f400/0xd6c4b8f05867f2a8 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb7479 expref: 34 pid: 8031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134990.126603:0:5769:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43f400/0xd6c4b8f05867f2a8 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb7479 expref: 34 pid: 8031 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783134990.126628:0:5769:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9f5ce2680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5769:1869752384419200:192.168.201.41@tcp:104: 00000100:00100000:1.0:1783134990.126715:0:5769:0:(client.c:2701:ptlrpc_set_wait()) set ffff9fe9ca8ae780 going to sleep for 11 seconds 00000100:00100000:3.0:1783134990.132030:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:2.0:1783134990.132640:0:5769:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9f5ce2680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5769:1869752384419200:192.168.201.41@tcp:104: 00000100:00100000:1.0:1783134990.132697:0:5772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373952768 00010000:00010000:2.0:1783134990.132702:0:5769:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43e400/0xd6c4b8f05867f303 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783134990.132715:0:5772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373952768 00000100:00100000:1.0:1783134990.132792:0:5772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 52 00000100:00100000:1.0:1783134990.132805:0:5772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9f68f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+35:5573:x1869752373952768:12345-192.168.201.41@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1783134990.133147:0:5772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9f68f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+36:5573:x1869752373952768:12345-192.168.201.41@tcp:35:ldlm_bl.0 Request processed in 344us (1132us total) trans 4294967477 rc 0/0 00000100:00100000:1.0:1783134990.133156:0:5772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 52 00000100:00100000:2.0:1783134990.136156:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:2.0:1783134990.136196:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373952896 00000100:00100000:2.0:1783134990.136205:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373952896 00010000:00010000:2.0:1783134990.136246:0:6592:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43f400/0xd6c4b8f05867f2a8 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb7479 expref: 36 pid: 8031 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783134990.136538:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 76 00000100:00100000:2.0:1783134990.136557:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9d1622c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+36:2370:x1869752373952896:12345-192.168.201.41@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783134990.136573:0:6592:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783134990.136581:0:6592:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43f400/0xd6c4b8f05867f2a8 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb7479 expref: 36 pid: 8031 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134990.136605:0:6592:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43f400/0xd6c4b8f05867f2a8 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb7479 expref: 36 pid: 8031 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134990.136631:0:6592:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43f400/0xd6c4b8f05867f2a8 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb7479 expref: 36 pid: 8031 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134990.136644:0:6592:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9fe9c8301900) 00010000:00010000:2.0:1783134990.136648:0:6592:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43e400/0xd6c4b8f05867f303 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134990.136656:0:6592:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43e400/0xd6c4b8f05867f303 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134990.136661:0:6592:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43e400/0xd6c4b8f05867f303 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134990.136696:0:6592:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783134990.136740:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9d1622c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+35:2370:x1869752373952896:12345-192.168.201.41@tcp:103:ldlm_bl.0 Request processed in 192us (593us total) trans 0 rc 0/0 00000100:00100000:2.0:1783134990.136745:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 76 00010000:00010000:3.0:1783134990.136843:0:5769:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43e400/0xd6c4b8f05867f303 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134990.136853:0:5769:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43e400/0xd6c4b8f05867f303 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134990.136883:0:5769:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43e400/0xd6c4b8f05867f303 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134990.136898:0:5769:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43e400/0xd6c4b8f05867f303 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134990.136906:0:5769:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43e400/0xd6c4b8f05867f303 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134990.136914:0:5769:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe9fe43e400 already unused, calling callback (ffffffffc1f634f0) 00010000:00010000:3.0:1783134990.136919:0:5769:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43e400/0xd6c4b8f05867f303 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134990.136927:0:5769:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43e400/0xd6c4b8f05867f303 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134990.137217:0:5769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9fe9c8301900) 00010000:00010000:3.0:1783134990.137221:0:5769:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1783134990.137226:0:5769:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43e400/0xd6c4b8f05867f303 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134990.137233:0:5769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43e400/0xd6c4b8f05867f303 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783134990.137324:0:5769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9f6fc3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+34:11529:x1869752373952512:12345-192.168.201.41@tcp:54:lfs.0 Request processed in 10868us (11668us total) trans 0 rc 0/0 00000100:00100000:3.0:1783134990.137333:0:5769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 196 00000100:00100000:2.0:1783134990.139669:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:1.0:1783134990.139733:0:5773:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373953152 00000100:00100000:1.0:1783134990.139742:0:5773:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373953152 00000100:00100000:1.0:1783134990.139846:0:5773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 53 00000100:00100000:1.0:1783134990.139859:0:5773:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9f6881c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+34:11529:x1869752373953152:12345-192.168.201.41@tcp:35:lfs.0 00000100:00100000:1.0:1783134990.140074:0:5773:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9f6881c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+35:11529:x1869752373953152:12345-192.168.201.41@tcp:35:lfs.0 Request processed in 218us (414us total) trans 4294967478 rc 0/0 00000100:00100000:1.0:1783134990.140080:0:5773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 53 00000001:00080000:0.0:1783134990.144500:0:7470:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967318 is committed 00000001:00080000:0.0:1783134990.144516:0:7470:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967317 is committed 00000100:00100000:2.0:1783134990.144626:0:6576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9f68f1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+9:2369:x1869752373952128:12345-192.168.201.41@tcp:16:kworker.0 Request processed in 27291us (27573us total) trans 0 rc 0/0 00000100:00100000:2.0:1783134990.144638:0:6576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 59 00000100:00100000:2.0:1783134990.203522:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:3.0:1783134990.203683:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373953408 00000100:00100000:3.0:1783134990.203692:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373953408 00000100:00100000:3.0:1783134990.203750:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 197 00000100:00100000:3.0:1783134990.203761:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9f6882300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+35:11540:x1869752373953408:12345-192.168.201.41@tcp:101:cat.0 00010000:00010000:3.0:1783134990.203797:0:5770:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783134990.203829:0:5770:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b74e00/0xd6c4b8f05867f30a lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4428da03f5eb7495 expref: -99 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134990.203921:0:5770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b75c00/0xd6c4b8f05867f311 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134990.203935:0:5770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b75c00/0xd6c4b8f05867f311 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134990.203947:0:5770:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b75c00/0xd6c4b8f05867f311 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134990.203961:0:5770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b74600/0xd6c4b8f05867f318 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134990.203969:0:5770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b74600/0xd6c4b8f05867f318 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134990.203976:0:5770:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b74600/0xd6c4b8f05867f318 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134990.204344:0:5770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b74c00/0xd6c4b8f05867f31f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134990.204354:0:5770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b74c00/0xd6c4b8f05867f31f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134990.204362:0:5770:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b74c00/0xd6c4b8f05867f31f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783134990.204395:0:5770:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 8 00010000:00010000:3.0:1783134990.204478:0:5770:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b75c00/0xd6c4b8f05867f311 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134990.204495:0:5770:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b75c00/0xd6c4b8f05867f311 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134990.204502:0:5770:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b75c00/0xd6c4b8f05867f311 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134990.204508:0:5770:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe9d2b75c00 already unused, calling callback (ffffffffc1f634f0) 00010000:00010000:3.0:1783134990.204513:0:5770:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b75c00/0xd6c4b8f05867f311 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134990.204520:0:5770:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b75c00/0xd6c4b8f05867f311 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134990.204533:0:5770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9fe9e1c2b700) 00010000:00010000:3.0:1783134990.204536:0:5770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783134990.204541:0:5770:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b75c00/0xd6c4b8f05867f311 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134990.204547:0:5770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b75c00/0xd6c4b8f05867f311 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134990.204558:0:5770:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b74600/0xd6c4b8f05867f318 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134990.204570:0:5770:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b74600/0xd6c4b8f05867f318 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134990.204577:0:5770:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b74600/0xd6c4b8f05867f318 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134990.204582:0:5770:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe9d2b74600 already unused, calling callback (ffffffffc1f634f0) 00010000:00010000:3.0:1783134990.204590:0:5770:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b74600/0xd6c4b8f05867f318 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134990.204596:0:5770:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b74600/0xd6c4b8f05867f318 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134990.204604:0:5770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9fe9cb8f4d00) 00010000:00010000:3.0:1783134990.204607:0:5770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783134990.204610:0:5770:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b74600/0xd6c4b8f05867f318 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134990.204616:0:5770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b74600/0xd6c4b8f05867f318 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134990.204655:0:5770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b74e00/0xd6c4b8f05867f30a lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb7495 expref: 38 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134990.204668:0:5770:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b74c00/0xd6c4b8f05867f31f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb7495 expref: 37 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134990.204675:0:5770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9fe9c8301900) 00010000:00010000:3.0:1783134990.204677:0:5770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1783134990.204680:0:5770:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fe9d2b74c00, rc 0) 00000100:00100000:3.0:1783134990.204742:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9f6882300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+37:11540:x1869752373953408:12345-192.168.201.41@tcp:101:cat.0 Request processed in 983us (1230us total) trans 4294967479 rc 0/0 00000100:00100000:3.0:1783134990.204749:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 197 00000100:00100000:0.0:1783134990.210828:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:2.0:1783134990.210949:0:5772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373953664 00000100:00100000:2.0:1783134990.210958:0:5772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373953664 00000100:00100000:2.0:1783134990.211025:0:5772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 54 00000100:00100000:2.0:1783134990.211035:0:5772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9f6cbed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+37:11540:x1869752373953664:12345-192.168.201.41@tcp:35:cat.0 00000100:00100000:2.0:1783134990.212021:0:5772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9f6cbed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+38:11540:x1869752373953664:12345-192.168.201.41@tcp:35:cat.0 Request processed in 984us (1198us total) trans 4294967480 rc 0/0 00000100:00100000:2.0:1783134990.212030:0:5772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 54 00000100:00100000:0.0:1783134990.238714:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:1.0:1783134990.239089:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373953920 00000100:00100000:1.0:1783134990.239098:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373953920 00000100:00100000:1.0:1783134990.239140:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 198 00000100:00100000:1.0:1783134990.239148:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9f6cbca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+38:11541:x1869752373953920:12345-192.168.201.41@tcp:36:rm.0 00010000:00010000:1.0:1783134990.239194:0:5771:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1783134990.239214:0:5771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b74c00/0xd6c4b8f05867f31f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb7495 expref: 38 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134990.239245:0:5771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43f200/0xd6c4b8f05867f2f5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb748e expref: 37 pid: 8031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134990.239253:0:5771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ad800/0xd6c4b8f05867f2bd lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb7480 expref: 36 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134990.239259:0:5771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9fe9c8301900) 00010000:00010000:1.0:1783134990.239266:0:5771:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1783134990.239302:0:5771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43f600/0xd6c4b8f05867f32d lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134990.239313:0:5771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43f600/0xd6c4b8f05867f32d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134990.239322:0:5771:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43f600/0xd6c4b8f05867f32d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134990.239335:0:5771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43e200/0xd6c4b8f05867f334 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134990.239343:0:5771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43e200/0xd6c4b8f05867f334 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134990.239351:0:5771:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43e200/0xd6c4b8f05867f334 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134990.239593:0:5771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43fa00/0xd6c4b8f05867f33b lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134990.239599:0:5771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43fa00/0xd6c4b8f05867f33b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134990.239608:0:5771:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43fa00/0xd6c4b8f05867f33b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1783134990.240047:0:5771:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].7, 64 off8712 00000004:00080000:1.0:1783134990.240054:0:5771:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 272635773883ns, next at 273635772503ns, rc = 0 00010000:00010000:1.0:1783134990.240094:0:5771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43f400/0xd6c4b8f05867f342 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134990.240100:0:5771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43f400/0xd6c4b8f05867f342 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134990.240105:0:5771:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43f400/0xd6c4b8f05867f342 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134990.240110:0:5771:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43f400/0xd6c4b8f05867f342 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134990.240113:0:5771:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43f400/0xd6c4b8f05867f342 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134990.240117:0:5771:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43f400/0xd6c4b8f05867f342 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134990.240130:0:5771:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783134990.240146:0:5771:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43fa00/0xd6c4b8f05867f33b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134990.240149:0:5771:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43fa00/0xd6c4b8f05867f33b lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134990.240153:0:5771:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43fa00/0xd6c4b8f05867f33b lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134990.240161:0:5757:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783134990.240162:0:5771:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe9fe43fa00 already unused, calling callback (ffffffffc1f634f0) 00010000:00010000:1.0:1783134990.240169:0:5771:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43fa00/0xd6c4b8f05867f33b lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134990.240169:0:5757:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43f400/0xd6c4b8f05867f342 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134990.240188:0:5757:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe9fe43f400 already unused, calling callback (ffffffffc1527ce0) 00010000:00010000:1.0:1783134990.240189:0:5771:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43fa00/0xd6c4b8f05867f33b lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134990.240192:0:5757:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43f400/0xd6c4b8f05867f342 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134990.240201:0:5771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9fe9e1c2b200) 00010000:00010000:1.0:1783134990.240205:0:5771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1783134990.240207:0:5771:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43fa00/0xd6c4b8f05867f33b lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134990.240208:0:5757:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43f400/0xd6c4b8f05867f342 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134990.240212:0:5771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43fa00/0xd6c4b8f05867f33b lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134990.240224:0:5771:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43f600/0xd6c4b8f05867f32d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134990.240227:0:5757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9fe9e1c2b200) 00010000:00010000:0.0:1783134990.240232:0:5757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1783134990.240233:0:5771:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43f600/0xd6c4b8f05867f32d lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134990.240235:0:5757:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43f400/0xd6c4b8f05867f342 lrc: 1/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134990.240242:0:5771:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43f600/0xd6c4b8f05867f32d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134990.240244:0:5757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43f400/0xd6c4b8f05867f342 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134990.240248:0:5771:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe9fe43f600 already unused, calling callback (ffffffffc1f634f0) 00010000:00010000:1.0:1783134990.240253:0:5771:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43f600/0xd6c4b8f05867f32d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134990.240259:0:5771:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43f600/0xd6c4b8f05867f32d lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134990.240261:0:5757:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783134990.240263:0:5757:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783134990.240265:0:5757:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783134990.240275:0:5771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9fe9e1c2b700) 00010000:00010000:1.0:1783134990.240291:0:5771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783134990.240294:0:5771:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43f600/0xd6c4b8f05867f32d lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134990.240299:0:5771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43f600/0xd6c4b8f05867f32d lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1783134990.240308:0:5771:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000cba0f853 reply state 000000007891751a transno 4294967481 ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43e200/0xd6c4b8f05867f334 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783134990.240316:0:5771:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1783134990.240402:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9f6cbca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+37:11541:x1869752373953920:12345-192.168.201.41@tcp:36:rm.0 Request processed in 1253us (1693us total) trans 4294967481 rc 0/0 00000100:00100000:1.0:1783134990.240411:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 198 00010000:00010000:0.0:1783134990.243411:0:3272:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43e200/0xd6c4b8f05867f334 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134990.243427:0:3272:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43e200/0xd6c4b8f05867f334 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134990.243434:0:3272:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43e200/0xd6c4b8f05867f334 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134990.243441:0:3272:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe9fe43e200 already unused, calling callback (ffffffffc1f634f0) 00010000:00010000:0.0:1783134990.243446:0:3272:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43e200/0xd6c4b8f05867f334 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134990.243454:0:3272:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43e200/0xd6c4b8f05867f334 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134990.243470:0:3272:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9fe9e1c2b000) 00010000:00010000:0.0:1783134990.243473:0:3272:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783134990.243478:0:3272:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43e200/0xd6c4b8f05867f334 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134990.243499:0:3272:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43e200/0xd6c4b8f05867f334 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783134990.273433:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:1.0:1783134990.273533:0:8031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373954176 00000100:00100000:1.0:1783134990.273541:0:8031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373954176 00000100:00100000:1.0:1783134990.273620:0:8031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 199 00000100:00100000:1.0:1783134990.273631:0:8031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9f6cbc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+36:11547:x1869752373954176:12345-192.168.201.41@tcp:101:bash.0 00010000:00010000:1.0:1783134990.273666:0:8031:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783134990.273685:0:8031:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43f600/0xd6c4b8f05867f349 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4428da03f5eb749c expref: -99 pid: 8031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134990.273797:0:8031:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43fa00/0xd6c4b8f05867f350 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134990.273809:0:8031:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43fa00/0xd6c4b8f05867f350 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134990.273832:0:8031:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43fa00/0xd6c4b8f05867f350 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134990.273846:0:8031:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43f200/0xd6c4b8f05867f357 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134990.273853:0:8031:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43f200/0xd6c4b8f05867f357 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134990.273859:0:8031:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43f200/0xd6c4b8f05867f357 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1783134990.274344:0:8031:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x5:0x0], index 0: 0 00010000:00010000:1.0:1783134990.274510:0:8031:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43e400/0xd6c4b8f05867f35e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134990.274520:0:8031:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43e400/0xd6c4b8f05867f35e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134990.274527:0:8031:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43e400/0xd6c4b8f05867f35e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134990.274561:0:8031:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43fa00/0xd6c4b8f05867f350 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134990.274568:0:8031:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43fa00/0xd6c4b8f05867f350 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134990.274575:0:8031:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43fa00/0xd6c4b8f05867f350 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134990.274581:0:8031:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe9fe43fa00 already unused, calling callback (ffffffffc1f634f0) 00010000:00010000:1.0:1783134990.274592:0:8031:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43fa00/0xd6c4b8f05867f350 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134990.274598:0:8031:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43fa00/0xd6c4b8f05867f350 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134990.274609:0:8031:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9fe9e1c2b700) 00010000:00010000:1.0:1783134990.274613:0:8031:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783134990.274617:0:8031:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43fa00/0xd6c4b8f05867f350 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134990.274623:0:8031:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43fa00/0xd6c4b8f05867f350 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1783134990.274641:0:8031:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000031e138cd reply state 00000000a947a2be transno 4294967482 ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43f200/0xd6c4b8f05867f357 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783134990.274650:0:8031:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1783134990.274677:0:8031:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43f600/0xd6c4b8f05867f349 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb749c expref: 39 pid: 8031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134990.274690:0:8031:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43e400/0xd6c4b8f05867f35e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb749c expref: 38 pid: 8031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134990.274698:0:8031:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9fe9e1c2bc00) 00010000:00010000:1.0:1783134990.274701:0:8031:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1783134990.274703:0:8031:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fe9fe43e400, rc 0) 00000100:00100000:1.0:1783134990.274766:0:8031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9f6cbc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+39:11547:x1869752373954176:12345-192.168.201.41@tcp:101:bash.0 Request processed in 1136us (1342us total) trans 4294967482 rc 0/0 00000100:00100000:1.0:1783134990.274774:0:8031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 199 00010000:00010000:0.0:1783134990.278609:0:3273:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43f200/0xd6c4b8f05867f357 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134990.278628:0:3273:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43f200/0xd6c4b8f05867f357 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134990.278635:0:3273:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43f200/0xd6c4b8f05867f357 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134990.278641:0:3273:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe9fe43f200 already unused, calling callback (ffffffffc1f634f0) 00010000:00010000:0.0:1783134990.278646:0:3273:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43f200/0xd6c4b8f05867f357 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134990.278654:0:3273:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43f200/0xd6c4b8f05867f357 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134990.278670:0:3273:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9fe9e1c2be00) 00010000:00010000:0.0:1783134990.278673:0:3273:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783134990.278677:0:3273:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43f200/0xd6c4b8f05867f357 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134990.278683:0:3273:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43f200/0xd6c4b8f05867f357 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783134990.278798:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:0.0:1783134990.278964:0:6574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373954304 00000100:00100000:0.0:1783134990.278973:0:6574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373954304 00000100:00100000:0.0:1783134990.279084:0:6574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 60 00000100:00100000:0.0:1783134990.279094:0:6574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9f68f1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+5:2370:x1869752373954304:12345-192.168.201.41@tcp:101:bash.0 00010000:00010000:0.0:1783134990.279113:0:6574:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783134990.279134:0:6574:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fa01f675/0xd6c4b8f05867f36c lrc: 2/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4428da03f5eb74a3 expref: -99 pid: 6574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1783134990.279160:0:6574:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1783134990.279180:0:6574:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=272s v=(0 0) 00010000:00010000:0.0:1783134990.279184:0:6574:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783134990.279194:0:6574:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fa01f675/0xd6c4b8f05867f36c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb74a3 expref: 6 pid: 6574 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134990.279212:0:6574:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000fa01f675/0xd6c4b8f05867f36c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb74a3 expref: 6 pid: 6574 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134990.279225:0:6574:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fe9f68ade00, rc 0) 00000100:00100000:0.0:1783134990.279312:0:6574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9f68f1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+6:2370:x1869752373954304:12345-192.168.201.41@tcp:101:bash.0 Request processed in 220us (518us total) trans 0 rc 0/0 00000100:00100000:0.0:1783134990.279319:0:6574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 60 00000100:00100000:0.0:1783134990.281679:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:3.0:1783134990.281798:0:6577:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373954432 00000100:00100000:3.0:1783134990.281806:0:6577:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373954432 00000100:00100000:3.0:1783134990.281896:0:6577:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 61 00000100:00100000:3.0:1783134990.281918:0:6577:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9f6cbe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+6:11547:x1869752373954432:12345-192.168.201.41@tcp:101:bash.0 00010000:00010000:3.0:1783134990.281936:0:6577:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783134990.281952:0:6577:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e4e233eb/0xd6c4b8f05867f373 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4428da03f5eb74aa expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134990.281979:0:6577:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000fa01f675/0xd6c4b8f05867f36c lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb74a3 expref: 7 pid: 6574 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134990.281988:0:6577:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783134990.281991:0:6577:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783134990.281996:0:6577:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e4e233eb/0xd6c4b8f05867f373 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb74aa expref: 7 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134990.282023:0:6577:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000fa01f675/0xd6c4b8f05867f36c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb74a3 expref: 7 pid: 6574 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134990.282036:0:6577:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000fa01f675/0xd6c4b8f05867f36c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb74a3 expref: 7 pid: 6574 timeout: 372 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783134990.282052:0:6577:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9f68f3800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6577:1869752384419328:192.168.201.41@tcp:104: 00000100:00100000:3.0:1783134990.282179:0:6577:0:(client.c:2701:ptlrpc_set_wait()) set ffff9fe9e9c68780 going to sleep for 11 seconds 00000100:00100000:3.0:1783134990.284005:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:0.0:1783134990.284094:0:5756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373954560 00000100:00100000:0.0:1783134990.284102:0:5756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373954560 00010000:00010000:0.0:1783134990.284133:0:5756:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000fa01f675/0xd6c4b8f05867f36c lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb74a3 expref: 8 pid: 6574 timeout: 372 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783134990.284170:0:5756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 77 00000100:00100000:0.0:1783134990.284179:0:5756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9f68f0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+8:2370:x1869752373954560:12345-192.168.201.41@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783134990.284203:0:5756:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783134990.284226:0:5756:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000fa01f675/0xd6c4b8f05867f36c lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb74a3 expref: 8 pid: 6574 timeout: 372 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134990.284240:0:5756:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000fa01f675/0xd6c4b8f05867f36c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb74a3 expref: 8 pid: 6574 timeout: 372 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134990.284265:0:5756:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783134990.284269:0:5756:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783134990.284316:0:5756:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000e4e233eb/0xd6c4b8f05867f373 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb74aa expref: 8 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134990.284330:0:5756:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e4e233eb/0xd6c4b8f05867f373 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb74aa expref: 8 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134990.284364:0:5756:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000e4e233eb/0xd6c4b8f05867f373 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb74aa expref: 8 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783134990.284389:0:5756:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9f6cbc700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5756:1869752384419456:192.168.201.41@tcp:105: 00000100:00100000:0.0:1783134990.284464:0:5756:0:(client.c:2701:ptlrpc_set_wait()) set ffff9fe9d1552600 going to sleep for 11 seconds 00010000:00010000:2.0:1783134990.285938:0:6577:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fa01f675/0xd6c4b8f05867f36c lrc: 0/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb74a3 expref: 8 pid: 6574 timeout: 372 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783134990.285957:0:6577:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9f68f3800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6577:1869752384419328:192.168.201.41@tcp:104: 00010000:00010000:2.0:1783134990.285986:0:6577:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000e4e233eb/0xd6c4b8f05867f373 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb74aa expref: 7 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134990.285999:0:6577:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fe9d2b74e00, rc 0) 00000100:00100000:2.0:1783134990.286092:0:6577:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9f6cbe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+7:11547:x1869752373954432:12345-192.168.201.41@tcp:101:bash.0 Request processed in 4175us (4420us total) trans 0 rc 0/0 00000100:00100000:2.0:1783134990.286100:0:6577:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 61 00000100:00100000:0.0:1783134990.287238:0:5756:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9f6cbc700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5756:1869752384419456:192.168.201.41@tcp:105: 00010000:00010000:0.0:1783134990.287265:0:5756:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783134990.287633:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:2.0:1783134990.287706:0:5773:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373954816 00000100:00100000:2.0:1783134990.287712:0:5773:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373954816 00000100:00100000:2.0:1783134990.287760:0:5773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 55 00000100:00100000:2.0:1783134990.287770:0:5773:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9f5ce1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+38:11547:x1869752373954816:12345-192.168.201.41@tcp:35:bash.0 00000100:00100000:0.0:1783134990.288268:0:5756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9f68f0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+6:2370:x1869752373954560:12345-192.168.201.41@tcp:103:ldlm_bl.0 Request processed in 4089us (4269us total) trans 0 rc 0/0 00000100:00100000:0.0:1783134990.288377:0:5756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 77 00000100:00100000:2.0:1783134990.288648:0:5773:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9f5ce1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+39:11547:x1869752373954816:12345-192.168.201.41@tcp:35:bash.0 Request processed in 879us (1015us total) trans 4294967483 rc 0/0 00000100:00100000:2.0:1783134990.288656:0:5773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 55 00000100:00100000:1.0:1783134990.380851:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:3.0:1783134990.380947:0:5769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373954944 00000100:00100000:3.0:1783134990.380958:0:5769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373954944 00000100:00100000:3.0:1783134990.381030:0:5769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 200 00000100:00100000:3.0:1783134990.381041:0:5769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9f5ce2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+39:11563:x1869752373954944:12345-192.168.201.41@tcp:101:lfs.0 00010000:00010000:3.0:1783134990.381079:0:5769:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783134990.381100:0:5769:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b75c00/0xd6c4b8f05867f37a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4428da03f5eb74b1 expref: -99 pid: 5769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134990.381181:0:5769:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b74600/0xd6c4b8f05867f381 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134990.381196:0:5769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b74600/0xd6c4b8f05867f381 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134990.381207:0:5769:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b74600/0xd6c4b8f05867f381 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783134990.381271:0:5769:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00000004:00200000:3.0:1783134990.381275:0:5769:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:3.0:1783134990.381337:0:5769:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b74600/0xd6c4b8f05867f381 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134990.381361:0:5769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b75c00/0xd6c4b8f05867f37a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb74b1 expref: 41 pid: 5769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134990.381390:0:5769:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b74600/0xd6c4b8f05867f381 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb74b1 expref: 40 pid: 5769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134990.381399:0:5769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9fe9e1c2b700) 00010000:00010000:3.0:1783134990.381402:0:5769:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1783134990.381406:0:5769:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fe9d2b74600, rc 0) 00000100:00100000:3.0:1783134990.381458:0:5769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9f5ce2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+40:11563:x1869752373954944:12345-192.168.201.41@tcp:101:lfs.0 Request processed in 419us (620us total) trans 0 rc 0/0 00000100:00100000:3.0:1783134990.381465:0:5769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 200 00000100:00100000:3.0:1783134990.386643:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:0.0:1783134990.386736:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373955200 00000100:00100000:0.0:1783134990.386744:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373955200 00000100:00100000:0.0:1783134990.386789:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 201 00000100:00100000:0.0:1783134990.386796:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9f68f2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+40:11563:x1869752373955200:12345-192.168.201.41@tcp:101:lfs.0 00010000:00010000:0.0:1783134990.386813:0:5770:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783134990.386832:0:5770:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ad600/0xd6c4b8f05867f388 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4428da03f5eb74b8 expref: -99 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134990.386931:0:5770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ad000/0xd6c4b8f05867f38f lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134990.386946:0:5770:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43e400/0xd6c4b8f05867f35e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb749c expref: 41 pid: 8031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134990.386956:0:5770:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ad000/0xd6c4b8f05867f38f lrc: 4/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134990.387087:0:5770:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43e400/0xd6c4b8f05867f35e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb749c expref: 41 pid: 8031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134990.387097:0:5770:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43e400/0xd6c4b8f05867f35e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb749c expref: 41 pid: 8031 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783134990.387108:0:5770:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9f6cbc700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5770:1869752384419584:192.168.201.41@tcp:104: 00000100:00100000:0.0:1783134990.387202:0:5770:0:(client.c:2701:ptlrpc_set_wait()) set ffff9fe9d1552600 going to sleep for 11 seconds 00000100:00100000:0.0:1783134990.389307:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:2.0:1783134990.389388:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373955328 00000100:00100000:2.0:1783134990.389397:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373955328 00010000:00010000:2.0:1783134990.389444:0:6592:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43e400/0xd6c4b8f05867f35e lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb749c expref: 42 pid: 8031 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783134990.389496:0:5770:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9f6cbc700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5770:1869752384419584:192.168.201.41@tcp:104: 00010000:00010000:3.0:1783134990.389517:0:5770:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ad000/0xd6c4b8f05867f38f lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783134990.389524:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 78 00000100:00100000:2.0:1783134990.389533:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9f6cbfb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+42:2370:x1869752373955328:12345-192.168.201.41@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783134990.389546:0:6592:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783134990.389552:0:6592:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43e400/0xd6c4b8f05867f35e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb749c expref: 42 pid: 8031 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134990.389563:0:6592:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43e400/0xd6c4b8f05867f35e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb749c expref: 42 pid: 8031 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134990.389579:0:6592:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43e400/0xd6c4b8f05867f35e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb749c expref: 42 pid: 8031 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134990.389591:0:6592:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9fe9e1c2bc00) 00010000:00010000:2.0:1783134990.389594:0:6592:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ad000/0xd6c4b8f05867f38f lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134990.389600:0:6592:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ad000/0xd6c4b8f05867f38f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134990.389605:0:6592:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ad000/0xd6c4b8f05867f38f lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134990.389623:0:6592:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1783134990.389646:0:5770:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ad000/0xd6c4b8f05867f38f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134990.389652:0:5770:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ad000/0xd6c4b8f05867f38f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783134990.389669:0:5770:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00000100:00100000:2.0:1783134990.389671:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9f6cbfb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+41:2370:x1869752373955328:12345-192.168.201.41@tcp:103:ldlm_bl.0 Request processed in 139us (396us total) trans 0 rc 0/0 00000100:00100000:2.0:1783134990.389677:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 78 00010000:00010000:3.0:1783134990.389807:0:5770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ad600/0xd6c4b8f05867f388 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb74b8 expref: 42 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134990.389822:0:5770:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ad000/0xd6c4b8f05867f38f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb74b8 expref: 41 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134990.389829:0:5770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9fe9e1c2bc00) 00010000:00010000:3.0:1783134990.389832:0:5770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1783134990.389834:0:5770:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fe9f68ad000, rc 0) 00000100:00100000:3.0:1783134990.390089:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9f68f2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+41:11563:x1869752373955200:12345-192.168.201.41@tcp:101:lfs.0 Request processed in 3291us (3455us total) trans 4294967484 rc 0/0 00000100:00100000:3.0:1783134990.390097:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 201 00000100:00100000:0.0:1783134990.391743:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:3.0:1783134990.391829:0:5769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373955584 00000100:00100000:3.0:1783134990.391837:0:5769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373955584 00000100:00100000:3.0:1783134990.391892:0:5769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 202 00000100:00100000:3.0:1783134990.391900:0:5769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9f6cbd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+41:11563:x1869752373955584:12345-192.168.201.41@tcp:101:lfs.0 00010000:00010000:3.0:1783134990.391933:0:5769:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783134990.391936:0:5769:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1783134990.391956:0:5769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ad000/0xd6c4b8f05867f38f lrc: 0/0,0 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb74b8 expref: 41 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134990.391972:0:5769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9fe9e1c2bc00) 00010000:00010000:3.0:1783134990.392246:0:5769:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1783134990.392263:0:5769:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b75c00/0xd6c4b8f05867f39d lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4428da03f5eb74bf expref: -99 pid: 5769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134990.392436:0:5769:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b75800/0xd6c4b8f05867f3a4 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134990.392449:0:5769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b75800/0xd6c4b8f05867f3a4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134990.392459:0:5769:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b75800/0xd6c4b8f05867f3a4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783134990.392471:0:5769:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:3.0:1783134990.392576:0:5769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b75c00/0xd6c4b8f05867f39d lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb74bf expref: 43 pid: 5769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134990.392590:0:5769:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b75800/0xd6c4b8f05867f3a4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb74bf expref: 42 pid: 5769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134990.392597:0:5769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9fe9cb8f4d00) 00010000:00010000:3.0:1783134990.392600:0:5769:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1783134990.392602:0:5769:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fe9d2b75800, rc 0) 00000100:00100000:3.0:1783134990.392698:0:5769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9f6cbd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+42:11563:x1869752373955584:12345-192.168.201.41@tcp:101:lfs.0 Request processed in 798us (961us total) trans 4294967485 rc 0/0 00000100:00100000:3.0:1783134990.392706:0:5769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 202 00000100:00100000:1.0:1783134990.396705:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:2.0:1783134990.398565:0:8031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373955712 00000100:00100000:2.0:1783134990.398577:0:8031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373955712 00000100:00100000:2.0:1783134990.398674:0:8031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 203 00000100:00100000:2.0:1783134990.398684:0:8031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9f6cb1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+42:11563:x1869752373955712:12345-192.168.201.41@tcp:101:lfs.0 00010000:00010000:2.0:1783134990.398709:0:8031:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783134990.398728:0:8031:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828000/0xd6c4b8f05867f3b2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4428da03f5eb74c6 expref: -99 pid: 8031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134990.398788:0:8031:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828000/0xd6c4b8f05867f3b2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb74c6 expref: 43 pid: 8031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134990.398803:0:8031:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828000/0xd6c4b8f05867f3b2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb74c6 expref: 43 pid: 8031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134990.398822:0:8031:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9fe9cb8f4d00) 00010000:00010000:2.0:1783134990.398825:0:8031:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1783134990.398829:0:8031:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fe9c7828000, rc 0) 00000100:00100000:2.0:1783134990.398897:0:8031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9f6cb1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+43:11563:x1869752373955712:12345-192.168.201.41@tcp:101:lfs.0 Request processed in 214us (2202us total) trans 0 rc 0/0 00000100:00100000:2.0:1783134990.398905:0:8031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 203 00000100:00100000:0.0:1783134990.405271:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:2.0:1783134990.405597:0:7676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373955840 00000100:00100000:2.0:1783134990.405607:0:7676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373955840 00000100:00100000:2.0:1783134990.405663:0:7676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 62 00000100:00100000:2.0:1783134990.405673:0:7676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9f6cbea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+6:2368:x1869752373955840:12345-192.168.201.41@tcp:1:lfs.0 00010000:00010000:2.0:1783134990.405718:0:7676:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000365388e0/0xd6c4b8f05867f3b9 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 7676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134990.405738:0:7676:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000e4e233eb/0xd6c4b8f05867f373 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb74aa expref: 6 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134990.405761:0:7676:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783134990.405766:0:7676:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1783134990.405770:0:7676:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000365388e0/0xd6c4b8f05867f3b9 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 7676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134990.405803:0:7676:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000e4e233eb/0xd6c4b8f05867f373 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb74aa expref: 6 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134990.405817:0:7676:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000e4e233eb/0xd6c4b8f05867f373 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb74aa expref: 6 pid: 6577 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783134990.405832:0:7676:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9f6881500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:7676:1869752384419712:192.168.201.41@tcp:104: 00000100:00100000:2.0:1783134990.405959:0:7676:0:(client.c:2701:ptlrpc_set_wait()) set ffff9fe9f42c36c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783134990.413473:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:2.0:1783134990.413806:0:7676:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9f6881500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:7676:1869752384419712:192.168.201.41@tcp:104: 00010000:00010000:2.0:1783134990.413832:0:7676:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000365388e0/0xd6c4b8f05867f3b9 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 7676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783134990.413984:0:6581:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373955968 00000100:00100000:1.0:1783134990.413991:0:6581:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373955968 00002000:00100000:1.0:1783134990.414037:0:6581:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x5:0x0] (0->8) req@ffff9fe9f6cbd500 x1869752373955968/t0(0) o4->28f4ba61-cfae-499e-ab3d-81cb8215f7bb@192.168.201.41@tcp:161/0 lens 504/0 e 0 to 0 dl 1783135001 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1783134990.414047:0:6581:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9fe9f6cbd500 with x1869752373955968 ext(0->8) 00010000:00010000:1.0:1783134990.414055:0:6581:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000e4e233eb/0xd6c4b8f05867f373 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb74aa expref: 7 pid: 6577 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134990.414069:0:6581:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000e4e233eb/0xd6c4b8f05867f373 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb74aa expref: 7 pid: 6577 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1783134990.414077:0:6581:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9fe9f6cbd500 00000100:00100000:1.0:1783134990.414148:0:6581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 3 00000100:00100000:1.0:1783134990.414158:0:6581:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9f6cbd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+7:2369:x1869752373955968:12345-192.168.201.41@tcp:4:lfs.0 00000100:00100000:1.0:1783134990.414798:0:6581:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9f6cbd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+9:2369:x1869752373955968:12345-192.168.201.41@tcp:4:lfs.0 Request processed in 639us (1333us total) trans 4294967308 rc 0/0 00000100:00100000:1.0:1783134990.414808:0:6581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 3 00002000:00100000:1.0:1783134990.414815:0:6581:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x5:0x0] (0->8) req@ffff9fe9f6cbd500 x1869752373955968/t4294967308(0) o4->28f4ba61-cfae-499e-ab3d-81cb8215f7bb@192.168.201.41@tcp:161/0 lens 504/448 e 0 to 0 dl 1783135001 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1783134990.414825:0:6581:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9fe9f6cbd500 with x1869752373955968 ext(0->8) 00010000:00010000:1.0:1783134990.414831:0:6581:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000e4e233eb/0xd6c4b8f05867f373 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb74aa expref: 9 pid: 6577 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134990.414857:0:6581:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000e4e233eb/0xd6c4b8f05867f373 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb74aa expref: 9 pid: 6577 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1783134990.414865:0:6581:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9fe9f6cbd500 00000100:00100000:1.0:1783134990.417051:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:3.0:1783134990.417127:0:5755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373956096 00000100:00100000:3.0:1783134990.417137:0:5755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373956096 00010000:00010000:3.0:1783134990.417174:0:5755:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000e4e233eb/0xd6c4b8f05867f373 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb74aa expref: 9 pid: 6577 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783134990.417214:0:5755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 79 00000100:00100000:3.0:1783134990.417224:0:5755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9f6cb3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+9:2370:x1869752373956096:12345-192.168.201.41@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783134990.417239:0:5755:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1783134990.417256:0:5755:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:3.0:1783134990.417259:0:5755:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 0 -> 1783134990 00002000:00010000:3.0:1783134990.417261:0:5755:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb atime from disk: 0 -> 1783134990 00002000:00010000:3.0:1783134990.417264:0:5755:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 0 -> 1783134990 00010000:00010000:3.0:1783134990.417270:0:5755:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000e4e233eb/0xd6c4b8f05867f373 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb74aa expref: 9 pid: 6577 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134990.417478:0:5755:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000e4e233eb/0xd6c4b8f05867f373 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb74aa expref: 9 pid: 6577 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134990.417502:0:5755:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e4e233eb/0xd6c4b8f05867f373 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb74aa expref: 9 pid: 6577 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134990.417520:0:5755:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1783134990.417524:0:5755:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1783134990.417529:0:5755:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000365388e0/0xd6c4b8f05867f3b9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 7676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134990.417550:0:5755:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000365388e0/0xd6c4b8f05867f3b9 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 7676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134990.417860:0:5755:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783134990.417924:0:5755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9f6cb3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+8:2370:x1869752373956096:12345-192.168.201.41@tcp:103:ldlm_bl.0 Request processed in 701us (881us total) trans 0 rc 0/0 00000100:00100000:2.0:1783134990.417930:0:5755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 79 00010000:00010000:0.0:1783134990.417967:0:7676:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000365388e0/0xd6c4b8f05867f3b9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 7676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134990.417974:0:7676:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000365388e0/0xd6c4b8f05867f3b9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 7676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134990.417992:0:7676:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000365388e0/0xd6c4b8f05867f3b9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 7676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134990.417997:0:7676:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000365388e0/0xd6c4b8f05867f3b9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 7676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134990.418002:0:7676:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000365388e0/0xd6c4b8f05867f3b9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 7676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134990.418006:0:7676:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe9c7828c00 already unused, calling callback (ffffffffc1527ce0) 00010000:00010000:0.0:1783134990.418009:0:7676:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000365388e0/0xd6c4b8f05867f3b9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 7676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134990.418014:0:7676:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000365388e0/0xd6c4b8f05867f3b9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 7676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134990.418022:0:7676:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000365388e0/0xd6c4b8f05867f3b9 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 7676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134990.418026:0:7676:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000365388e0/0xd6c4b8f05867f3b9 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 7676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783134990.418082:0:7676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9f6cbea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+7:2368:x1869752373955840:12345-192.168.201.41@tcp:1:lfs.0 Request processed in 12410us (12821us total) trans 0 rc 0/0 00000100:00100000:0.0:1783134990.418091:0:7676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 62 00000100:00100000:0.0:1783134990.420140:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:1.0:1783134990.420207:0:5772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373956352 00000100:00100000:1.0:1783134990.420215:0:5772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373956352 00000100:00100000:1.0:1783134990.420262:0:5772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 56 00000100:00100000:1.0:1783134990.420273:0:5772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9e0bf4c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+43:11563:x1869752373956352:12345-192.168.201.41@tcp:35:lfs.0 00000004:00010000:1.0:1783134990.420357:0:5772:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0xe:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b75800/0xd6c4b8f05867f3a4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb74bf expref: 43 pid: 5769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1783134990.420610:0:5772:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967486 00000001:00080000:1.0:1783134990.420636:0:5772:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967487 00000001:00080000:1.0:1783134990.420874:0:5772:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967488 00010000:00010000:1.0:1783134990.420923:0:5772:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43ec00/0xd6c4b8f05867f3c0 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134990.420937:0:5772:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828000/0xd6c4b8f05867f3b2 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb74c6 expref: 47 pid: 8031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134990.420944:0:5772:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43ec00/0xd6c4b8f05867f3c0 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134990.420970:0:5772:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828000/0xd6c4b8f05867f3b2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb74c6 expref: 47 pid: 8031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134990.420987:0:5772:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828000/0xd6c4b8f05867f3b2 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb74c6 expref: 47 pid: 8031 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783134990.420998:0:5772:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9f6cb3100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5772:1869752384419840:192.168.201.41@tcp:104: 00000100:00100000:1.0:1783134990.421207:0:5772:0:(client.c:2701:ptlrpc_set_wait()) set ffff9fe9e9c696c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783134990.424502:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:2.0:1783134990.424554:0:5754:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373956480 00000100:00100000:2.0:1783134990.424563:0:5754:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373956480 00000100:00100000:1.0:1783134990.424601:0:5772:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9f6cb3100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5772:1869752384419840:192.168.201.41@tcp:104: 00010000:00010000:2.0:1783134990.424602:0:5754:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828000/0xd6c4b8f05867f3b2 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb74c6 expref: 48 pid: 8031 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134990.424625:0:5772:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43ec00/0xd6c4b8f05867f3c0 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5772 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783134990.424713:0:5754:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 80 00000100:00100000:2.0:1783134990.424724:0:5754:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9f6cbdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+48:2370:x1869752373956480:12345-192.168.201.41@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783134990.424739:0:5754:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783134990.424746:0:5754:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828000/0xd6c4b8f05867f3b2 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb74c6 expref: 48 pid: 8031 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134990.424759:0:5754:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828000/0xd6c4b8f05867f3b2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb74c6 expref: 48 pid: 8031 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134990.424847:0:5754:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828000/0xd6c4b8f05867f3b2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb74c6 expref: 48 pid: 8031 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134990.424875:0:5754:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9fe9cb8f4d00) 00010000:00010000:2.0:1783134990.424880:0:5754:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43ec00/0xd6c4b8f05867f3c0 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134990.424889:0:5754:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43ec00/0xd6c4b8f05867f3c0 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134990.424896:0:5754:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43ec00/0xd6c4b8f05867f3c0 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134990.424923:0:5754:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783134990.424975:0:5754:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9f6cbdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+47:2370:x1869752373956480:12345-192.168.201.41@tcp:103:ldlm_bl.0 Request processed in 253us (479us total) trans 0 rc 0/0 00010000:00010000:1.0:1783134990.425161:0:5772:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43ec00/0xd6c4b8f05867f3c0 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134990.425168:0:5772:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43ec00/0xd6c4b8f05867f3c0 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5772 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1783134990.425310:0:5772:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967489 00000001:00080000:1.0:1783134990.426546:0:5772:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967490 00000100:00100000:1.0:1783134990.426673:0:5772:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9f6cb3100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5772:1869752384419968:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1783134990.426744:0:5772:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783134990.426778:0:5772:0:(client.c:2701:ptlrpc_set_wait()) set ffff9fe9e9c69900 going to sleep for 11 seconds 00000100:00100000:0.0:1783134990.426841:0:5775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384419968 00000100:00100000:0.0:1783134990.426848:0:5775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384419968 00000100:00100000:0.0:1783134990.426915:0:5775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1783134990.426924:0:5775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9f6cb0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5772:x1869752384419968:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1783134990.426993:0:5775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9f6cb0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5772:x1869752384419968:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 70us (248us total) trans 0 rc 0/0 00000100:00100000:0.0:1783134990.427000:0:5775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00080000:1.0:1783134990.427056:0:5766:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1783134990.427086:0:5772:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9f6cb3100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5772:1869752384419968:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:1.0:1783134990.427590:0:5772:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967491 00000100:00100000:1.0:1783134990.427649:0:5772:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9f6cb3100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5772:1869752384420096:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1783134990.427675:0:5772:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783134990.427700:0:5772:0:(client.c:2701:ptlrpc_set_wait()) set ffff9fe9e9c696c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783134990.427740:0:5774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384420096 00000100:00100000:1.0:1783134990.427745:0:5774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384420096 00000100:00100000:1.0:1783134990.427763:0:5774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1783134990.427770:0:5774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9f6cb3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5772:x1869752384420096:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1783134990.427892:0:5774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9f6cb3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:5772:x1869752384420096:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 122us (215us total) trans 4294967309 rc 0/0 00000100:00100000:1.0:1783134990.427899:0:5774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1783134990.427927:0:5772:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9f6cb3100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5772:1869752384420096:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:1.0:1783134990.427964:0:5772:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967492 00010000:00010000:1.0:1783134990.427999:0:5772:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43ec00/0xd6c4b8f05867f3c0 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134990.428009:0:5772:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43ec00/0xd6c4b8f05867f3c0 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134990.428016:0:5772:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43ec00/0xd6c4b8f05867f3c0 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134990.428023:0:5772:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe9fe43ec00 already unused, calling callback (ffffffffc1f634f0) 00010000:00010000:1.0:1783134990.428028:0:5772:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43ec00/0xd6c4b8f05867f3c0 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134990.428035:0:5772:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43ec00/0xd6c4b8f05867f3c0 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134990.428050:0:5772:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9fe9cb8f4d00) 00010000:00010000:1.0:1783134990.428053:0:5772:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1783134990.428058:0:5772:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43ec00/0xd6c4b8f05867f3c0 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134990.428064:0:5772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43ec00/0xd6c4b8f05867f3c0 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5772 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1783134990.428217:0:5772:0:(mdd_object.c:4010:mdd_close()) Object [0x200000401:0xf:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:1.0:1783134990.428335:0:5772:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5, 64 off8512 00000004:00080000:1.0:1783134990.428345:0:5772:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 272824064934ns, next at 273824062727ns, rc = 0 00000001:00080000:1.0:1783134990.428352:0:5772:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967493 00010000:00010000:1.0:1783134990.429592:0:5772:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9fe9cb8f4d00) 00010000:00010000:1.0:1783134990.429597:0:5772:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1783134990.429608:0:5772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b75800/0xd6c4b8f05867f3a4 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb74bf expref: 52 pid: 5769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783134990.429726:0:5772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9e0bf4c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+51:11563:x1869752373956352:12345-192.168.201.41@tcp:35:lfs.0 Request processed in 9454us (9589us total) trans 4294967494 rc 0/0 00000100:00100000:1.0:1783134990.429734:0:5772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 56 00000020:00080000:1.0:1783134990.429739:0:5772:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:2.0:1783134990.430382:0:5754:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 80 00000100:00100000:0.0:1783134990.435175:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:1.0:1783134990.435401:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373956608 00000100:00100000:1.0:1783134990.435415:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373956608 00000100:00100000:1.0:1783134990.435739:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 204 00000100:00100000:1.0:1783134990.435750:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9f6cbd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+50:11563:x1869752373956608:12345-192.168.201.41@tcp:101:lfs.0 00010000:00010000:1.0:1783134990.435774:0:5771:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783134990.435798:0:5771:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43fe00/0xd6c4b8f05867f3c7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4428da03f5eb74cd expref: -99 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134990.435857:0:5771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43fe00/0xd6c4b8f05867f3c7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb74cd expref: 51 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134990.435872:0:5771:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43fe00/0xd6c4b8f05867f3c7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb74cd expref: 51 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134990.435912:0:5771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9fe9e1c2ba00) 00010000:00010000:1.0:1783134990.435916:0:5771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1783134990.435920:0:5771:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fe9fe43fe00, rc 0) 00000100:00100000:1.0:1783134990.436494:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9f6cbd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+51:11563:x1869752373956608:12345-192.168.201.41@tcp:101:lfs.0 Request processed in 743us (1330us total) trans 0 rc 0/0 00000100:00100000:1.0:1783134990.436502:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 204 00000100:00100000:0.0:1783134990.440711:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:2.0:1783134990.440768:0:5773:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373956864 00000100:00100000:2.0:1783134990.440790:0:5773:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373956864 00000100:00100000:2.0:1783134990.440846:0:5773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 57 00000100:00100000:2.0:1783134990.440857:0:5773:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9f6cbe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+51:11563:x1869752373956864:12345-192.168.201.41@tcp:35:lfs.0 00000100:00100000:2.0:1783134990.441079:0:5773:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9f6cbe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+52:11563:x1869752373956864:12345-192.168.201.41@tcp:35:lfs.0 Request processed in 223us (376us total) trans 4294967495 rc 0/0 00000100:00100000:2.0:1783134990.441085:0:5773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 57 00000100:00100000:0.0:1783134990.496711:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:3.0:1783134990.496790:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373956992 00000100:00100000:3.0:1783134990.496799:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373956992 00000100:00100000:3.0:1783134990.496928:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 205 00000100:00100000:3.0:1783134990.496939:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9f6cbdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+52:11573:x1869752373956992:12345-192.168.201.41@tcp:34:lfs.0 00010000:00010000:3.0:1783134990.497013:0:5770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b74e00/0xd6c4b8f05867f3ce lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134990.497030:0:5770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b74e00/0xd6c4b8f05867f3ce lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134990.497051:0:5770:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b74e00/0xd6c4b8f05867f3ce lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134990.497066:0:5770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b75c00/0xd6c4b8f05867f3d5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134990.497071:0:5770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b75c00/0xd6c4b8f05867f3d5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134990.497076:0:5770:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b75c00/0xd6c4b8f05867f3d5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134990.497175:0:5770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b74000/0xd6c4b8f05867f3dc lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134990.497181:0:5770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b74000/0xd6c4b8f05867f3dc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134990.497196:0:5770:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b74000/0xd6c4b8f05867f3dc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1783134990.497231:0:5770:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b74000/0xd6c4b8f05867f3dc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134990.497240:0:5770:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b74e00/0xd6c4b8f05867f3ce lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134990.497244:0:5770:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b74e00/0xd6c4b8f05867f3ce lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134990.497249:0:5770:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b74e00/0xd6c4b8f05867f3ce lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134990.497252:0:5770:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe9d2b74e00 already unused, calling callback (ffffffffc1f634f0) 00010000:00010000:3.0:1783134990.497255:0:5770:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b74e00/0xd6c4b8f05867f3ce lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134990.497259:0:5770:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b74e00/0xd6c4b8f05867f3ce lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134990.497267:0:5770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9fe9e1c2b700) 00010000:00010000:3.0:1783134990.497269:0:5770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783134990.497272:0:5770:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b74e00/0xd6c4b8f05867f3ce lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134990.497275:0:5770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b74e00/0xd6c4b8f05867f3ce lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134990.497315:0:5770:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b75c00/0xd6c4b8f05867f3d5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134990.497324:0:5770:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b75c00/0xd6c4b8f05867f3d5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134990.497328:0:5770:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b75c00/0xd6c4b8f05867f3d5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134990.497331:0:5770:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe9d2b75c00 already unused, calling callback (ffffffffc1f634f0) 00010000:00010000:3.0:1783134990.497333:0:5770:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b75c00/0xd6c4b8f05867f3d5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134990.497338:0:5770:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b75c00/0xd6c4b8f05867f3d5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134990.497345:0:5770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9fe9cb8f4c00) 00010000:00010000:3.0:1783134990.497346:0:5770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783134990.497348:0:5770:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b75c00/0xd6c4b8f05867f3d5 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134990.497352:0:5770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b75c00/0xd6c4b8f05867f3d5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134990.497375:0:5770:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b74000/0xd6c4b8f05867f3dc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134990.497383:0:5770:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b74000/0xd6c4b8f05867f3dc lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134990.497387:0:5770:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b74000/0xd6c4b8f05867f3dc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134990.497390:0:5770:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe9d2b74000 already unused, calling callback (ffffffffc1f634f0) 00010000:00010000:3.0:1783134990.497397:0:5770:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b74000/0xd6c4b8f05867f3dc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134990.497401:0:5770:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b74000/0xd6c4b8f05867f3dc lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134990.497406:0:5770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9fe9e1c2ba00) 00010000:00010000:3.0:1783134990.497408:0:5770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783134990.497409:0:5770:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b74000/0xd6c4b8f05867f3dc lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134990.497413:0:5770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b74000/0xd6c4b8f05867f3dc lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783134990.497529:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9f6cbdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+52:11573:x1869752373956992:12345-192.168.201.41@tcp:34:lfs.0 Request processed in 590us (825us total) trans 0 rc 0/0 00000100:00100000:2.0:1783134990.497539:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 205 00000100:00100000:0.0:1783134990.522762:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:3.0:1783134990.523000:0:5769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373957248 00000100:00100000:3.0:1783134990.523100:0:5769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373957248 00000100:00100000:3.0:1783134990.523160:0:5769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 206 00000100:00100000:3.0:1783134990.523169:0:5769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9f6cbf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+52:11576:x1869752373957248:12345-192.168.201.41@tcp:101:lfs.0 00010000:00010000:3.0:1783134990.523188:0:5769:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783134990.523207:0:5769:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b74000/0xd6c4b8f05867f3e3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4428da03f5eb74d4 expref: -99 pid: 5769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134990.523274:0:5769:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b75c00/0xd6c4b8f05867f3ea lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134990.523378:0:5769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b75c00/0xd6c4b8f05867f3ea lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134990.523390:0:5769:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b75c00/0xd6c4b8f05867f3ea lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134990.523595:0:5769:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828000/0xd6c4b8f05867f3f1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134990.523662:0:5769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828000/0xd6c4b8f05867f3f1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134990.523670:0:5769:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828000/0xd6c4b8f05867f3f1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134990.523784:0:5769:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829400/0xd6c4b8f05867f3f8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134990.523791:0:5769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829400/0xd6c4b8f05867f3f8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134990.523798:0:5769:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829400/0xd6c4b8f05867f3f8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783134990.523807:0:5769:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:2.0:1783134990.523997:0:5769:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b75c00/0xd6c4b8f05867f3ea lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134990.524118:0:5769:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b75c00/0xd6c4b8f05867f3ea lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134990.524125:0:5769:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b75c00/0xd6c4b8f05867f3ea lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134990.524132:0:5769:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe9d2b75c00 already unused, calling callback (ffffffffc1f634f0) 00010000:00010000:2.0:1783134990.524136:0:5769:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b75c00/0xd6c4b8f05867f3ea lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134990.524144:0:5769:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b75c00/0xd6c4b8f05867f3ea lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134990.524155:0:5769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9fe9e1c2b700) 00010000:00010000:2.0:1783134990.524158:0:5769:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783134990.524162:0:5769:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b75c00/0xd6c4b8f05867f3ea lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134990.524168:0:5769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b75c00/0xd6c4b8f05867f3ea lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134990.524181:0:5769:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828000/0xd6c4b8f05867f3f1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134990.524186:0:5769:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828000/0xd6c4b8f05867f3f1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134990.524192:0:5769:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828000/0xd6c4b8f05867f3f1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134990.524198:0:5769:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe9c7828000 already unused, calling callback (ffffffffc1f634f0) 00010000:00010000:2.0:1783134990.524204:0:5769:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828000/0xd6c4b8f05867f3f1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134990.524210:0:5769:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828000/0xd6c4b8f05867f3f1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134990.524216:0:5769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9fe9cc3c1200) 00010000:00010000:2.0:1783134990.524219:0:5769:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783134990.524221:0:5769:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828000/0xd6c4b8f05867f3f1 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134990.524226:0:5769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828000/0xd6c4b8f05867f3f1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134990.524263:0:5769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b74000/0xd6c4b8f05867f3e3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb74d4 expref: 55 pid: 5769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134990.524275:0:5769:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829400/0xd6c4b8f05867f3f8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb74d4 expref: 54 pid: 5769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134990.524419:0:5769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9fe9e1c2ba00) 00010000:00010000:2.0:1783134990.524421:0:5769:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1783134990.524424:0:5769:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fe9c7829400, rc 0) 00000100:00100000:2.0:1783134990.524501:0:5769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9f6cbf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+54:11576:x1869752373957248:12345-192.168.201.41@tcp:101:lfs.0 Request processed in 1332us (1749us total) trans 4294967496 rc 0/0 00000100:00100000:2.0:1783134990.524509:0:5769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 206 00000100:00100000:0.0:1783134990.533498:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:2.0:1783134990.534122:0:8031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373957376 00000100:00100000:2.0:1783134990.534137:0:8031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373957376 00000100:00100000:2.0:1783134990.534207:0:8031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 207 00000100:00100000:2.0:1783134990.534217:0:8031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9f6cbf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+54:11576:x1869752373957376:12345-192.168.201.41@tcp:54:lfs.0 00010000:00010000:2.0:1783134990.534330:0:8031:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828000/0xd6c4b8f05867f406 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134990.534345:0:8031:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828000/0xd6c4b8f05867f406 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134990.534353:0:8031:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828000/0xd6c4b8f05867f406 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134990.534387:0:8031:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828000/0xd6c4b8f05867f406 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134990.534394:0:8031:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828000/0xd6c4b8f05867f406 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134990.534400:0:8031:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828000/0xd6c4b8f05867f406 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134990.534405:0:8031:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe9c7828000 already unused, calling callback (ffffffffc1f634f0) 00010000:00010000:2.0:1783134990.534409:0:8031:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828000/0xd6c4b8f05867f406 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134990.534417:0:8031:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828000/0xd6c4b8f05867f406 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134990.534429:0:8031:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9fe9e1c2ba00) 00010000:00010000:2.0:1783134990.534432:0:8031:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1783134990.534436:0:8031:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828000/0xd6c4b8f05867f406 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134990.534442:0:8031:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828000/0xd6c4b8f05867f406 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783134990.534543:0:8031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9f6cbf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+54:11576:x1869752373957376:12345-192.168.201.41@tcp:54:lfs.0 Request processed in 327us (1065us total) trans 0 rc 0/0 00000100:00100000:2.0:1783134990.534552:0:8031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 207 00000100:00100000:3.0:1783134990.538452:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:2.0:1783134990.538543:0:5773:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373957632 00000100:00100000:2.0:1783134990.538557:0:5773:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373957632 00000100:00100000:2.0:1783134990.538628:0:5773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 58 00000100:00100000:2.0:1783134990.538639:0:5773:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9f68f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+54:11576:x1869752373957632:12345-192.168.201.41@tcp:35:lfs.0 00000100:00100000:2.0:1783134990.539451:0:5773:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9f68f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+55:11576:x1869752373957632:12345-192.168.201.41@tcp:35:lfs.0 Request processed in 799us (998us total) trans 4294967497 rc 0/0 00000100:00100000:2.0:1783134990.539462:0:5773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 58 00010000:00010000:1.0:1783134990.596685:0:6591:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783134990.597164:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:3.0:1783134990.597227:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373957888 00000100:00100000:3.0:1783134990.597242:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373957888 00000100:00100000:3.0:1783134990.597342:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 208 00000100:00100000:3.0:1783134990.597353:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9f6cb0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+55:11586:x1869752373957888:12345-192.168.201.41@tcp:101:bash.0 00010000:00010000:3.0:1783134990.597396:0:5771:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783134990.597401:0:5771:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1783134990.597434:0:5771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b74600/0xd6c4b8f05867f381 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb74b1 expref: 55 pid: 5769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134990.597456:0:5771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9fe9e1c2b700) 00010000:00010000:3.0:1783134990.597460:0:5771:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1783134990.597476:0:5771:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b74e00/0xd6c4b8f05867f40d lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4428da03f5eb74db expref: -99 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134990.597601:0:5771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b75a00/0xd6c4b8f05867f414 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134990.597614:0:5771:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829400/0xd6c4b8f05867f3f8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb74d4 expref: 55 pid: 5769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134990.597621:0:5771:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b75a00/0xd6c4b8f05867f414 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134990.597654:0:5771:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829400/0xd6c4b8f05867f3f8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb74d4 expref: 55 pid: 5769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134990.597668:0:5771:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829400/0xd6c4b8f05867f3f8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb74d4 expref: 55 pid: 5769 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783134990.597707:0:5771:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9f68f3800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5771:1869752384420224:192.168.201.41@tcp:104: 00000100:00100000:3.0:1783134990.597823:0:5771:0:(client.c:2701:ptlrpc_set_wait()) set ffff9fe9e9c68d80 going to sleep for 11 seconds 00000100:00100000:3.0:1783134990.599434:0:5771:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9f68f3800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5771:1869752384420224:192.168.201.41@tcp:104: 00010000:00010000:3.0:1783134990.599468:0:5771:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b75a00/0xd6c4b8f05867f414 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783134990.602132:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:0.0:1783134990.602242:0:5756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373958016 00000100:00100000:0.0:1783134990.602251:0:5756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373958016 00010000:00010000:0.0:1783134990.602553:0:5756:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829400/0xd6c4b8f05867f3f8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb74d4 expref: 56 pid: 5769 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783134990.602589:0:5756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 81 00000100:00100000:0.0:1783134990.602600:0:5756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9f6cb2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+56:2369:x1869752373958016:12345-192.168.201.41@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783134990.602616:0:5756:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783134990.602635:0:5756:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829400/0xd6c4b8f05867f3f8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb74d4 expref: 56 pid: 5769 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134990.602649:0:5756:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829400/0xd6c4b8f05867f3f8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb74d4 expref: 56 pid: 5769 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134990.602672:0:5756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829400/0xd6c4b8f05867f3f8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb74d4 expref: 56 pid: 5769 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134990.602689:0:5756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9fe9e1c2ba00) 00010000:00010000:0.0:1783134990.602695:0:5756:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b75a00/0xd6c4b8f05867f414 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134990.602704:0:5756:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b75a00/0xd6c4b8f05867f414 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134990.602711:0:5756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b75a00/0xd6c4b8f05867f414 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134990.602740:0:5756:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1783134990.602780:0:5771:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b75a00/0xd6c4b8f05867f414 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134990.602794:0:5771:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b75a00/0xd6c4b8f05867f414 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783134990.602803:0:5756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9f6cb2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+55:2369:x1869752373958016:12345-192.168.201.41@tcp:103:ldlm_bl.0 Request processed in 200us (676us total) trans 0 rc 0/0 00000100:00100000:0.0:1783134990.602814:0:5756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 81 00000004:00200000:3.0:1783134990.602823:0:5771:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:3.0:1783134990.603081:0:5771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b74e00/0xd6c4b8f05867f40d lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb74db expref: 56 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134990.603106:0:5771:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b75a00/0xd6c4b8f05867f414 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb74db expref: 55 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134990.603116:0:5771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9fe9e1c2ba00) 00010000:00010000:3.0:1783134990.603119:0:5771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1783134990.603123:0:5771:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fe9d2b75a00, rc 0) 00000100:00100000:3.0:1783134990.603189:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9f6cb0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+55:11586:x1869752373957888:12345-192.168.201.41@tcp:101:bash.0 Request processed in 5838us (6028us total) trans 4294967498 rc 0/0 00000100:00100000:3.0:1783134990.603200:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 208 00000100:00100000:1.0:1783134990.607053:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:2.0:1783134990.607144:0:8031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373958272 00000100:00100000:2.0:1783134990.607151:0:8031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373958272 00000100:00100000:2.0:1783134990.607222:0:8031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 209 00000100:00100000:2.0:1783134990.607231:0:8031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9f6cb0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+55:11586:x1869752373958272:12345-192.168.201.41@tcp:36:bash.0 00010000:00010000:2.0:1783134990.607517:0:8031:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828000/0xd6c4b8f05867f422 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134990.607533:0:8031:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828000/0xd6c4b8f05867f422 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134990.607544:0:8031:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828000/0xd6c4b8f05867f422 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1783134990.607592:0:8031:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967499 00000004:00010000:2.0:1783134990.607614:0:8031:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000077e59d09 reply state 000000004e5764f1 transno 4294967500 ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828000/0xd6c4b8f05867f422 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783134990.607641:0:8031:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1783134990.607710:0:8031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9f6cb0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+58:11586:x1869752373958272:12345-192.168.201.41@tcp:36:bash.0 Request processed in 481us (667us total) trans 4294967500 rc 0/0 00000100:00100000:2.0:1783134990.607716:0:8031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 209 00000020:00080000:2.0:1783134990.607720:0:8031:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1783134990.612240:0:3272:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828000/0xd6c4b8f05867f422 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134990.612374:0:3272:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828000/0xd6c4b8f05867f422 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134990.612385:0:3272:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828000/0xd6c4b8f05867f422 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134990.612393:0:3272:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe9c7828000 already unused, calling callback (ffffffffc1f634f0) 00010000:00010000:3.0:1783134990.612399:0:3272:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828000/0xd6c4b8f05867f422 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134990.612408:0:3272:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828000/0xd6c4b8f05867f422 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134990.612431:0:3272:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9fe9e1c2ba00) 00010000:00010000:3.0:1783134990.612434:0:3272:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783134990.612440:0:3272:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828000/0xd6c4b8f05867f422 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134990.612447:0:3272:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828000/0xd6c4b8f05867f422 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783134990.614503:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:2.0:1783134990.614623:0:5769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373958400 00000100:00100000:2.0:1783134990.614638:0:5769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373958400 00000100:00100000:2.0:1783134990.614714:0:5769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 210 00000100:00100000:2.0:1783134990.614728:0:5769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9f6cb0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+57:11586:x1869752373958400:12345-192.168.201.41@tcp:101:bash.0 00010000:00010000:2.0:1783134990.614751:0:5769:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783134990.614773:0:5769:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829200/0xd6c4b8f05867f429 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4428da03f5eb74e2 expref: -99 pid: 5769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134990.614853:0:5769:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828800/0xd6c4b8f05867f430 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134990.614868:0:5769:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b75a00/0xd6c4b8f05867f414 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb74db expref: 58 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134990.614877:0:5769:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828800/0xd6c4b8f05867f430 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134990.614913:0:5769:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b75a00/0xd6c4b8f05867f414 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb74db expref: 58 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134990.614927:0:5769:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b75a00/0xd6c4b8f05867f414 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb74db expref: 58 pid: 5771 timeout: 373 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783134990.614962:0:5769:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9f6881500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5769:1869752384420352:192.168.201.41@tcp:104: 00000100:00100000:2.0:1783134990.615059:0:5769:0:(client.c:2701:ptlrpc_set_wait()) set ffff9fe9f42c36c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783134990.617670:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:1.0:1783134990.617778:0:5754:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373958528 00000100:00100000:1.0:1783134990.617790:0:5754:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373958528 00010000:00010000:1.0:1783134990.617839:0:5754:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b75a00/0xd6c4b8f05867f414 lrc: 5/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb74db expref: 59 pid: 5771 timeout: 373 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783134990.617889:0:5754:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 82 00000100:00100000:1.0:1783134990.617900:0:5754:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9f6cbce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+59:2370:x1869752373958528:12345-192.168.201.41@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1783134990.617919:0:5754:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783134990.617926:0:5754:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b75a00/0xd6c4b8f05867f414 lrc: 5/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb74db expref: 59 pid: 5771 timeout: 373 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134990.617941:0:5754:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b75a00/0xd6c4b8f05867f414 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb74db expref: 59 pid: 5771 timeout: 373 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134990.617968:0:5754:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9fe9e1c2ba00) 00010000:00010000:1.0:1783134990.617991:0:5754:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828800/0xd6c4b8f05867f430 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134990.618002:0:5754:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828800/0xd6c4b8f05867f430 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134990.618011:0:5754:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828800/0xd6c4b8f05867f430 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134990.618035:0:5754:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783134990.618103:0:5754:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9f6cbce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+59:2370:x1869752373958528:12345-192.168.201.41@tcp:103:ldlm_bl.0 Request processed in 203us (444us total) trans 0 rc 0/0 00000100:00100000:1.0:1783134990.618112:0:5754:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 82 00010000:00010000:2.0:1783134990.618602:0:5769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b75a00/0xd6c4b8f05867f414 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb74db expref: 58 pid: 5771 timeout: 373 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783134990.618629:0:5769:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9f6881500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5769:1869752384420352:192.168.201.41@tcp:104: 00010000:00010000:2.0:1783134990.618652:0:5769:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828800/0xd6c4b8f05867f430 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134990.618662:0:5769:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828800/0xd6c4b8f05867f430 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134990.618666:0:5769:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828800/0xd6c4b8f05867f430 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783134990.618708:0:5769:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:2.0:1783134990.618711:0:5769:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1783134990.618726:0:5769:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828800/0xd6c4b8f05867f430 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134990.618751:0:5769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829200/0xd6c4b8f05867f429 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb74e2 expref: 58 pid: 5769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134990.618764:0:5769:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828800/0xd6c4b8f05867f430 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb74e2 expref: 57 pid: 5769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134990.618770:0:5769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9fe9e1c2ba00) 00010000:00010000:2.0:1783134990.618786:0:5769:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1783134990.618788:0:5769:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fe9c7828800, rc 0) 00000100:00100000:2.0:1783134990.618843:0:5769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9f6cb0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+57:11586:x1869752373958400:12345-192.168.201.41@tcp:101:bash.0 Request processed in 4121us (4354us total) trans 0 rc 0/0 00000100:00100000:2.0:1783134990.618852:0:5769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 210 00000100:00100000:0.0:1783134990.627084:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:1.0:1783134990.627249:0:5772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373958784 00000100:00100000:1.0:1783134990.627261:0:5772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373958784 00000100:00100000:2.0:1783134990.627465:0:5773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 59 00000100:00100000:2.0:1783134990.627494:0:5773:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9f6cbed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+57:11586:x1869752373958784:12345-192.168.201.41@tcp:35:bash.0 00000100:00100000:2.0:1783134990.627732:0:5773:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9f6cbed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+58:11586:x1869752373958784:12345-192.168.201.41@tcp:35:bash.0 Request processed in 252us (661us total) trans 4294967501 rc 0/0 00000100:00100000:2.0:1783134990.627741:0:5773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 59 00000040:00080000:1.0:1783134990.661236:0:11499:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1783134990.661249:0:11499:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1783134990.661591:0:11499:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:1.0:1783134990.661600:0:11499:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1783134990.678717:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:0.0:1783134990.678941:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373958912 00000100:00100000:0.0:1783134990.678952:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373958912 00000100:00100000:0.0:1783134990.679021:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 211 00000100:00100000:0.0:1783134990.679030:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9f6cb2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+58:11593:x1869752373958912:12345-192.168.201.41@tcp:101:lfs.0 00010000:00010000:0.0:1783134990.679082:0:5770:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783134990.679106:0:5770:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ad800/0xd6c4b8f05867f437 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4428da03f5eb74e9 expref: -99 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134990.679182:0:5770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ad200/0xd6c4b8f05867f43e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134990.679199:0:5770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ad200/0xd6c4b8f05867f43e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134990.679213:0:5770:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ad200/0xd6c4b8f05867f43e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783134990.679319:0:5770:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00000004:00200000:0.0:1783134990.679323:0:5770:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:0.0:1783134990.679346:0:5770:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ad200/0xd6c4b8f05867f43e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134990.679382:0:5770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ad800/0xd6c4b8f05867f437 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb74e9 expref: 60 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134990.679404:0:5770:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ad200/0xd6c4b8f05867f43e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb74e9 expref: 59 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134990.679415:0:5770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9fe9e1c2b700) 00010000:00010000:0.0:1783134990.679418:0:5770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1783134990.679421:0:5770:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fe9f68ad200, rc 0) 00000100:00100000:0.0:1783134990.679495:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9f6cb2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+59:11593:x1869752373958912:12345-192.168.201.41@tcp:101:lfs.0 Request processed in 466us (792us total) trans 0 rc 0/0 00000100:00100000:0.0:1783134990.679501:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 211 00000100:00100000:0.0:1783134990.683655:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:3.0:1783134990.683731:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373959040 00000100:00100000:3.0:1783134990.683742:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373959040 00000100:00100000:3.0:1783134990.683858:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 212 00000100:00100000:3.0:1783134990.683868:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9f6cbc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+59:11593:x1869752373959040:12345-192.168.201.41@tcp:101:lfs.0 00010000:00010000:3.0:1783134990.683893:0:5771:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783134990.683914:0:5771:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b74e00/0xd6c4b8f05867f445 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4428da03f5eb74f0 expref: -99 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134990.683994:0:5771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b74600/0xd6c4b8f05867f44c lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134990.684030:0:5771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b74600/0xd6c4b8f05867f44c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134990.684044:0:5771:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b74600/0xd6c4b8f05867f44c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134990.684065:0:5771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b75a00/0xd6c4b8f05867f453 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134990.684074:0:5771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b75a00/0xd6c4b8f05867f453 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134990.684080:0:5771:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b75a00/0xd6c4b8f05867f453 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134990.684210:0:5771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b74000/0xd6c4b8f05867f45a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134990.684220:0:5771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b74000/0xd6c4b8f05867f45a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134990.684227:0:5771:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b74000/0xd6c4b8f05867f45a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783134990.684275:0:5771:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:3.0:1783134990.684323:0:5771:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1783134990.684345:0:5771:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b74000/0xd6c4b8f05867f45a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134990.684372:0:5771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b74000/0xd6c4b8f05867f45a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134990.684406:0:5771:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b74600/0xd6c4b8f05867f44c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134990.684413:0:5771:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b74600/0xd6c4b8f05867f44c lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134990.684421:0:5771:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b74600/0xd6c4b8f05867f44c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134990.684427:0:5771:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe9d2b74600 already unused, calling callback (ffffffffc1f634f0) 00010000:00010000:3.0:1783134990.684432:0:5771:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b74600/0xd6c4b8f05867f44c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134990.684440:0:5771:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b74600/0xd6c4b8f05867f44c lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134990.684455:0:5771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9fe9e1c2b700) 00010000:00010000:3.0:1783134990.684458:0:5771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783134990.684476:0:5771:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b74600/0xd6c4b8f05867f44c lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134990.684484:0:5771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b74600/0xd6c4b8f05867f44c lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134990.684498:0:5771:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b75a00/0xd6c4b8f05867f453 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134990.684504:0:5771:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b75a00/0xd6c4b8f05867f453 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134990.684509:0:5771:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b75a00/0xd6c4b8f05867f453 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134990.684521:0:5771:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe9d2b75a00 already unused, calling callback (ffffffffc1f634f0) 00010000:00010000:3.0:1783134990.684523:0:5771:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b75a00/0xd6c4b8f05867f453 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134990.684529:0:5771:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b75a00/0xd6c4b8f05867f453 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134990.684538:0:5771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9fe9cb8f4c00) 00010000:00010000:3.0:1783134990.684540:0:5771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783134990.684543:0:5771:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b75a00/0xd6c4b8f05867f453 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134990.684548:0:5771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b75a00/0xd6c4b8f05867f453 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134990.684588:0:5771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b74e00/0xd6c4b8f05867f445 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb74f0 expref: 61 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134990.684601:0:5771:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b74000/0xd6c4b8f05867f45a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb74f0 expref: 60 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134990.684608:0:5771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9fe9e1c2ba00) 00010000:00010000:3.0:1783134990.684610:0:5771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1783134990.684613:0:5771:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fe9d2b74000, rc 0) 00000100:00100000:3.0:1783134990.684695:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9f6cbc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+60:11593:x1869752373959040:12345-192.168.201.41@tcp:101:lfs.0 Request processed in 827us (1054us total) trans 0 rc 0/0 00000100:00100000:3.0:1783134990.684703:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 212 00000100:00100000:1.0:1783134990.688829:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:0.0:1783134990.688915:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373959296 00000100:00100000:0.0:1783134990.688927:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373959296 00000100:00100000:0.0:1783134990.688983:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 213 00000100:00100000:0.0:1783134990.688991:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9f6cb0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+60:11593:x1869752373959296:12345-192.168.201.41@tcp:101:lfs.0 00010000:00010000:0.0:1783134990.689013:0:5770:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783134990.689084:0:5770:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ad800/0xd6c4b8f05867f461 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4428da03f5eb74f7 expref: -99 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134990.689218:0:5770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ade00/0xd6c4b8f05867f468 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134990.689235:0:5770:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828800/0xd6c4b8f05867f430 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb74e2 expref: 61 pid: 5769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134990.689243:0:5770:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b74000/0xd6c4b8f05867f45a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb74f0 expref: 61 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134990.689253:0:5770:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ade00/0xd6c4b8f05867f468 lrc: 5/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134990.690595:0:5770:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b74000/0xd6c4b8f05867f45a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb74f0 expref: 61 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134990.690612:0:5770:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b74000/0xd6c4b8f05867f45a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb74f0 expref: 61 pid: 5771 timeout: 373 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783134990.690625:0:5770:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9fe8fd180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5770:1869752384420480:192.168.201.41@tcp:104: 00010000:00010000:0.0:1783134990.691520:0:5770:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828800/0xd6c4b8f05867f430 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb74e2 expref: 61 pid: 5769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134990.691544:0:5770:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828800/0xd6c4b8f05867f430 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb74e2 expref: 61 pid: 5769 timeout: 373 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783134990.691552:0:5770:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9fe8fea00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5770:1869752384420608:192.168.201.41@tcp:104: 00000100:00100000:0.0:1783134990.691576:0:5770:0:(client.c:2701:ptlrpc_set_wait()) set ffff9fe9d1552b40 going to sleep for 11 seconds 00000100:00100000:1.0:1783134990.691909:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:3.0:1783134990.692018:0:5756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373959424 00000100:00100000:3.0:1783134990.692034:0:5756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373959424 00010000:00010000:3.0:1783134990.692074:0:5756:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b74000/0xd6c4b8f05867f45a lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb74f0 expref: 62 pid: 5771 timeout: 373 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783134990.692121:0:5756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 83 00000100:00100000:3.0:1783134990.692132:0:5756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9d1623450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+62:2370:x1869752373959424:12345-192.168.201.41@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783134990.692148:0:5756:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783134990.692154:0:5756:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b74000/0xd6c4b8f05867f45a lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb74f0 expref: 62 pid: 5771 timeout: 373 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134990.692168:0:5756:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b74000/0xd6c4b8f05867f45a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb74f0 expref: 62 pid: 5771 timeout: 373 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134990.692195:0:5756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9fe9e1c2ba00) 00010000:00010000:3.0:1783134990.692202:0:5756:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ade00/0xd6c4b8f05867f468 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134990.692210:0:5756:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ade00/0xd6c4b8f05867f468 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134990.692217:0:5756:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783134990.695339:0:5756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9d1623450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+62:2370:x1869752373959424:12345-192.168.201.41@tcp:103:ldlm_bl.0 Request processed in 3190us (3413us total) trans 0 rc 0/0 00000100:00100000:3.0:1783134990.695452:0:5756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 83 00000100:00100000:0.0:1783134990.695506:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:1.0:1783134990.695558:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373959552 00000100:00100000:1.0:1783134990.695568:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373959552 00000100:00100000:2.0:1783134990.695589:0:5770:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9fe8fea00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5770:1869752384420608:192.168.201.41@tcp:104: 00010000:00010000:2.0:1783134990.695607:0:5770:0:(ldlm_lockd.c:741:ldlm_handle_ast_error()) ### client (nid 192.168.201.41@tcp) returned -22 from blocking AST (req@00000000986e2633 x1869752384420480) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b74000/0xd6c4b8f05867f45a lrc: 1/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb74f0 expref: 62 pid: 5771 timeout: 373 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134990.695610:0:6592:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828800/0xd6c4b8f05867f430 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb74e2 expref: 62 pid: 5769 timeout: 373 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134990.695629:0:5770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b74000/0xd6c4b8f05867f45a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb74f0 expref: 62 pid: 5771 timeout: 373 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783134990.695646:0:5770:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9fe8fd180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5770:1869752384420480:192.168.201.41@tcp:104: 00010000:00010000:2.0:1783134990.695673:0:5770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9fe9e1c2ba00) 00010000:00010000:2.0:1783134990.695680:0:5770:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ade00/0xd6c4b8f05867f468 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134990.695691:0:5770:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ade00/0xd6c4b8f05867f468 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783134990.695699:0:5756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 84 00010000:00010000:2.0:1783134990.695702:0:5770:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ade00/0xd6c4b8f05867f468 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783134990.695712:0:5756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fe8fd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+61:2369:x1869752373959552:12345-192.168.201.41@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783134990.695727:0:5756:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783134990.695734:0:5756:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828800/0xd6c4b8f05867f430 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb74e2 expref: 61 pid: 5769 timeout: 373 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134990.695758:0:5756:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828800/0xd6c4b8f05867f430 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb74e2 expref: 61 pid: 5769 timeout: 373 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134990.695778:0:5756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828800/0xd6c4b8f05867f430 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb74e2 expref: 61 pid: 5769 timeout: 373 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134990.695789:0:5756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9fe9e1c2ba00) 00010000:00010000:3.0:1783134990.695792:0:5756:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ade00/0xd6c4b8f05867f468 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134990.695798:0:5756:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ade00/0xd6c4b8f05867f468 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134990.695804:0:5756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ade00/0xd6c4b8f05867f468 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134990.695824:0:5756:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1783134990.695835:0:5770:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ade00/0xd6c4b8f05867f468 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134990.695842:0:5770:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ade00/0xd6c4b8f05867f468 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783134990.695862:0:5770:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000100:00100000:3.0:1783134990.695867:0:5756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fe8fd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+60:2369:x1869752373959552:12345-192.168.201.41@tcp:103:ldlm_bl.0 Request processed in 159us (364us total) trans 0 rc 0/0 00000100:00100000:3.0:1783134990.695872:0:5756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 84 00010000:00010000:2.0:1783134990.696073:0:5770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ad800/0xd6c4b8f05867f461 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb74f7 expref: 61 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134990.696098:0:5770:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ade00/0xd6c4b8f05867f468 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb74f7 expref: 60 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134990.696104:0:5770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9fe9e1c2ba00) 00010000:00010000:2.0:1783134990.696106:0:5770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1783134990.696108:0:5770:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fe9f68ade00, rc 0) 00000100:00100000:2.0:1783134990.696148:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9f6cb0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+60:11593:x1869752373959296:12345-192.168.201.41@tcp:101:lfs.0 Request processed in 7157us (7330us total) trans 4294967502 rc 0/0 00000100:00100000:2.0:1783134990.696155:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 213 00000100:00100000:0.0:1783134990.699575:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:2.0:1783134990.699882:0:5755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373959808 00000100:00100000:2.0:1783134990.699896:0:5755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373959808 00000100:00100000:2.0:1783134990.700259:0:5755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 14 00000100:00100000:2.0:1783134990.700272:0:5755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fe8fdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+60:11593:x1869752373959808:12345-192.168.201.41@tcp:103:lfs.0 00010000:00010000:2.0:1783134990.700387:0:5755:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783134990.700420:0:5755:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43fe00/0xd6c4b8f05867f3c7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb74cd expref: 60 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134990.700467:0:5755:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9fe9e1c2ba00) 00010000:00010000:2.0:1783134990.700474:0:5755:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783134990.700554:0:5755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fe8fdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+59:11593:x1869752373959808:12345-192.168.201.41@tcp:103:lfs.0 Request processed in 284us (993us total) trans 0 rc 0/0 00000100:00100000:2.0:1783134990.700563:0:5755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 14 00000100:00100000:1.0:1783134990.703698:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:3.0:1783134990.703812:0:5769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373959936 00000100:00100000:3.0:1783134990.703826:0:5769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373959936 00000100:00100000:3.0:1783134990.703902:0:5769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 214 00000100:00100000:3.0:1783134990.703926:0:5769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9f6cb3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+59:11593:x1869752373959936:12345-192.168.201.41@tcp:58:lfs.0 00010000:00010000:3.0:1783134990.704241:0:5769:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b74e00/0xd6c4b8f05867f476 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134990.704264:0:5769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b74e00/0xd6c4b8f05867f476 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134990.704346:0:5769:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b74e00/0xd6c4b8f05867f476 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1783134990.704608:0:5769:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5, 136 off8872 00000100:00100000:3.0:1783134990.704727:0:5769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9f6cb3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+59:11593:x1869752373959936:12345-192.168.201.41@tcp:58:lfs.0 Request processed in 802us (1042us total) trans 0 rc 0/0 00000100:00100000:3.0:1783134990.704736:0:5769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 214 00000100:00100000:0.0:1783134990.708557:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:2.0:1783134990.708644:0:8031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373960064 00000100:00100000:2.0:1783134990.708657:0:8031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373960064 00000100:00100000:2.0:1783134990.708765:0:8031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 215 00000100:00100000:2.0:1783134990.708775:0:8031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fe8fd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+59:11593:x1869752373960064:12345-192.168.201.41@tcp:101:lfs.0 00010000:00010000:2.0:1783134990.708798:0:8031:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783134990.708820:0:8031:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829600/0xd6c4b8f05867f47d lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4428da03f5eb74fe expref: -99 pid: 8031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134990.708880:0:8031:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b74e00/0xd6c4b8f05867f476 lrc: 2/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134990.708889:0:8031:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829600/0xd6c4b8f05867f47d lrc: 4/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb74fe expref: 60 pid: 8031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134990.708909:0:8031:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b74e00/0xd6c4b8f05867f476 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134990.708919:0:8031:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829600/0xd6c4b8f05867f47d lrc: 3/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb74fe expref: 60 pid: 8031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134990.708930:0:8031:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9fe9e1c2ba00) 00010000:00010000:2.0:1783134990.708948:0:8031:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1783134990.708952:0:8031:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829600/0xd6c4b8f05867f47d lrc: 3/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb74fe expref: 60 pid: 8031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134990.708958:0:8031:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fe9c7829600, rc 0) 00000100:00100000:2.0:1783134990.709069:0:8031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fe8fd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+60:11593:x1869752373960064:12345-192.168.201.41@tcp:101:lfs.0 Request processed in 295us (529us total) trans 0 rc 0/0 00000100:00100000:2.0:1783134990.709075:0:8031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 215 00000004:00080000:2.0:1783134991.491633:0:7675:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 273887349340ns, next at 274887345057ns, rc = 0 00000004:00080000:1.0:1783134991.491633:0:7170:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 273887349397ns, next at 274887344809ns, rc = 0 00000100:00100000:1.0:1783134991.491667:0:3287:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1783134991.491683:0:3289:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9f6881500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1869752384420736:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1783134991.491704:0:3287:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9f6cb1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1869752384420864:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1783134991.491850:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1783134991.491866:0:3286:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9f6882d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:88a2002e-2ea7-4f07-912a-8d001832cfc0:3286:1869752384420992:0@lo:400:kworker.0 00000100:00100000:3.0:1783134991.492370:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783134991.492418:0:10783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384420736 00000100:00100000:2.0:1783134991.492428:0:10783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384420736 00000100:00100000:2.0:1783134991.492495:0:10783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1783134991.492505:0:10783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9f68f0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3289:x1869752384420736:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1783134991.492534:0:10783:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 1703936 free 3859808256 avail 3857711104 00000100:00080000:1.0:1783134991.492749:0:5766:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1783134991.492768:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783134991.492779:0:10783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9f68f0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3289:x1869752384420736:12345-0@lo:13:osp-pre-1-0.0 Request processed in 273us (407us total) trans 0 rc 0/0 00000100:00100000:2.0:1783134991.492789:0:10783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1783134991.492809:0:10783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384420864 00000100:00100000:1.0:1783134991.492809:0:3287:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9fe90dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3287:1869752384421504:0@lo:400:kworker.0 00000100:00100000:2.0:1783134991.492815:0:10783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384420864 00000100:00100000:3.0:1783134991.492817:0:3289:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967317 gen 2 00000004:00080000:3.0:1783134991.492824:0:3289:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967317 committed transno 4294967317 00000100:00100000:2.0:1783134991.492843:0:10783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1783134991.492850:0:10783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9f6cb2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3287:x1869752384420864:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1783134991.492857:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783134991.492864:0:3289:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9f6881500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1869752384420736:0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1783134991.492865:0:10783:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 52756480 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:0.0:1783134991.492881:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783134991.492887:0:3289:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9fe7d1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3289:1869752384421248:0@lo:400:kworker.0 00000100:00100000:1.0:1783134991.492889:0:3287:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1783134991.492900:0:3287:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9fe90e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1869752384421376:0@lo:400:kworker.0 00000100:00100000:2.0:1783134991.492918:0:10783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9f6cb2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3287:x1869752384420864:12345-0@lo:13:osp-pre-0-0.0 Request processed in 57us (139us total) trans 0 rc 0/0 00000100:00100000:3.0:1783134991.492923:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783134991.492927:0:10783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1783134991.492942:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783134991.492944:0:5763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384420992 00000100:00100000:3.0:1783134991.492949:0:3289:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1783134991.492950:0:5763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384420992 00000100:00100000:3.0:1783134991.492961:0:3289:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9f6881c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3289:1869752384421120:0@lo:400:kworker.0 00000100:00100000:2.0:1783134991.492972:0:5769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384421504 00000100:00100000:2.0:1783134991.492976:0:5769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384421504 00000100:00100000:1.0:1783134991.492989:0:3287:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9f6cb1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1869752384420864:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1783134991.492998:0:5763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 272 00000100:00100000:3.0:1783134991.492999:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783134991.493013:0:5763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9d1654450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88a2002e-2ea7-4f07-912a-8d001832cfc0+19:3286:x1869752384420992:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783134991.493022:0:3289:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9fe90ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1869752384421632:0@lo:400:kworker.0 00000100:00100000:2.0:1783134991.493022:0:5769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384421248 00000100:00100000:2.0:1783134991.493025:0:5769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384421248 00000100:00100000:2.0:1783134991.493039:0:5769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384421120 00000100:00100000:3.0:1783134991.493054:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783134991.493064:0:5763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9d1654450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88a2002e-2ea7-4f07-912a-8d001832cfc0+19:3286:x1869752384420992:12345-0@lo:400:kworker.0 Request processed in 55us (186us total) trans 0 rc 0/0 00000100:00100000:0.0:1783134991.493073:0:5763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 272 00000100:00100000:3.0:1783134991.493091:0:6577:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384421376 00000100:00100000:3.0:1783134991.493097:0:6577:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384421376 00000100:00100000:0.0:1783134991.493125:0:3286:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9f6882d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:88a2002e-2ea7-4f07-912a-8d001832cfc0:3286:1869752384420992:0@lo:400:kworker.0 00000100:00100000:3.0:1783134991.493133:0:6577:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384421632 00000100:00100000:3.0:1783134991.493137:0:6577:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384421632 00000100:00100000:2.0:1783134991.493153:0:5769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384421120 00000100:00100000:0.0:1783134991.493157:0:6574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1783134991.493165:0:6577:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1783134991.493173:0:5769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1783134991.493174:0:6577:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9f68f6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3289:x1869752384421632:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1783134991.493176:0:5766:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1783134991.493179:0:5769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9f6cb1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3287:x1869752384421504:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783134991.493185:0:6574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9f6cb1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3287:x1869752384421376:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783134991.493196:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1783134991.493208:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9f68f3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3289:x1869752384421248:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783134991.493231:0:6577:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9f68f6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3289:x1869752384421632:12345-0@lo:400:kworker.0 Request processed in 57us (175us total) trans 0 rc 0/0 00000100:00100000:3.0:1783134991.493239:0:6577:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1783134991.493259:0:6574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9f6cb1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3287:x1869752384421376:12345-0@lo:400:kworker.0 Request processed in 92us (318us total) trans 0 rc 0/0 00000100:00100000:2.0:1783134991.493262:0:5769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9f6cb1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3287:x1869752384421504:12345-0@lo:400:kworker.0 Request processed in 81us (406us total) trans 0 rc 0/0 00000100:00100000:1.0:1783134991.493271:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9f68f3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3289:x1869752384421248:12345-0@lo:400:kworker.0 Request processed in 63us (345us total) trans 0 rc 0/0 00000100:00100000:3.0:1783134991.493276:0:3289:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9fe90ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1869752384421632:0@lo:400:kworker.0 00000100:00100000:0.0:1783134991.493276:0:6574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1783134991.493277:0:5769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1783134991.493309:0:3289:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9fe7d1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3289:1869752384421248:0@lo:400:kworker.0 00000100:00100000:1.0:1783134991.493311:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1783134991.493321:0:5769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1783134991.493328:0:5769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9f6881500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3289:x1869752384421120:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783134991.493379:0:3287:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9fe90e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1869752384421376:0@lo:400:kworker.0 00000100:00100000:2.0:1783134991.493388:0:5769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9f6881500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3289:x1869752384421120:12345-0@lo:400:kworker.0 Request processed in 58us (392us total) trans 0 rc 0/0 00000100:00100000:2.0:1783134991.493398:0:5769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1783134991.493398:0:3287:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9fe90dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3287:1869752384421504:0@lo:400:kworker.0 00000100:00100000:3.0:1783134991.493413:0:3289:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9f6881c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3289:1869752384421120:0@lo:400:kworker.0 00010000:00010000:0.0:1783134991.619740:0:10987:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1783134991.684613:0:11499:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1783134991.684626:0:11499:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1783134991.684704:0:11499:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 3 00000040:00080000:1.0:1783134991.684713:0:11499:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1783134991.684887:0:11499:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9f6cb1180 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11499:1869752384421760:192.168.201.41@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1783134991.685036:0:11499:0:(client.c:2701:ptlrpc_set_wait()) set ffff9fe9fe944a80 going to sleep for 11 seconds 00000100:00100000:1.0:1783134991.689462:0:11499:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9f6cb1180 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11499:1869752384421760:192.168.201.41@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1783134991.691539:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:0.0:1783134991.692009:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373960192 00000100:00100000:0.0:1783134991.692021:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373960192 00000100:00100000:0.0:1783134991.692098:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 216 00000100:00100000:0.0:1783134991.692107:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9f6cb1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+60:11594:x1869752373960192:12345-192.168.201.41@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1783134991.692144:0:5770:0:(mdt_handler.c:7960:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1783134991.692261:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9f6cb1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+60:11594:x1869752373960192:12345-192.168.201.41@tcp:53:lhsmtool_posix.0 Request processed in 155us (733us total) trans 0 rc 0/0 00000100:00100000:0.0:1783134991.692267:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 216 00000100:00080000:1.0:1783134991.692383:0:5766:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783134991.695021:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:2.0:1783134991.695453:0:5769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373960320 00000100:00100000:2.0:1783134991.695465:0:5769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373960320 00000100:00100000:2.0:1783134991.695539:0:5769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 217 00000100:00100000:2.0:1783134991.695550:0:5769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fe8fe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+60:11594:x1869752373960320:12345-192.168.201.41@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1783134991.695644:0:5769:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829a00/0xd6c4b8f05867f484 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134991.695665:0:5769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829a00/0xd6c4b8f05867f484 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134991.695680:0:5769:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829a00/0xd6c4b8f05867f484 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134991.695699:0:5769:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829e00/0xd6c4b8f05867f48b lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134991.695730:0:5769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829e00/0xd6c4b8f05867f48b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134991.695738:0:5769:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829e00/0xd6c4b8f05867f48b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134991.695767:0:5769:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828e00/0xd6c4b8f05867f492 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134991.695777:0:5769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828e00/0xd6c4b8f05867f492 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134991.695783:0:5769:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828e00/0xd6c4b8f05867f492 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783134991.695829:0:5769:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:2.0:1783134991.695834:0:5769:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1783134991.695850:0:5769:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828e00/0xd6c4b8f05867f492 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134991.695863:0:5769:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829a00/0xd6c4b8f05867f484 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134991.695870:0:5769:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829a00/0xd6c4b8f05867f484 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134991.695877:0:5769:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829a00/0xd6c4b8f05867f484 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134991.695884:0:5769:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe9c7829a00 already unused, calling callback (ffffffffc1f634f0) 00010000:00010000:2.0:1783134991.695888:0:5769:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829a00/0xd6c4b8f05867f484 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134991.695900:0:5769:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829a00/0xd6c4b8f05867f484 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134991.695911:0:5769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9fe9e1c2b600) 00010000:00010000:2.0:1783134991.695913:0:5769:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783134991.695917:0:5769:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829a00/0xd6c4b8f05867f484 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134991.695922:0:5769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829a00/0xd6c4b8f05867f484 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134991.695934:0:5769:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829e00/0xd6c4b8f05867f48b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134991.695937:0:5769:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829e00/0xd6c4b8f05867f48b lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134991.695940:0:5769:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829e00/0xd6c4b8f05867f48b lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134991.695944:0:5769:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe9c7829e00 already unused, calling callback (ffffffffc1f634f0) 00010000:00010000:2.0:1783134991.695946:0:5769:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829e00/0xd6c4b8f05867f48b lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134991.695949:0:5769:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829e00/0xd6c4b8f05867f48b lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134991.695952:0:5769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0xafd4eada (ffff9fe9cc3c1200) 00010000:00010000:2.0:1783134991.695954:0:5769:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783134991.695955:0:5769:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829e00/0xd6c4b8f05867f48b lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134991.695964:0:5769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829e00/0xd6c4b8f05867f48b lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134991.695975:0:5769:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828e00/0xd6c4b8f05867f492 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134991.695978:0:5769:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828e00/0xd6c4b8f05867f492 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134991.695982:0:5769:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828e00/0xd6c4b8f05867f492 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134991.695985:0:5769:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe9c7828e00 already unused, calling callback (ffffffffc1f634f0) 00010000:00010000:2.0:1783134991.695987:0:5769:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828e00/0xd6c4b8f05867f492 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134991.695990:0:5769:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828e00/0xd6c4b8f05867f492 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134991.695995:0:5769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9fe9e1c2ba00) 00010000:00010000:2.0:1783134991.695997:0:5769:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783134991.695999:0:5769:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828e00/0xd6c4b8f05867f492 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134991.696002:0:5769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828e00/0xd6c4b8f05867f492 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783134991.696080:0:5769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fe8fe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+60:11594:x1869752373960320:12345-192.168.201.41@tcp:34:lhsmtool_posix.0 Request processed in 532us (1072us total) trans 0 rc 0/0 00000100:00100000:2.0:1783134991.696086:0:5769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 217 00000100:00100000:2.0:1783134991.698214:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:0.0:1783134991.698310:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373960576 00000100:00100000:0.0:1783134991.698321:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373960576 00000100:00100000:0.0:1783134991.698388:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 218 00000100:00100000:0.0:1783134991.698398:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fe90dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+60:11594:x1869752373960576:12345-192.168.201.41@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1783134991.698418:0:5770:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783134991.698439:0:5770:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ad600/0xd6c4b8f05867f499 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4428da03f5eb7505 expref: -99 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134991.698564:0:5770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ad000/0xd6c4b8f05867f4a0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134991.698580:0:5770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ad000/0xd6c4b8f05867f4a0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134991.698591:0:5770:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ad000/0xd6c4b8f05867f4a0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783134991.698616:0:5770:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:0.0:1783134991.698732:0:5770:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ad000/0xd6c4b8f05867f4a0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134991.698741:0:5770:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ad000/0xd6c4b8f05867f4a0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134991.698748:0:5770:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ad000/0xd6c4b8f05867f4a0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134991.698754:0:5770:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe9f68ad000 already unused, calling callback (ffffffffc1f634f0) 00010000:00010000:0.0:1783134991.698759:0:5770:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ad000/0xd6c4b8f05867f4a0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134991.698767:0:5770:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ad000/0xd6c4b8f05867f4a0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134991.698780:0:5770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9fe9e1c2ba00) 00010000:00010000:0.0:1783134991.698783:0:5770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1783134991.698787:0:5770:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ad000/0xd6c4b8f05867f4a0 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134991.698794:0:5770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ad000/0xd6c4b8f05867f4a0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134991.698851:0:5770:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ad600/0xd6c4b8f05867f499 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb7505 expref: 62 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134991.698862:0:5770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9fe9e1c2b600) 00010000:00010000:0.0:1783134991.698865:0:5770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1783134991.698876:0:5770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ad600/0xd6c4b8f05867f499 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb7505 expref: 62 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134991.698885:0:5770:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fe9f68ad600, rc 0) 00000100:00100000:0.0:1783134991.698962:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fe90dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+61:11594:x1869752373960576:12345-192.168.201.41@tcp:101:lhsmtool_posix.0 Request processed in 566us (757us total) trans 4294967503 rc 301/301 00000100:00100000:0.0:1783134991.698971:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 218 00000100:00100000:3.0:1783134991.708184:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:2.0:1783134991.708263:0:5769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373960704 00000100:00100000:2.0:1783134991.708308:0:5769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373960704 00000100:00100000:2.0:1783134991.708382:0:5769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 219 00000100:00100000:2.0:1783134991.708394:0:5769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fe7d1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+61:11594:x1869752373960704:12345-192.168.201.41@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1783134991.708446:0:5769:0:(mdt_handler.c:7960:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1783134991.708585:0:5769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fe7d1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+61:11594:x1869752373960704:12345-192.168.201.41@tcp:53:lhsmtool_posix.0 Request processed in 193us (415us total) trans 0 rc 0/0 00000100:00100000:2.0:1783134991.708594:0:5769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 219 00000100:00100000:1.0:1783134991.710906:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:0.0:1783134991.710953:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373960960 00000100:00100000:0.0:1783134991.710965:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373960960 00000100:00100000:0.0:1783134991.711085:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 220 00000100:00100000:0.0:1783134991.711098:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9f6cb1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+61:11594:x1869752373960960:12345-192.168.201.41@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1783134991.711122:0:5770:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783134991.711126:0:5770:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1783134991.711160:0:5770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ad200/0xd6c4b8f05867f43e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb74e9 expref: 61 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134991.711181:0:5770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9fe9e1c2b700) 00010000:00010000:0.0:1783134991.711187:0:5770:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1783134991.711202:0:5770:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ad000/0xd6c4b8f05867f4ae lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4428da03f5eb750c expref: -99 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1783134991.711904:0:5770:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x6:0x0], index 1: 0 00010000:00010000:0.0:1783134991.712141:0:5770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ac000/0xd6c4b8f05867f4b5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134991.712158:0:5770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ac000/0xd6c4b8f05867f4b5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134991.712170:0:5770:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ac000/0xd6c4b8f05867f4b5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134991.712245:0:5770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ad000/0xd6c4b8f05867f4ae lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb750c expref: 63 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134991.712262:0:5770:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ac000/0xd6c4b8f05867f4b5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb750c expref: 62 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134991.712277:0:5770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9fe9c8301a00) 00010000:00010000:0.0:1783134991.712308:0:5770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1783134991.712311:0:5770:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fe9f68ac000, rc 0) 00000100:00100000:0.0:1783134991.712405:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9f6cb1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+62:11594:x1869752373960960:12345-192.168.201.41@tcp:101:lhsmtool_posix.0 Request processed in 1310us (1508us total) trans 4294967504 rc 0/0 00000100:00100000:0.0:1783134991.712415:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 220 00000100:00100000:0.0:1783134991.714859:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:2.0:1783134991.714930:0:5769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373961216 00000100:00100000:2.0:1783134991.714943:0:5769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373961216 00000100:00100000:2.0:1783134991.715017:0:5769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 221 00000100:00100000:2.0:1783134991.715030:0:5769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fe8fdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+62:11594:x1869752373961216:12345-192.168.201.41@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1783134991.715183:0:5769:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783134991.715219:0:5769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ac000/0xd6c4b8f05867f4b5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb750c expref: 62 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134991.715242:0:5769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9fe9c8301a00) 00010000:00010000:2.0:1783134991.715255:0:5769:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1783134991.715424:0:5769:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828e00/0xd6c4b8f05867f4c3 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134991.715443:0:5769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828e00/0xd6c4b8f05867f4c3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134991.715454:0:5769:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828e00/0xd6c4b8f05867f4c3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134991.715596:0:5769:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829e00/0xd6c4b8f05867f4ca lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0xb74c4b66 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134991.715652:0:5769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829e00/0xd6c4b8f05867f4ca lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xb74c4b66 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134991.715666:0:5769:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829e00/0xd6c4b8f05867f4ca lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xb74c4b66 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134991.715779:0:5769:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828e00/0xd6c4b8f05867f4c3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134991.715787:0:5769:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828e00/0xd6c4b8f05867f4c3 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134991.715794:0:5769:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828e00/0xd6c4b8f05867f4c3 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134991.715800:0:5769:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe9c7828e00 already unused, calling callback (ffffffffc1f634f0) 00010000:00010000:2.0:1783134991.715805:0:5769:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828e00/0xd6c4b8f05867f4c3 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134991.715812:0:5769:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828e00/0xd6c4b8f05867f4c3 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134991.715825:0:5769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9fe9e1c2b700) 00010000:00010000:2.0:1783134991.715828:0:5769:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783134991.715832:0:5769:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828e00/0xd6c4b8f05867f4c3 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134991.715838:0:5769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828e00/0xd6c4b8f05867f4c3 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134991.715865:0:5769:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829e00/0xd6c4b8f05867f4ca lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xb74c4b66 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134991.715876:0:5769:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829e00/0xd6c4b8f05867f4ca lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xb74c4b66 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134991.715882:0:5769:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829e00/0xd6c4b8f05867f4ca lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xb74c4b66 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134991.715887:0:5769:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe9c7829e00 already unused, calling callback (ffffffffc1f634f0) 00010000:00010000:2.0:1783134991.715890:0:5769:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829e00/0xd6c4b8f05867f4ca lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xb74c4b66 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134991.715895:0:5769:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829e00/0xd6c4b8f05867f4ca lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xb74c4b66 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134991.715903:0:5769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0xb74c4b66 (ffff9fe9cc3c1200) 00010000:00010000:2.0:1783134991.715906:0:5769:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783134991.715909:0:5769:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829e00/0xd6c4b8f05867f4ca lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0xb74c4b66 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134991.715915:0:5769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829e00/0xd6c4b8f05867f4ca lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0xb74c4b66 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783134991.716037:0:5769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fe8fdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+61:11594:x1869752373961216:12345-192.168.201.41@tcp:36:lhsmtool_posix.0 Request processed in 1006us (1186us total) trans 0 rc -2/-2 00000100:00100000:2.0:1783134991.716047:0:5769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 221 00000100:00100000:1.0:1783134991.718397:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:3.0:1783134991.718484:0:8031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373961344 00000100:00100000:3.0:1783134991.718507:0:8031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373961344 00000100:00100000:3.0:1783134991.718580:0:8031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 222 00000100:00100000:3.0:1783134991.718593:0:8031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9f6cb2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+61:11594:x1869752373961344:12345-192.168.201.41@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1783134991.718620:0:8031:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783134991.718648:0:8031:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b75a00/0xd6c4b8f05867f4d1 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4428da03f5eb7513 expref: -99 pid: 8031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134991.718691:0:8031:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b74600/0xd6c4b8f05867f4d8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134991.718705:0:8031:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b74600/0xd6c4b8f05867f4d8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134991.718716:0:8031:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b74600/0xd6c4b8f05867f4d8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134991.718830:0:8031:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b75a00/0xd6c4b8f05867f4d1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb7513 expref: 63 pid: 8031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134991.718863:0:8031:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b74600/0xd6c4b8f05867f4d8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb7513 expref: 62 pid: 8031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134991.718872:0:8031:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9fe9cb8f4c00) 00010000:00010000:3.0:1783134991.718876:0:8031:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1783134991.718879:0:8031:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fe9d2b74600, rc 0) 00000100:00100000:3.0:1783134991.718948:0:8031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9f6cb2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+62:11594:x1869752373961344:12345-192.168.201.41@tcp:101:lhsmtool_posix.0 Request processed in 358us (563us total) trans 0 rc 0/0 00000100:00100000:3.0:1783134991.718956:0:8031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 222 00000100:00100000:1.0:1783134991.720603:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:2.0:1783134991.720673:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373961600 00000100:00100000:2.0:1783134991.720684:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373961600 00000100:00100000:2.0:1783134991.720753:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 223 00000100:00100000:2.0:1783134991.720762:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9f6cb3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+62:11594:x1869752373961600:12345-192.168.201.41@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1783134991.720835:0:5771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829a00/0xd6c4b8f05867f4df lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134991.720859:0:5771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829a00/0xd6c4b8f05867f4df lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134991.720868:0:5771:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829a00/0xd6c4b8f05867f4df lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1783134991.721093:0:5771:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].8, 88 off8800 00000004:00010000:2.0:1783134991.721163:0:5771:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000ecb1bcc3 reply state 00000000de7db564 transno 4294967505 ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829a00/0xd6c4b8f05867f4df lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783134991.721170:0:5771:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1783134991.721251:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9f6cb3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+64:11594:x1869752373961600:12345-192.168.201.41@tcp:36:lhsmtool_posix.0 Request processed in 491us (657us total) trans 4294967505 rc 0/0 00000100:00100000:2.0:1783134991.721256:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 223 00010000:00010000:1.0:1783134991.723439:0:3273:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829a00/0xd6c4b8f05867f4df lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783134991.723452:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00010000:00010000:1.0:1783134991.723461:0:3273:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829a00/0xd6c4b8f05867f4df lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134991.723472:0:3273:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829a00/0xd6c4b8f05867f4df lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134991.723479:0:3273:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe9c7829a00 already unused, calling callback (ffffffffc1f634f0) 00010000:00010000:1.0:1783134991.723485:0:3273:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829a00/0xd6c4b8f05867f4df lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134991.723494:0:3273:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829a00/0xd6c4b8f05867f4df lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134991.723514:0:3273:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9fe9cb8f4c00) 00010000:00010000:1.0:1783134991.723517:0:3273:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1783134991.723523:0:3273:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829a00/0xd6c4b8f05867f4df lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134991.723529:0:3273:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829a00/0xd6c4b8f05867f4df lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783134991.723944:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373961728 00000100:00100000:2.0:1783134991.723956:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373961728 00000100:00100000:2.0:1783134991.724030:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 224 00000100:00100000:2.0:1783134991.724043:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fe8ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+63:11594:x1869752373961728:12345-192.168.201.41@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1783134991.724066:0:5770:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783134991.724086:0:5770:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828800/0xd6c4b8f05867f4e6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4428da03f5eb751a expref: -99 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134991.724140:0:5770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828800/0xd6c4b8f05867f4e6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb751a expref: 64 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134991.724154:0:5770:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828800/0xd6c4b8f05867f4e6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb751a expref: 64 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134991.724197:0:5770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9fe9cb8f4c00) 00010000:00010000:2.0:1783134991.724200:0:5770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1783134991.724204:0:5770:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fe9c7828800, rc 0) 00000100:00100000:2.0:1783134991.724267:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fe8ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+64:11594:x1869752373961728:12345-192.168.201.41@tcp:101:lhsmtool_posix.0 Request processed in 227us (825us total) trans 0 rc 0/0 00000100:00100000:2.0:1783134991.724274:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 224 00000100:00100000:1.0:1783134991.727807:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:2.0:1783134991.727998:0:6576:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373961856 00000100:00100000:2.0:1783134991.728014:0:6576:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373961856 00000100:00100000:2.0:1783134991.728085:0:6576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 63 00000100:00100000:2.0:1783134991.728097:0:6576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9f6cb2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+9:2370:x1869752373961856:12345-192.168.201.41@tcp:2:lhsmtool_posix.0 00000100:00100000:2.0:1783134991.728459:0:6576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9f6cb2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+10:2370:x1869752373961856:12345-192.168.201.41@tcp:2:lhsmtool_posix.0 Request processed in 364us (663us total) trans 4294967320 rc 0/0 00000100:00100000:2.0:1783134991.728468:0:6576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 63 00000100:00100000:1.0:1783134991.732378:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:2.0:1783134991.732491:0:5772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373962112 00000100:00100000:2.0:1783134991.732504:0:5772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373962112 00000100:00100000:2.0:1783134991.732565:0:5772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 60 00000100:00100000:2.0:1783134991.732572:0:5772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9f6fe6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+64:11594:x1869752373962112:12345-192.168.201.41@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1783134991.732828:0:5772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9f6fe6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+65:11594:x1869752373962112:12345-192.168.201.41@tcp:35:lhsmtool_posix.0 Request processed in 255us (466us total) trans 4294967506 rc 0/0 00000100:00100000:2.0:1783134991.732840:0:5772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 60 00000100:00100000:0.0:1783134991.735171:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:3.0:1783134991.735263:0:5769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373962368 00000100:00100000:3.0:1783134991.735315:0:5769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373962368 00000100:00100000:3.0:1783134991.735398:0:5769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 225 00000100:00100000:3.0:1783134991.735410:0:5769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fe8ff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+65:11594:x1869752373962368:12345-192.168.201.41@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1783134991.735570:0:5769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fe8ff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+65:11594:x1869752373962368:12345-192.168.201.41@tcp:57:lhsmtool_posix.0 Request processed in 162us (410us total) trans 0 rc 0/0 00000100:00100000:3.0:1783134991.735579:0:5769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 225 00000100:00100000:3.0:1783134991.737349:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:0.0:1783134991.737476:0:8031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373962496 00000100:00100000:0.0:1783134991.737487:0:8031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373962496 00000100:00100000:0.0:1783134991.737564:0:8031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 226 00000100:00100000:0.0:1783134991.737576:0:8031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9f6cbfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+65:11594:x1869752373962496:12345-192.168.201.41@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1783134991.737598:0:8031:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783134991.737622:0:8031:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ad200/0xd6c4b8f05867f4ed lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4428da03f5eb7521 expref: -99 pid: 8031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134991.737701:0:8031:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ada00/0xd6c4b8f05867f4f4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134991.737739:0:8031:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ada00/0xd6c4b8f05867f4f4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134991.737759:0:8031:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ada00/0xd6c4b8f05867f4f4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783134991.737919:0:8031:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1783134991.737943:0:8031:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ada00/0xd6c4b8f05867f4f4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134991.738031:0:8031:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ad200/0xd6c4b8f05867f4ed lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb7521 expref: 67 pid: 8031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134991.738053:0:8031:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ada00/0xd6c4b8f05867f4f4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb7521 expref: 66 pid: 8031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134991.738063:0:8031:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9fe9cb8f4c00) 00010000:00010000:0.0:1783134991.738066:0:8031:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1783134991.738070:0:8031:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fe9f68ada00, rc 0) 00000100:00100000:0.0:1783134991.738135:0:8031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9f6cbfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+66:11594:x1869752373962496:12345-192.168.201.41@tcp:101:lhsmtool_posix.0 Request processed in 561us (802us total) trans 0 rc 0/0 00000100:00100000:0.0:1783134991.738143:0:8031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 226 00000100:00100000:1.0:1783134991.741082:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:0.0:1783134991.741172:0:6574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373962624 00000100:00100000:0.0:1783134991.741183:0:6574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373962624 00000100:00100000:0.0:1783134991.741247:0:6574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 64 00000100:00100000:0.0:1783134991.741257:0:6574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9f5ce1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+10:2370:x1869752373962624:12345-192.168.201.41@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1783134991.741409:0:6574:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783134991.741450:0:6574:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000049d8e907/0xd6c4b8f05867f4fb lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4428da03f5eb7528 expref: -99 pid: 6574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1783134991.741484:0:6574:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a487b0f, blocks: 0x1 00010000:00010000:0.0:1783134991.741746:0:6574:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=274s v=(0 0) 00010000:00010000:0.0:1783134991.741752:0:6574:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783134991.741764:0:6574:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000049d8e907/0xd6c4b8f05867f4fb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb7528 expref: 11 pid: 6574 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134991.741784:0:6574:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000049d8e907/0xd6c4b8f05867f4fb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb7528 expref: 11 pid: 6574 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134991.741799:0:6574:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fe9f68acc00, rc 0) 00000100:00100000:0.0:1783134991.741968:0:6574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9f5ce1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+11:2370:x1869752373962624:12345-192.168.201.41@tcp:101:lhsmtool_posix.0 Request processed in 712us (897us total) trans 0 rc 0/0 00000100:00100000:0.0:1783134991.741976:0:6574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 64 00000100:00100000:2.0:1783134991.746682:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:3.0:1783134991.746828:0:5769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373962880 00000100:00100000:3.0:1783134991.746843:0:5769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373962880 00000100:00100000:3.0:1783134991.746919:0:5769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 227 00000100:00100000:3.0:1783134991.746931:0:5769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fe90e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+66:11594:x1869752373962880:12345-192.168.201.41@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1783134991.747165:0:5769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fe90e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+66:11594:x1869752373962880:12345-192.168.201.41@tcp:57:lhsmtool_posix.0 Request processed in 236us (493us total) trans 0 rc 0/0 00000100:00100000:3.0:1783134991.747174:0:5769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 227 00000100:00100000:3.0:1783134991.750479:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:2.0:1783134991.750645:0:6577:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373963008 00000100:00100000:2.0:1783134991.750656:0:6577:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373963008 00000100:00100000:2.0:1783134991.750722:0:6577:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 65 00000100:00100000:2.0:1783134991.750744:0:6577:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9f6cbdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+11:11594:x1869752373963008:12345-192.168.201.41@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1783134991.750766:0:6577:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783134991.750787:0:6577:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007c6793cf/0xd6c4b8f05867f502 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4428da03f5eb752f expref: -99 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134991.750823:0:6577:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000049d8e907/0xd6c4b8f05867f4fb lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb7528 expref: 12 pid: 6574 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134991.750833:0:6577:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783134991.750837:0:6577:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783134991.750843:0:6577:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007c6793cf/0xd6c4b8f05867f502 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb752f expref: 12 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134991.750883:0:6577:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000049d8e907/0xd6c4b8f05867f4fb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb7528 expref: 12 pid: 6574 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134991.750898:0:6577:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000049d8e907/0xd6c4b8f05867f4fb lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb7528 expref: 12 pid: 6574 timeout: 374 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783134991.750915:0:6577:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9fe90ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6577:1869752384421888:192.168.201.41@tcp:104: 00000100:00100000:2.0:1783134991.751037:0:6577:0:(client.c:2701:ptlrpc_set_wait()) set ffff9fe9f42c3cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1783134991.755021:0:6577:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9fe90ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6577:1869752384421888:192.168.201.41@tcp:104: 00010000:00010000:2.0:1783134991.755065:0:6577:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000007c6793cf/0xd6c4b8f05867f502 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb752f expref: 12 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134991.755113:0:6577:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fe9c7828e00, rc 0) 00000100:00100000:2.0:1783134991.755213:0:6577:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9f6cbdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+12:11594:x1869752373963008:12345-192.168.201.41@tcp:101:lhsmtool_posix.0 Request processed in 4469us (4744us total) trans 0 rc 0/0 00000100:00100000:2.0:1783134991.755224:0:6577:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 65 00000100:00100000:0.0:1783134991.755885:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:1.0:1783134991.755957:0:5754:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373963136 00000100:00100000:1.0:1783134991.755966:0:5754:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373963136 00010000:00010000:1.0:1783134991.756004:0:5754:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000049d8e907/0xd6c4b8f05867f4fb lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb7528 expref: 12 pid: 6574 timeout: 374 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783134991.756084:0:5754:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 85 00000100:00100000:1.0:1783134991.756094:0:5754:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fe8fce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+12:2370:x1869752373963136:12345-192.168.201.41@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1783134991.756113:0:5754:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783134991.756137:0:5754:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000049d8e907/0xd6c4b8f05867f4fb lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb7528 expref: 12 pid: 6574 timeout: 374 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134991.756152:0:5754:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000049d8e907/0xd6c4b8f05867f4fb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb7528 expref: 12 pid: 6574 timeout: 374 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134991.756178:0:5754:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000049d8e907/0xd6c4b8f05867f4fb lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb7528 expref: 12 pid: 6574 timeout: 374 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134991.756193:0:5754:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783134991.756197:0:5754:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783134991.756205:0:5754:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000007c6793cf/0xd6c4b8f05867f502 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb752f expref: 11 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134991.756217:0:5754:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007c6793cf/0xd6c4b8f05867f502 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb752f expref: 11 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134991.756336:0:5754:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000007c6793cf/0xd6c4b8f05867f502 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb752f expref: 11 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783134991.756367:0:5754:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9fe959500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5754:1869752384422016:192.168.201.41@tcp:105: 00000100:00100000:1.0:1783134991.756448:0:5754:0:(client.c:2701:ptlrpc_set_wait()) set ffff9fe9fe944a80 going to sleep for 11 seconds 00000100:00100000:1.0:1783134991.758826:0:5754:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9fe959500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5754:1869752384422016:192.168.201.41@tcp:105: 00010000:00010000:1.0:1783134991.758857:0:5754:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783134991.758954:0:5754:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fe8fce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+11:2370:x1869752373963136:12345-192.168.201.41@tcp:103:ldlm_bl.0 Request processed in 2859us (3069us total) trans 0 rc 0/0 00000100:00100000:1.0:1783134991.758965:0:5754:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 85 00000100:00100000:0.0:1783134991.762977:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:1.0:1783134991.763050:0:6582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373963264 00000100:00100000:1.0:1783134991.763062:0:6582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373963264 00002000:00100000:1.0:1783134991.763120:0:6582:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x6:0x0] (0->12) req@ffff9fe9fe8ff800 x1869752373963264/t0(0) o4->28f4ba61-cfae-499e-ab3d-81cb8215f7bb@192.168.201.41@tcp:162/0 lens 504/0 e 0 to 0 dl 1783135002 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1783134991.763132:0:6582:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9fe9fe8ff800 with x1869752373963264 ext(0->12) 00002000:00010000:1.0:1783134991.763138:0:6582:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9fe9fe8ff800 00000100:00100000:1.0:1783134991.763171:0:6582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 7 00000100:00100000:1.0:1783134991.763180:0:6582:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fe8ff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+11:2369:x1869752373963264:12345-192.168.201.41@tcp:4:lhsmtool_posix.0 00000100:00100000:1.0:1783134991.763763:0:6582:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fe8ff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+13:2369:x1869752373963264:12345-192.168.201.41@tcp:4:lhsmtool_posix.0 Request processed in 582us (798us total) trans 4294967321 rc 0/0 00000100:00100000:1.0:1783134991.763772:0:6582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 7 00002000:00100000:1.0:1783134991.763780:0:6582:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x6:0x0] (0->12) req@ffff9fe9fe8ff800 x1869752373963264/t4294967321(0) o4->28f4ba61-cfae-499e-ab3d-81cb8215f7bb@192.168.201.41@tcp:162/0 lens 504/448 e 0 to 0 dl 1783135002 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1783134991.763788:0:6582:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9fe9fe8ff800 with x1869752373963264 ext(0->12) 00002000:00010000:1.0:1783134991.763792:0:6582:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9fe9fe8ff800 00000100:00100000:0.0:1783134991.766408:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:3.0:1783134991.766499:0:8031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373963392 00000100:00100000:3.0:1783134991.766519:0:8031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373963392 00000100:00100000:3.0:1783134991.766590:0:8031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 228 00000100:00100000:3.0:1783134991.766601:0:8031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fe8fc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+66:11594:x1869752373963392:12345-192.168.201.41@tcp:44:lhsmtool_posix.0 00000001:00080000:1.0:1783134991.829365:0:5791:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967504 is committed 00000004:00080000:1.0:1783134991.829406:0:5791:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 6 committed 00000004:00080000:1.0:1783134991.829443:0:5791:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 5 committed 00000020:00080000:1.0:1783134991.829457:0:5791:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9fe9d2b13900 refcount 2 committed 0 result 0 batchid 7 00000020:00080000:1.0:1783134991.829480:0:5791:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9fe9d1315600 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9fe9d2b13780 00000020:00080000:1.0:1783134991.829484:0:5791:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9fe9d1315c00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9fe9dffa4400 00000004:00080000:1.0:1783134991.829511:0:5791:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 8 committed 00000020:00080000:1.0:1783134991.829538:0:5791:0:(update_trans.c:1341:distribute_txn_batchid_cb()) lustre-MDT0000: 5 batchid updated 00000001:00080000:1.0:1783134991.829546:0:5791:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967506 is committed 00000004:00080000:1.0:1783134991.829554:0:5791:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 9 committed 00000020:00080000:1.0:1783134991.829591:0:5791:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9fe8c5d18a80 refcount 2 committed 0 result 0 batchid 6 00000020:00080000:1.0:1783134991.829594:0:5791:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9fe9cb2bdb00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9fe8c5d18b40 00000020:00080000:1.0:1783134991.829597:0:5791:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9fe9d2912400 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9fe9c9bc6000 00000020:00080000:1.0:1783134991.829632:0:5802:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 7 committed batchid 5 00000020:00080000:1.0:1783134991.829846:0:5802:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000100:00100000:1.0:1783134991.829979:0:3288:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1783134991.830017:0:3288:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9fe959500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1869752384422144:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1783134991.830198:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783134991.830300:0:7676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384422144 00000100:00100000:1.0:1783134991.830308:0:7676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384422144 00000100:00100000:1.0:1783134991.830368:0:7676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1783134991.830378:0:7676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fe959c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3288:x1869752384422144:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1783134991.830413:0:7676:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:5 count 1 00010000:00010000:1.0:1783134991.830444:0:7676:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000df406bb1/0xd6c4b8f05867f509 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 7676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134991.830471:0:7676:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000d97e2b8d/0xd6c4b8f05867f2c4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb7487 expref: 12 pid: 6574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134991.830482:0:7676:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x5:0x0].0x0 since=2s v=(0 0) 00010000:00010000:1.0:1783134991.830493:0:7676:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1783134991.830499:0:7676:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000df406bb1/0xd6c4b8f05867f509 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 7676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134991.830528:0:7676:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000d97e2b8d/0xd6c4b8f05867f2c4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb7487 expref: 12 pid: 6574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134991.830543:0:7676:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000d97e2b8d/0xd6c4b8f05867f2c4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb7487 expref: 12 pid: 6574 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783134991.830556:0:7676:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9fe959880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:7676:1869752384422272:192.168.201.41@tcp:104: 00000100:00100000:1.0:1783134991.830624:0:7676:0:(client.c:2701:ptlrpc_set_wait()) set ffff9fe9e9c699c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783134991.831166:0:8031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fe8fc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+20:11594:x1869752373963392:12345-192.168.201.41@tcp:44:lhsmtool_posix.0 Request processed in 64564us (64768us total) trans 0 rc 0/0 00000100:00100000:3.0:1783134991.831178:0:8031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 228 00000100:00100000:1.0:1783134991.831242:0:3286:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9fe90ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1869752384422400:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1783134991.831274:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783134991.831442:0:6576:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384422400 00000100:00100000:2.0:1783134991.831447:0:6576:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384422400 00000100:00100000:2.0:1783134991.831480:0:6576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1783134991.831487:0:6576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fe95a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3286:x1869752384422400:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1783134991.831503:0:6576:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:5 count 1 00002000:00010000:2.0:1783134991.831533:0:6576:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 9, mtime: 0x6a487b0e, atime: 0x6a487b0e, ctime: 0x6a487b0e, blocks: 0x1 00010000:00010000:2.0:1783134991.831541:0:6576:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cda93d77/0xd6c4b8f05867f510 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6576 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134991.831553:0:6576:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=274s v=(0 0) 00010000:00010000:2.0:1783134991.831556:0:6576:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783134991.831562:0:6576:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cda93d77/0xd6c4b8f05867f510 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6576 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134991.831579:0:6576:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cda93d77/0xd6c4b8f05867f510 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6576 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134991.831590:0:6576:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cda93d77/0xd6c4b8f05867f510 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6576 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134991.831599:0:6576:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cda93d77/0xd6c4b8f05867f510 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6576 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134991.831629:0:6576:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1783134991.832617:0:6576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fe95a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+8:3286:x1869752384422400:12345-0@lo:6:osp-syn-0-0.0 Request processed in 1128us (1339us total) trans 4294967310 rc 0/0 00000100:00100000:2.0:1783134991.832625:0:6576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00010000:00010000:0.0:1783134991.832707:0:5758:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783134991.832716:0:5758:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cda93d77/0xd6c4b8f05867f510 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6576 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134991.832727:0:5758:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe9c7829200 already unused, calling callback (ffffffffc1527ce0) 00010000:00010000:0.0:1783134991.832732:0:5758:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cda93d77/0xd6c4b8f05867f510 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6576 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134991.832756:0:5758:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cda93d77/0xd6c4b8f05867f510 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6576 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134991.832775:0:5758:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cda93d77/0xd6c4b8f05867f510 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6576 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134991.832782:0:5758:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cda93d77/0xd6c4b8f05867f510 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6576 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134991.832803:0:5758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783134991.832805:0:5758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783134991.832807:0:5758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1783134991.832855:0:3286:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9fe9fe90ed80/2, rc 0, transno 4294967310 00000100:00100000:3.0:1783134991.832862:0:3286:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9fe90ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1869752384422400:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1783134991.836359:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:1.0:1783134991.836463:0:6574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373963520 00000100:00100000:1.0:1783134991.836476:0:6574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373963520 00000100:00100000:1.0:1783134991.836548:0:6574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 68 00000100:00100000:1.0:1783134991.836561:0:6574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fe8fed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+13:2370:x1869752373963520:12345-192.168.201.41@tcp:16:lhsmtool_posix.0 00000100:00100000:0.0:1783134991.837238:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:2.0:1783134991.837312:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373963648 00000100:00100000:2.0:1783134991.837318:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373963648 00010000:00010000:2.0:1783134991.837358:0:6592:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000d97e2b8d/0xd6c4b8f05867f2c4 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb7487 expref: 14 pid: 6574 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783134991.837394:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 86 00000100:00100000:2.0:1783134991.837402:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fe8fca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+14:2370:x1869752373963648:12345-192.168.201.41@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783134991.837416:0:6592:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783134991.837422:0:6592:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000d97e2b8d/0xd6c4b8f05867f2c4 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb7487 expref: 14 pid: 6574 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134991.837438:0:6592:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000d97e2b8d/0xd6c4b8f05867f2c4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb7487 expref: 14 pid: 6574 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134991.837468:0:6592:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1783134991.837474:0:6592:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1783134991.837480:0:6592:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000df406bb1/0xd6c4b8f05867f509 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 7676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134991.837490:0:6592:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000df406bb1/0xd6c4b8f05867f509 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 7676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134991.837549:0:6592:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783134991.837619:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fe8fca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+14:2370:x1869752373963648:12345-192.168.201.41@tcp:103:ldlm_bl.0 Request processed in 218us (382us total) trans 0 rc 0/0 00000100:00100000:2.0:1783134991.837628:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 86 00010000:00010000:1.0:1783134991.838311:0:7676:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d97e2b8d/0xd6c4b8f05867f2c4 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb7487 expref: 13 pid: 6574 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783134991.838330:0:7676:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9fe959880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:7676:1869752384422272:192.168.201.41@tcp:104: 00010000:00010000:1.0:1783134991.838364:0:7676:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000df406bb1/0xd6c4b8f05867f509 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 7676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134991.838390:0:7676:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000df406bb1/0xd6c4b8f05867f509 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 7676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134991.838398:0:7676:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000df406bb1/0xd6c4b8f05867f509 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 7676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134991.838410:0:7676:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000df406bb1/0xd6c4b8f05867f509 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 7676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134991.838418:0:7676:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000df406bb1/0xd6c4b8f05867f509 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 7676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134991.838437:0:7676:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1783134991.838836:0:5757:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783134991.838845:0:5757:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000df406bb1/0xd6c4b8f05867f509 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 7676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134991.838854:0:5757:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe9fe43f800 already unused, calling callback (ffffffffc1527ce0) 00010000:00010000:0.0:1783134991.838859:0:5757:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000df406bb1/0xd6c4b8f05867f509 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 7676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134991.838870:0:5757:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000df406bb1/0xd6c4b8f05867f509 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 7676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134991.838886:0:5757:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000df406bb1/0xd6c4b8f05867f509 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 7676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134991.838900:0:5757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000df406bb1/0xd6c4b8f05867f509 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 7676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134991.838919:0:5757:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783134991.838920:0:5757:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783134991.838922:0:5757:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783134991.839543:0:7676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fe959c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3288:x1869752384422144:12345-0@lo:6:osp-syn-1-0.0 Request processed in 9164us (9343us total) trans 4294967322 rc 0/0 00000100:00100000:1.0:1783134991.839552:0:7676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000004:00080000:3.0:1783134991.839916:0:3288:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9fe9fe959500/2, rc 0, transno 4294967322 00000100:00100000:3.0:1783134991.839935:0:3288:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9fe959500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1869752384422144:0@lo:6:osp-syn-1-0.0 00000001:00080000:3.0:1783134991.862991:0:7470:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967321 is committed 00000100:00100000:1.0:1783134991.863228:0:6574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fe8fed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+7:2370:x1869752373963520:12345-192.168.201.41@tcp:16:lhsmtool_posix.0 Request processed in 26662us (26883us total) trans 0 rc 0/0 00000100:00100000:1.0:1783134991.863239:0:6574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 68 00000100:00100000:0.0:1783134991.866073:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:2.0:1783134991.866229:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373963904 00000100:00100000:2.0:1783134991.866240:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373963904 00000100:00100000:2.0:1783134991.866324:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 229 00000100:00100000:2.0:1783134991.866346:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fe8fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+20:11594:x1869752373963904:12345-192.168.201.41@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1783134991.866423:0:5771:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783134991.866457:0:5771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ada00/0xd6c4b8f05867f4f4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb7521 expref: 20 pid: 8031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134991.866480:0:5771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9fe9cb8f4c00) 00010000:00010000:2.0:1783134991.866486:0:5771:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1783134991.866522:0:5771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828000/0xd6c4b8f05867f517 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134991.866537:0:5771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828000/0xd6c4b8f05867f517 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134991.866548:0:5771:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828000/0xd6c4b8f05867f517 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1783134991.866851:0:5771:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000009424482c reply state 000000006878133d transno 4294967507 ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828000/0xd6c4b8f05867f517 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783134991.866862:0:5771:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1783134991.867011:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fe8fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+21:11594:x1869752373963904:12345-192.168.201.41@tcp:36:lhsmtool_posix.0 Request processed in 675us (949us total) trans 4294967507 rc 0/0 00000100:00100000:2.0:1783134991.867020:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 229 00010000:00010000:3.0:1783134991.868216:0:3272:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828000/0xd6c4b8f05867f517 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134991.868229:0:3272:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828000/0xd6c4b8f05867f517 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134991.868237:0:3272:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828000/0xd6c4b8f05867f517 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134991.868245:0:3272:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe9c7828000 already unused, calling callback (ffffffffc1f634f0) 00010000:00010000:3.0:1783134991.868250:0:3272:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828000/0xd6c4b8f05867f517 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134991.868260:0:3272:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828000/0xd6c4b8f05867f517 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134991.868373:0:3272:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9fe9cb8f4c00) 00010000:00010000:3.0:1783134991.868377:0:3272:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783134991.868381:0:3272:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828000/0xd6c4b8f05867f517 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134991.868389:0:3272:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828000/0xd6c4b8f05867f517 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783134991.869204:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:2.0:1783134991.869308:0:6576:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373964032 00000100:00100000:2.0:1783134991.869319:0:6576:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373964032 00000100:00100000:2.0:1783134991.869386:0:6576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 69 00000100:00100000:2.0:1783134991.869397:0:6576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fe8fe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+7:2369:x1869752373964032:12345-192.168.201.41@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1783134991.869606:0:6576:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:2.0:1783134991.869609:0:6576:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb mtime from disk: 0 -> 1783134990 00002000:00010000:2.0:1783134991.869611:0:6576:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb atime from disk: 0 -> 1783134990 00002000:00010000:2.0:1783134991.869612:0:6576:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb ctime from disk: 1783134991 -> 1783134990 00002000:00010000:2.0:1783134991.869614:0:6576:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:2.0:1783134991.869681:0:6576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fe8fe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+8:2369:x1869752373964032:12345-192.168.201.41@tcp:2:lhsmtool_posix.0 Request processed in 286us (482us total) trans 4294967323 rc 0/0 00000100:00100000:2.0:1783134991.869689:0:6576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 69 00000100:00100000:1.0:1783134991.874428:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:2.0:1783134991.874499:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373964288 00000100:00100000:2.0:1783134991.874513:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373964288 00000100:00100000:2.0:1783134991.874589:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 230 00000100:00100000:2.0:1783134991.874602:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fe959880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+20:11594:x1869752373964288:12345-192.168.201.41@tcp:55:lhsmtool_posix.0 00010000:00010000:2.0:1783134991.874715:0:5770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829400/0xd6c4b8f05867f51e lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134991.874737:0:5770:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b74600/0xd6c4b8f05867f4d8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb7513 expref: 20 pid: 8031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134991.874749:0:5770:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829400/0xd6c4b8f05867f51e lrc: 4/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134991.874819:0:5770:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b74600/0xd6c4b8f05867f4d8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb7513 expref: 20 pid: 8031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134991.874836:0:5770:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b74600/0xd6c4b8f05867f4d8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb7513 expref: 20 pid: 8031 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783134991.874853:0:5770:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9fe82ad80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5770:1869752384422528:192.168.201.41@tcp:104: 00000100:00100000:2.0:1783134991.875035:0:5770:0:(client.c:2701:ptlrpc_set_wait()) set ffff9fe9c9baca80 going to sleep for 11 seconds 00000100:00100000:1.0:1783134991.877933:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:2.0:1783134991.878086:0:5770:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9fe82ad80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5770:1869752384422528:192.168.201.41@tcp:104: 00010000:00010000:2.0:1783134991.878125:0:5770:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829400/0xd6c4b8f05867f51e lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783134991.878198:0:5756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373964416 00000100:00100000:3.0:1783134991.878207:0:5756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373964416 00010000:00010000:3.0:1783134991.878259:0:5756:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b74600/0xd6c4b8f05867f4d8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb7513 expref: 21 pid: 8031 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783134991.878373:0:5754:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 87 00000100:00100000:1.0:1783134991.878387:0:5754:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fe959f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+21:2370:x1869752373964416:12345-192.168.201.41@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1783134991.878407:0:5754:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783134991.878437:0:5754:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b74600/0xd6c4b8f05867f4d8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb7513 expref: 21 pid: 8031 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134991.878450:0:5754:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b74600/0xd6c4b8f05867f4d8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb7513 expref: 21 pid: 8031 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134991.878479:0:5754:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b74600/0xd6c4b8f05867f4d8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb7513 expref: 21 pid: 8031 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134991.878499:0:5754:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9fe9cb8f4c00) 00010000:00010000:1.0:1783134991.878505:0:5754:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829400/0xd6c4b8f05867f51e lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134991.878516:0:5754:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829400/0xd6c4b8f05867f51e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134991.878524:0:5754:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829400/0xd6c4b8f05867f51e lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134991.878603:0:5754:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783134991.878685:0:5754:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fe959f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+20:2370:x1869752373964416:12345-192.168.201.41@tcp:103:ldlm_bl.0 Request processed in 300us (765us total) trans 0 rc 0/0 00000100:00100000:1.0:1783134991.878694:0:5754:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 87 00010000:00010000:2.0:1783134991.879546:0:5770:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829400/0xd6c4b8f05867f51e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134991.879558:0:5770:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829400/0xd6c4b8f05867f51e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134991.879596:0:5770:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829400/0xd6c4b8f05867f51e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134991.879606:0:5770:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829400/0xd6c4b8f05867f51e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134991.879614:0:5770:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829400/0xd6c4b8f05867f51e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134991.879620:0:5770:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe9c7829400 already unused, calling callback (ffffffffc1f634f0) 00010000:00010000:2.0:1783134991.879624:0:5770:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829400/0xd6c4b8f05867f51e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134991.879644:0:5770:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829400/0xd6c4b8f05867f51e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134991.879670:0:5770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9fe9cb8f4c00) 00010000:00010000:2.0:1783134991.879674:0:5770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:2.0:1783134991.879679:0:5770:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829400/0xd6c4b8f05867f51e lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134991.879685:0:5770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829400/0xd6c4b8f05867f51e lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783134991.879852:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fe959880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+19:11594:x1869752373964288:12345-192.168.201.41@tcp:55:lhsmtool_posix.0 Request processed in 5251us (5438us total) trans 0 rc -22/-22 00000100:00100000:2.0:1783134991.879862:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 230 00000100:00100000:1.0:1783134991.883396:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:2.0:1783134991.885560:0:7676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373964544 00000100:00100000:2.0:1783134991.885579:0:7676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373964544 00000100:00100000:2.0:1783134991.885809:0:7676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 70 00000100:00100000:2.0:1783134991.885825:0:7676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fe95b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+8:2369:x1869752373964544:12345-192.168.201.41@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1783134991.885890:0:7676:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000365388e0/0xd6c4b8f05867f525 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 7676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134991.885917:0:7676:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000007c6793cf/0xd6c4b8f05867f502 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb752f expref: 8 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134991.885929:0:7676:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783134991.885934:0:7676:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1783134991.885939:0:7676:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000365388e0/0xd6c4b8f05867f525 lrc: 4/1,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 7676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134991.886001:0:7676:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000007c6793cf/0xd6c4b8f05867f502 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb752f expref: 8 pid: 6577 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134991.886019:0:7676:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000007c6793cf/0xd6c4b8f05867f502 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb752f expref: 8 pid: 6577 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783134991.886038:0:7676:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9fe82ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:7676:1869752384422656:192.168.201.41@tcp:104: 00000100:00100000:2.0:1783134991.886153:0:7676:0:(client.c:2701:ptlrpc_set_wait()) set ffff9fe9c9baca80 going to sleep for 11 seconds 00000100:00100000:2.0:1783134991.893576:0:7676:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9fe82ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:7676:1869752384422656:192.168.201.41@tcp:104: 00010000:00010000:2.0:1783134991.893614:0:7676:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000365388e0/0xd6c4b8f05867f525 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 7676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783134991.894234:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:2.0:1783134991.894401:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373964672 00000100:00100000:2.0:1783134991.894411:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373964672 00010000:00010000:2.0:1783134991.894456:0:6592:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000007c6793cf/0xd6c4b8f05867f502 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb752f expref: 9 pid: 6577 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783134991.894500:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 88 00000100:00100000:2.0:1783134991.894511:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fe95b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+9:2370:x1869752373964672:12345-192.168.201.41@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783134991.894533:0:6592:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783134991.894560:0:6592:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000007c6793cf/0xd6c4b8f05867f502 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb752f expref: 9 pid: 6577 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134991.894571:0:6592:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000007c6793cf/0xd6c4b8f05867f502 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb752f expref: 9 pid: 6577 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134991.894611:0:6592:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007c6793cf/0xd6c4b8f05867f502 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb752f expref: 9 pid: 6577 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134991.894629:0:6592:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1783134991.894632:0:6592:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1783134991.894638:0:6592:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000365388e0/0xd6c4b8f05867f525 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 7676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134991.894645:0:6592:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000365388e0/0xd6c4b8f05867f525 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 7676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134991.894717:0:6592:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783134991.894789:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fe95b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+8:2370:x1869752373964672:12345-192.168.201.41@tcp:103:ldlm_bl.0 Request processed in 278us (556us total) trans 0 rc 0/0 00000100:00100000:2.0:1783134991.894797:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 88 00010000:00010000:1.0:1783134991.894882:0:7676:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000365388e0/0xd6c4b8f05867f525 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 7676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134991.894893:0:7676:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000365388e0/0xd6c4b8f05867f525 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 7676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134991.894940:0:7676:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000365388e0/0xd6c4b8f05867f525 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 7676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134991.894950:0:7676:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000365388e0/0xd6c4b8f05867f525 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 7676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134991.894959:0:7676:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000365388e0/0xd6c4b8f05867f525 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 7676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134991.894967:0:7676:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe9c7828c00 already unused, calling callback (ffffffffc1527ce0) 00010000:00010000:1.0:1783134991.894972:0:7676:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000365388e0/0xd6c4b8f05867f525 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 7676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134991.894981:0:7676:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000365388e0/0xd6c4b8f05867f525 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 7676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134991.895204:0:7676:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000365388e0/0xd6c4b8f05867f525 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 7676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134991.895211:0:7676:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000365388e0/0xd6c4b8f05867f525 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 7676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783134991.895262:0:7676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fe95b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+7:2369:x1869752373964544:12345-192.168.201.41@tcp:1:lhsmtool_posix.0 Request processed in 9441us (11880us total) trans 0 rc 0/0 00000100:00100000:1.0:1783134991.895271:0:7676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 70 00000100:00100000:1.0:1783134991.897866:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:2.0:1783134991.897977:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373964928 00000100:00100000:2.0:1783134991.897988:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373964928 00000100:00100000:2.0:1783134991.898199:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 231 00000100:00100000:2.0:1783134991.898210:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fe958e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+19:11594:x1869752373964928:12345-192.168.201.41@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1783134991.898374:0:5771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829400/0xd6c4b8f05867f52c lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134991.898394:0:5771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829400/0xd6c4b8f05867f52c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134991.898404:0:5771:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829400/0xd6c4b8f05867f52c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134991.898640:0:5771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829000/0xd6c4b8f05867f533 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134991.898649:0:5771:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828800/0xd6c4b8f05867f4e6 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb751a expref: 20 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134991.898655:0:5771:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829000/0xd6c4b8f05867f533 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134991.898697:0:5771:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828800/0xd6c4b8f05867f4e6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb751a expref: 20 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134991.898713:0:5771:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828800/0xd6c4b8f05867f4e6 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb751a expref: 20 pid: 5770 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783134991.898728:0:5771:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9fe82ad80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5771:1869752384422784:192.168.201.41@tcp:104: 00000100:00100000:2.0:1783134991.899387:0:5771:0:(client.c:2701:ptlrpc_set_wait()) set ffff9fe9c9baca80 going to sleep for 11 seconds 00000100:00100000:3.0:1783134991.901206:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:2.0:1783134991.901231:0:5771:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9fe82ad80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5771:1869752384422784:192.168.201.41@tcp:104: 00010000:00010000:2.0:1783134991.901262:0:5771:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829000/0xd6c4b8f05867f533 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783134991.901369:0:5756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373965056 00000100:00100000:0.0:1783134991.901379:0:5756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373965056 00010000:00010000:0.0:1783134991.901421:0:5756:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828800/0xd6c4b8f05867f4e6 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb751a expref: 21 pid: 5770 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783134991.901459:0:5756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 89 00000100:00100000:0.0:1783134991.901469:0:5756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9d29dd850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+21:2369:x1869752373965056:12345-192.168.201.41@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783134991.901486:0:5756:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783134991.901492:0:5756:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828800/0xd6c4b8f05867f4e6 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb751a expref: 21 pid: 5770 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134991.901502:0:5756:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828800/0xd6c4b8f05867f4e6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb751a expref: 21 pid: 5770 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134991.901522:0:5756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828800/0xd6c4b8f05867f4e6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb751a expref: 21 pid: 5770 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134991.901537:0:5756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9fe9cb8f4c00) 00010000:00010000:0.0:1783134991.901548:0:5756:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829000/0xd6c4b8f05867f533 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134991.901557:0:5756:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829000/0xd6c4b8f05867f533 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134991.901562:0:5756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829000/0xd6c4b8f05867f533 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134991.901583:0:5756:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1783134991.901617:0:5771:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829000/0xd6c4b8f05867f533 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134991.901624:0:5771:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829000/0xd6c4b8f05867f533 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783134991.901640:0:5756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9d29dd850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+20:2369:x1869752373965056:12345-192.168.201.41@tcp:103:ldlm_bl.0 Request processed in 173us (443us total) trans 0 rc 0/0 00000100:00100000:0.0:1783134991.901647:0:5756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 89 00000001:00080000:2.0:1783134991.902503:0:5771:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967508 00000001:00080000:2.0:1783134991.902652:0:5771:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967509 00000001:00080000:2.0:1783134991.902697:0:5771:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967510 00000100:00100000:2.0:1783134991.902815:0:5771:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9fe82ad80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5771:1869752384422912:0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1783134991.902875:0:5771:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783134991.902906:0:5771:0:(client.c:2701:ptlrpc_set_wait()) set ffff9fe9c9baccc0 going to sleep for 11 seconds 00000100:00100000:1.0:1783134991.903262:0:5774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384422912 00000100:00100000:1.0:1783134991.903269:0:5774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384422912 00000100:00100000:1.0:1783134991.903352:0:5774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1783134991.903362:0:5774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fe828a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5771:x1869752384422912:12345-0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1783134991.903452:0:5774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fe828a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5771:x1869752384422912:12345-0@lo:1000:mdt00_002.0 Request processed in 93us (576us total) trans 0 rc 0/0 00000100:00100000:1.0:1783134991.903460:0:5774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1783134991.903607:0:5771:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9fe82ad80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5771:1869752384422912:0@lo:1000:mdt00_002.0 00000001:00080000:2.0:1783134991.904424:0:5771:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967511 00000100:00100000:2.0:1783134991.904500:0:5771:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9fe82ad80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5771:1869752384423040:0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1783134991.904539:0:5771:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783134991.904565:0:5771:0:(client.c:2701:ptlrpc_set_wait()) set ffff9fe9c9baca80 going to sleep for 11 seconds 00000100:00100000:0.0:1783134991.904587:0:5775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384423040 00000100:00100000:0.0:1783134991.904594:0:5775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384423040 00000100:00100000:0.0:1783134991.905210:0:5775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1783134991.905221:0:5775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fe829180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5771:x1869752384423040:12345-0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1783134991.905513:0:5775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fe829180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:5771:x1869752384423040:12345-0@lo:1000:mdt00_002.0 Request processed in 294us (971us total) trans 4294967324 rc 0/0 00000100:00100000:0.0:1783134991.905520:0:5775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1783134991.905550:0:5771:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9fe82ad80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5771:1869752384423040:0@lo:1000:mdt00_002.0 00010000:00010000:2.0:1783134991.905592:0:5771:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829000/0xd6c4b8f05867f533 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134991.905603:0:5771:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829000/0xd6c4b8f05867f533 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134991.905611:0:5771:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829000/0xd6c4b8f05867f533 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134991.905618:0:5771:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe9c7829000 already unused, calling callback (ffffffffc1f634f0) 00010000:00010000:2.0:1783134991.905623:0:5771:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829000/0xd6c4b8f05867f533 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134991.905632:0:5771:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829000/0xd6c4b8f05867f533 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134991.905652:0:5771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9fe9cb8f4c00) 00010000:00010000:2.0:1783134991.905655:0:5771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1783134991.905669:0:5771:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829000/0xd6c4b8f05867f533 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134991.905676:0:5771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829000/0xd6c4b8f05867f533 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134991.905715:0:5771:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b74e00/0xd6c4b8f05867f476 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134991.905722:0:5771:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b74e00/0xd6c4b8f05867f476 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134991.905728:0:5771:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b74e00/0xd6c4b8f05867f476 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134991.905734:0:5771:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe9d2b74e00 already unused, calling callback (ffffffffc1f634f0) 00010000:00010000:2.0:1783134991.905749:0:5771:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b74e00/0xd6c4b8f05867f476 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134991.905755:0:5771:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b74e00/0xd6c4b8f05867f476 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134991.905765:0:5771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9fe9e1c2ba00) 00010000:00010000:2.0:1783134991.905767:0:5771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1783134991.905775:0:5771:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829600/0xd6c4b8f05867f47d lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb74fe expref: 23 pid: 8031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134991.905786:0:5771:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829600/0xd6c4b8f05867f47d lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb74fe expref: 23 pid: 8031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134991.905796:0:5771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829600/0xd6c4b8f05867f47d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb74fe expref: 23 pid: 8031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134991.905843:0:5771:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829600/0xd6c4b8f05867f47d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb74fe expref: 23 pid: 8031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783134991.905856:0:5771:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9fe82a300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5771:1869752384423168:192.168.201.41@tcp:105: 00000100:00100000:2.0:1783134991.905950:0:5771:0:(client.c:2701:ptlrpc_set_wait()) set ffff9fe9c9baca80 going to sleep for 11 seconds 00000100:00100000:3.0:1783134991.908436:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:2.0:1783134991.908453:0:5771:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9fe82a300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5771:1869752384423168:192.168.201.41@tcp:105: 00010000:00010000:2.0:1783134991.908484:0:5771:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b74e00/0xd6c4b8f05867f476 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134991.908496:0:5771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b74e00/0xd6c4b8f05867f476 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134991.908537:0:5771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828e00/0xd6c4b8f05867f53a lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134991.908553:0:5771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828e00/0xd6c4b8f05867f53a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134991.908566:0:5771:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828e00/0xd6c4b8f05867f53a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134991.908578:0:5771:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828e00/0xd6c4b8f05867f53a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134991.908584:0:5771:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828e00/0xd6c4b8f05867f53a lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134991.908590:0:5771:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828e00/0xd6c4b8f05867f53a lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134991.908618:0:5771:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe9c7828e00 already unused, calling callback (ffffffffc1f634f0) 00010000:00010000:2.0:1783134991.908622:0:5771:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828e00/0xd6c4b8f05867f53a lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134991.908630:0:5771:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828e00/0xd6c4b8f05867f53a lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134991.908644:0:5771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9fe9e1c2ba00) 00010000:00010000:2.0:1783134991.908646:0:5771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783134991.908648:0:5771:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828e00/0xd6c4b8f05867f53a lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134991.908652:0:5771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828e00/0xd6c4b8f05867f53a lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134991.908663:0:5771:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829400/0xd6c4b8f05867f52c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134991.908670:0:5771:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829400/0xd6c4b8f05867f52c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134991.908675:0:5771:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829400/0xd6c4b8f05867f52c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134991.908680:0:5771:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe9c7829400 already unused, calling callback (ffffffffc1f634f0) 00010000:00010000:2.0:1783134991.908683:0:5771:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829400/0xd6c4b8f05867f52c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134991.908689:0:5771:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829400/0xd6c4b8f05867f52c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134991.908711:0:5771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9fe9e1c2ba00) 00010000:00010000:2.0:1783134991.908713:0:5771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1783134991.908716:0:5771:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829400/0xd6c4b8f05867f52c lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134991.908722:0:5771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829400/0xd6c4b8f05867f52c lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783134991.908950:0:5772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373965184 00000100:00100000:1.0:1783134991.908958:0:5772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373965184 00000100:00100000:3.0:1783134991.909088:0:5773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 61 00000100:00100000:3.0:1783134991.909103:0:5773:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9f6cbce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+24:11593:x1869752373965184:12345-192.168.201.41@tcp:49:lfs.0 00000100:00100000:1.0:1783134991.909147:0:5772:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 2 min 2 max 80 00000100:00100000:1.0:1783134991.909158:0:5772:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_002' 00000100:00100000:3.0:1783134991.909264:0:5773:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9f6cbce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+24:11593:x1869752373965184:12345-192.168.201.41@tcp:49:lfs.0 Request processed in 165us (835us total) trans 0 rc 0/0 00000100:00100000:3.0:1783134991.909273:0:5773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 61 00000100:00100000:2.0:1783134991.909565:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fe958e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+23:11594:x1869752373964928:12345-192.168.201.41@tcp:57:lhsmtool_posix.0 Request processed in 11356us (11709us total) trans 4294967512 rc 0/0 00000100:00100000:2.0:1783134991.909574:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 231 00000020:00080000:2.0:1783134991.909578:0:5771:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:1.0:1783134991.909855:0:11499:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1783134991.909860:0:11499:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1783134991.910253:0:11499:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:1.0:1783134991.910260:0:11499:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1783134991.912832:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:0.0:1783134991.912882:0:8031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373965440 00000100:00100000:0.0:1783134991.912894:0:8031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373965440 00000100:00100000:0.0:1783134991.912950:0:8031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 232 00000100:00100000:0.0:1783134991.912958:0:8031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fe843480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+23:11593:x1869752373965440:12345-192.168.201.41@tcp:58:lfs.0 00000040:00080000:0.0:1783134991.913769:0:8031:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].6, 136 off9008 00000100:00100000:0.0:1783134991.913871:0:8031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fe843480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+23:11593:x1869752373965440:12345-192.168.201.41@tcp:58:lfs.0 Request processed in 911us (1047us total) trans 0 rc 0/0 00000100:00100000:0.0:1783134991.913881:0:8031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 232 00000100:00100000:3.0:1783134991.915881:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:1.0:1783134991.915947:0:5773:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373965696 00000100:00100000:1.0:1783134991.915956:0:5773:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373965696 00000100:00100000:2.0:1783134991.916107:0:5772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 62 00000100:00100000:2.0:1783134991.916117:0:5772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9e0bf4850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+23:11594:x1869752373965696:12345-192.168.201.41@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1783134991.916868:0:5772:0:(mdd_object.c:4010:mdd_close()) Object [0x200000401:0x10:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1783134991.916951:0:5772:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967513 00010000:00010000:2.0:1783134991.916994:0:5772:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829000/0xd6c4b8f05867f541 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134991.917025:0:5772:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829000/0xd6c4b8f05867f541 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134991.917040:0:5772:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829000/0xd6c4b8f05867f541 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134991.917056:0:5772:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829000/0xd6c4b8f05867f541 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134991.917061:0:5772:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829000/0xd6c4b8f05867f541 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134991.917071:0:5772:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829000/0xd6c4b8f05867f541 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134991.917089:0:5772:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1783134991.917206:0:5772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9e0bf4850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+25:11594:x1869752373965696:12345-192.168.201.41@tcp:35:lhsmtool_posix.0 Request processed in 1087us (1330us total) trans 4294967514 rc 0/0 00000100:00100000:2.0:1783134991.917214:0:5772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 62 00000020:00080000:2.0:1783134991.917219:0:5772:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1783134991.917388:0:6591:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783134991.917396:0:6591:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829000/0xd6c4b8f05867f541 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134991.917404:0:6591:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe9c7829000 already unused, calling callback (ffffffffc1527ce0) 00010000:00010000:1.0:1783134991.917409:0:6591:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829000/0xd6c4b8f05867f541 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134991.917417:0:6591:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829000/0xd6c4b8f05867f541 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134991.917433:0:6591:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9fe9cc3c1500) 00010000:00010000:1.0:1783134991.917436:0:6591:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1783134991.917450:0:6591:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829000/0xd6c4b8f05867f541 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134991.917457:0:6591:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829000/0xd6c4b8f05867f541 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5772 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134991.917477:0:6591:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783134991.917479:0:6591:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783134991.917481:0:6591:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783134991.932097:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:3.0:1783134991.932188:0:5769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373965824 00000100:00100000:3.0:1783134991.932199:0:5769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373965824 00000100:00100000:3.0:1783134991.932311:0:5769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 233 00000100:00100000:3.0:1783134991.932333:0:5769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fe95b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+25:11596:x1869752373965824:12345-192.168.201.41@tcp:101:lfs.0 00010000:00010000:3.0:1783134991.932380:0:5769:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783134991.932429:0:5769:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b75a00/0xd6c4b8f05867f548 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4428da03f5eb7536 expref: -99 pid: 5769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134991.932610:0:5769:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829400/0xd6c4b8f05867f54f lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134991.932629:0:5769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829400/0xd6c4b8f05867f54f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134991.932642:0:5769:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829400/0xd6c4b8f05867f54f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134991.932660:0:5769:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828e00/0xd6c4b8f05867f556 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134991.932668:0:5769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828e00/0xd6c4b8f05867f556 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134991.932676:0:5769:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828e00/0xd6c4b8f05867f556 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134991.932957:0:5769:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829800/0xd6c4b8f05867f55d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134991.932967:0:5769:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ade00/0xd6c4b8f05867f468 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb74f7 expref: 26 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134991.932980:0:5769:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829800/0xd6c4b8f05867f55d lrc: 4/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134991.933013:0:5769:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ade00/0xd6c4b8f05867f468 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb74f7 expref: 26 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134991.933024:0:5769:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ade00/0xd6c4b8f05867f468 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb74f7 expref: 26 pid: 5770 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783134991.933050:0:5769:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9fe82a300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5769:1869752384423296:192.168.201.41@tcp:104: 00000100:00100000:2.0:1783134991.933143:0:5769:0:(client.c:2701:ptlrpc_set_wait()) set ffff9fe9c9bac600 going to sleep for 11 seconds 00000100:00100000:3.0:1783134991.935455:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:2.0:1783134991.935463:0:5769:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9fe82a300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5769:1869752384423296:192.168.201.41@tcp:104: 00010000:00010000:2.0:1783134991.935496:0:5769:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829800/0xd6c4b8f05867f55d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783134991.935568:0:12384:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373966080 00000100:00100000:0.0:1783134991.935586:0:12384:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373966080 00000100:00100000:0.0:1783134991.935649:0:12384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 63 00000100:00100000:0.0:1783134991.935660:0:12384:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fea15c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+27:5573:x1869752373966080:12345-192.168.201.41@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1783134991.935953:0:12384:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fea15c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+28:5573:x1869752373966080:12345-192.168.201.41@tcp:35:ldlm_bl.0 Request processed in 294us (507us total) trans 4294967515 rc 0/0 00000100:00100000:0.0:1783134991.935962:0:12384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 63 00000100:00100000:3.0:1783134991.937707:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:0.0:1783134991.937762:0:5755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373966208 00000100:00100000:0.0:1783134991.937771:0:5755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373966208 00010000:00010000:0.0:1783134991.938076:0:5755:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ade00/0xd6c4b8f05867f468 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb74f7 expref: 28 pid: 5770 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783134991.938112:0:5755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 90 00000100:00100000:0.0:1783134991.938120:0:5755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fea15880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+28:2369:x1869752373966208:12345-192.168.201.41@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783134991.938137:0:5755:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783134991.938143:0:5755:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ade00/0xd6c4b8f05867f468 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb74f7 expref: 28 pid: 5770 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134991.938153:0:5755:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ade00/0xd6c4b8f05867f468 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb74f7 expref: 28 pid: 5770 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134991.938174:0:5755:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ade00/0xd6c4b8f05867f468 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb74f7 expref: 28 pid: 5770 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134991.938187:0:5755:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9fe9e1c2ba00) 00010000:00010000:0.0:1783134991.938192:0:5755:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829800/0xd6c4b8f05867f55d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134991.938217:0:5755:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829800/0xd6c4b8f05867f55d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134991.938223:0:5755:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829800/0xd6c4b8f05867f55d lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134991.938253:0:5755:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783134991.938332:0:5755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fea15880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+27:2369:x1869752373966208:12345-192.168.201.41@tcp:103:ldlm_bl.0 Request processed in 212us (632us total) trans 0 rc 0/0 00000100:00100000:0.0:1783134991.938350:0:5755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 90 00010000:00010000:1.0:1783134991.938514:0:5769:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829800/0xd6c4b8f05867f55d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134991.938524:0:5769:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829800/0xd6c4b8f05867f55d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783134991.938580:0:5769:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:1.0:1783134991.938585:0:5769:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1783134991.938608:0:5769:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829800/0xd6c4b8f05867f55d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134991.938622:0:5769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829800/0xd6c4b8f05867f55d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134991.938633:0:5769:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829400/0xd6c4b8f05867f54f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134991.938640:0:5769:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829400/0xd6c4b8f05867f54f lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134991.938648:0:5769:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829400/0xd6c4b8f05867f54f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134991.938654:0:5769:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe9c7829400 already unused, calling callback (ffffffffc1f634f0) 00010000:00010000:1.0:1783134991.938666:0:5769:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829400/0xd6c4b8f05867f54f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134991.938675:0:5769:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829400/0xd6c4b8f05867f54f lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134991.938685:0:5769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9fe9e1c2b700) 00010000:00010000:1.0:1783134991.938689:0:5769:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783134991.938693:0:5769:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829400/0xd6c4b8f05867f54f lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134991.938699:0:5769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829400/0xd6c4b8f05867f54f lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134991.938712:0:5769:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828e00/0xd6c4b8f05867f556 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134991.938718:0:5769:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828e00/0xd6c4b8f05867f556 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134991.938723:0:5769:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828e00/0xd6c4b8f05867f556 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134991.938727:0:5769:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe9c7828e00 already unused, calling callback (ffffffffc1f634f0) 00010000:00010000:1.0:1783134991.938730:0:5769:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828e00/0xd6c4b8f05867f556 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134991.938735:0:5769:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828e00/0xd6c4b8f05867f556 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134991.938741:0:5769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9fe9cc3c1300) 00010000:00010000:1.0:1783134991.938743:0:5769:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783134991.938751:0:5769:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828e00/0xd6c4b8f05867f556 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134991.938757:0:5769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828e00/0xd6c4b8f05867f556 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134991.938805:0:5769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b75a00/0xd6c4b8f05867f548 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb7536 expref: 27 pid: 5769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134991.938820:0:5769:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829800/0xd6c4b8f05867f55d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb7536 expref: 26 pid: 5769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134991.938829:0:5769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9fe9e1c2ba00) 00010000:00010000:1.0:1783134991.938831:0:5769:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1783134991.938834:0:5769:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fe9c7829800, rc 0) 00000100:00100000:1.0:1783134991.938988:0:5769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fe95b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+26:11596:x1869752373965824:12345-192.168.201.41@tcp:101:lfs.0 Request processed in 6657us (6905us total) trans 0 rc 0/0 00000100:00100000:1.0:1783134991.938995:0:5769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 233 00000040:00080000:0.0:1783134992.422242:0:12422:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1783134992.422253:0:12422:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1783134992.422358:0:12422:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:0.0:1783134992.422366:0:12422:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:0.0:1783134992.646491:0:10987:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1783134992.965088:0:11499:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1783134992.965101:0:11499:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1783134992.965152:0:11499:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:1.0:1783134992.965161:0:11499:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1783134992.965547:0:11499:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9fe958380 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11499:1869752384423424:192.168.201.41@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1783134992.965708:0:11499:0:(client.c:2701:ptlrpc_set_wait()) set ffff9fe9ca2f3180 going to sleep for 11 seconds 00000100:00100000:0.0:1783134992.970275:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:1.0:1783134992.970528:0:11499:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9fe958380 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11499:1869752384423424:192.168.201.41@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1783134992.971091:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373966336 00000100:00100000:2.0:1783134992.971100:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373966336 00000100:00100000:2.0:1783134992.971171:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 234 00000100:00100000:2.0:1783134992.971184:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fe8fd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+26:11608:x1869752373966336:12345-192.168.201.41@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1783134992.971232:0:5770:0:(mdt_handler.c:7960:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1783134992.971412:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fe8fd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+26:11608:x1869752373966336:12345-192.168.201.41@tcp:53:lhsmtool_posix.0 Request processed in 228us (1150us total) trans 0 rc 0/0 00000100:00100000:2.0:1783134992.971421:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 234 00000100:00100000:3.0:1783134992.973598:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:2.0:1783134992.973790:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373966592 00000100:00100000:2.0:1783134992.973800:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373966592 00000100:00100000:2.0:1783134992.973904:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 235 00000100:00100000:2.0:1783134992.973913:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fea16300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+26:11608:x1869752373966592:12345-192.168.201.41@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1783134992.973934:0:5771:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783134992.973956:0:5771:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828800/0xd6c4b8f05867f564 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4428da03f5eb753d expref: -99 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134992.974082:0:5771:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828c00/0xd6c4b8f05867f56b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134992.974096:0:5771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828c00/0xd6c4b8f05867f56b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134992.974105:0:5771:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828c00/0xd6c4b8f05867f56b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5771 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783134992.974116:0:5771:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:2.0:1783134992.974250:0:5771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828800/0xd6c4b8f05867f564 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb753d expref: 29 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134992.974270:0:5771:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828c00/0xd6c4b8f05867f56b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb753d expref: 28 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134992.974336:0:5771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9fe9e1c2ba00) 00010000:00010000:2.0:1783134992.974341:0:5771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1783134992.974345:0:5771:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fe9c7828c00, rc 0) 00000100:00100000:2.0:1783134992.974461:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fea16300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+28:11608:x1869752373966592:12345-192.168.201.41@tcp:101:lhsmtool_posix.0 Request processed in 548us (875us total) trans 4294967516 rc 0/0 00000100:00100000:2.0:1783134992.974469:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 235 00000100:00100000:3.0:1783134992.979144:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:0.0:1783134992.979246:0:8031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373966848 00000100:00100000:0.0:1783134992.979259:0:8031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373966848 00000100:00100000:0.0:1783134992.979428:0:8031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 236 00000100:00100000:0.0:1783134992.979442:0:8031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fea15f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+28:11608:x1869752373966848:12345-192.168.201.41@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1783134992.979573:0:8031:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ad800/0xd6c4b8f05867f579 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134992.979598:0:8031:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ad800/0xd6c4b8f05867f579 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134992.979613:0:8031:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ad800/0xd6c4b8f05867f579 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134992.979957:0:8031:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ad800/0xd6c4b8f05867f579 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134992.979968:0:8031:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ad800/0xd6c4b8f05867f579 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134992.979979:0:8031:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ad800/0xd6c4b8f05867f579 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134992.979987:0:8031:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe9f68ad800 already unused, calling callback (ffffffffc1f634f0) 00010000:00010000:0.0:1783134992.979993:0:8031:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ad800/0xd6c4b8f05867f579 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134992.980005:0:8031:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ad800/0xd6c4b8f05867f579 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134992.980023:0:8031:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9fe9e1c2ba00) 00010000:00010000:0.0:1783134992.980038:0:8031:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1783134992.980047:0:8031:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ad800/0xd6c4b8f05867f579 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134992.980054:0:8031:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ad800/0xd6c4b8f05867f579 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8031 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783134992.980256:0:8031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fea15f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+29:11608:x1869752373966848:12345-192.168.201.41@tcp:57:lhsmtool_posix.0 Request processed in 815us (1125us total) trans 4294967517 rc 0/0 00000100:00100000:0.0:1783134992.980265:0:8031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 236 00000100:00100000:3.0:1783134992.980777:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:3.0:1783134992.980916:0:5754:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373966976 00000100:00100000:3.0:1783134992.980924:0:5754:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373966976 00000100:00100000:3.0:1783134992.980976:0:5754:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 15 00000100:00100000:3.0:1783134992.980986:0:5754:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fea17480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+29:2370:x1869752373966976:12345-192.168.201.41@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783134992.981001:0:5754:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783134992.981023:0:5754:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828c00/0xd6c4b8f05867f56b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb753d expref: 29 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783134992.981041:0:5754:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9fe9e1c2ba00) 00010000:00010000:3.0:1783134992.981045:0:5754:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783134992.981077:0:5754:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fea17480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+28:2370:x1869752373966976:12345-192.168.201.41@tcp:103:ldlm_bl.0 Request processed in 92us (300us total) trans 0 rc 0/0 00000100:00100000:3.0:1783134992.981085:0:5754:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 15 00000040:00080000:1.0:1783134992.981104:0:11499:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1783134992.981112:0:11499:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1783134992.983175:0:11499:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:1.0:1783134992.983209:0:11499:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1783134992.987266:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:2.0:1783134992.987536:0:5772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373967232 00000100:00100000:2.0:1783134992.987561:0:5772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373967232 00000100:00100000:2.0:1783134992.987666:0:5772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 64 00000100:00100000:2.0:1783134992.987687:0:5772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fea17100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+28:11608:x1869752373967232:12345-192.168.201.41@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1783134992.987996:0:5772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fea17100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+29:11608:x1869752373967232:12345-192.168.201.41@tcp:35:lhsmtool_posix.0 Request processed in 311us (744us total) trans 4294967518 rc 0/0 00000100:00100000:2.0:1783134992.988005:0:5772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 64 00000001:00080000:3.0:1783134993.575684:0:6602:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967309 is committed 00000001:00080000:3.0:1783134993.575709:0:6602:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967308 is committed 00000001:00080000:3.0:1783134993.575732:0:6602:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967310 is committed 00010000:00010000:0.0:1783134993.667656:0:5758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1783134994.016744:0:12476:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1783134994.016755:0:12476:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1783134994.016814:0:12476:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:0.0:1783134994.016821:0:12476:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1783134994.102527:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:0.0:1783134994.102877:0:5769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373967488 00000100:00100000:0.0:1783134994.102889:0:5769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373967488 00000100:00100000:0.0:1783134994.102966:0:5769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 237 00000100:00100000:0.0:1783134994.102979:0:5769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fe8fdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+29:11628:x1869752373967488:12345-192.168.201.41@tcp:101:lfs.0 00010000:00010000:0.0:1783134994.103009:0:5769:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783134994.103035:0:5769:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ad800/0xd6c4b8f05867f580 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4428da03f5eb7544 expref: -99 pid: 5769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134994.103163:0:5769:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ac400/0xd6c4b8f05867f587 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134994.103182:0:5769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ac400/0xd6c4b8f05867f587 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134994.103195:0:5769:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ac400/0xd6c4b8f05867f587 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783134994.103211:0:5769:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:0.0:1783134994.103411:0:5769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ad800/0xd6c4b8f05867f580 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb7544 expref: 32 pid: 5769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134994.103430:0:5769:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ac400/0xd6c4b8f05867f587 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb7544 expref: 31 pid: 5769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783134994.103441:0:5769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9fe9e1c2ba00) 00010000:00010000:0.0:1783134994.103444:0:5769:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1783134994.103454:0:5769:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fe9f68ac400, rc 0) 00000100:00100000:0.0:1783134994.103529:0:5769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fe8fdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+31:11628:x1869752373967488:12345-192.168.201.41@tcp:101:lfs.0 Request processed in 552us (1012us total) trans 4294967519 rc 0/0 00000100:00100000:0.0:1783134994.103538:0:5769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 237 00000100:00080000:0.0:1783134994.103568:0:5766:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1783134994.107240:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:2.0:1783134994.107411:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373967616 00000100:00100000:2.0:1783134994.107422:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373967616 00000100:00100000:2.0:1783134994.107488:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 238 00000100:00100000:2.0:1783134994.107501:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fea14e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+31:11628:x1869752373967616:12345-192.168.201.41@tcp:54:lfs.0 00010000:00010000:2.0:1783134994.107585:0:5770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829e00/0xd6c4b8f05867f595 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134994.107605:0:5770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829e00/0xd6c4b8f05867f595 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134994.107619:0:5770:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829e00/0xd6c4b8f05867f595 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134994.107654:0:5770:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829e00/0xd6c4b8f05867f595 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134994.107667:0:5770:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829e00/0xd6c4b8f05867f595 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134994.107676:0:5770:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829e00/0xd6c4b8f05867f595 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134994.107683:0:5770:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe9c7829e00 already unused, calling callback (ffffffffc1f634f0) 00010000:00010000:2.0:1783134994.107688:0:5770:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829e00/0xd6c4b8f05867f595 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134994.107704:0:5770:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829e00/0xd6c4b8f05867f595 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134994.107721:0:5770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9fe9e1c2ba00) 00010000:00010000:2.0:1783134994.107724:0:5770:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1783134994.107729:0:5770:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829e00/0xd6c4b8f05867f595 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134994.107734:0:5770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829e00/0xd6c4b8f05867f595 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5770 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783134994.107815:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fea14e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+31:11628:x1869752373967616:12345-192.168.201.41@tcp:54:lfs.0 Request processed in 316us (586us total) trans 0 rc 0/0 00000100:00100000:2.0:1783134994.107823:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 238 00000100:00100000:0.0:1783134994.182460:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:2.0:1783134994.182569:0:6576:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373967744 00000100:00100000:2.0:1783134994.182583:0:6576:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373967744 00000100:00100000:2.0:1783134994.182681:0:6576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 71 00000100:00100000:2.0:1783134994.182694:0:6576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fe8fce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+7:2367:x1869752373967744:12345-192.168.201.41@tcp:101:cat.0 00010000:00010000:2.0:1783134994.182717:0:6576:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00080000:0.0:1783134994.182740:0:5766:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1783134994.182746:0:6576:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b1cb05b0/0xd6c4b8f05867f59c lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4428da03f5eb754b expref: -99 pid: 6576 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1783134994.182778:0:6576:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x6:0x0] initial LVB size: 13, mtime: 0x6a487b0e, atime: 0x6a487b0e, ctime: 0x6a487b0e, blocks: 0xb 00010000:00010000:2.0:1783134994.182803:0:6576:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=276s v=(0 0) 00010000:00010000:2.0:1783134994.182808:0:6576:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783134994.182819:0:6576:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b1cb05b0/0xd6c4b8f05867f59c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb754b expref: 8 pid: 6576 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134994.182861:0:6576:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000b1cb05b0/0xd6c4b8f05867f59c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb754b expref: 8 pid: 6576 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783134994.182876:0:6576:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fe9c7829e00, rc 0) 00000100:00100000:2.0:1783134994.182965:0:6576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fe8fce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+8:2367:x1869752373967744:12345-192.168.201.41@tcp:101:cat.0 Request processed in 273us (519us total) trans 0 rc 0/0 00000100:00100000:2.0:1783134994.182972:0:6576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 71 00000100:00100000:3.0:1783134994.186831:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:1.0:1783134994.186933:0:6581:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373967872 00000100:00100000:1.0:1783134994.186945:0:6581:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373967872 00002000:00100000:1.0:1783134994.187008:0:6581:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x6:0x0] (0->4095) req@ffff9fe9fea17800 x1869752373967872/t0(0) o3->28f4ba61-cfae-499e-ab3d-81cb8215f7bb@192.168.201.41@tcp:165/0 lens 488/0 e 0 to 0 dl 1783135005 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1783134994.187021:0:6581:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9fe9fea17800 with x1869752373967872 ext(0->4095) 00002000:00010000:1.0:1783134994.187028:0:6581:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9fe9fea17800 00000100:00100000:1.0:1783134994.187063:0:6581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 8 00000100:00100000:1.0:1783134994.187072:0:6581:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fea17800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+8:2368:x1869752373967872:12345-192.168.201.41@tcp:3:cat.0 00000100:00100000:2.0:1783134994.187743:0:6581:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fea17800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+8:2368:x1869752373967872:12345-192.168.201.41@tcp:3:cat.0 Request processed in 669us (921us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1783134994.187753:0:6581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 8 00002000:00100000:2.0:1783134994.187760:0:6581:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x6:0x0] (0->4095) req@ffff9fe9fea17800 x1869752373967872/t0(0) o3->28f4ba61-cfae-499e-ab3d-81cb8215f7bb@192.168.201.41@tcp:165/0 lens 488/4536 e 0 to 0 dl 1783135005 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1783134994.187766:0:6581:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9fe9fea17800 with x1869752373967872 ext(0->4095) 00002000:00010000:2.0:1783134994.187769:0:6581:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9fe9fea17800 00000100:00100000:0.0:1783134994.218491:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:0.0:1783134994.218544:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:2.0:1783134994.218577:0:5765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373968000 00000100:00100000:2.0:1783134994.218588:0:5765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373968000 00000100:00100000:0.0:1783134994.218594:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:2.0:1783134994.218721:0:5765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 273 00000100:00100000:2.0:1783134994.218734:0:5765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9d1656450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f39b22bc-4faf-4b59-bb00-2a11f91e37c0+13:2367:x1869752373968000:12345-192.168.201.41@tcp:400:kworker.0 00000100:00100000:2.0:1783134994.218818:0:5765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9d1656450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f39b22bc-4faf-4b59-bb00-2a11f91e37c0+13:2367:x1869752373968000:12345-192.168.201.41@tcp:400:kworker.0 Request processed in 88us (343us total) trans 0 rc 0/0 00000100:00100000:2.0:1783134994.218824:0:5765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 273 00000100:00100000:3.0:1783134994.219265:0:6574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373968128 00000100:00100000:3.0:1783134994.219335:0:6574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373968128 00000100:00080000:0.0:1783134994.219372:0:5766:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1783134994.219399:0:6574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 52 00000100:00100000:3.0:1783134994.219410:0:6574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fe8fc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+5:2367:x1869752373968128:12345-192.168.201.41@tcp:400:kworker.0 00000100:00100000:3.0:1783134994.219457:0:6574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fe8fc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+5:2367:x1869752373968128:12345-192.168.201.41@tcp:400:kworker.0 Request processed in 51us (863us total) trans 0 rc 0/0 00000100:00100000:3.0:1783134994.219464:0:6574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 52 00000100:00100000:1.0:1783134994.219539:0:5769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373968256 00000100:00100000:1.0:1783134994.219544:0:5769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373968256 00000100:00100000:1.0:1783134994.219594:0:5769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 105 00000100:00100000:1.0:1783134994.219601:0:5769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fe8fca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c936801d-68e8-41a4-8fbc-6becd5e1be74+5:2367:x1869752373968256:12345-192.168.201.41@tcp:400:kworker.0 00000100:00100000:1.0:1783134994.219635:0:5769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fe8fca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c936801d-68e8-41a4-8fbc-6becd5e1be74+5:2367:x1869752373968256:12345-192.168.201.41@tcp:400:kworker.0 Request processed in 35us (1092us total) trans 0 rc 0/0 00000100:00100000:1.0:1783134994.219642:0:5769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 105 00000100:00080000:3.0:1783134994.219706:0:5766:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1783134994.691991:0:5757:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783134995.715965:0:6591:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783134996.611455:0:3288:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9fe82a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1869752384423552:0@lo:13:osp-pre-1-0.0 00000004:00080000:2.0:1783134996.611464:0:7675:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 279007182386ns, next at 280007178322ns, rc = 0 00000100:00100000:2.0:1783134996.611521:0:3287:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9fe958380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1869752384423680:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1783134996.611531:0:3286:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9fe958a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3286:1869752384423936:0@lo:400:kworker.0 00000100:00100000:3.0:1783134996.611557:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783134996.611592:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783134996.611594:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783134996.611627:0:3287:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9fe958000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3287:1869752384424064:0@lo:400:kworker.0 00000100:00100000:1.0:1783134996.611632:0:3286:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9fe95bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1869752384424448:0@lo:400:kworker.0 00000100:00100000:3.0:1783134996.611634:0:3288:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9fe95a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1869752384424192:0@lo:400:kworker.0 00000100:00100000:2.0:1783134996.611672:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783134996.611680:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783134996.611687:0:3289:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9fe95ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:88a2002e-2ea7-4f07-912a-8d001832cfc0:3289:1869752384423808:0@lo:400:kworker.0 00000100:00100000:2.0:1783134996.611725:0:8031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384423936 00000100:00100000:3.0:1783134996.611732:0:10783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384423552 00000100:00100000:1.0:1783134996.611732:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783134996.611736:0:8031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384423936 00000100:00100000:3.0:1783134996.611738:0:10783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384423552 00000100:00100000:1.0:1783134996.611784:0:3289:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9fe958700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3289:1869752384424320:0@lo:400:kworker.0 00000100:00100000:2.0:1783134996.611797:0:8031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384424064 00000100:00100000:3.0:1783134996.611800:0:10783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384423680 00000100:00100000:2.0:1783134996.611803:0:8031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384424064 00000100:00100000:3.0:1783134996.611806:0:10783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384423680 00000100:00100000:1.0:1783134996.611816:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783134996.611837:0:8031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384424320 00000100:00100000:2.0:1783134996.611842:0:8031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384424320 00000100:00100000:3.0:1783134996.611857:0:10783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1783134996.611872:0:6578:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1783134996.611877:0:8031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1783134996.611878:0:10783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fea14380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3288:x1869752384423552:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1783134996.611889:0:6578:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fe828e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3287:x1869752384423680:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1783134996.611893:0:8031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fe959180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3286:x1869752384423936:12345-0@lo:400:kworker.0 00002000:00000024:3.0:1783134996.611927:0:10783:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00002000:00000024:1.0:1783134996.611927:0:6578:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1783134996.611969:0:8031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fe959180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3286:x1869752384423936:12345-0@lo:400:kworker.0 Request processed in 80us (377us total) trans 0 rc 0/0 00000100:00100000:2.0:1783134996.611978:0:8031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1783134996.611997:0:6578:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fe828e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3287:x1869752384423680:12345-0@lo:13:osp-pre-0-0.0 Request processed in 112us (407us total) trans 0 rc 0/0 00000100:00100000:1.0:1783134996.612007:0:6578:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1783134996.612008:0:10783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fea14380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3288:x1869752384423552:12345-0@lo:13:osp-pre-1-0.0 Request processed in 140us (451us total) trans 0 rc 0/0 00000100:00100000:2.0:1783134996.612013:0:8031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1783134996.612022:0:10783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1783134996.612027:0:8031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fe82a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3287:x1869752384424064:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783134996.612042:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1783134996.612053:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fe95aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3289:x1869752384424320:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783134996.612063:0:6577:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384424192 00000100:00100000:3.0:1783134996.612070:0:6577:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384424192 00000100:00100000:2.0:1783134996.612070:0:8031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fe82a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3287:x1869752384424064:12345-0@lo:400:kworker.0 Request processed in 44us (396us total) trans 0 rc 0/0 00000100:00100000:2.0:1783134996.612090:0:8031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1783134996.612105:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fe95aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3289:x1869752384424320:12345-0@lo:400:kworker.0 Request processed in 54us (288us total) trans 0 rc 0/0 00000100:00100000:3.0:1783134996.612115:0:6577:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1783134996.612115:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1783134996.612138:0:6577:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fea16d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3288:x1869752384424192:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1783134996.612139:0:5766:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1783134996.612146:0:5762:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384423808 00000100:00080000:2.0:1783134996.612149:0:5766:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1783134996.612151:0:5762:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384423808 00000100:00080000:2.0:1783134996.612153:0:5766:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1783134996.612190:0:6577:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fea16d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3288:x1869752384424192:12345-0@lo:400:kworker.0 Request processed in 64us (509us total) trans 0 rc 0/0 00000100:00100000:1.0:1783134996.612193:0:5762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 274 00000100:00100000:1.0:1783134996.612204:0:5762:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9d1655450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88a2002e-2ea7-4f07-912a-8d001832cfc0+19:3289:x1869752384423808:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783134996.612206:0:3288:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9fe82a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1869752384423552:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1783134996.612210:0:6577:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1783134996.612244:0:3288:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 2 00000004:00080000:2.0:1783134996.612249:0:3288:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9fe9f6881180, transno 4294967307 00000100:00100000:1.0:1783134996.612254:0:5762:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9d1655450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88a2002e-2ea7-4f07-912a-8d001832cfc0+19:3289:x1869752384423808:12345-0@lo:400:kworker.0 Request processed in 51us (522us total) trans 0 rc 0/0 00000100:00100000:1.0:1783134996.612276:0:5762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 274 00000100:00100000:1.0:1783134996.612355:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:2.0:1783134996.612371:0:3288:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967309 committed transno 4294967310 00000100:00100000:1.0:1783134996.612391:0:3286:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9fe958a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3286:1869752384423936:0@lo:400:kworker.0 00000004:00080000:2.0:1783134996.612395:0:3288:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9fe9fe90ed80, transno 4294967310 00000100:00100000:2.0:1783134996.612411:0:3288:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9fe95a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1869752384424192:0@lo:400:kworker.0 00000100:00100000:1.0:1783134996.612419:0:6574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384424448 00000100:00100000:1.0:1783134996.612424:0:6574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384424448 00000100:00100000:1.0:1783134996.612465:0:6574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1783134996.612473:0:6574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fe959f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3286:x1869752384424448:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783134996.612509:0:6574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fe959f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3286:x1869752384424448:12345-0@lo:400:kworker.0 Request processed in 37us (154us total) trans 0 rc 0/0 00000100:00100000:1.0:1783134996.612526:0:6574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1783134996.612557:0:3289:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9fe95ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:88a2002e-2ea7-4f07-912a-8d001832cfc0:3289:1869752384423808:0@lo:400:kworker.0 00000100:00100000:1.0:1783134996.612574:0:3289:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9fe958700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3289:1869752384424320:0@lo:400:kworker.0 00000100:00100000:1.0:1783134996.612605:0:3287:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9fe958380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1869752384423680:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1783134996.612618:0:3287:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9fe958000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3287:1869752384424064:0@lo:400:kworker.0 00000100:00100000:0.0:1783134996.612651:0:3286:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9fe95bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1869752384424448:0@lo:400:kworker.0 00010000:00010000:3.0:1783134996.744725:0:10987:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783134996.779759:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:2.0:1783134996.779837:0:8031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373968384 00000100:00100000:2.0:1783134996.779851:0:8031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373968384 00000100:00080000:3.0:1783134996.779914:0:5766:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1783134996.779944:0:8031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 239 00000100:00100000:2.0:1783134996.779957:0:8031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fe8ffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+31:11274:x1869752373968384:12345-192.168.201.41@tcp:60:lhsmtool_posix.0 00000100:00100000:2.0:1783134996.780102:0:8031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fe8ffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+31:11274:x1869752373968384:12345-192.168.201.41@tcp:60:lhsmtool_posix.0 Request processed in 147us (357us total) trans 0 rc 0/0 00000100:00100000:2.0:1783134996.780110:0:8031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 239 00000100:00100000:0.0:1783134996.782721:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:1.0:1783134996.782862:0:5773:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373968640 00000100:00100000:1.0:1783134996.782875:0:5773:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373968640 00000100:00100000:1.0:1783134996.782982:0:5773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 65 00000100:00100000:1.0:1783134996.783005:0:5773:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fe8fd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+31:11274:x1869752373968640:12345-192.168.201.41@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1783134996.783613:0:5773:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fe8fd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+32:11274:x1869752373968640:12345-192.168.201.41@tcp:35:lhsmtool_posix.0 Request processed in 610us (904us total) trans 4294967520 rc 0/0 00000100:00100000:1.0:1783134996.783636:0:5773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 65 00000100:00100000:3.0:1783134996.921611:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:1.0:1783134996.921719:0:5769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373968768 00000100:00100000:1.0:1783134996.921736:0:5769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373968768 00000100:00100000:1.0:1783134996.921898:0:5769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 240 00000100:00100000:1.0:1783134996.921909:0:5769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fea14a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c936801d-68e8-41a4-8fbc-6becd5e1be74+5:12079:x1869752373968768:12345-192.168.201.41@tcp:101:lsof.0 00010000:00010000:1.0:1783134996.921933:0:5769:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783134996.921956:0:5769:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43f400/0xd6c4b8f05867f5a3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4428da03f5eb7552 expref: -99 pid: 5769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134996.922036:0:5769:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43e200/0xd6c4b8f05867f5aa lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134996.922053:0:5769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43e200/0xd6c4b8f05867f5aa lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134996.922084:0:5769:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43e200/0xd6c4b8f05867f5aa lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783134996.922407:0:5769:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:1.0:1783134996.922412:0:5769:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:1.0:1783134996.922498:0:5769:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43e200/0xd6c4b8f05867f5aa lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5769 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134996.922527:0:5769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43f400/0xd6c4b8f05867f5a3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb7552 expref: 7 pid: 5769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134996.922544:0:5769:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43e200/0xd6c4b8f05867f5aa lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb7552 expref: 6 pid: 5769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783134996.922553:0:5769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fe9e1c2b400) 00010000:00010000:1.0:1783134996.922556:0:5769:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1783134996.922560:0:5769:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fe9fe43e200, rc 0) 00000100:00100000:1.0:1783134996.922698:0:5769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fea14a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c936801d-68e8-41a4-8fbc-6becd5e1be74+6:12079:x1869752373968768:12345-192.168.201.41@tcp:101:lsof.0 Request processed in 789us (1095us total) trans 0 rc 0/0 00000100:00100000:1.0:1783134996.922705:0:5769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 240 00000100:00080000:3.0:1783134996.922899:0:5766:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00080000:3.0:1783134997.152097:0:7470:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967324 is committed 00000001:00080000:3.0:1783134997.152119:0:7470:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967323 is committed 00000001:00080000:2.0:1783134997.168633:0:5791:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967519 is committed 00000001:00080000:2.0:1783134997.168663:0:5791:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967520 is committed 00000020:00080000:2.0:1783134997.168672:0:5791:0:(update_trans.c:1341:distribute_txn_batchid_cb()) lustre-MDT0000: 7 batchid updated 00000004:00080000:2.0:1783134997.168691:0:5791:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 10 committed 00000020:00080000:2.0:1783134997.168719:0:5791:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9fe9c9baccc0 refcount 2 committed 0 result 0 batchid 8 00000020:00080000:2.0:1783134997.168725:0:5791:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9fe9d2912500 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9fe9c9bac9c0 00000020:00080000:2.0:1783134997.168728:0:5791:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9fe9d2912c00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9fe9f6e34c00 00000020:00080000:3.0:1783134997.168802:0:5802:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 8 committed batchid 7 00000020:00080000:3.0:1783134997.169016:0:5802:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 7 00000100:00100000:2.0:1783134997.169195:0:3287:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9fe958000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1869752384424576:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1783134997.169307:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783134997.169411:0:6577:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384424576 00000100:00100000:0.0:1783134997.169419:0:6577:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384424576 00000100:00100000:0.0:1783134997.169486:0:6577:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1783134997.169496:0:6577:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fe82a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3287:x1869752384424576:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1783134997.169698:0:6577:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:0.0:1783134997.169701:0:6577:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb mtime from disk: 1783134990 -> 1783134990 00002000:00010000:0.0:1783134997.169704:0:6577:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb atime from disk: 1783134990 -> 1783134990 00002000:00010000:0.0:1783134997.169707:0:6577:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb ctime from disk: 1783134990 -> 1783134990 00002000:00010000:0.0:1783134997.169709:0:6577:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:0.0:1783134997.170179:0:6577:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fe82a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3287:x1869752384424576:12345-0@lo:2:osp-syn-1-0.0 Request processed in 683us (871us total) trans 4294967325 rc 0/0 00000100:00100000:0.0:1783134997.170187:0:6577:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1783134997.170261:0:3287:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967324 gen 2 00000004:00080000:2.0:1783134997.170268:0:3287:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9fe9fe959500, transno 4294967322 00000004:00080000:2.0:1783134997.170381:0:3287:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967324 committed transno 4294967324 00000100:00100000:2.0:1783134997.170410:0:3287:0:(client.c:3155:ptlrpc_free_committed()) @@@ stopping search req@ffff9fe9fe958000 x1869752384424576/t4294967325(4294967325) o2->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1783135013 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:2.0:1783134997.170422:0:3287:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9fe9fe958000/2, rc 0, transno 4294967325 00000100:00100000:2.0:1783134997.170849:0:3287:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9fe958000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1869752384424576:0@lo:2:osp-syn-1-0.0 00010000:00010000:0.0:1783134997.763480:0:5758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1783134998.500211:0:12674:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1c: Test automated attach using Project ID with manual HSM restore ========================================================== 23:16:37 (1783134997) 00010000:00010000:3.0:1783134998.787422:0:5757:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783134999.332407:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:3.0:1783134999.332458:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:2.0:1783134999.332488:0:8031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373969024 00000100:00100000:3.0:1783134999.332502:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:2.0:1783134999.332517:0:8031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373969024 00000100:00100000:2.0:1783134999.332600:0:8031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 109 00000100:00100000:2.0:1783134999.332612:0:8031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fea14000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+18:2370:x1869752373969024:12345-192.168.201.41@tcp:400:kworker.0 00000100:00080000:3.0:1783134999.332686:0:5766:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1783134999.332706:0:8031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fea14000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+18:2370:x1869752373969024:12345-192.168.201.41@tcp:400:kworker.0 Request processed in 95us (310us total) trans 0 rc 0/0 00000100:00100000:2.0:1783134999.332715:0:8031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 109 00000100:00100000:1.0:1783134999.332737:0:6574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373969280 00000100:00100000:1.0:1783134999.332746:0:6574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373969280 00000100:00100000:2.0:1783134999.332772:0:5763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373968896 00000100:00100000:2.0:1783134999.332778:0:5763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373968896 00000100:00100000:1.0:1783134999.332825:0:6574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 55 00000100:00100000:1.0:1783134999.332843:0:6574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fea16680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+7:2370:x1869752373969280:12345-192.168.201.41@tcp:400:kworker.0 00000100:00100000:2.0:1783134999.332850:0:5763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 275 00000100:00100000:2.0:1783134999.332872:0:5763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9d1654c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f39b22bc-4faf-4b59-bb00-2a11f91e37c0+13:2369:x1869752373968896:12345-192.168.201.41@tcp:400:kworker.0 00000100:00080000:3.0:1783134999.332897:0:5766:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1783134999.332935:0:6574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fea16680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+7:2370:x1869752373969280:12345-192.168.201.41@tcp:400:kworker.0 Request processed in 98us (430us total) trans 0 rc 0/0 00000100:00100000:2.0:1783134999.332941:0:5763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9d1654c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f39b22bc-4faf-4b59-bb00-2a11f91e37c0+13:2369:x1869752373968896:12345-192.168.201.41@tcp:400:kworker.0 Request processed in 72us (481us total) trans 0 rc 0/0 00000100:00100000:2.0:1783134999.332957:0:5763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 275 00000100:00100000:1.0:1783134999.332965:0:6574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 55 00000100:00100000:1.0:1783134999.334908:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:1.0:1783134999.334992:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:0.0:1783134999.335035:0:6577:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373969152 00000100:00100000:2.0:1783134999.335041:0:5771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373969408 00000100:00100000:0.0:1783134999.335045:0:6577:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373969152 00000100:00100000:2.0:1783134999.335053:0:5771:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373969408 00000100:00080000:1.0:1783134999.335116:0:5766:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1783134999.335124:0:5766:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783134999.335134:0:6577:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 56 00000100:00100000:2.0:1783134999.335149:0:5771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 110 00000100:00100000:0.0:1783134999.335151:0:6577:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fe959500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+5:2369:x1869752373969152:12345-192.168.201.41@tcp:400:kworker.0 00000100:00100000:2.0:1783134999.335169:0:5771:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fe958380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c936801d-68e8-41a4-8fbc-6becd5e1be74+6:2369:x1869752373969408:12345-192.168.201.41@tcp:400:kworker.0 00000100:00100000:0.0:1783134999.335251:0:6577:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fe959500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+5:2369:x1869752373969152:12345-192.168.201.41@tcp:400:kworker.0 Request processed in 105us (349us total) trans 0 rc 0/0 00000100:00100000:2.0:1783134999.335261:0:5771:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fe958380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c936801d-68e8-41a4-8fbc-6becd5e1be74+6:2369:x1869752373969408:12345-192.168.201.41@tcp:400:kworker.0 Request processed in 91us (258us total) trans 0 rc 0/0 00000100:00100000:0.0:1783134999.335271:0:6577:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 56 00000100:00100000:2.0:1783134999.335329:0:5771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 110 00010000:00010000:1.0:1783134999.811590:0:6591:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1783135000.131647:0:11499:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1783135000.131660:0:11499:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1783135000.132232:0:11499:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 3 00000040:00080000:1.0:1783135000.132241:0:11499:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1783135000.208638:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:2.0:1783135000.209062:0:5772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373969664 00000100:00100000:2.0:1783135000.209075:0:5772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373969664 00000100:00100000:2.0:1783135000.209147:0:5772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 66 00000100:00100000:2.0:1783135000.209160:0:5772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fea14700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+18:12299:x1869752373969664:12345-192.168.201.41@tcp:35:umount.0 00000100:00100000:2.0:1783135000.209949:0:5772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fea14700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+19:12299:x1869752373969664:12345-192.168.201.41@tcp:35:umount.0 Request processed in 789us (1324us total) trans 4294967521 rc 0/0 00000100:00100000:2.0:1783135000.209969:0:5772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 66 00000100:00100000:3.0:1783135000.212376:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:1.0:1783135000.212442:0:5773:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373969920 00000100:00100000:1.0:1783135000.212452:0:5773:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373969920 00000100:00100000:1.0:1783135000.212503:0:5773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 67 00000100:00100000:1.0:1783135000.212511:0:5773:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fea17b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+19:12299:x1869752373969920:12345-192.168.201.41@tcp:35:umount.0 00000100:00100000:1.0:1783135000.212968:0:5773:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fea17b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+20:12299:x1869752373969920:12345-192.168.201.41@tcp:35:umount.0 Request processed in 455us (601us total) trans 4294967522 rc 0/0 00000100:00100000:1.0:1783135000.212977:0:5773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 67 00000100:00100000:1.0:1783135000.214503:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:2.0:1783135000.214690:0:5772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373970176 00000100:00100000:2.0:1783135000.214701:0:5772:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373970176 00000100:00100000:2.0:1783135000.214754:0:5772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 68 00000100:00100000:2.0:1783135000.214766:0:5772:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9e0bf7050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+20:12299:x1869752373970176:12345-192.168.201.41@tcp:35:umount.0 00000100:00100000:2.0:1783135000.215378:0:5772:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9e0bf7050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+21:12299:x1869752373970176:12345-192.168.201.41@tcp:35:umount.0 Request processed in 612us (879us total) trans 4294967523 rc 0/0 00000100:00100000:2.0:1783135000.215387:0:5772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 68 00000100:00100000:3.0:1783135000.216592:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:1.0:1783135000.216675:0:5773:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373970432 00000100:00100000:1.0:1783135000.216684:0:5773:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373970432 00000100:00100000:1.0:1783135000.216729:0:5773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 69 00000100:00100000:1.0:1783135000.216738:0:5773:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fea15180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+21:12299:x1869752373970432:12345-192.168.201.41@tcp:35:umount.0 00000100:00100000:1.0:1783135000.217016:0:5773:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fea15180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+22:12299:x1869752373970432:12345-192.168.201.41@tcp:35:umount.0 Request processed in 279us (426us total) trans 4294967524 rc 0/0 00000100:00100000:1.0:1783135000.217024:0:5773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 69 00000100:00100000:3.0:1783135000.219755:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:3.0:1783135000.219891:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:3.0:1783135000.219933:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:0.0:1783135000.220008:0:5756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373970688 00000100:00100000:0.0:1783135000.220021:0:5756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373970688 00000100:00100000:0.0:1783135000.220099:0:5756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373970560 00000100:00100000:0.0:1783135000.220104:0:5756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373970560 00000100:00100000:2.0:1783135000.220114:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373970816 00000100:00100000:2.0:1783135000.220120:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373970816 00000100:00100000:0.0:1783135000.220140:0:5756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 16 00000100:00100000:0.0:1783135000.220153:0:5756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fea16a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f39b22bc-4faf-4b59-bb00-2a11f91e37c0+15:2369:x1869752373970688:12345-192.168.201.41@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783135000.220171:0:5756:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783135000.220206:0:5756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fea02167400/0xd6c4b8f05867e57a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb7097 expref: 15 pid: 5763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135000.220240:0:5756:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783135000.220359:0:5756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fea16a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f39b22bc-4faf-4b59-bb00-2a11f91e37c0+14:2369:x1869752373970688:12345-192.168.201.41@tcp:103:ldlm_bl.0 Request processed in 209us (614us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135000.223153:0:5754:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 17 00000100:00100000:0.0:1783135000.223529:0:5756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 16 00000100:00100000:1.0:1783135000.223543:0:5754:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fea15500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f39b22bc-4faf-4b59-bb00-2a11f91e37c0+14:2369:x1869752373970560:12345-192.168.201.41@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1783135000.223556:0:5755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 18 00010000:00010000:1.0:1783135000.223571:0:5754:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1783135000.223582:0:5755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fea15c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f39b22bc-4faf-4b59-bb00-2a11f91e37c0+13:2370:x1869752373970816:12345-192.168.201.41@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783135000.223594:0:5755:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783135000.223600:0:5754:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fe9c148b800/0xd6c4b8f05867e614 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb70cf expref: 13 pid: 5765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135000.223609:0:5755:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fe9d2b75400/0xd6c4b8f05867e821 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb719a expref: 13 pid: 5765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135000.223624:0:5754:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1783135000.223625:0:5755:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783135000.223650:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:3.0:1783135000.223675:0:5755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fea15c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f39b22bc-4faf-4b59-bb00-2a11f91e37c0+11:2370:x1869752373970816:12345-192.168.201.41@tcp:103:ldlm_bl.0 Request processed in 99us (3741us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135000.223681:0:5755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 18 00000100:00100000:3.0:1783135000.223707:0:7676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373971200 00000100:00100000:3.0:1783135000.223713:0:7676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373971200 00000100:00100000:3.0:1783135000.223748:0:7676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 73 00000100:00100000:3.0:1783135000.223753:0:7676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fe8fea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+7:2366:x1869752373971200:12345-192.168.201.41@tcp:9:umount.0 00000020:00000080:3.0:1783135000.223779:0:7676:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xd6c4b8f05867eb4d 00000020:00010000:3.0:1783135000.223787:0:7676:0:(genops.c:1942:obd_stale_export_put()) Put export ffff9fe9fe928800: total 0 00000100:00080000:3.0:1783135000.223791:0:7676:0:(import.c:65:import_set_state_nolock()) ffff9fe9fe929000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1783135000.223825:0:7676:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967325 00000100:00100000:1.0:1783135000.223992:0:5754:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fea15500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f39b22bc-4faf-4b59-bb00-2a11f91e37c0+10:2369:x1869752373970560:12345-192.168.201.41@tcp:103:ldlm_bl.0 Request processed in 462us (4100us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135000.223999:0:5754:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 17 00000020:00010000:0.0:1783135000.224028:0:10987:0:(genops.c:1928:obd_stale_export_get()) Get export ffff9fe9fe928800: total 0 00010000:00010000:0.0:1783135000.224072:0:10987:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff9fe9fe928800, canceled 0 locks, left on hash table 2. 00010000:00010000:0.0:1783135000.224116:0:10987:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b1cb05b0/0xd6c4b8f05867f59c lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb754b expref: 6 pid: 6576 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135000.224182:0:10987:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fd8fb796/0xd6c4b8f05867eef7 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb7376 expref: 5 pid: 6577 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135000.224444:0:10987:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff9fe9fe928800, canceled 2 locks, left on hash table 0. 00010000:00010000:0.0:1783135000.224473:0:10987:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783135000.224475:0:10987:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783135000.224477:0:10987:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783135000.224713:0:7676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fe8fea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+2:2366:x1869752373971200:12345-192.168.201.41@tcp:9:umount.0 Request processed in 958us (1064us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135000.224720:0:7676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 73 00000100:00100000:0.0:1783135000.228035:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:1.0:1783135000.228083:0:6576:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373971328 00000100:00100000:1.0:1783135000.228096:0:6576:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373971328 00000100:00100000:1.0:1783135000.228163:0:6576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 74 00000100:00100000:1.0:1783135000.228172:0:6576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fe8fd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+5:2366:x1869752373971328:12345-192.168.201.41@tcp:9:umount.0 00000020:00000080:1.0:1783135000.228228:0:6576:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xd6c4b8f05867e8ec 00000100:00080000:1.0:1783135000.228242:0:6576:0:(import.c:65:import_set_state_nolock()) ffff9fe9fe92b000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1783135000.228335:0:6576:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967310 00000100:00100000:1.0:1783135000.228631:0:6576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fe8fd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+2:2366:x1869752373971328:12345-192.168.201.41@tcp:9:umount.0 Request processed in 459us (608us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135000.228638:0:6576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 74 00010000:00010000:0.0:1783135000.228730:0:5758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783135000.235614:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:1.0:1783135000.235671:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373972352 00000100:00100000:1.0:1783135000.235684:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373972352 00000100:00100000:1.0:1783135000.235759:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 241 00000100:00100000:1.0:1783135000.235772:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fea17100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+22:2366:x1869752373972352:12345-192.168.201.41@tcp:39:umount.0 00000020:00000080:1.0:1783135000.235817:0:5770:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xd6c4b8f05867e588 00000020:00010000:1.0:1783135000.235836:0:5770:0:(genops.c:1942:obd_stale_export_put()) Put export ffff9fe9fe80f800: total 0 00000100:00080000:1.0:1783135000.235842:0:5770:0:(import.c:65:import_set_state_nolock()) ffff9fe9fe80d000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1783135000.235877:0:5770:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967524 00000020:00010000:3.0:1783135000.235915:0:5757:0:(genops.c:1928:obd_stale_export_get()) Get export ffff9fe9fe80f800: total 0 00010000:00010000:3.0:1783135000.235965:0:5757:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff9fe9fe80f800, canceled 0 locks, left on hash table 13. 00010000:00010000:3.0:1783135000.235999:0:5757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9fe9e1c2bd00) 00010000:00010000:3.0:1783135000.236003:0:5757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1783135000.236011:0:5757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43ea00/0xd6c4b8f05867e8c2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb71c4 expref: 21 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135000.236027:0:5757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9fe9e1c2bd00) 00010000:00010000:3.0:1783135000.236030:0:5757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1783135000.236033:0:5757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43e600/0xd6c4b8f05867ebaf lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb7296 expref: 20 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135000.236058:0:5757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fe9e1c2b400) 00010000:00010000:3.0:1783135000.236068:0:5757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1783135000.236074:0:5757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43fc00/0xd6c4b8f05867ef59 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb7392 expref: 19 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135000.236091:0:5757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9fe9cc3c1b00) 00010000:00010000:3.0:1783135000.236094:0:5757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1783135000.236099:0:5757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b74400/0xd6c4b8f05867eee2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb736f expref: 18 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135000.236113:0:5757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9fe9e1c2ba00) 00010000:00010000:3.0:1783135000.236115:0:5757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1783135000.236119:0:5757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829600/0xd6c4b8f05867f47d lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb74fe expref: 17 pid: 8031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135000.236135:0:5757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9fe9cc3c1b00) 00010000:00010000:3.0:1783135000.236138:0:5757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1783135000.236142:0:5757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828600/0xd6c4b8f05867eeb8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb7361 expref: 16 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135000.236159:0:5757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9fe9e1c2b600) 00010000:00010000:3.0:1783135000.236162:0:5757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783135000.236166:0:5757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43e800/0xd6c4b8f05867e86e lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb71af expref: 15 pid: 8031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135000.236185:0:5757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9fe9e1c2b700) 00010000:00010000:3.0:1783135000.236186:0:5757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1783135000.236189:0:5757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b75000/0xd6c4b8f05867f254 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb746b expref: 14 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135000.236230:0:5757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9fe9e1c2ba00) 00010000:00010000:3.0:1783135000.236233:0:5757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1783135000.236237:0:5757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829800/0xd6c4b8f05867f55d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb7536 expref: 13 pid: 5769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135000.236250:0:5757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9fe9e1c2b700) 00010000:00010000:3.0:1783135000.236253:0:5757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1783135000.236257:0:5757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43f000/0xd6c4b8f05867ef75 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb7399 expref: 12 pid: 8031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135000.236274:0:5757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9fe9e1c2ba00) 00010000:00010000:3.0:1783135000.236383:0:5757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1783135000.236392:0:5757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ac400/0xd6c4b8f05867f587 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb7544 expref: 11 pid: 5769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135000.236414:0:5757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9fe9e1c2b100) 00010000:00010000:3.0:1783135000.236417:0:5757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1783135000.236421:0:5757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43ee00/0xd6c4b8f05867e852 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb71a8 expref: 11 pid: 5770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135000.236439:0:5757:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9fe9cc3c1b00) 00010000:00010000:3.0:1783135000.236441:0:5757:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1783135000.236445:0:5757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9d2b74200/0xd6c4b8f05867edd8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb7329 expref: 10 pid: 5771 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135000.236461:0:5757:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff9fe9fe80f800, canceled 13 locks, left on hash table 0. 00010000:00010000:3.0:1783135000.236474:0:5757:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783135000.236482:0:5757:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783135000.236484:0:5757:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783135000.236689:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fea17100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:28f4ba61-cfae-499e-ab3d-81cb8215f7bb+7:2366:x1869752373972352:12345-192.168.201.41@tcp:39:umount.0 Request processed in 919us (1084us total) trans 4294967525 rc 0/0 00000100:00100000:1.0:1783135000.236699:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 241 00010000:00010000:1.0:1783135000.836606:0:6591:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783135001.018482:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:2.0:1783135001.018699:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:2.0:1783135001.019041:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:0.0:1783135001.019066:0:5756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373972480 00000100:00100000:0.0:1783135001.019077:0:5756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373972480 00000100:00100000:1.0:1783135001.019153:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373972736 00000100:00100000:1.0:1783135001.019157:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373972736 00000100:00100000:1.0:1783135001.019207:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 19 00000100:00100000:1.0:1783135001.019218:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fe82ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f39b22bc-4faf-4b59-bb00-2a11f91e37c0+11:2368:x1869752373972480:12345-192.168.201.41@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1783135001.019238:0:6592:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783135001.019260:0:6592:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fe9c148b200/0xd6c4b8f05867e65a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb70e4 expref: 11 pid: 5762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135001.019317:0:6592:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783135001.019384:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fe82ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f39b22bc-4faf-4b59-bb00-2a11f91e37c0+10:2368:x1869752373972480:12345-192.168.201.41@tcp:103:ldlm_bl.0 Request processed in 167us (916us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135001.019392:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 19 00000100:00100000:1.0:1783135001.019413:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 20 00000100:00100000:1.0:1783135001.019419:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9d29de850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f39b22bc-4faf-4b59-bb00-2a11f91e37c0+9:2368:x1869752373972736:12345-192.168.201.41@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1783135001.019430:0:6592:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783135001.019439:0:6592:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fe9f68ac600/0xd6c4b8f05867e81a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb7193 expref: 9 pid: 5763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135001.019448:0:6592:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783135001.019468:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9d29de850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f39b22bc-4faf-4b59-bb00-2a11f91e37c0+8:2368:x1869752373972736:12345-192.168.201.41@tcp:103:ldlm_bl.0 Request processed in 49us (770us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135001.019473:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 20 00000100:00100000:0.0:1783135001.020733:0:5756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373972608 00000100:00100000:0.0:1783135001.020753:0:5756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373972608 00000100:00100000:0.0:1783135001.020804:0:5756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 21 00000100:00100000:0.0:1783135001.020813:0:5756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fe829500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f39b22bc-4faf-4b59-bb00-2a11f91e37c0+8:2368:x1869752373972608:12345-192.168.201.41@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783135001.020826:0:5756:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783135001.020851:0:5756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fe9c1523e00/0xd6c4b8f05867e661 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb710e expref: 8 pid: 5765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135001.020876:0:5756:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783135001.020923:0:5756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fe829500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f39b22bc-4faf-4b59-bb00-2a11f91e37c0+7:2368:x1869752373972608:12345-192.168.201.41@tcp:103:ldlm_bl.0 Request processed in 111us (1882us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135001.020931:0:5756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 21 00000100:00100000:3.0:1783135001.028893:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:1.0:1783135001.029004:0:5769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373972992 00000100:00100000:1.0:1783135001.029034:0:5769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373972992 00000100:00100000:1.0:1783135001.029138:0:5769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 242 00000100:00100000:1.0:1783135001.029151:0:5769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fea14700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c936801d-68e8-41a4-8fbc-6becd5e1be74+6:2366:x1869752373972992:12345-192.168.201.41@tcp:39:umount.0 00000100:00080000:3.0:1783135001.029310:0:5766:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000020:00000080:1.0:1783135001.029434:0:5769:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xd6c4b8f05867e66f 00000020:00010000:1.0:1783135001.029445:0:5769:0:(genops.c:1942:obd_stale_export_put()) Put export ffff9fe9fe808000: total 0 00000100:00080000:1.0:1783135001.029451:0:5769:0:(import.c:65:import_set_state_nolock()) ffff9fe8c57d9000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1783135001.029538:0:5769:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967525 00000100:00100000:1.0:1783135001.029835:0:5769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fea14700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c936801d-68e8-41a4-8fbc-6becd5e1be74+5:2366:x1869752373972992:12345-192.168.201.41@tcp:39:umount.0 Request processed in 685us (956us total) trans 4294967526 rc 0/0 00000100:00100000:1.0:1783135001.029844:0:5769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 242 00000020:00010000:0.0:1783135001.033548:0:10987:0:(genops.c:1928:obd_stale_export_get()) Get export ffff9fe9fe808000: total 0 00010000:00010000:0.0:1783135001.033631:0:10987:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff9fe9fe808000, canceled 0 locks, left on hash table 1. 00010000:00010000:0.0:1783135001.033689:0:10987:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fe9e1c2b400) 00010000:00010000:0.0:1783135001.033710:0:10987:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1783135001.033725:0:10987:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43e200/0xd6c4b8f05867f5aa lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb7552 expref: 4 pid: 5769 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135001.033757:0:10987:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff9fe9fe808000, canceled 1 locks, left on hash table 0. 00010000:00010000:0.0:1783135001.033769:0:10987:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783135001.033771:0:10987:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783135001.033773:0:10987:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783135001.042873:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:1.0:1783135001.042970:0:5765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373973248 00000100:00100000:1.0:1783135001.042983:0:5765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373973248 00000100:00100000:1.0:1783135001.043059:0:5765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 276 00000100:00100000:1.0:1783135001.043071:0:5765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9d1654850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f39b22bc-4faf-4b59-bb00-2a11f91e37c0+7:2366:x1869752373973248:12345-192.168.201.41@tcp:251:umount.0 00000020:00000080:1.0:1783135001.043129:0:5765:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xd6c4b8f05867e565 00000020:00010000:1.0:1783135001.043139:0:5765:0:(genops.c:1942:obd_stale_export_put()) Put export ffff9fe8c5ffb000: total 0 00000100:00080000:1.0:1783135001.043145:0:5765:0:(import.c:65:import_set_state_nolock()) ffff9fe8c5ff9000 : changing import state from FULL to CLOSED 00000100:00100000:1.0:1783135001.043260:0:5765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9d1654850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f39b22bc-4faf-4b59-bb00-2a11f91e37c0+3:2366:x1869752373973248:12345-192.168.201.41@tcp:251:umount.0 Request processed in 190us (399us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135001.043269:0:5765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 276 00000020:00010000:0.0:1783135001.043475:0:5758:0:(genops.c:1928:obd_stale_export_get()) Get export ffff9fe8c5ffb000: total 0 00010000:00010000:0.0:1783135001.043480:0:5758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783135001.043542:0:5758:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff9fe8c5ffb000, canceled 0 locks, left on hash table 1. 00010000:00010000:0.0:1783135001.043581:0:5758:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fea02166800/0xd6c4b8f05867e61b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb70d6 expref: 2 pid: 5763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135001.043597:0:5758:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff9fe8c5ffb000, canceled 1 locks, left on hash table 0. 00000020:00000080:0.0:1783135001.043604:0:5758:0:(genops.c:906:class_export_put()) final put ffff9fe8c5ffb000/f39b22bc-4faf-4b59-bb00-2a11f91e37c0 00010000:00010000:0.0:1783135001.043620:0:5758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783135001.043622:0:5758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783135001.043624:0:5758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1783135001.043654:0:483:0:(genops.c:865:class_export_destroy()) destroying export ffff9fe8c5ffb000/f39b22bc-4faf-4b59-bb00-2a11f91e37c0 for MGS 00000020:00000080:1.0:1783135001.043694:0:483:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9fe8c5ff9000 for MGS 00000100:00100000:0.0:1783135001.735698:0:3288:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9f6881180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1869752384424704:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1783135001.735813:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135001.735910:0:6578:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384424704 00000100:00100000:0.0:1783135001.735919:0:6578:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384424704 00000100:00100000:0.0:1783135001.735987:0:6578:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1783135001.735998:0:6578:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9f6881c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3288:x1869752384424704:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1783135001.736042:0:6578:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1783135001.736090:0:6578:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9f6881c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3288:x1869752384424704:12345-0@lo:13:osp-pre-1-0.0 Request processed in 94us (278us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135001.736110:0:6578:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00080000:0.0:1783135001.736137:0:5766:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1783135001.736194:0:3288:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9f6881180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1869752384424704:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1783135001.736908:0:3288:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1783135001.736919:0:3288:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9f6881180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1869752384424832:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1783135001.736952:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135001.739635:0:6579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384424832 00000100:00100000:1.0:1783135001.739654:0:6579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384424832 00000100:00100000:1.0:1783135001.739736:0:6579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1783135001.739748:0:6579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9f6882d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3288:x1869752384424832:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1783135001.739806:0:6579:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1783135001.739908:0:6579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9f6882d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3288:x1869752384424832:12345-0@lo:13:osp-pre-0-0.0 Request processed in 162us (2953us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135001.739916:0:6579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00080000:1.0:1783135001.739964:0:5766:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1783135001.740014:0:3288:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9f6881180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1869752384424832:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1783135001.748194:0:3286:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9fe958700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:88a2002e-2ea7-4f07-912a-8d001832cfc0:3286:1869752384424960:0@lo:400:kworker.0 00000100:00100000:1.0:1783135001.748310:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135001.748404:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1783135001.748411:0:3286:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9fe95ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3286:1869752384425088:0@lo:400:kworker.0 00000100:00100000:1.0:1783135001.748441:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135001.748505:0:3288:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9fe95b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3288:1869752384425216:0@lo:400:kworker.0 00000100:00100000:1.0:1783135001.748535:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135001.748576:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384425088 00000100:00100000:1.0:1783135001.748586:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384425088 00000100:00100000:1.0:1783135001.748639:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384425216 00000100:00100000:1.0:1783135001.748642:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384425216 00000100:00100000:1.0:1783135001.748673:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1783135001.748682:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fe958a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3286:x1869752384425088:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783135001.748744:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fe958a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3286:x1869752384425088:12345-0@lo:400:kworker.0 Request processed in 62us (300us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135001.748751:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1783135001.748771:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1783135001.748777:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fe95bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3288:x1869752384425216:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783135001.749592:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fe95bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3288:x1869752384425216:12345-0@lo:400:kworker.0 Request processed in 813us (1054us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135001.749600:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00080000:1.0:1783135001.749631:0:5766:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1783135001.749672:0:3286:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9fe95ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3286:1869752384425088:0@lo:400:kworker.0 00000100:00100000:1.0:1783135001.749707:0:3288:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9fe95b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3288:1869752384425216:0@lo:400:kworker.0 00000100:00100000:1.0:1783135001.749750:0:3289:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9fe95b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3289:1869752384425344:0@lo:400:kworker.0 00000100:00100000:1.0:1783135001.749849:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135001.749883:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384425344 00000100:00100000:1.0:1783135001.749889:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384425344 00000100:00100000:1.0:1783135001.749919:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1783135001.749926:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fe95ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3289:x1869752384425344:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783135001.749960:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fe95ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3289:x1869752384425344:12345-0@lo:400:kworker.0 Request processed in 34us (112us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135001.749968:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00080000:1.0:1783135001.749981:0:5766:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1783135001.749998:0:3289:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9fe95b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3289:1869752384425344:0@lo:400:kworker.0 00000100:00100000:2.0:1783135001.750334:0:5763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384424960 00000100:00100000:2.0:1783135001.750340:0:5763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384424960 00000100:00100000:2.0:1783135001.750373:0:5763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 277 00000100:00100000:2.0:1783135001.750380:0:5763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9d1657050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88a2002e-2ea7-4f07-912a-8d001832cfc0+19:3286:x1869752384424960:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783135001.750423:0:5763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9d1657050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88a2002e-2ea7-4f07-912a-8d001832cfc0+19:3286:x1869752384424960:12345-0@lo:400:kworker.0 Request processed in 43us (2114us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135001.750429:0:5763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 277 00000100:00100000:2.0:1783135001.752655:0:3286:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9fe958700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:88a2002e-2ea7-4f07-912a-8d001832cfc0:3286:1869752384424960:0@lo:400:kworker.0 00010000:00010000:3.0:1783135001.859610:0:5757:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1783135002.217084:0:12871:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:2.0:1783135002.239147:0:12871:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:3.0:1783135002.239599:0:12871:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.141@tcp lock: ffff9fe9c0031400/0xd6c4b8f05867e5ea lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xd6c4b8f05867e5f1 expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135002.239628:0:12871:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.141@tcp lock: ffff9fe9c0031400/0xd6c4b8f05867e5ea lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xd6c4b8f05867e5f1 expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135002.239638:0:12871:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.141@tcp lock: ffff9fe9c0031400/0xd6c4b8f05867e5ea lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0xd6c4b8f05867e5f1 expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135002.239646:0:12871:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.141@tcp lock: ffff9fe9c0031400/0xd6c4b8f05867e5ea lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0xd6c4b8f05867e5f1 expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135002.239670:0:12871:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1783135002.239677:0:12871:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:3.0:1783135002.239706:0:12871:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1783135002.239712:0:12871:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:3.0:1783135002.239718:0:12871:0:(pinger.c:400:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1783135002.239752:0:12871:0:(import.c:65:import_set_state_nolock()) ffff9fe9cb455800 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:2.0:1783135002.239858:0:3285:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9fea17b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3285:1869752384425472:0@lo:39:umount.0 00010000:00010000:1.0:1783135002.239879:0:6591:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783135002.239889:0:6591:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.141@tcp lock: ffff9fe9c0031400/0xd6c4b8f05867e5ea lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0xd6c4b8f05867e5f1 expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135002.239898:0:6591:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe9c0031400 already unused, calling callback (ffffffffc1b40c20) 10000000:00010000:1.0:1783135002.239902:0:6591:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.141@tcp lock: ffff9fe9c0031400/0xd6c4b8f05867e5ea lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0xd6c4b8f05867e5f1 expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135002.239913:0:6591:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.141@tcp lock: ffff9fe9c0031400/0xd6c4b8f05867e5ea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0xd6c4b8f05867e5f1 expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783135002.239922:0:6591:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.141@tcp lock: ffff9fe9c0031400/0xd6c4b8f05867e5ea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0xd6c4b8f05867e5f1 expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783135002.239952:0:6591:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1783135002.239955:0:6591:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:1.0:1783135002.239959:0:6591:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00000100:00100000:2.0:1783135002.239971:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1783135002.239991:0:6591:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.141@tcp lock: ffff9fe9c0031400/0xd6c4b8f05867e5ea lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xd6c4b8f05867e5f1 expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135002.239999:0:6591:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1783135002.240024:0:6591:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.141@tcp lock: ffff9fe9c0031400/0xd6c4b8f05867e5ea lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xd6c4b8f05867e5f1 expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135002.240032:0:6591:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.141@tcp lock: ffff9fe9c0031400/0xd6c4b8f05867e5ea lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xd6c4b8f05867e5f1 expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135002.240051:0:6591:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783135002.240053:0:6591:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783135002.240055:0:6591:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783135002.240067:0:3286:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9fe95b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:88a2002e-2ea7-4f07-912a-8d001832cfc0:3286:1869752384425600:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1783135002.240106:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135002.240181:0:5756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384425600 00000100:00100000:1.0:1783135002.240191:0:5756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384425600 00000100:00100000:1.0:1783135002.240254:0:5756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1783135002.240267:0:5756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fe95a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:88a2002e-2ea7-4f07-912a-8d001832cfc0+19:3286:x1869752384425600:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1783135002.240322:0:5756:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783135002.240343:0:5756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fe9c0030a00/0xd6c4b8f05867e5f1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xd6c4b8f05867e5ea expref: 19 pid: 5762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135002.240358:0:5756:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783135002.240403:0:5756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fe95a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:88a2002e-2ea7-4f07-912a-8d001832cfc0+18:3286:x1869752384425600:12345-0@lo:103:ldlm_bl.0 Request processed in 137us (295us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135002.240417:0:5756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1783135002.240520:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384425472 00000100:00100000:3.0:1783135002.240525:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384425472 00000100:00100000:0.0:1783135002.240560:0:3286:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9fe95b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:88a2002e-2ea7-4f07-912a-8d001832cfc0:3286:1869752384425600:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1783135002.240572:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 243 00000100:00100000:3.0:1783135002.240583:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fe829c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1869752384425472:12345-0@lo:39:umount.0 00000020:00000080:3.0:1783135002.240615:0:5770:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xd6c4b8f05867e374 00000100:00080000:3.0:1783135002.240638:0:5770:0:(import.c:65:import_set_state_nolock()) ffff9fe9cb453000 : changing import state from FULL to CLOSED 00010000:00010000:0.0:1783135002.240686:0:10987:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783135002.240708:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fe829c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+1:3285:x1869752384425472:12345-0@lo:39:umount.0 Request processed in 127us (738us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135002.240723:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 243 00000020:00000080:3.0:1783135002.240732:0:5770:0:(genops.c:906:class_export_put()) final put ffff9fe9cb450000/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:0.0:1783135002.240782:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9fe9cb450000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:0.0:1783135002.240851:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9fe9cb453000 for lustre-MDT0000 00000100:00080000:3.0:1783135002.242808:0:3285:0:(import.c:65:import_set_state_nolock()) ffff9fe9cb455800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:3.0:1783135002.242837:0:3285:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9fea17b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3285:1869752384425472:0@lo:39:umount.0 00000100:00080000:2.0:1783135002.242859:0:12871:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1783135002.242881:0:12871:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:2.0:1783135002.242887:0:12871:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:3.0:1783135002.244856:0:12871:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.141@tcp lock: ffff9fea02167800/0xd6c4b8f05867e5f8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xd6c4b8f05867e5ff expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135002.244875:0:12871:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.141@tcp lock: ffff9fea02167800/0xd6c4b8f05867e5f8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xd6c4b8f05867e5ff expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135002.244883:0:12871:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.141@tcp lock: ffff9fea02167800/0xd6c4b8f05867e5f8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0xd6c4b8f05867e5ff expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135002.244890:0:12871:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.141@tcp lock: ffff9fea02167800/0xd6c4b8f05867e5f8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0xd6c4b8f05867e5ff expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135002.244963:0:12871:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783135002.244971:0:12871:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.141@tcp lock: ffff9fe9c1523000/0xd6c4b8f05867e51f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd6c4b8f05867e526 expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135002.244976:0:12871:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.141@tcp lock: ffff9fe9c1523000/0xd6c4b8f05867e51f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd6c4b8f05867e526 expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135002.244980:0:12871:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.141@tcp lock: ffff9fe9c1523000/0xd6c4b8f05867e51f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xd6c4b8f05867e526 expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135002.244984:0:12871:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.141@tcp lock: ffff9fe9c1523000/0xd6c4b8f05867e51f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xd6c4b8f05867e526 expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135002.245195:0:5758:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1783135002.245206:0:5758:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.141@tcp lock: ffff9fea02167800/0xd6c4b8f05867e5f8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0xd6c4b8f05867e5ff expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135002.245214:0:5758:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fea02167800 already unused, calling callback (ffffffffc1b40c20) 10000000:00010000:0.0:1783135002.245219:0:5758:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.141@tcp lock: ffff9fea02167800/0xd6c4b8f05867e5f8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0xd6c4b8f05867e5ff expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135002.245230:0:5758:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.141@tcp lock: ffff9fea02167800/0xd6c4b8f05867e5f8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0xd6c4b8f05867e5ff expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1783135002.245239:0:5758:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.141@tcp lock: ffff9fea02167800/0xd6c4b8f05867e5f8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0xd6c4b8f05867e5ff expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783135002.245246:0:5758:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1783135002.245249:0:5758:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 00010000:00010000:0.0:1783135002.245356:0:5758:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.141@tcp lock: ffff9fea02167800/0xd6c4b8f05867e5f8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xd6c4b8f05867e5ff expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135002.245379:0:5758:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1783135002.245422:0:5758:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.141@tcp lock: ffff9fea02167800/0xd6c4b8f05867e5f8 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xd6c4b8f05867e5ff expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135002.245431:0:5758:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.141@tcp lock: ffff9fea02167800/0xd6c4b8f05867e5f8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xd6c4b8f05867e5ff expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783135002.245441:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00010000:00010000:0.0:1783135002.245452:0:5758:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783135002.245458:0:5758:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.141@tcp lock: ffff9fe9c1523000/0xd6c4b8f05867e51f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xd6c4b8f05867e526 expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135002.245465:0:5758:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe9c1523000 already unused, calling callback (ffffffffc1b40c20) 10000000:00010000:0.0:1783135002.245469:0:5758:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.141@tcp lock: ffff9fe9c1523000/0xd6c4b8f05867e51f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xd6c4b8f05867e526 expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783135002.245475:0:3286:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9f6881180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:88a2002e-2ea7-4f07-912a-8d001832cfc0:3286:1869752384425728:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1783135002.245491:0:5758:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.141@tcp lock: ffff9fe9c1523000/0xd6c4b8f05867e51f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xd6c4b8f05867e526 expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1783135002.245499:0:5758:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.141@tcp lock: ffff9fe9c1523000/0xd6c4b8f05867e51f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xd6c4b8f05867e526 expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783135002.245505:0:5758:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:0.0:1783135002.245508:0:5758:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 00010000:00010000:0.0:1783135002.245543:0:5758:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.141@tcp lock: ffff9fe9c1523000/0xd6c4b8f05867e51f lrc: 3/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xd6c4b8f05867e526 expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135002.245551:0:5758:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1783135002.245568:0:5758:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.141@tcp lock: ffff9fe9c1523000/0xd6c4b8f05867e51f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xd6c4b8f05867e526 expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783135002.245581:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1783135002.245604:0:5758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783135002.245607:0:5758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783135002.245609:0:5758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783135002.246300:0:3288:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe8c6dfdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:88a2002e-2ea7-4f07-912a-8d001832cfc0:3288:1869752384425856:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1783135002.246364:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135002.246404:0:5754:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384425728 00000100:00100000:0.0:1783135002.246413:0:5754:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384425728 00000100:00100000:0.0:1783135002.246471:0:5754:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384425856 00000100:00100000:0.0:1783135002.246475:0:5754:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384425856 00000100:00100000:0.0:1783135002.246514:0:5754:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1783135002.246525:0:5754:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fe828380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:88a2002e-2ea7-4f07-912a-8d001832cfc0+19:3286:x1869752384425728:12345-0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1783135002.246535:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00010000:00010000:0.0:1783135002.246544:0:5754:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1783135002.246558:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fe95b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:88a2002e-2ea7-4f07-912a-8d001832cfc0+19:3288:x1869752384425856:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1783135002.246567:0:5754:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fe9c1522000/0xd6c4b8f05867e5ff lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xd6c4b8f05867e5f8 expref: 19 pid: 5762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135002.246582:0:6592:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783135002.246587:0:5754:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1783135002.246608:0:6592:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fe9d2b75e00/0xd6c4b8f05867e526 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xd6c4b8f05867e51f expref: 18 pid: 5765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135002.246631:0:6592:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783135002.246707:0:5754:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fe828380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:88a2002e-2ea7-4f07-912a-8d001832cfc0+17:3286:x1869752384425728:12345-0@lo:103:ldlm_bl.0 Request processed in 180us (1131us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135002.246717:0:5754:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1783135002.246741:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fe95b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:88a2002e-2ea7-4f07-912a-8d001832cfc0+17:3288:x1869752384425856:12345-0@lo:103:ldlm_bl.0 Request processed in 194us (375us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135002.246750:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1783135002.247167:0:3288:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe8c6dfdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:88a2002e-2ea7-4f07-912a-8d001832cfc0:3288:1869752384425856:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1783135002.247213:0:3286:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9f6881180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:88a2002e-2ea7-4f07-912a-8d001832cfc0:3286:1869752384425728:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1783135002.247803:0:5757:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783135002.248218:0:12871:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1783135002.248231:0:12871:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.141@tcp lock: ffff9fe9c1523000/0xd6c4b8f05867e51f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xd6c4b8f05867e526 expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783135002.248252:0:12871:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:3.0:1783135002.248273:0:12871:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.141@tcp lock: ffff9fe9c7828400/0xd6c4b8f05867e80c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd6c4b8f05867e813 expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135002.248305:0:12871:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.141@tcp lock: ffff9fe9c7828400/0xd6c4b8f05867e80c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xd6c4b8f05867e813 expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135002.248313:0:12871:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.141@tcp lock: ffff9fe9c7828400/0xd6c4b8f05867e80c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xd6c4b8f05867e813 expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135002.248319:0:12871:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.141@tcp lock: ffff9fe9c7828400/0xd6c4b8f05867e80c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xd6c4b8f05867e813 expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135002.248343:0:12871:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783135002.248350:0:12871:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.141@tcp lock: ffff9fe9c0030600/0xd6c4b8f05867e2d3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd6c4b8f05867e2da expref: -99 pid: 5750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135002.248358:0:12871:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.141@tcp lock: ffff9fe9c0030600/0xd6c4b8f05867e2d3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd6c4b8f05867e2da expref: -99 pid: 5750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135002.248364:0:12871:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.141@tcp lock: ffff9fe9c0030600/0xd6c4b8f05867e2d3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xd6c4b8f05867e2da expref: -99 pid: 5750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135002.248371:0:12871:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.141@tcp lock: ffff9fe9c0030600/0xd6c4b8f05867e2d3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xd6c4b8f05867e2da expref: -99 pid: 5750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135002.248407:0:12871:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:3.0:1783135002.248412:0:12871:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 10000000:01000000:3.0:1783135002.248417:0:12871:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00000020:01000004:3.0:1783135002.248457:0:12871:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-MDT0000 00000020:01000000:3.0:1783135002.248462:0:12871:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='F') 00000020:00000080:3.0:1783135002.248467:0:12871:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1783135002.248473:0:12871:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 2/9 00000020:00080000:3.0:1783135002.248479:0:12871:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff9fe8c5fcd800 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1783135002.248485:0:12871:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff9fe9dff19000 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1783135002.248493:0:12871:0:(genops.c:1840:print_export_data()) lustre-MDT0000: UNLINKED ffff9fe9fe808000 c936801d-68e8-41a4-8fbc-6becd5e1be74 192.168.201.41@tcp 2 (0 2 0) 1 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1783135002.248497:0:12871:0:(genops.c:1840:print_export_data()) lustre-MDT0000: UNLINKED ffff9fe9fe80f800 28f4ba61-cfae-499e-ab3d-81cb8215f7bb 192.168.201.41@tcp 6 (0 6 0) 1 0 0 0: 0000000000000000 4294967520 stale:0 00000020:00080000:3.0:1783135002.248502:0:12871:0:(genops.c:1574:class_disconnect_exports()) OBD device 5 (ffff9fea00c43380) has exports, disconnecting them 00000020:00080000:3.0:1783135002.248506:0:12871:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9fe8c5fcd800), last request at 1783135001 00000020:00000080:3.0:1783135002.248515:0:12871:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xd6c4b8f05867e4e7 00000100:00080000:3.0:1783135002.248535:0:12871:0:(import.c:65:import_set_state_nolock()) ffff9fe8c5fcf000 : changing import state from FULL to CLOSED 00000020:00080000:3.0:1783135002.248587:0:12871:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9fe8c5fcd800): rc 0 00000020:00000080:3.0:1783135002.248589:0:12871:0:(genops.c:906:class_export_put()) final put ffff9fe8c5fcd800/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:3.0:1783135002.248601:0:12871:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9fe9dff19000), last request at 1783135001 00000020:00000080:3.0:1783135002.248604:0:12871:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xd6c4b8f05867e41c 00000100:00080000:3.0:1783135002.248609:0:12871:0:(import.c:65:import_set_state_nolock()) ffff9fe9dff18800 : changing import state from FULL to CLOSED 00000020:00000080:3.0:1783135002.248622:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9fe8c5fcd800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00000080:3.0:1783135002.248665:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9fe8c5fcf000 for lustre-MDT0000 00000020:00080000:3.0:1783135002.248679:0:12871:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9fe9dff19000): rc 0 00000020:00000080:3.0:1783135002.248682:0:12871:0:(genops.c:906:class_export_put()) final put ffff9fe9dff19000/lustre-MDT0000-lwp-OST0000_UUID 00000004:00000080:3.0:1783135002.248696:0:12871:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffb1f243c87ae0 00010000:00010000:2.0:1783135002.248698:0:10987:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1783135002.248705:0:10987:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.141@tcp lock: ffff9fe9c7828400/0xd6c4b8f05867e80c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xd6c4b8f05867e813 expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:3.0:1783135002.248708:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9fe9dff19000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00010000:00010000:2.0:1783135002.248714:0:10987:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe9c7828400 already unused, calling callback (ffffffffc1b40c20) 10000000:00010000:2.0:1783135002.248717:0:10987:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.141@tcp lock: ffff9fe9c7828400/0xd6c4b8f05867e80c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xd6c4b8f05867e813 expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:3.0:1783135002.248747:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9fe9dff18800 for lustre-MDT0000 00000100:00080000:3.0:1783135002.248772:0:12871:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1783135002.248777:0:12871:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 3 00000004:00080000:3.0:1783135002.248793:0:12871:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:3.0:1783135002.248856:0:12871:0:(pinger.c:400:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:3.0:1783135002.248878:0:12871:0:(import.c:65:import_set_state_nolock()) ffff9fe8c451c800 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:3.0:1783135002.248897:0:12871:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1783135002.248899:0:12871:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967324 gen 3 00000100:00100000:3.0:1783135002.248909:0:12871:0:(client.c:3149:ptlrpc_free_committed()) @@@ free request with old gen req@ffff9fe9fe958000 x1869752384424576/t4294967325(4294967325) o2->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1783135013 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:3.0:1783135002.248918:0:12871:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9fe9fe958000, transno 4294967325 00000004:00080000:3.0:1783135002.248934:0:12871:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1783135002.249006:0:3285:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9fea17b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3285:1869752384425984:0@lo:9:umount.0 00000100:00100000:3.0:1783135002.249077:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1783135002.249149:0:10987:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.141@tcp lock: ffff9fe9c7828400/0xd6c4b8f05867e80c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xd6c4b8f05867e813 expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783135002.249165:0:10987:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.141@tcp lock: ffff9fe9c7828400/0xd6c4b8f05867e80c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xd6c4b8f05867e813 expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783135002.249184:0:10987:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:2.0:1783135002.249187:0:10987:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:2.0:1783135002.249189:0:10987:0:(mgc_request.c:130:config_log_put()) dropping config log params 00000100:00080000:3.0:1783135002.251602:0:12871:0:(pinger.c:400:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:3.0:1783135002.251636:0:12871:0:(import.c:65:import_set_state_nolock()) ffff9fe8c4e44000 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:3.0:1783135002.251677:0:3285:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9fea17480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3285:1869752384426112:0@lo:9:umount.0 00000100:00100000:3.0:1783135002.253025:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135002.253100:0:7676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384425984 00000100:00100000:3.0:1783135002.253111:0:7676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384425984 00010000:00010000:1.0:1783135002.253296:0:5757:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783135002.253307:0:5757:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.141@tcp lock: ffff9fe9c0030600/0xd6c4b8f05867e2d3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xd6c4b8f05867e2da expref: -99 pid: 5750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135002.253320:0:5757:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe9c0030600 already unused, calling callback (ffffffffc1b40c20) 10000000:00010000:1.0:1783135002.253324:0:5757:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.141@tcp lock: ffff9fe9c0030600/0xd6c4b8f05867e2d3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xd6c4b8f05867e2da expref: -99 pid: 5750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135002.253336:0:5757:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.141@tcp lock: ffff9fe9c0030600/0xd6c4b8f05867e2d3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xd6c4b8f05867e2da expref: -99 pid: 5750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783135002.253345:0:5757:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.141@tcp lock: ffff9fe9c0030600/0xd6c4b8f05867e2d3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xd6c4b8f05867e2da expref: -99 pid: 5750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783135002.253351:0:5757:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:1.0:1783135002.253355:0:5757:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:1.0:1783135002.253358:0:5757:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:1.0:1783135002.253400:0:5757:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.141@tcp lock: ffff9fe9c0030600/0xd6c4b8f05867e2d3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xd6c4b8f05867e2da expref: -99 pid: 5750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135002.253407:0:5757:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1783135002.253428:0:5757:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.141@tcp lock: ffff9fe9c0030600/0xd6c4b8f05867e2d3 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xd6c4b8f05867e2da expref: -99 pid: 5750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135002.253450:0:5757:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.141@tcp lock: ffff9fe9c0030600/0xd6c4b8f05867e2d3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xd6c4b8f05867e2da expref: -99 pid: 5750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135002.253469:0:5757:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783135002.253470:0:5757:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783135002.253472:0:5757:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783135002.253487:0:3289:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9fe958000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:88a2002e-2ea7-4f07-912a-8d001832cfc0:3289:1869752384426240:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1783135002.253535:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1783135002.253592:0:6591:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783135002.253608:0:5756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384426240 00000100:00100000:1.0:1783135002.253612:0:5756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384426240 00000100:00100000:1.0:1783135002.253654:0:5756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1783135002.253663:0:5756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fe958700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:88a2002e-2ea7-4f07-912a-8d001832cfc0+16:3289:x1869752384426240:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1783135002.253679:0:5756:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783135002.253694:0:5756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fe9c1522c00/0xd6c4b8f05867e2da lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xd6c4b8f05867e2d3 expref: 16 pid: 5763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135002.253711:0:5756:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1783135002.253782:0:10987:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.141@tcp lock: ffff9fe9c7828400/0xd6c4b8f05867e80c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xd6c4b8f05867e813 expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135002.253790:0:10987:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1783135002.253810:0:10987:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.141@tcp lock: ffff9fe9c7828400/0xd6c4b8f05867e80c lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xd6c4b8f05867e813 expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135002.253818:0:10987:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.141@tcp lock: ffff9fe9c7828400/0xd6c4b8f05867e80c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xd6c4b8f05867e813 expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135002.253830:0:10987:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783135002.253833:0:10987:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783135002.253834:0:10987:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783135002.253841:0:3287:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1783135002.253851:0:3287:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9fe82ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:88a2002e-2ea7-4f07-912a-8d001832cfc0:3287:1869752384426368:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1783135002.253883:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135002.253916:0:5754:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384426368 00000100:00100000:2.0:1783135002.253921:0:5754:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384426368 00000100:00100000:2.0:1783135002.253950:0:5754:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1783135002.253957:0:5754:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9f6cb3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:88a2002e-2ea7-4f07-912a-8d001832cfc0+16:3287:x1869752384426368:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1783135002.253965:0:5754:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783135002.253974:0:5754:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fe9f68ac800/0xd6c4b8f05867e813 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xd6c4b8f05867e80c expref: 16 pid: 5765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135002.253985:0:5754:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783135002.254014:0:5754:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9f6cb3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:88a2002e-2ea7-4f07-912a-8d001832cfc0+15:3287:x1869752384426368:12345-0@lo:103:ldlm_bl.0 Request processed in 57us (130us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135002.254029:0:5754:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1783135002.254077:0:3287:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9fe82ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:88a2002e-2ea7-4f07-912a-8d001832cfc0:3287:1869752384426368:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1783135002.254593:0:6574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384426112 00000100:00100000:0.0:1783135002.254599:0:6574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384426112 00000100:00100000:0.0:1783135002.254701:0:6574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1783135002.254713:0:6574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fea15880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3285:x1869752384425984:12345-0@lo:9:umount.0 00000100:00100000:1.0:1783135002.254925:0:5756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fe958700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:88a2002e-2ea7-4f07-912a-8d001832cfc0+14:3289:x1869752384426240:12345-0@lo:103:ldlm_bl.0 Request processed in 1262us (1389us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135002.254935:0:5756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1783135002.254953:0:6576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1783135002.254964:0:6576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fea16a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3285:x1869752384426112:12345-0@lo:9:umount.0 00000100:00100000:1.0:1783135002.254975:0:3289:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9fe958000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:88a2002e-2ea7-4f07-912a-8d001832cfc0:3289:1869752384426240:0@lo:103:ldlm_bl.0 00000020:00000080:2.0:1783135002.254993:0:6576:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xd6c4b8f05867e550 00010000:00010000:1.0:1783135002.254999:0:5758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1783135002.255005:0:6576:0:(import.c:65:import_set_state_nolock()) ffff9fea01d7e800 : changing import state from FULL to CLOSED 00000020:00080000:3.0:1783135002.255044:0:12871:0:(genops.c:1579:class_disconnect_exports()) OBD device 5 (ffff9fea00c43380) has no exports 00000001:00000004:2.0:1783135002.255052:0:6576:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967325 00010000:00010000:3.0:1783135002.255088:0:5757:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1783135002.255256:0:6574:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xd6c4b8f05867e469 00000100:00080000:0.0:1783135002.255264:0:6574:0:(import.c:65:import_set_state_nolock()) ffff9fe8c4e40800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1783135002.255315:0:6574:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967310 00010000:00010000:3.0:1783135002.255366:0:6591:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783135002.255478:0:6574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fea15880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+2:3285:x1869752384425984:12345-0@lo:9:umount.0 Request processed in 768us (6399us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135002.255495:0:6574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00080000:3.0:1783135002.255563:0:3285:0:(import.c:65:import_set_state_nolock()) ffff9fe8c451c800 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:3.0:1783135002.255584:0:3285:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:3.0:1783135002.255588:0:3285:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1783135002.255592:0:3285:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9fea17b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3285:1869752384425984:0@lo:9:umount.0 00000100:00100000:2.0:1783135002.256137:0:6576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fea16a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+3:3285:x1869752384426112:12345-0@lo:9:umount.0 Request processed in 1173us (3114us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135002.256145:0:6576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00080000:2.0:1783135002.256196:0:3285:0:(import.c:65:import_set_state_nolock()) ffff9fe8c4e44000 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:2.0:1783135002.256210:0:3285:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:2.0:1783135002.256213:0:3285:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1783135002.256217:0:3285:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9fea17480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3285:1869752384426112:0@lo:9:umount.0 00000001:00100000:2.0:1783135002.273276:0:5791:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of c936801d-68e8-41a4-8fbc-6becd5e1be74 00000001:00080000:2.0:1783135002.274243:0:5791:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967526 is committed 00000020:00000080:2.0:1783135002.274251:0:5791:0:(genops.c:906:class_export_put()) final put ffff9fe9fe808000/c936801d-68e8-41a4-8fbc-6becd5e1be74 00000001:00100000:2.0:1783135002.274303:0:5791:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 28f4ba61-cfae-499e-ab3d-81cb8215f7bb 00000001:00080000:2.0:1783135002.274310:0:5791:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967525 is committed 00000020:00000080:2.0:1783135002.274333:0:5791:0:(genops.c:906:class_export_put()) final put ffff9fe9fe80f800/28f4ba61-cfae-499e-ab3d-81cb8215f7bb 00000020:00080000:2.0:1783135002.274345:0:5791:0:(update_trans.c:1341:distribute_txn_batchid_cb()) lustre-MDT0000: 8 batchid updated 00000020:00080000:2.0:1783135002.274585:0:5802:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9fe9c9baccc0 refcount 1 committed 1 result 0 batchid 8 00000020:00080000:2.0:1783135002.274592:0:5802:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9fe9d2912500 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9fe9c9bac9c0 00000020:00080000:2.0:1783135002.274597:0:5802:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9fe9d2912c00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9fe9f6e34c00 00000020:00000080:0.0:1783135002.274876:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9fe9fe808000/c936801d-68e8-41a4-8fbc-6becd5e1be74 for lustre-MDT0000 00000020:00000080:0.0:1783135002.274950:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9fe9fe80f800/28f4ba61-cfae-499e-ab3d-81cb8215f7bb for lustre-MDT0000 00000020:00000080:0.0:1783135002.274984:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9fe8c57d9000 for lustre-MDT0000 00000020:00000080:0.0:1783135002.274991:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9fe9fe80d000 for lustre-MDT0000 00000001:00080000:3.0:1783135002.286680:0:7470:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967325 is committed 00000001:00100000:3.0:1783135002.286727:0:7470:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 28f4ba61-cfae-499e-ab3d-81cb8215f7bb 00000020:00000080:3.0:1783135002.286732:0:7470:0:(genops.c:906:class_export_put()) final put ffff9fe9fe928800/28f4ba61-cfae-499e-ab3d-81cb8215f7bb 00000020:00000080:2.0:1783135002.286808:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9fe9fe928800/28f4ba61-cfae-499e-ab3d-81cb8215f7bb for lustre-OST0001 00000020:00000080:2.0:1783135002.286878:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9fe9fe929000 for lustre-OST0001 00000020:00080000:0.0:1783135002.287721:0:12871:0:(genops.c:1579:class_disconnect_exports()) OBD device 5 (ffff9fea00c43380) has no exports 00000020:00000080:0.0:1783135002.321357:0:12871:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xd6c4b8f05867e32e 00000020:00000080:0.0:1783135002.321373:0:12871:0:(genops.c:906:class_export_put()) final put ffff9fe9f5c90000/lustre-QMT0000_UUID 00000020:01000000:0.0:1783135002.321395:0:12871:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:1.0:1783135002.321426:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9fe9f5c90000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:1.0:1783135002.321471:0:12871:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1783135002.321480:0:12871:0:(obd_config.c:955:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1783135002.321496:0:12871:0:(genops.c:1579:class_disconnect_exports()) OBD device 7 (ffff9fe9d1380000) has no exports 00000020:00000080:1.0:1783135002.324449:0:12871:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xd6c4b8f05867e327 00000020:00000080:1.0:1783135002.324460:0:12871:0:(genops.c:906:class_export_put()) final put ffff9fea01d1e000/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1783135002.324525:0:12871:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1783135002.324536:0:12871:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:1.0:1783135002.324538:0:12871:0:(genops.c:906:class_export_put()) final put ffff9fea01d0e000/lustre-QMT0000_UUID 00000020:00000080:1.0:1783135002.324541:0:12871:0:(genops.c:865:class_export_destroy()) destroying export ffff9fea01d0e000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:1.0:1783135002.324545:0:12871:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000020:00000080:0.0:1783135002.324688:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9fea01d1e000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:1.0:1783135002.324724:0:12871:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9fe9fea8d960 - data ffff9fe9f86cf438/ffff9fe8c4522800 00000020:01000000:1.0:1783135002.324850:0:12871:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9fe9d2a104e0 - data ffff9fe9f137d0d8/ffff9fe9ca889000 00000001:00000004:1.0:1783135002.339549:0:12871:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967526 00000100:00080000:1.0:1783135002.414966:0:12871:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1783135002.414990:0:12871:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 4 00000004:00080000:1.0:1783135002.415020:0:12871:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1783135002.415024:0:12871:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:3.0:1783135002.415786:0:7169:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:3.0:1783135002.415792:0:7169:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x3:0x0] index 5 count 1 00000040:00080000:3.0:1783135002.415804:0:7169:0:(llog.c:857:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 1 count 2 00000100:00080000:1.0:1783135002.417577:0:12871:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1783135002.417585:0:12871:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967324 gen 4 00000004:00080000:1.0:1783135002.417606:0:12871:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1783135002.417610:0:12871:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:2.0:1783135002.418191:0:7674:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:2.0:1783135002.418197:0:7674:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x6:0x0] index 8 count 2 00000040:00080000:2.0:1783135002.418208:0:7674:0:(llog.c:857:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 1 count 2 00000020:00000080:1.0:1783135002.460418:0:12871:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xd6c4b8f05867e2f6 00000020:00000080:1.0:1783135002.460436:0:12871:0:(genops.c:906:class_export_put()) final put ffff9fea00c4c800/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1783135002.460590:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9fea00c4c800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1783135002.461320:0:12871:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xd6c4b8f05867e30b 00000020:00000080:1.0:1783135002.461329:0:12871:0:(genops.c:906:class_export_put()) final put ffff9fea00c4d000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:1.0:1783135002.461342:0:12871:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:1.0:1783135002.461352:0:12871:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1783135002.461362:0:12871:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1783135002.461367:0:12871:0:(genops.c:1579:class_disconnect_exports()) OBD device 4 (ffff9fea00c44d40) has no exports 00000004:01000000:1.0:1783135002.461564:0:12871:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:1.0:1783135002.461575:0:12871:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xd6c4b8f05867e549 00000020:00000080:1.0:1783135002.461580:0:12871:0:(genops.c:906:class_export_put()) final put ffff9fe8c5fcc800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:1.0:1783135002.461585:0:12871:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:1.0:1783135002.461589:0:12871:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1783135002.461605:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9fea00c4d000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:00000080:1.0:1783135002.461612:0:12871:0:(obd_config.c:955:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1783135002.461616:0:12871:0:(genops.c:1579:class_disconnect_exports()) OBD device 17 (ffff9fe9d0e83380) has no exports 00000020:00000080:2.0:1783135002.461618:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9fe8c5fcc800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00000080:1.0:1783135002.461624:0:12871:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xd6c4b8f05867e542 00000020:00000080:1.0:1783135002.461629:0:12871:0:(genops.c:906:class_export_put()) final put ffff9fe8c4e43800/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1783135002.461647:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9fe8c4e43800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:1.0:1783135002.462002:0:12871:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:1.0:1783135002.462008:0:12871:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1783135002.462013:0:12871:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967324 gen 5 00000004:00080000:1.0:1783135002.462020:0:12871:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1783135002.462023:0:12871:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1783135002.462064:0:12871:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1783135002.462072:0:12871:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1783135002.462077:0:12871:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xd6c4b8f05867e462 00000020:00000080:1.0:1783135002.462082:0:12871:0:(genops.c:906:class_export_put()) final put ffff9fe9dff1a000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:1.0:1783135002.462085:0:12871:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:1.0:1783135002.462089:0:12871:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1783135002.462093:0:12871:0:(obd_config.c:955:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1783135002.462097:0:12871:0:(genops.c:1579:class_disconnect_exports()) OBD device 13 (ffff9fe9ca8999c0) has no exports 00000020:00000080:2.0:1783135002.462099:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9fe8c4e44000 for lustre-OST0001-osc-MDT0000 00000020:00000080:1.0:1783135002.462101:0:12871:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xd6c4b8f05867e45b 00000020:00000080:1.0:1783135002.462107:0:12871:0:(genops.c:906:class_export_put()) final put ffff9fe8c451d000/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1783135002.462115:0:36:0:(genops.c:906:class_export_put()) final put ffff9fe8c5fcd000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1783135002.462120:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9fe8c5fcd000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:2.0:1783135002.462129:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1783135002.462451:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9fe9dff1a000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00010000:01000000:1.0:1783135002.462585:0:12871:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:1.0:1783135002.462589:0:12871:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1783135002.462592:0:12871:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 5 00000004:00080000:1.0:1783135002.462595:0:12871:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1783135002.462597:0:12871:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1783135002.462643:0:12871:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1783135002.462649:0:12871:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1783135002.462689:0:12871:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1783135002.462693:0:12871:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1783135002.462696:0:12871:0:(genops.c:906:class_export_put()) final put ffff9fe9cb457000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1783135002.462698:0:12871:0:(genops.c:865:class_export_destroy()) destroying export ffff9fe9cb457000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:1.0:1783135002.462708:0:12871:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1783135002.462761:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9fe8c451d000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1783135002.462834:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9fe8c451c800 for lustre-OST0000-osc-MDT0000 00000020:00000080:2.0:1783135002.462842:0:36:0:(genops.c:906:class_export_put()) final put ffff9fe8c47e6000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1783135002.462845:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9fe8c47e6000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:2.0:1783135002.462851:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1783135002.462914:0:12871:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xd6c4b8f05867e312 00000020:00000080:1.0:1783135002.462929:0:12871:0:(genops.c:906:class_export_put()) final put ffff9fea00c4b000/lustre-MDD0000_UUID 00000020:01000000:1.0:1783135002.462947:0:12871:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:2.0:1783135002.462948:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9fea00c4b000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:1.0:1783135002.462952:0:12871:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1783135002.462958:0:12871:0:(obd_config.c:955:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1783135002.462961:0:12871:0:(genops.c:1579:class_disconnect_exports()) OBD device 6 (ffff9fea00c419c0) has no exports 00000020:00000080:1.0:1783135002.462989:0:12871:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1783135002.462993:0:12871:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:1.0:1783135002.462996:0:12871:0:(genops.c:906:class_export_put()) final put ffff9fea00c4a800/lustre-MDD0000_UUID 00000020:00000080:1.0:1783135002.462998:0:12871:0:(genops.c:865:class_export_destroy()) destroying export ffff9fea00c4a800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:1.0:1783135002.463003:0:12871:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:00000080:1.0:1783135002.463847:0:12871:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xd6c4b8f05867e319 00000020:00000080:1.0:1783135002.463855:0:12871:0:(genops.c:906:class_export_put()) final put ffff9fea00c4f800/lustre-MDT0000-osd_UUID 00000020:01000004:1.0:1783135002.463880:0:12871:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9fe9e0d14800 from lustre-MDT0000, refs=3 00000020:01000004:1.0:1783135002.463884:0:12871:0:(obd_mount.c:701:lustre_put_lsi()) put ffff9fe9e0d14800 3 00000020:01000004:1.0:1783135002.463888:0:12871:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9fe9e0d14800 from lustre-MDT0000 00000020:00000080:3.0:1783135002.463901:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9fea00c4f800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1783135002.463915:0:12871:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1783135002.463923:0:12871:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:1.0:1783135002.463926:0:12871:0:(genops.c:906:class_export_put()) final put ffff9fea00c4c000/lustre-MDT0000_UUID 00000020:00000080:1.0:1783135002.463929:0:12871:0:(genops.c:865:class_export_destroy()) destroying export ffff9fea00c4c000/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:1.0:1783135002.463938:0:12871:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:1.0:1783135002.463967:0:12871:0:(obd_mount.c:569:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000004:1.0:1783135002.463970:0:12871:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:1.0:1783135002.463973:0:12871:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:1.0:1783135002.463977:0:12871:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1783135002.463980:0:12871:0:(obd_config.c:955:class_cleanup()) MGS: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1783135002.463987:0:12871:0:(genops.c:1840:print_export_data()) MGS: ACTIVE ffff9fe9d07ce000 88a2002e-2ea7-4f07-912a-8d001832cfc0 0@lo 13 (0 0 8) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1783135002.463993:0:12871:0:(genops.c:1574:class_disconnect_exports()) OBD device 1 (ffff9fe9ca898000) has exports, disconnecting them 00000020:00080000:1.0:1783135002.463999:0:12871:0:(genops.c:1549:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff9fe9d07ce000), last request at 1783134863 00000020:00000080:1.0:1783135002.464019:0:12871:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xd6c4b8f05867e2b7 00000020:00010000:1.0:1783135002.464023:0:12871:0:(genops.c:1942:obd_stale_export_put()) Put export ffff9fe9d07ce000: total 0 00000100:00080000:1.0:1783135002.464028:0:12871:0:(import.c:65:import_set_state_nolock()) ffff9fe9d07ca000 : changing import state from FULL to CLOSED 00000020:00080000:1.0:1783135002.464045:0:12871:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9fe9d07ce000): rc 0 00000020:00080000:1.0:1783135002.464059:0:12871:0:(genops.c:1579:class_disconnect_exports()) OBD device 1 (ffff9fe9ca898000) has no exports 00000020:00010000:2.0:1783135002.464073:0:10987:0:(genops.c:1928:obd_stale_export_get()) Get export ffff9fe9d07ce000: total 0 00010000:00010000:2.0:1783135002.464106:0:10987:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff9fe9d07ce000, canceled 0 locks, left on hash table 8. 00000100:00100000:3.0:1783135002.464134:0:5762:0:(service.c:3183:ptlrpc_main()) ll_mgs_0000: service thread [ffff9fe9d179da00:5762] 0 exiting: rc = 1 00010000:00010000:2.0:1783135002.464142:0:10987:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fea02166000/0xd6c4b8f05867e3cf lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xd6c4b8f05867e3c8 expref: 9 pid: 5762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135002.464181:0:10987:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fe9c1523200/0xd6c4b8f05867e60d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xd6c4b8f05867e606 expref: 8 pid: 5762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135002.464195:0:10987:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fea02166200/0xd6c4b8f05867e5b9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xd6c4b8f05867e5b2 expref: 7 pid: 5763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135002.464218:0:10987:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fe9c7829c00/0xd6c4b8f05867e7f7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xd6c4b8f05867e7f0 expref: 6 pid: 5762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135002.464231:0:10987:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fe9d2b74800/0xd6c4b8f05867e805 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xd6c4b8f05867e7fe expref: 5 pid: 5762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135002.464247:0:10987:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fe9d2b74a00/0xd6c4b8f05867e5e3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xd6c4b8f05867e5dc expref: 4 pid: 5765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135002.464259:0:10987:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fe9c0030c00/0xd6c4b8f05867e5c7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xd6c4b8f05867e5c0 expref: 3 pid: 5765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135002.464272:0:10987:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fe9c0030800/0xd6c4b8f05867e5d5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xd6c4b8f05867e5ce expref: 2 pid: 5765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135002.464302:0:10987:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff9fe9d07ce000, canceled 8 locks, left on hash table 0. 00000020:00000080:2.0:1783135002.464317:0:10987:0:(genops.c:906:class_export_put()) final put ffff9fe9d07ce000/88a2002e-2ea7-4f07-912a-8d001832cfc0 00010000:00010000:2.0:1783135002.464330:0:10987:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783135002.464333:0:10987:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783135002.464336:0:10987:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783135002.464341:0:5763:0:(service.c:3183:ptlrpc_main()) ll_mgs_0001: service thread [ffff9fe9d179ca00:5763] 1 exiting: rc = 0 00000020:00000080:3.0:1783135002.464381:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9fe9d07ce000/88a2002e-2ea7-4f07-912a-8d001832cfc0 for MGS 00000100:00100000:2.0:1783135002.464388:0:5765:0:(service.c:3183:ptlrpc_main()) ll_mgs_0002: service thread [ffff9fe9d179d400:5765] 2 exiting: rc = 0 00000020:00000080:3.0:1783135002.464419:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9fe9d07ca000 for MGS 00000100:00100000:1.0:1783135002.464503:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135002.464512:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135002.464519:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135002.464526:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135002.464532:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135002.464539:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135002.464548:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135002.464556:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135002.464562:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135002.464569:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135002.464578:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135002.464584:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135002.464590:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135002.464597:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135002.464603:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135002.464610:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135002.464617:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135002.464626:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135002.464632:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135002.464637:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135002.464642:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135002.464648:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135002.464655:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135002.464661:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135002.464667:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135002.464672:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135002.464679:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135002.464685:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135002.464691:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135002.464696:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135002.464703:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135002.464709:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135002.464715:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135002.464729:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135002.464734:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135002.464740:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135002.464746:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135002.464751:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135002.464758:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135002.464764:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135002.464770:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135002.464776:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135002.464782:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135002.464789:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135002.464795:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135002.464801:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135002.464807:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135002.464813:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135002.464819:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135002.464826:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135002.464832:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135002.464838:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135002.464843:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135002.464848:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135002.464853:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135002.464858:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135002.464863:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135002.464869:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135002.464874:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135002.464879:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135002.464884:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135002.464890:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135002.464895:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135002.464900:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 20000000:01000000:1.0:1783135002.465579:0:12871:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:1.0:1783135002.465584:0:12871:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 00000020:01000000:1.0:1783135002.467774:0:12871:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9fe9cb7f52a0 - data ffff9fe9f84176c0/ffff9fea00beec00 00000020:01000000:1.0:1783135002.467919:0:12871:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9fe9f89c3c00 - data ffff9fe9f136ba20/ffff9fe9d07c5c00 00000020:00000080:1.0:1783135002.469397:0:12871:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xd6c4b8f05867e29b 00000020:00000080:1.0:1783135002.469410:0:12871:0:(genops.c:906:class_export_put()) final put ffff9fe9d29a6800/lustre-MDT0000-osd_UUID 00000020:01000004:1.0:1783135002.469433:0:12871:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9fe9e0d14800 from MGS, refs=2 00000020:01000004:1.0:1783135002.469437:0:12871:0:(obd_mount.c:701:lustre_put_lsi()) put ffff9fe9e0d14800 2 00000020:01000004:1.0:1783135002.469441:0:12871:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9fe9e0d14800 from MGS 00000020:00000080:2.0:1783135002.469451:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9fe9d29a6800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1783135002.469468:0:12871:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1783135002.469476:0:12871:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:1.0:1783135002.469479:0:12871:0:(genops.c:906:class_export_put()) final put ffff9fe9d1291000/MGS 00000020:00000080:1.0:1783135002.469481:0:12871:0:(genops.c:865:class_export_destroy()) destroying export ffff9fe9d1291000/MGS for MGS 00000020:01000000:1.0:1783135002.469487:0:12871:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:1.0:1783135002.469558:0:12871:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:1.0:1783135002.469562:0:12871:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1783135002.469568:0:12871:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1783135002.469575:0:12871:0:(genops.c:1840:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff9fe9cb455000 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1783135002.469579:0:12871:0:(genops.c:1574:class_disconnect_exports()) OBD device 8 (ffff9fe9d1384d40) has exports, disconnecting them 00000020:00080000:1.0:1783135002.469583:0:12871:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff9fe9cb455000), last request at 1783134864 00000020:00000080:1.0:1783135002.469587:0:12871:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xd6c4b8f05867e366 00000020:00080000:1.0:1783135002.469595:0:12871:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9fe9cb455000): rc 0 00000020:00000080:1.0:1783135002.469599:0:12871:0:(genops.c:906:class_export_put()) final put ffff9fe9cb455000/lustre-MDT0000-lwp-MDT0000 00000020:00000080:2.0:1783135002.469833:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9fe9cb455000/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:2.0:1783135002.471358:0:12871:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:2.0:1783135002.471365:0:12871:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1783135002.471370:0:12871:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:2.0:1783135002.471377:0:12871:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1783135002.471558:0:12871:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1783135002.471581:0:12871:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:2.0:1783135002.471589:0:12871:0:(obd_mount.c:701:lustre_put_lsi()) put ffff9fe9e0d14800 1 00000020:00000080:2.0:1783135002.471596:0:12871:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xd6c4b8f05867e28d 00000020:00000080:2.0:1783135002.471604:0:12871:0:(genops.c:906:class_export_put()) final put ffff9fe9d1295000/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1783135002.471626:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9fe9cb455800 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:3.0:1783135002.471634:0:36:0:(genops.c:906:class_export_put()) final put ffff9fea01d1f000/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:3.0:1783135002.471638:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9fea01d1f000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:3.0:1783135002.471644:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000000:2.0:1783135002.471773:0:12871:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:2.0:1783135002.471779:0:12871:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1783135002.471782:0:12871:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1783135002.471786:0:12871:0:(genops.c:1579:class_disconnect_exports()) OBD device 0 (ffff9fe9d1383380) has no exports 00000020:00000080:3.0:1783135002.472133:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9fe9d1295000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1783135002.485791:0:12871:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1783135002.485811:0:12871:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:3.0:1783135002.485819:0:12871:0:(genops.c:906:class_export_put()) final put ffff9fe9e0d15000/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1783135002.485826:0:12871:0:(genops.c:865:class_export_destroy()) destroying export ffff9fe9e0d15000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:3.0:1783135002.485839:0:12871:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:3.0:1783135002.486033:0:12871:0:(obd_mount.c:659:lustre_free_lsi()) Freeing lsi ffff9fe9e0d17000 00000020:01000000:3.0:1783135002.486104:0:12871:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:3.0:1783135002.486110:0:12871:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1783135002.486116:0:12871:0:(obd_config.c:955:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1783135002.486121:0:12871:0:(genops.c:1579:class_disconnect_exports()) OBD device 3 (ffff9fe9d0e819c0) has no exports 00000100:00100000:1.0:1783135002.486314:0:8031:0:(service.c:3183:ptlrpc_main()) mdt00_003: service thread [ffff9fe8c4e59200:8031] 3 exiting: rc = 0 00000100:00100000:1.0:1783135002.486446:0:5769:0:(service.c:3183:ptlrpc_main()) mdt00_000: service thread [ffff9fe9d0ea0000:5769] 0 exiting: rc = 1 00000100:00100000:3.0:1783135002.486637:0:5770:0:(service.c:3183:ptlrpc_main()) mdt00_001: service thread [ffff9fe9d0ea0200:5770] 1 exiting: rc = 0 00000100:00100000:3.0:1783135002.487371:0:5771:0:(service.c:3183:ptlrpc_main()) mdt00_002: service thread [ffff9fe9d0ea1000:5771] 2 exiting: rc = 0 00000100:00100000:1.0:1783135002.487504:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135002.487512:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135002.487519:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135002.487524:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135002.487531:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135002.487537:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135002.487543:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135002.487550:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135002.487557:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135002.487564:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135002.487574:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135002.487599:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135002.487607:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135002.487613:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135002.487620:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135002.487626:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135002.487635:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135002.487644:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135002.487651:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135002.487657:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135002.487664:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135002.487671:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135002.487682:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135002.487691:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135002.487699:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135002.487708:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135002.487718:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135002.487729:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135002.487739:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135002.487746:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135002.487757:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135002.487766:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135002.487772:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135002.487783:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135002.487793:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135002.487819:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135002.487826:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135002.487832:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135002.487838:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135002.487844:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135002.487850:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135002.487862:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135002.487869:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135002.487876:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135002.487883:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135002.487889:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135002.487902:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135002.487908:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135002.487914:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135002.487920:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135002.487927:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135002.487938:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135002.487945:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135002.487951:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135002.487958:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135002.487963:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135002.487970:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135002.487976:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135002.487984:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135002.487997:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135002.488007:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135002.488013:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135002.488020:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135002.488030:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783135002.497969:0:5772:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_000: service thread [ffff9fe9d0ea0600:5772] 0 exiting: rc = 1 00000100:00100000:1.0:1783135002.498162:0:5773:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_001: service thread [ffff9fe9d0ea1600:5773] 1 exiting: rc = 0 00000100:00100000:0.0:1783135002.498167:0:12384:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_002: service thread [ffff9fe9c80fc200:12384] 2 exiting: rc = 0 00000100:00100000:2.0:1783135002.498372:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135002.498382:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135002.498389:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135002.498399:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135002.498407:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135002.498415:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135002.498425:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135002.498452:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135002.498460:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135002.498466:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135002.498478:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135002.498487:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135002.498493:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135002.498498:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135002.498504:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135002.498509:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135002.498515:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135002.498521:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135002.498527:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135002.498532:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135002.498538:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135002.498543:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135002.498549:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135002.498555:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135002.498561:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135002.498568:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135002.498574:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135002.498593:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135002.498599:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135002.498604:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135002.498609:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135002.498614:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135002.498619:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135002.498625:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135002.498631:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135002.498636:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135002.498642:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135002.498647:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135002.498659:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135002.498665:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135002.498671:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135002.498676:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135002.498681:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135002.498688:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135002.498694:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135002.498700:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135002.498705:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135002.498711:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135002.498716:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135002.498721:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135002.498727:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135002.498732:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135002.498737:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135002.498743:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135002.498748:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135002.498753:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135002.498758:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135002.498764:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135002.498769:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135002.498774:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135002.498779:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135002.498784:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135002.498796:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135002.498802:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783135002.499551:0:5775:0:(service.c:3183:ptlrpc_main()) mdt_out00_001: service thread [ffff9fe9e9d54a00:5775] 1 exiting: rc = 0 00000100:00100000:1.0:1783135002.499801:0:5774:0:(service.c:3183:ptlrpc_main()) mdt_out00_000: service thread [ffff9fe9d0ea0e00:5774] 0 exiting: rc = 1 00000100:00100000:2.0:1783135002.499894:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135002.499900:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135002.499912:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135002.499928:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135002.499934:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135002.499938:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135002.499944:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135002.499950:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135002.499957:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135002.499964:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135002.499970:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135002.499976:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135002.499981:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135002.499987:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135002.499992:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135002.500014:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135002.500020:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135002.500024:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135002.500029:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135002.500034:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135002.500039:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135002.500043:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135002.500048:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135002.500053:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135002.500057:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135002.500061:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135002.500066:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135002.500081:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135002.500092:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135002.500100:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135002.500108:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135002.500113:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135002.500121:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135002.500148:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135002.500195:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135002.500205:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135002.500212:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135002.500219:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135002.500227:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135002.500250:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135002.500259:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135002.500267:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135002.500274:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135002.500368:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135002.500376:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135002.500384:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135002.500394:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135002.500400:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135002.500407:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135002.500413:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135002.500421:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135002.500443:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135002.500451:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135002.500458:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135002.500465:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135002.500475:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135002.500483:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135002.500488:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135002.500493:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135002.500501:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135002.500598:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135002.500610:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135002.500616:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135002.500630:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135002.512795:0:5776:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0000: service thread [ffff9fe9e9d54600:5776] 0 exiting: rc = 1 00000100:00100000:0.0:1783135002.512943:0:5777:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0001: service thread [ffff9fe9cc2eea00:5777] 1 exiting: rc = 0 00000100:00100000:1.0:1783135002.513013:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135002.513022:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135002.513028:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135002.513034:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135002.513040:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135002.513045:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135002.513051:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135002.513057:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135002.513063:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135002.513070:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135002.513075:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135002.513080:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135002.513086:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135002.513091:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135002.513112:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135002.513117:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135002.513123:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135002.513129:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135002.513133:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135002.513139:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135002.513144:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135002.513150:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135002.513168:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135002.513185:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135002.513191:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135002.513197:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135002.513202:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135002.513207:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135002.513213:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135002.513218:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135002.513223:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135002.513228:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135002.513233:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135002.513238:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135002.513244:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135002.513250:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135002.513256:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135002.513262:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135002.513267:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135002.513273:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135002.513299:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135002.513308:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135002.513315:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135002.513321:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135002.513326:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135002.513331:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135002.513337:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135002.513342:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135002.513348:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135002.513360:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135002.513366:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135002.513371:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135002.513377:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135002.513382:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135002.513388:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135002.513394:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135002.513399:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135002.513404:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135002.513410:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135002.513416:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135002.513421:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135002.513426:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135002.513431:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135002.513436:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135002.513816:0:5779:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0001: service thread [ffff9fe9d0ea3a00:5779] 1 exiting: rc = 0 00000100:00100000:0.0:1783135002.513982:0:5778:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0000: service thread [ffff9fe9d0ea3e00:5778] 0 exiting: rc = 1 00000100:00100000:1.0:1783135002.514044:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135002.514052:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135002.514058:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135002.514064:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135002.514069:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135002.514075:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135002.514081:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135002.514086:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135002.514092:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135002.514097:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135002.514103:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135002.514108:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135002.514113:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135002.514118:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135002.514124:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135002.514129:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135002.514135:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135002.514141:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135002.514146:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135002.514258:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135002.514264:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135002.514270:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135002.514275:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135002.514305:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135002.514312:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135002.514318:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135002.514323:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135002.514328:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135002.514334:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135002.514338:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135002.514344:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135002.514348:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135002.514354:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135002.514358:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135002.514364:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135002.514370:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135002.514375:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135002.514380:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135002.514386:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135002.514392:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135002.514398:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135002.514403:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135002.514409:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135002.514415:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135002.514421:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135002.514426:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135002.514432:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135002.514437:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135002.514443:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135002.514449:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135002.514455:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135002.514461:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135002.514466:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135002.514472:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135002.514484:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135002.514489:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135002.514495:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135002.514500:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135002.514506:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135002.514511:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135002.514517:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135002.514523:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135002.514528:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135002.514534:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135002.514874:0:5781:0:(service.c:3183:ptlrpc_main()) mdt_fld_0001: service thread [ffff9fe9d0ea3200:5781] 1 exiting: rc = 0 00000100:00100000:0.0:1783135002.515167:0:5780:0:(service.c:3183:ptlrpc_main()) mdt_fld_0000: service thread [ffff9fe9d0ea3400:5780] 0 exiting: rc = 1 00000100:00100000:1.0:1783135002.515219:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135002.515229:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135002.515236:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135002.515242:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135002.515248:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135002.515254:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135002.515260:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135002.515265:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135002.515271:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135002.515310:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135002.515320:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135002.515328:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135002.515335:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135002.515341:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135002.515350:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135002.515360:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135002.515369:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135002.515376:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135002.515381:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135002.515387:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135002.515392:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135002.515398:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135002.515404:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135002.515409:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135002.515426:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135002.515431:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135002.515437:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135002.515443:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135002.515449:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135002.515455:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135002.515460:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135002.515466:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135002.515472:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135002.515478:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135002.515484:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135002.515489:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135002.515495:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135002.515500:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135002.515507:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135002.515512:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135002.515519:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135002.515524:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135002.515530:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135002.515535:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135002.515541:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135002.515546:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135002.515552:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135002.515557:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135002.515563:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135002.515569:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135002.515574:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135002.515580:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135002.515585:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135002.515591:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135002.515596:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135002.515602:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135002.515608:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135002.515613:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135002.515618:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135002.515631:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135002.515636:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135002.515642:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135002.515647:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135002.515653:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135002.516244:0:5784:0:(service.c:3183:ptlrpc_main()) mdt_io00_002: service thread [ffff9fe9d0ea2000:5784] 2 exiting: rc = 0 00000100:00100000:0.0:1783135002.516324:0:5783:0:(service.c:3183:ptlrpc_main()) mdt_io00_001: service thread [ffff9fe9d0ea2c00:5783] 1 exiting: rc = 0 00000100:00100000:3.0:1783135002.516735:0:5782:0:(service.c:3183:ptlrpc_main()) mdt_io00_000: service thread [ffff9fe9d0ea2400:5782] 0 exiting: rc = 1 00000100:00100000:1.0:1783135002.516953:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135002.516961:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135002.516967:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135002.516973:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135002.516979:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135002.516986:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135002.516992:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135002.516999:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135002.517005:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135002.517012:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135002.517019:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135002.517039:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135002.517047:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135002.517053:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135002.517059:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135002.517065:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135002.517072:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135002.517078:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135002.517085:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135002.517092:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135002.517098:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135002.517104:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135002.517111:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135002.517118:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135002.517125:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135002.517131:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135002.517139:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135002.517145:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135002.517160:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135002.517615:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135002.517624:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135002.517630:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135002.517636:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135002.517642:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135002.517649:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135002.517673:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135002.517681:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135002.517688:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135002.517694:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135002.517700:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135002.517707:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135002.517713:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135002.517720:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135002.517727:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135002.517734:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135002.517740:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135002.517746:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135002.517752:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135002.517759:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135002.517764:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135002.517770:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135002.517777:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135002.517783:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135002.517792:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135002.517799:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135002.517804:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135002.517810:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135002.517817:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135002.517823:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135002.517829:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135002.517836:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135002.517842:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135002.517849:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135002.517855:0:12871:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:0.0:1783135002.524270:0:12871:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1783135002.524301:0:12871:0:(obd_config.c:883:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:0.0:1783135002.524309:0:12871:0:(genops.c:906:class_export_put()) final put ffff9fe9d11a4000/MDS_uuid 00000020:00000080:0.0:1783135002.524314:0:12871:0:(genops.c:865:class_export_destroy()) destroying export ffff9fe9d11a4000/MDS_uuid for MDS 00000020:01000000:0.0:1783135002.524329:0:12871:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:0.0:1783135002.524489:0:12871:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-MDT0000 complete 00010000:00010000:3.0:1783135002.883849:0:5758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1783135003.832995:0:6602:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1783135003.833007:0:6602:0:(genops.c:906:class_export_put()) final put ffff9fe8c4e42800/lustre-MDT0000-mdtlov_UUID 00000001:00100000:3.0:1783135003.833040:0:6602:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 28f4ba61-cfae-499e-ab3d-81cb8215f7bb 00000020:00000080:3.0:1783135003.833043:0:6602:0:(genops.c:906:class_export_put()) final put ffff9fe9fe92f800/28f4ba61-cfae-499e-ab3d-81cb8215f7bb 00000020:00000080:0.0:1783135003.833162:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9fe8c4e42800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:0.0:1783135003.833217:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9fe9fe92f800/28f4ba61-cfae-499e-ab3d-81cb8215f7bb for lustre-OST0000 00000020:00000080:0.0:1783135003.833241:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9fe8c4e40800 for lustre-OST0000 00000020:00000080:0.0:1783135003.833246:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9fe9fe92b000 for lustre-OST0000 00010000:00010000:1.0:1783135003.911729:0:5757:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1783135004.492054:0:13025:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:3.0:1783135004.499416:0:13025:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-OST0000 00010000:00010000:3.0:1783135004.499478:0:13025:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.141@tcp lock: ffff9fe9c1522400/0xd6c4b8f05867e5ce lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xd6c4b8f05867e5d5 expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135004.499494:0:13025:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.141@tcp lock: ffff9fe9c1522400/0xd6c4b8f05867e5ce lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xd6c4b8f05867e5d5 expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135004.499502:0:13025:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.141@tcp lock: ffff9fe9c1522400/0xd6c4b8f05867e5ce lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0xd6c4b8f05867e5d5 expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135004.499510:0:13025:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.141@tcp lock: ffff9fe9c1522400/0xd6c4b8f05867e5ce lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0xd6c4b8f05867e5d5 expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135004.499534:0:13025:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1783135004.499541:0:13025:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:3.0:1783135004.499566:0:13025:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1783135004.499570:0:13025:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:3.0:1783135004.499576:0:13025:0:(pinger.c:400:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1783135004.499609:0:13025:0:(import.c:65:import_set_state_nolock()) ffff9fe8c47e2800 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:2.0:1783135004.499682:0:3285:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9fea17b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3285:1869752384426496:0@lo:39:umount.0 00000400:00000100:2.0:1783135004.499753:0:3285:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1869752384426496 offset 0 length 224: 4 00010000:00010000:1.0:1783135004.500344:0:6591:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783135004.500353:0:6591:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.141@tcp lock: ffff9fe9c1522400/0xd6c4b8f05867e5ce lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0xd6c4b8f05867e5d5 expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135004.500360:0:6591:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe9c1522400 already unused, calling callback (ffffffffc1b40c20) 10000000:00010000:1.0:1783135004.500363:0:6591:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.141@tcp lock: ffff9fe9c1522400/0xd6c4b8f05867e5ce lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0xd6c4b8f05867e5d5 expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135004.500370:0:6591:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.141@tcp lock: ffff9fe9c1522400/0xd6c4b8f05867e5ce lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1008400000000 nid: local remote: 0xd6c4b8f05867e5d5 expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783135004.500376:0:6591:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.141@tcp lock: ffff9fe9c1522400/0xd6c4b8f05867e5ce lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1009400000000 nid: local remote: 0xd6c4b8f05867e5d5 expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783135004.500379:0:6591:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1783135004.500381:0:6591:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:1.0:1783135004.500383:0:6591:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:1.0:1783135004.500411:0:6591:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.141@tcp lock: ffff9fe9c1522400/0xd6c4b8f05867e5ce lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0xd6c4b8f05867e5d5 expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135004.500415:0:6591:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1783135004.500448:0:3287:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9fe959880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:88a2002e-2ea7-4f07-912a-8d001832cfc0:3287:1869752384426624:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1783135004.500449:0:6591:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.141@tcp lock: ffff9fe9c1522400/0xd6c4b8f05867e5ce lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0xd6c4b8f05867e5d5 expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135004.500457:0:6591:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.141@tcp lock: ffff9fe9c1522400/0xd6c4b8f05867e5ce lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0xd6c4b8f05867e5d5 expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135004.500472:0:6591:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783135004.500475:0:6591:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783135004.500478:0:6591:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783135004.500512:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135004.500583:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384426624 00000100:00100000:0.0:1783135004.500593:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384426624 00000100:00100000:0.0:1783135004.500643:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1783135004.500652:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9d29de050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3287:x1869752384426624:12345-0@lo:103:ldlm_bl.0 00010000:00020000:0.0:1783135004.500663:0:6592:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1783135004 with bad export cookie 15475697561966731959 00000100:00100000:0.0:1783135004.505264:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9d29de050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3287:x1869752384426624:12345-0@lo:103:ldlm_bl.0 Request processed in 4601us (4741us total) trans 0 rc -107/-107 00000100:00100000:0.0:1783135004.505308:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00080000:2.0:1783135004.505459:0:3287:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.201.141@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1783135004.505467:0:3287:0:(import.c:65:import_set_state_nolock()) ffff9fe9d0e21800 MGS: changing import state from FULL to DISCONN 00000100:02020000:2.0:1783135004.505472:0:3287:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.201.141@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00000100:00080000:2.0:1783135004.509340:0:3287:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.201.141@tcp not replayable, auto-deactivating 00000100:00080000:2.0:1783135004.509347:0:3287:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:2.0:1783135004.509360:0:3287:0:(client.c:3588:ptlrpc_abort_inflight()) @@@ inflight req@ffff9fe9fe959880 x1869752384426624/t0(0) o103->MGC192.168.201.141@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1783135020 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 10000000:01000000:2.0:1783135004.509381:0:3287:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:2.0:1783135004.509385:0:3287:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:2.0:1783135004.509386:0:3287:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:2.0:1783135004.509391:0:3287:0:(import.c:65:import_set_state_nolock()) ffff9fe9d0e21800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1783135004.509396:0:3287:0:(import.c:512:import_select_connection()) MGC192.168.201.141@tcp: connect to NID 0@lo last attempt 146 00000100:00080000:2.0:1783135004.509408:0:3287:0:(import.c:626:import_select_connection()) MGC192.168.201.141@tcp: import ffff9fe9d0e21800 using connection 192.168.201.141@tcp/0@lo 00000100:00100000:2.0:1783135004.509453:0:3287:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9fe9f6cb0e00 x1869752384426752/t0(0) o250->MGC192.168.201.141@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1783135004.509508:0:3287:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9fe959880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:88a2002e-2ea7-4f07-912a-8d001832cfc0:3287:1869752384426624:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1783135004.509562:0:3285:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9f6cb0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:88a2002e-2ea7-4f07-912a-8d001832cfc0:3285:1869752384426752:0@lo:250:ptlrpcd_00_01.0 00000400:00000100:3.0:1783135004.509634:0:3285:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1869752384426752 offset 0 length 520: 4 00010000:00010000:2.0:1783135004.931877:0:10987:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783135005.956073:0:5758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1783135006.851874:0:36:0:(pinger.c:231:ptlrpc_pinger_process_import()) 88a2002e-2ea7-4f07-912a-8d001832cfc0->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1783135006.851886:0:36:0:(pinger.c:249:ptlrpc_pinger_process_import()) 88a2002e-2ea7-4f07-912a-8d001832cfc0->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1783135006.852134:0:3288:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe8c6dff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3288:1869752384426880:0@lo:400:kworker.0 00000400:00000100:2.0:1783135006.852210:0:3288:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1869752384426880 offset 0 length 224: 4 00010000:00010000:1.0:1783135006.980138:0:5757:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1783135007.438835:0:7470:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1783135007.438848:0:7470:0:(genops.c:906:class_export_put()) final put ffff9fea01d79000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1783135007.438927:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9fea01d79000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:3.0:1783135007.439005:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9fea01d7e800 for lustre-OST0001 00010000:00010000:1.0:1783135008.003595:0:6591:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1783135008.899544:0:36:0:(pinger.c:231:ptlrpc_pinger_process_import()) 88a2002e-2ea7-4f07-912a-8d001832cfc0->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1783135008.899554:0:36:0:(pinger.c:249:ptlrpc_pinger_process_import()) 88a2002e-2ea7-4f07-912a-8d001832cfc0->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1783135008.899640:0:3289:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9f6cb3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3289:1869752384427008:0@lo:400:kworker.0 00000400:00000100:0.0:1783135008.899695:0:3289:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1869752384427008 offset 0 length 224: 4 00010000:00010000:2.0:1783135009.027545:0:10987:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783135010.054955:0:5758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783135011.076056:0:5757:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783135012.103060:0:6591:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783135013.123655:0:10987:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1783135014.019434:0:36:0:(pinger.c:231:ptlrpc_pinger_process_import()) 88a2002e-2ea7-4f07-912a-8d001832cfc0->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1783135014.019448:0:36:0:(pinger.c:249:ptlrpc_pinger_process_import()) 88a2002e-2ea7-4f07-912a-8d001832cfc0->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1783135014.019568:0:3287:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1783135014.019577:0:3285:0:(client.c:2489:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1783135004/real 1783135004] req@ffff9fe9f6cb0e00 x1869752384426752/t0(0) o250->MGC192.168.201.141@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1783135014 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'ptlrpcd_00_01.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783135014.019594:0:3287:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9f6cb3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3287:1869752384427136:0@lo:400:kworker.0 00000100:00100000:0.0:1783135014.019616:0:3285:0:(client.c:2520:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9fe9f6cb0e00 x1869752384426752/t0(0) o250->MGC192.168.201.141@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1783135014 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'ptlrpcd_00_01.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783135014.019632:0:3285:0:(client.c:2489:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1783135004/real 1783135004] req@ffff9fe9fea17b80 x1869752384426496/t0(0) o39->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1783135014 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783135014.019645:0:3285:0:(client.c:2520:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9fe9fea17b80 x1869752384426496/t0(0) o39->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1783135014 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1783135014.019661:0:3285:0:(import.c:65:import_set_state_nolock()) ffff9fe9d0e21800 MGS: changing import state from CONNECTING to DISCONN 00000400:00000100:2.0:1783135014.019666:0:3287:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1869752384427136 offset 0 length 224: 4 00000100:00080000:0.0:1783135014.019672:0:3285:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:0.0:1783135014.019677:0:3285:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9f6cb0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:88a2002e-2ea7-4f07-912a-8d001832cfc0:3285:1869752384426752:0@lo:250:ptlrpcd_00_01.0 00000100:00080000:0.0:1783135014.019684:0:3285:0:(import.c:65:import_set_state_nolock()) ffff9fe8c47e2800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:0.0:1783135014.019694:0:3285:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9fea17b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3285:1869752384426496:0@lo:39:umount.0 00000100:00080000:2.0:1783135014.019887:0:13025:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1783135014.019892:0:13025:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:2.0:1783135014.019897:0:13025:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:1.0:1783135014.020407:0:36:0:(pinger.c:231:ptlrpc_pinger_process_import()) 88a2002e-2ea7-4f07-912a-8d001832cfc0->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1783135014.020413:0:36:0:(pinger.c:239:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:1.0:1783135014.020972:0:36:0:(import.c:65:import_set_state_nolock()) ffff9fe9d0e21800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1783135014.020982:0:36:0:(import.c:512:import_select_connection()) MGC192.168.201.141@tcp: connect to NID 0@lo last attempt 286 00000100:00080000:1.0:1783135014.020990:0:36:0:(import.c:591:import_select_connection()) MGC192.168.201.141@tcp: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1783135014.020999:0:36:0:(import.c:626:import_select_connection()) MGC192.168.201.141@tcp: import ffff9fe9d0e21800 using connection 192.168.201.141@tcp/0@lo 00000100:00100000:1.0:1783135014.021064:0:36:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9fe9fe958e00 x1869752384427264/t0(0) o250->MGC192.168.201.141@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00010000:00010000:2.0:1783135014.021097:0:13025:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.141@tcp lock: ffff9fe9c0030200/0xd6c4b8f05867e5dc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xd6c4b8f05867e5e3 expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783135014.021099:0:3285:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9fe958e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:88a2002e-2ea7-4f07-912a-8d001832cfc0:3285:1869752384427264:0@lo:250:kworker.0 00010000:00010000:2.0:1783135014.021117:0:13025:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.141@tcp lock: ffff9fe9c0030200/0xd6c4b8f05867e5dc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xd6c4b8f05867e5e3 expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135014.021125:0:13025:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.141@tcp lock: ffff9fe9c0030200/0xd6c4b8f05867e5dc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xd6c4b8f05867e5e3 expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135014.021132:0:13025:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.141@tcp lock: ffff9fe9c0030200/0xd6c4b8f05867e5dc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xd6c4b8f05867e5e3 expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135014.021153:0:13025:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1783135014.021160:0:13025:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.141@tcp lock: ffff9fe9fe43e000/0xd6c4b8f05867e7fe lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd6c4b8f05867e805 expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135014.021166:0:13025:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.141@tcp lock: ffff9fe9fe43e000/0xd6c4b8f05867e7fe lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xd6c4b8f05867e805 expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135014.021172:0:13025:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.141@tcp lock: ffff9fe9fe43e000/0xd6c4b8f05867e7fe lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xd6c4b8f05867e805 expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135014.021178:0:13025:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.141@tcp lock: ffff9fe9fe43e000/0xd6c4b8f05867e7fe lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xd6c4b8f05867e805 expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135014.021203:0:13025:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:2.0:1783135014.021207:0:13025:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00000020:01000004:2.0:1783135014.021240:0:13025:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-OST0000 00000020:01000000:2.0:1783135014.021244:0:13025:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='F') 00000020:00000080:2.0:1783135014.021249:0:13025:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1783135014.021255:0:13025:0:(obd_config.c:955:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1783135014.021261:0:13025:0:(genops.c:1579:class_disconnect_exports()) OBD device 11 (ffff9fea00c40000) has no exports 00000020:00080000:2.0:1783135014.021316:0:13025:0:(genops.c:1579:class_disconnect_exports()) OBD device 11 (ffff9fea00c40000) has no exports 00010000:00010000:3.0:1783135014.021318:0:5758:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1783135014.021328:0:5758:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.141@tcp lock: ffff9fe9c0030200/0xd6c4b8f05867e5dc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xd6c4b8f05867e5e3 expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135014.021338:0:5758:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe9c0030200 already unused, calling callback (ffffffffc1b40c20) 10000000:00010000:3.0:1783135014.021343:0:5758:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.141@tcp lock: ffff9fe9c0030200/0xd6c4b8f05867e5dc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xd6c4b8f05867e5e3 expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000400:00000100:1.0:1783135014.021354:0:3285:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1869752384427264 offset 0 length 520: 4 00010000:00010000:3.0:1783135014.021355:0:5758:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.141@tcp lock: ffff9fe9c0030200/0xd6c4b8f05867e5dc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0xd6c4b8f05867e5e3 expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1783135014.021363:0:5758:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.141@tcp lock: ffff9fe9c0030200/0xd6c4b8f05867e5dc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0xd6c4b8f05867e5e3 expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783135014.021369:0:5758:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1783135014.021373:0:5758:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 10000000:01000000:3.0:1783135014.021375:0:5758:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 00010000:00010000:3.0:1783135014.021390:0:5758:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9fe9d0e21800 00010000:00010000:3.0:1783135014.021395:0:5758:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.141@tcp lock: ffff9fe9c0030200/0xd6c4b8f05867e5dc lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0xd6c4b8f05867e5e3 expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135014.021402:0:5758:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.141@tcp lock: ffff9fe9c0030200/0xd6c4b8f05867e5dc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0xd6c4b8f05867e5e3 expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135014.021416:0:5758:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783135014.021419:0:5758:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.141@tcp lock: ffff9fe9fe43e000/0xd6c4b8f05867e7fe lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xd6c4b8f05867e805 expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135014.021425:0:5758:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe9fe43e000 already unused, calling callback (ffffffffc1b40c20) 10000000:00010000:3.0:1783135014.021436:0:5758:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.141@tcp lock: ffff9fe9fe43e000/0xd6c4b8f05867e7fe lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xd6c4b8f05867e805 expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135014.021443:0:5758:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.141@tcp lock: ffff9fe9fe43e000/0xd6c4b8f05867e7fe lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xd6c4b8f05867e805 expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1783135014.021450:0:5758:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.141@tcp lock: ffff9fe9fe43e000/0xd6c4b8f05867e7fe lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xd6c4b8f05867e805 expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783135014.021456:0:5758:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:3.0:1783135014.021458:0:5758:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:3.0:1783135014.021460:0:5758:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:3.0:1783135014.021467:0:5758:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9fe9d0e21800 00010000:00010000:3.0:1783135014.021471:0:5758:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.141@tcp lock: ffff9fe9fe43e000/0xd6c4b8f05867e7fe lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xd6c4b8f05867e805 expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135014.021478:0:5758:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.141@tcp lock: ffff9fe9fe43e000/0xd6c4b8f05867e7fe lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xd6c4b8f05867e805 expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135014.021488:0:5758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783135014.021490:0:5758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783135014.021492:0:5758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783135014.021519:0:5757:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:2.0:1783135014.023379:0:13025:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9fe8c60753c0 - data ffff9fe9fdbb2af8/ffff9fe9fe468800 00000020:01000000:2.0:1783135014.023529:0:13025:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9fe9fecc9600 - data ffff9fe9f132aaf8/ffff9fe8c4e69000 00100000:10000000:2.0:1783135014.041874:0:13025:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:3.0:1783135014.062969:0:13025:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xd6c4b8f05867e3eb 00000020:00000080:3.0:1783135014.062985:0:13025:0:(genops.c:906:class_export_put()) final put ffff9fe8c451a800/lustre-OST0000-osd_UUID 00000020:01000004:3.0:1783135014.063010:0:13025:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9fea01d1b000 from lustre-OST0000, refs=2 00000020:01000004:3.0:1783135014.063014:0:13025:0:(obd_mount.c:701:lustre_put_lsi()) put ffff9fea01d1b000 2 00000020:01000004:3.0:1783135014.063018:0:13025:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9fea01d1b000 from lustre-OST0000 00000020:00000080:3.0:1783135014.063046:0:13025:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1783135014.063063:0:13025:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:3.0:1783135014.063066:0:13025:0:(genops.c:906:class_export_put()) final put ffff9fe8c4519000/lustre-OST0000_UUID 00000020:00000080:3.0:1783135014.063070:0:13025:0:(genops.c:865:class_export_destroy()) destroying export ffff9fe8c4519000/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:3.0:1783135014.063089:0:13025:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:00000080:0.0:1783135014.063105:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9fe8c451a800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000004:3.0:1783135014.063147:0:13025:0:(obd_mount.c:569:lustre_stop_mgc()) MGC still has 1 references. 00000020:01000000:3.0:1783135014.063152:0:13025:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:3.0:1783135014.063156:0:13025:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1783135014.063161:0:13025:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1783135014.063169:0:13025:0:(genops.c:1840:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff9fe8c47e0000 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1783135014.063176:0:13025:0:(genops.c:1574:class_disconnect_exports()) OBD device 12 (ffff9fe9ca89b380) has exports, disconnecting them 00000020:00080000:3.0:1783135014.063185:0:13025:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff9fe8c47e0000), last request at 1783134872 00000020:00000080:3.0:1783135014.063190:0:13025:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xd6c4b8f05867e415 00000020:00080000:3.0:1783135014.063200:0:13025:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9fe8c47e0000): rc 0 00000020:00000080:3.0:1783135014.063206:0:13025:0:(genops.c:906:class_export_put()) final put ffff9fe8c47e0000/lustre-MDT0000-lwp-OST0000 00000020:00000080:0.0:1783135014.063373:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9fe8c47e0000/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00010000:01000000:2.0:1783135014.065533:0:13025:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:2.0:1783135014.065542:0:13025:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1783135014.065547:0:13025:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:2.0:1783135014.065554:0:13025:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1783135014.065666:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9fe8c47e2800 for lustre-MDT0000-lwp-OST0000 00000020:00000080:2.0:1783135014.065779:0:13025:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1783135014.065787:0:13025:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:2.0:1783135014.065792:0:13025:0:(genops.c:906:class_export_put()) final put ffff9fe8c47e4000/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:2.0:1783135014.065797:0:13025:0:(genops.c:865:class_export_destroy()) destroying export ffff9fe8c47e4000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:2.0:1783135014.065809:0:13025:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000004:2.0:1783135014.065875:0:13025:0:(obd_mount.c:701:lustre_put_lsi()) put ffff9fea01d1b000 1 00000020:00000080:2.0:1783135014.065882:0:13025:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xd6c4b8f05867e3a5 00000020:00000080:2.0:1783135014.065892:0:13025:0:(genops.c:906:class_export_put()) final put ffff9fea01d36800/lustre-OST0000-osd_UUID 00000020:01000000:2.0:1783135014.065902:0:13025:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:2.0:1783135014.065907:0:13025:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1783135014.065911:0:13025:0:(obd_config.c:955:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1783135014.065914:0:13025:0:(genops.c:1579:class_disconnect_exports()) OBD device 9 (ffff9fe9d0e80000) has no exports 00000020:00000080:0.0:1783135014.065939:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9fea01d36800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:3.0:1783135014.073849:0:13025:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1783135014.073868:0:13025:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:3.0:1783135014.073874:0:13025:0:(genops.c:906:class_export_put()) final put ffff9fea01d1c000/lustre-OST0000-osd_UUID 00000020:00000080:3.0:1783135014.073881:0:13025:0:(genops.c:865:class_export_destroy()) destroying export ffff9fea01d1c000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:3.0:1783135014.073889:0:13025:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:3.0:1783135014.074061:0:13025:0:(obd_mount.c:659:lustre_free_lsi()) Freeing lsi ffff9fea01d1d000 00000020:02000400:3.0:1783135014.074114:0:13025:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-OST0000 complete 00010000:00010000:0.0:1783135014.147656:0:6591:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783135015.172203:0:10987:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1783135015.840864:0:13178:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:0.0:1783135015.850453:0:13178:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-OST0001 00010000:00010000:0.0:1783135015.850552:0:13178:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.141@tcp lock: ffff9fe9c1523c00/0xd6c4b8f05867e5b2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd6c4b8f05867e5b9 expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135015.850572:0:13178:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.141@tcp lock: ffff9fe9c1523c00/0xd6c4b8f05867e5b2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xd6c4b8f05867e5b9 expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135015.850581:0:13178:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.141@tcp lock: ffff9fe9c1523c00/0xd6c4b8f05867e5b2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xd6c4b8f05867e5b9 expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135015.850589:0:13178:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.141@tcp lock: ffff9fe9c1523c00/0xd6c4b8f05867e5b2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xd6c4b8f05867e5b9 expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135015.850608:0:13178:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1783135015.850616:0:13178:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:0.0:1783135015.850646:0:13178:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1783135015.850661:0:13178:0:(client.c:3588:ptlrpc_abort_inflight()) @@@ inflight req@ffff9fe8c6dff480 x1869752384426880/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783135022 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783135015.850680:0:13178:0:(client.c:3588:ptlrpc_abort_inflight()) @@@ inflight req@ffff9fe9f6cb3800 x1869752384427008/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783135024 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783135015.850704:0:13178:0:(client.c:3588:ptlrpc_abort_inflight()) @@@ inflight req@ffff9fe9f6cb3100 x1869752384427136/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783135030 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783135015.850717:0:13178:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:0.0:1783135015.850723:0:13178:0:(pinger.c:400:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1783135015.850767:0:13178:0:(import.c:65:import_set_state_nolock()) ffff9fe8c57da800 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:1.0:1783135015.850873:0:3288:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe8c6dff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3288:1869752384426880:0@lo:400:kworker.0 00000100:00100000:1.0:1783135015.850912:0:3287:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9f6cb3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3287:1869752384427136:0@lo:400:kworker.0 00000100:00100000:2.0:1783135015.850965:0:3289:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9f6cb3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3289:1869752384427008:0@lo:400:kworker.0 00000100:00100000:1.0:1783135015.851016:0:3285:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe8c6dff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3285:1869752384427392:0@lo:39:umount.0 00000400:00000100:1.0:1783135015.851077:0:3285:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1869752384427392 offset 0 length 224: 4 00010000:00010000:3.0:1783135015.851192:0:5758:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783135015.851201:0:5758:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.141@tcp lock: ffff9fe9c1523c00/0xd6c4b8f05867e5b2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xd6c4b8f05867e5b9 expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135015.851210:0:5758:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe9c1523c00 already unused, calling callback (ffffffffc1b40c20) 10000000:00010000:3.0:1783135015.851214:0:5758:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.141@tcp lock: ffff9fe9c1523c00/0xd6c4b8f05867e5b2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xd6c4b8f05867e5b9 expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135015.851225:0:5758:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.141@tcp lock: ffff9fe9c1523c00/0xd6c4b8f05867e5b2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xd6c4b8f05867e5b9 expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1783135015.851234:0:5758:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.141@tcp lock: ffff9fe9c1523c00/0xd6c4b8f05867e5b2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xd6c4b8f05867e5b9 expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783135015.851247:0:5758:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1783135015.851250:0:5758:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:3.0:1783135015.851253:0:5758:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:3.0:1783135015.851267:0:5758:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9fe9d0e21800 00010000:00010000:3.0:1783135015.851272:0:5758:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.141@tcp lock: ffff9fe9c1523c00/0xd6c4b8f05867e5b2 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xd6c4b8f05867e5b9 expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135015.851422:0:5758:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.141@tcp lock: ffff9fe9c1523c00/0xd6c4b8f05867e5b2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xd6c4b8f05867e5b9 expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135015.851435:0:5758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783135015.851437:0:5758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783135015.851439:0:5758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783135016.195569:0:5757:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783135017.219610:0:6591:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783135018.243456:0:10987:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1783135019.139510:0:8:0:(pinger.c:231:ptlrpc_pinger_process_import()) 88a2002e-2ea7-4f07-912a-8d001832cfc0->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1783135019.139524:0:8:0:(pinger.c:249:ptlrpc_pinger_process_import()) 88a2002e-2ea7-4f07-912a-8d001832cfc0->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00010000:3.0:1783135019.268927:0:5758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783135020.291590:0:5757:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783135021.315503:0:6591:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783135022.339440:0:10987:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783135023.363459:0:5758:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1783135024.260206:0:36:0:(pinger.c:231:ptlrpc_pinger_process_import()) 88a2002e-2ea7-4f07-912a-8d001832cfc0->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1783135024.260215:0:36:0:(pinger.c:249:ptlrpc_pinger_process_import()) 88a2002e-2ea7-4f07-912a-8d001832cfc0->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00010000:3.0:1783135024.388943:0:5757:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783135025.027418:0:3285:0:(client.c:2489:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1783135015/real 1783135015] req@ffff9fe8c6dff100 x1869752384427392/t0(0) o39->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1783135025 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783135025.027452:0:3285:0:(client.c:2520:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9fe8c6dff100 x1869752384427392/t0(0) o39->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1783135025 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1783135025.027500:0:3285:0:(import.c:65:import_set_state_nolock()) ffff9fe8c57da800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:1.0:1783135025.027520:0:3285:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe8c6dff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3285:1869752384427392:0@lo:39:umount.0 00000100:00080000:0.0:1783135025.027623:0:13178:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1783135025.027628:0:13178:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:0.0:1783135025.027633:0:13178:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:0.0:1783135025.028496:0:13178:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.141@tcp lock: ffff9fea02166c00/0xd6c4b8f05867e5c0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd6c4b8f05867e5c7 expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135025.028510:0:13178:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.141@tcp lock: ffff9fea02166c00/0xd6c4b8f05867e5c0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xd6c4b8f05867e5c7 expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135025.028518:0:13178:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.141@tcp lock: ffff9fea02166c00/0xd6c4b8f05867e5c0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xd6c4b8f05867e5c7 expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135025.028524:0:13178:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.141@tcp lock: ffff9fea02166c00/0xd6c4b8f05867e5c0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xd6c4b8f05867e5c7 expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135025.028552:0:13178:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1783135025.028560:0:13178:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.141@tcp lock: ffff9fe9d2b75600/0xd6c4b8f05867e7f0 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd6c4b8f05867e7f7 expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135025.028566:0:13178:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.141@tcp lock: ffff9fe9d2b75600/0xd6c4b8f05867e7f0 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd6c4b8f05867e7f7 expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135025.028572:0:13178:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.141@tcp lock: ffff9fe9d2b75600/0xd6c4b8f05867e7f0 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xd6c4b8f05867e7f7 expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135025.028578:0:13178:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.141@tcp lock: ffff9fe9d2b75600/0xd6c4b8f05867e7f0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xd6c4b8f05867e7f7 expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135025.028614:0:13178:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:0.0:1783135025.028619:0:13178:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0001 (0) 00000020:01000004:0.0:1783135025.028640:0:13178:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-OST0001 00000020:01000000:0.0:1783135025.028644:0:13178:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-OST0001 (flags='F') 00000020:00000080:0.0:1783135025.028649:0:13178:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1783135025.028654:0:13178:0:(obd_config.c:955:class_cleanup()) lustre-OST0001: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1783135025.028659:0:13178:0:(genops.c:1579:class_disconnect_exports()) OBD device 15 (ffff9fe8c456b380) has no exports 00000020:00080000:0.0:1783135025.028682:0:13178:0:(genops.c:1579:class_disconnect_exports()) OBD device 15 (ffff9fe8c456b380) has no exports 00010000:00010000:2.0:1783135025.028733:0:10987:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1783135025.028742:0:10987:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.141@tcp lock: ffff9fea02166c00/0xd6c4b8f05867e5c0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xd6c4b8f05867e5c7 expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135025.028751:0:10987:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fea02166c00 already unused, calling callback (ffffffffc1b40c20) 10000000:00010000:2.0:1783135025.028755:0:10987:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.141@tcp lock: ffff9fea02166c00/0xd6c4b8f05867e5c0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xd6c4b8f05867e5c7 expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135025.028774:0:10987:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.141@tcp lock: ffff9fea02166c00/0xd6c4b8f05867e5c0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xd6c4b8f05867e5c7 expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783135025.028782:0:10987:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.141@tcp lock: ffff9fea02166c00/0xd6c4b8f05867e5c0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xd6c4b8f05867e5c7 expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783135025.028788:0:10987:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1783135025.028791:0:10987:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0001: stopping, won't requeue 10000000:01000000:2.0:1783135025.028793:0:10987:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0001 00010000:00010000:2.0:1783135025.028807:0:10987:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9fe9d0e21800 00010000:00010000:2.0:1783135025.028811:0:10987:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.141@tcp lock: ffff9fea02166c00/0xd6c4b8f05867e5c0 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xd6c4b8f05867e5c7 expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135025.028817:0:10987:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.141@tcp lock: ffff9fea02166c00/0xd6c4b8f05867e5c0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xd6c4b8f05867e5c7 expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135025.028831:0:10987:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783135025.028843:0:10987:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.141@tcp lock: ffff9fe9d2b75600/0xd6c4b8f05867e7f0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xd6c4b8f05867e7f7 expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135025.028862:0:10987:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe9d2b75600 already unused, calling callback (ffffffffc1b40c20) 10000000:00010000:2.0:1783135025.028865:0:10987:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.141@tcp lock: ffff9fe9d2b75600/0xd6c4b8f05867e7f0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xd6c4b8f05867e7f7 expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135025.028872:0:10987:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.141@tcp lock: ffff9fe9d2b75600/0xd6c4b8f05867e7f0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xd6c4b8f05867e7f7 expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783135025.028878:0:10987:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.141@tcp lock: ffff9fe9d2b75600/0xd6c4b8f05867e7f0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xd6c4b8f05867e7f7 expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783135025.028883:0:10987:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:2.0:1783135025.028886:0:10987:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:2.0:1783135025.028888:0:10987:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:2.0:1783135025.028893:0:10987:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9fe9d0e21800 00010000:00010000:2.0:1783135025.029139:0:10987:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.141@tcp lock: ffff9fe9d2b75600/0xd6c4b8f05867e7f0 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0xd6c4b8f05867e7f7 expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135025.029148:0:10987:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.141@tcp lock: ffff9fe9d2b75600/0xd6c4b8f05867e7f0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0xd6c4b8f05867e7f7 expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135025.029161:0:10987:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783135025.029163:0:10987:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783135025.029165:0:10987:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:0.0:1783135025.030347:0:13178:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9fe9f8985ae0 - data ffff9fe8c4973e58/ffff9fea00bee400 00000020:01000000:0.0:1783135025.030465:0:13178:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9fe9d1534420 - data ffff9fe9f86cf798/ffff9fe9f665b400 00010000:00010000:1.0:1783135025.030811:0:6591:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00100000:10000000:0.0:1783135025.042640:0:13178:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0001-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:3.0:1783135025.067725:0:13178:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xd6c4b8f05867e4b6 00000020:00000080:3.0:1783135025.067737:0:13178:0:(genops.c:906:class_export_put()) final put ffff9fe9f6727000/lustre-OST0001-osd_UUID 00000020:01000004:3.0:1783135025.067756:0:13178:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9fe8c47e1800 from lustre-OST0001, refs=2 00000020:01000004:3.0:1783135025.067759:0:13178:0:(obd_mount.c:701:lustre_put_lsi()) put ffff9fe8c47e1800 2 00000020:01000004:3.0:1783135025.067773:0:13178:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9fe8c47e1800 from lustre-OST0001 00000020:00000080:1.0:1783135025.067792:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9fe9f6727000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:3.0:1783135025.067860:0:13178:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1783135025.067871:0:13178:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:00000080:3.0:1783135025.067874:0:13178:0:(genops.c:906:class_export_put()) final put ffff9fe9f6720000/lustre-OST0001_UUID 00000020:00000080:3.0:1783135025.067877:0:13178:0:(genops.c:865:class_export_destroy()) destroying export ffff9fe9f6720000/lustre-OST0001_UUID for lustre-OST0001 00000020:01000000:3.0:1783135025.067893:0:13178:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001 (lustre-OST0001_UUID) 00000100:00080000:3.0:1783135025.068020:0:13178:0:(pinger.c:400:ptlrpc_pinger_del_import()) removing pingable import 88a2002e-2ea7-4f07-912a-8d001832cfc0->MGS 00010000:00010000:3.0:1783135025.068036:0:13178:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.141@tcp lock: ffff9fe9c1523800/0xd6c4b8f05867e3c8 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xd6c4b8f05867e3cf expref: -99 pid: 6572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1783135025.068047:0:13178:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.141@tcp lock: ffff9fe9c1523800/0xd6c4b8f05867e3c8 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xd6c4b8f05867e3cf expref: -99 pid: 6572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783135025.068053:0:13178:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 10000000:01000000:3.0:1783135025.068056:0:13178:0:(mgc_request.c:954:mgc_blocking_ast()) log nodemap: disconnecting, won't requeue 10000000:01000000:3.0:1783135025.068059:0:13178:0:(mgc_request.c:130:config_log_put()) dropping config log nodemap 00010000:00010000:3.0:1783135025.068106:0:13178:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9fe9d0e21800 00010000:00010000:3.0:1783135025.068111:0:13178:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.141@tcp lock: ffff9fe9c1523800/0xd6c4b8f05867e3c8 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xd6c4b8f05867e3cf expref: -99 pid: 6572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135025.068125:0:13178:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.141@tcp lock: ffff9fea02166400/0xd6c4b8f05867e606 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xd6c4b8f05867e60d expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1783135025.068132:0:13178:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.141@tcp lock: ffff9fea02166400/0xd6c4b8f05867e606 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xd6c4b8f05867e60d expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783135025.068138:0:13178:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1783135025.068140:0:13178:0:(mgc_request.c:954:mgc_blocking_ast()) log lustre-s: disconnecting, won't requeue 10000000:01000000:3.0:1783135025.068142:0:13178:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:3.0:1783135025.068149:0:13178:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9fe9d0e21800 00010000:00010000:3.0:1783135025.068151:0:13178:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.141@tcp lock: ffff9fea02166400/0xd6c4b8f05867e606 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xd6c4b8f05867e60d expref: -99 pid: 5767 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1783135025.068202:0:13178:0:(import.c:65:import_set_state_nolock()) ffff9fe9d0e21800 MGS: changing import state from CONNECTING to CLOSED 10000000:01000000:3.0:1783135025.068206:0:13178:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:3.0:1783135025.068209:0:13178:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:3.0:1783135025.068216:0:13178:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:3.0:1783135025.068220:0:13178:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:3.0:1783135025.068230:0:13178:0:(client.c:3588:ptlrpc_abort_inflight()) @@@ inflight req@ffff9fe9fe958e00 x1869752384427264/t0(0) o250->MGC192.168.201.141@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1783135029 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:01000000:3.0:1783135025.068355:0:13178:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:3.0:1783135025.068359:0:13178:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 5s for inflight to error out 00000100:00100000:1.0:1783135025.068512:0:3285:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9fe958e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:88a2002e-2ea7-4f07-912a-8d001832cfc0:3285:1869752384427264:0@lo:250:kworker.0 10000000:01000000:3.0:1783135025.068574:0:13178:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:3.0:1783135025.068582:0:13178:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xd6c4b8f05867e2a9 00000020:00000080:3.0:1783135025.068587:0:13178:0:(genops.c:906:class_export_put()) final put ffff9fe9d11a1800/88a2002e-2ea7-4f07-912a-8d001832cfc0 00000020:01000000:3.0:1783135025.068595:0:13178:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of MGC192.168.201.141@tcp (flags='') 00000020:00000080:3.0:1783135025.068600:0:13178:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1783135025.068610:0:13178:0:(obd_config.c:955:class_cleanup()) MGC192.168.201.141@tcp: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1783135025.068613:0:13178:0:(genops.c:1579:class_disconnect_exports()) OBD device 2 (ffff9fe9d13819c0) has no exports 00000020:00000080:2.0:1783135025.068626:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9fe9d11a1800/88a2002e-2ea7-4f07-912a-8d001832cfc0 for MGC192.168.201.141@tcp 10000000:01000000:3.0:1783135025.068644:0:5767:0:(mgc_request.c:708:mgc_requeue_thread()) Ending requeue thread 10000000:01000000:3.0:1783135025.068701:0:13178:0:(obd_class.h:671:obd_cleanup_client_import()) MGC192.168.201.141@tcp: client import never connected 00000100:00080000:3.0:1783135025.068704:0:13178:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:3.0:1783135025.068706:0:13178:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:3.0:1783135025.068708:0:13178:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:3.0:1783135025.068777:0:13178:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:3.0:1783135025.068862:0:13178:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1783135025.068867:0:13178:0:(obd_config.c:883:class_detach()) detach on obd MGC192.168.201.141@tcp (uuid 88a2002e-2ea7-4f07-912a-8d001832cfc0) 00000020:01000000:3.0:1783135025.068871:0:13178:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0001 (flags='F') 00000020:00000080:3.0:1783135025.068875:0:13178:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1783135025.068877:0:13178:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1783135025.068882:0:13178:0:(genops.c:1840:print_export_data()) lustre-MDT0000-lwp-OST0001: ACTIVE ffff9fe8c57d9800 lustre-MDT0000-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1783135025.068887:0:13178:0:(genops.c:1574:class_disconnect_exports()) OBD device 16 (ffff9fe8c57c19c0) has exports, disconnecting them 00000020:00080000:3.0:1783135025.068890:0:13178:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0001: disconnecting export at 0@lo (ffff9fe8c57d9800), last request at 1783134881 00000020:00000080:3.0:1783135025.068893:0:13178:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xd6c4b8f05867e4e0 00000020:00080000:3.0:1783135025.068904:0:13178:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9fe8c57d9800): rc 0 00000020:00000080:3.0:1783135025.068908:0:13178:0:(genops.c:906:class_export_put()) final put ffff9fe8c57d9800/lustre-MDT0000-lwp-OST0001 00000020:00000080:2.0:1783135025.069734:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9fe8c57d9800/lustre-MDT0000-lwp-OST0001 for lustre-MDT0000-lwp-OST0001 00000020:00000080:2.0:1783135025.069904:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9fe9d0e21800 for MGC192.168.201.141@tcp 00000020:00000080:2.0:1783135025.069911:0:36:0:(genops.c:906:class_export_put()) final put ffff9fe9d0e20000/88a2002e-2ea7-4f07-912a-8d001832cfc0 00000020:00000080:2.0:1783135025.069913:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9fe9d0e20000/88a2002e-2ea7-4f07-912a-8d001832cfc0 for MGC192.168.201.141@tcp 00000020:01000000:2.0:1783135025.069928:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGC192.168.201.141@tcp (88a2002e-2ea7-4f07-912a-8d001832cfc0) 00010000:01000000:2.0:1783135025.073343:0:13178:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0001: client import never connected 00000100:00080000:2.0:1783135025.073352:0:13178:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1783135025.073356:0:13178:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:2.0:1783135025.073363:0:13178:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1783135025.073679:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9fe8c57da800 for lustre-MDT0000-lwp-OST0001 00010000:00010000:2.0:1783135025.079984:0:5758:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-1 blwis in pool) 00010000:00010000:2.0:1783135025.080333:0:5757:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-2 blwis in pool) 00010000:00010000:2.0:1783135025.080534:0:10987:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-3 blwis in pool) 00010000:00010000:2.0:1783135025.080680:0:6591:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-4 blwis in pool) 00000100:00100000:2.0:1783135025.080794:0:5752:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_000: service thread [ffff9fe9d1194c00:5752] 0 exiting: rc = 1 00000100:00100000:2.0:1783135025.080832:0:6590:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_002: service thread [ffff9fe9d1195200:6590] 2 exiting: rc = 0 00000100:00100000:3.0:1783135025.080974:0:5753:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_001: service thread [ffff9fe9d1195400:5753] 1 exiting: rc = 0 00000100:00100000:2.0:1783135025.081080:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135025.081256:0:5754:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_000: service thread [ffff9fe9c9da9000:5754] 0 exiting: rc = 1 00000100:00100000:2.0:1783135025.081312:0:5755:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_001: service thread [ffff9fe9d16bbc00:5755] 1 exiting: rc = 0 00000100:00100000:1.0:1783135025.081405:0:5756:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_002: service thread [ffff9fe9d16bae00:5756] 2 exiting: rc = 0 00000100:00100000:1.0:1783135025.081638:0:6592:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_003: service thread [ffff9fe9df295400:6592] 3 exiting: rc = 0 00000100:00100000:2.0:1783135025.081815:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135025.081820:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135025.081824:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135025.081829:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135025.081833:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135025.081837:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135025.081841:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135025.081844:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135025.081848:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135025.081851:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135025.081855:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135025.081859:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135025.081862:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135025.081870:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135025.081874:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135025.081877:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135025.081881:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135025.081887:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135025.081899:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135025.081905:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135025.081910:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135025.081916:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135025.081920:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135025.081926:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135025.081931:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135025.081937:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135025.081942:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135025.081949:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135025.081954:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135025.081960:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135025.081965:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135025.081971:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135025.081976:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135025.081980:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135025.081983:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135025.081986:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135025.081990:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135025.081993:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135025.081996:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135025.081999:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135025.082002:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135025.082005:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135025.082008:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135025.082011:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135025.082014:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135025.082016:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135025.082019:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135025.082022:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135025.082024:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135025.082027:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135025.082031:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135025.082036:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135025.082040:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135025.082053:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135025.082058:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135025.082063:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135025.082069:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135025.082074:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135025.082080:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135025.082085:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135025.082089:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135025.082092:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135025.082096:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135025.082099:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:2.0:1783135025.082670:0:13178:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1783135025.082677:0:13178:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000020:00000080:2.0:1783135025.082681:0:13178:0:(genops.c:906:class_export_put()) final put ffff9fe9f6a14800/lustre-MDT0000-lwp-OST0001_UUID 00000020:00000080:2.0:1783135025.082684:0:13178:0:(genops.c:865:class_export_destroy()) destroying export ffff9fe9f6a14800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000-lwp-OST0001 00000020:01000000:2.0:1783135025.082688:0:13178:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0001 (lustre-MDT0000-lwp-OST0001_UUID) 00000020:01000004:2.0:1783135025.082720:0:13178:0:(obd_mount.c:701:lustre_put_lsi()) put ffff9fe8c47e1800 1 00000020:00000080:2.0:1783135025.082725:0:13178:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xd6c4b8f05867e485 00000020:00000080:2.0:1783135025.082730:0:13178:0:(genops.c:906:class_export_put()) final put ffff9fe8c451f800/lustre-OST0001-osd_UUID 00000020:01000000:2.0:1783135025.082745:0:13178:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osd (flags='') 00000020:00000080:2.0:1783135025.082750:0:13178:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1783135025.082755:0:13178:0:(obd_config.c:955:class_cleanup()) lustre-OST0001-osd: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1783135025.082759:0:13178:0:(genops.c:1579:class_disconnect_exports()) OBD device 14 (ffff9fe9d0e84d40) has no exports 00000020:00000080:1.0:1783135025.082793:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9fe8c451f800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:0.0:1783135025.130326:0:13178:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1783135025.130343:0:13178:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00000020:00000080:0.0:1783135025.130349:0:13178:0:(genops.c:906:class_export_put()) final put ffff9fe8c47e3000/lustre-OST0001-osd_UUID 00000020:00000080:0.0:1783135025.130354:0:13178:0:(genops.c:865:class_export_destroy()) destroying export ffff9fe8c47e3000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:0.0:1783135025.130364:0:13178:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osd (lustre-OST0001-osd_UUID) 00000020:01000004:0.0:1783135025.130580:0:13178:0:(obd_mount.c:659:lustre_free_lsi()) Freeing lsi ffff9fe8c47e2000 00000020:01000000:0.0:1783135025.130600:0:13178:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of OSS (flags='F') 00000020:00000080:0.0:1783135025.130604:0:13178:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1783135025.130608:0:13178:0:(obd_config.c:955:class_cleanup()) OSS: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1783135025.130612:0:13178:0:(genops.c:1579:class_disconnect_exports()) OBD device 10 (ffff9fe9ca89cd40) has no exports 00000020:00000080:0.0:1783135025.130635:0:13178:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1783135025.130642:0:13178:0:(obd_config.c:883:class_detach()) detach on obd OSS (uuid OSS_uuid) 00000020:00000080:0.0:1783135025.130644:0:13178:0:(genops.c:906:class_export_put()) final put ffff9fea01d31000/OSS_uuid 00000020:00000080:0.0:1783135025.130647:0:13178:0:(genops.c:865:class_export_destroy()) destroying export ffff9fea01d31000/OSS_uuid for OSS 00000020:01000000:0.0:1783135025.130650:0:13178:0:(genops.c:441:class_free_dev()) finishing cleanup of obd OSS (OSS_uuid) 00000100:00100000:0.0:1783135025.130715:0:6574:0:(service.c:3183:ptlrpc_main()) ll_ost00_000: service thread [ffff9fe9ca920200:6574] 0 exiting: rc = 1 00000100:00100000:3.0:1783135025.130783:0:6577:0:(service.c:3183:ptlrpc_main()) ll_ost00_002: service thread [ffff9fe9fecb8a00:6577] 2 exiting: rc = 0 00000100:00100000:3.0:1783135025.130851:0:7676:0:(service.c:3183:ptlrpc_main()) ll_ost00_003: service thread [ffff9fe9d13fa600:7676] 3 exiting: rc = 0 00000100:00080000:1.0:1783135025.131338:0:5766:0:(pinger.c:550:ping_evictor_main()) Exiting Ping Evictor 00000100:00100000:2.0:1783135025.131658:0:6576:0:(service.c:3183:ptlrpc_main()) ll_ost00_001: service thread [ffff9fe9cab5bc00:6576] 1 exiting: rc = 0 00000100:00100000:0.0:1783135025.131786:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135025.131796:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135025.131805:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135025.131818:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135025.131824:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135025.131831:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135025.131838:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135025.131847:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135025.131856:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135025.131864:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135025.131873:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135025.131881:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135025.131889:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135025.131898:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135025.131905:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135025.131914:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135025.131923:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135025.131931:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135025.131938:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135025.131945:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135025.131952:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135025.131960:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135025.131969:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135025.131976:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135025.131984:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135025.131992:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135025.132000:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135025.132008:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135025.132016:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135025.132024:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135025.132029:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135025.132034:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135025.132038:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135025.132043:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135025.132047:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135025.132052:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135025.132056:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135025.132061:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135025.132073:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135025.132078:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135025.132083:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135025.132088:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135025.132093:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135025.132101:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135025.132109:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135025.132116:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135025.132124:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135025.132132:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135025.132137:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135025.132144:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135025.132151:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135025.132158:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135025.132165:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135025.132189:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135025.132198:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135025.132205:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135025.132212:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135025.132220:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135025.132227:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135025.132233:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135025.132240:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135025.132247:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135025.132254:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135025.132260:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135025.133125:0:6578:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_000: service thread [ffff9fe9e2ea2200:6578] 0 exiting: rc = 1 00000100:00100000:1.0:1783135025.133214:0:6579:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_001: service thread [ffff9fe9fecb8000:6579] 1 exiting: rc = 0 00000100:00100000:2.0:1783135025.133347:0:10783:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_002: service thread [ffff9fe9ca894200:10783] 2 exiting: rc = 0 00000100:00100000:0.0:1783135025.138640:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135025.138651:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135025.138656:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135025.138661:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135025.138666:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135025.138671:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135025.138676:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135025.138681:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135025.138686:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135025.138706:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135025.138711:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135025.138716:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135025.138815:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135025.138823:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135025.138828:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135025.138833:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135025.138838:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135025.138843:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135025.138847:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135025.138852:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135025.138858:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135025.138863:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135025.138868:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135025.138874:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135025.138879:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135025.138885:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135025.138890:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135025.138895:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135025.138900:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135025.138905:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135025.138913:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135025.138919:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135025.138923:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135025.138928:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135025.138933:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135025.138938:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135025.138943:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135025.138948:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135025.138953:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135025.138957:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135025.138962:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135025.138967:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135025.138972:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135025.138976:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135025.138988:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135025.138993:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135025.138998:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135025.139004:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135025.139012:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135025.139019:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135025.139024:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135025.139030:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135025.139034:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135025.139040:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135025.139045:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135025.139050:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135025.139055:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135025.139060:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135025.139065:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135025.139070:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135025.139075:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135025.139080:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135025.139085:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135025.139089:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135025.141092:0:6581:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_001: service thread [ffff9fe9f66f1c00:6581] 1 exiting: rc = 0 00000100:00100000:3.0:1783135025.141191:0:6580:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_000: service thread [ffff9fe9f66f1600:6580] 0 exiting: rc = 1 00000100:00100000:1.0:1783135025.141509:0:6582:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_002: service thread [ffff9fe9f66f0e00:6582] 2 exiting: rc = 0 00000100:00100000:0.0:1783135025.141584:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135025.141592:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135025.141599:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135025.141604:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135025.141610:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135025.141616:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135025.141629:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135025.141637:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135025.141643:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135025.141649:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135025.141654:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135025.141660:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135025.141665:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135025.141670:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135025.141676:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135025.141697:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135025.141703:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135025.141708:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135025.141713:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135025.141719:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135025.141724:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135025.141730:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135025.141736:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135025.141742:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135025.141747:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135025.141753:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135025.141770:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135025.141777:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135025.141782:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135025.141787:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135025.141793:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135025.141799:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135025.141804:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135025.141809:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135025.141815:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135025.141820:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135025.141825:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135025.141833:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135025.141838:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135025.141859:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135025.141866:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135025.141872:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135025.141877:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135025.141882:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135025.141887:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135025.141892:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135025.141896:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135025.141902:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135025.141907:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135025.141911:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135025.141924:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135025.141929:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135025.141934:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135025.141940:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135025.141945:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135025.141950:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135025.141955:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135025.141962:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135025.141968:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135025.141974:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135025.141979:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135025.141984:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135025.141989:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135025.141994:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783135025.146665:0:6583:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_000: service thread [ffff9fe9f66f1a00:6583] 0 exiting: rc = 1 00000100:00100000:1.0:1783135025.146798:0:6584:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_001: service thread [ffff9fe9f66f0a00:6584] 1 exiting: rc = 0 00000100:00100000:0.0:1783135025.146844:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135025.146853:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135025.146858:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135025.146862:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135025.146868:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135025.146873:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135025.146878:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135025.146883:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135025.146888:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135025.146893:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135025.146897:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135025.146901:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135025.146907:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135025.146912:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135025.146917:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135025.146922:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135025.146930:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135025.146934:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135025.146939:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135025.146945:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135025.146950:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135025.146967:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135025.146972:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135025.146976:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135025.146981:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135025.146986:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135025.146991:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135025.146996:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135025.147000:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135025.147004:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135025.147009:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135025.147014:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135025.147019:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135025.147024:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135025.147029:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135025.147033:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135025.147039:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135025.147045:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135025.147050:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135025.147055:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135025.147060:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135025.147066:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135025.147071:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135025.147077:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135025.147083:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135025.147089:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135025.147095:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135025.147101:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135025.147108:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135025.147114:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135025.147120:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135025.147126:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135025.147132:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135025.147138:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135025.147144:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135025.147149:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135025.147162:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135025.147168:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135025.147260:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135025.147267:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135025.147274:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135025.147298:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135025.147307:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135025.147315:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135025.148152:0:6586:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_001: service thread [ffff9fe9f66f1800:6586] 1 exiting: rc = 0 00000100:00100000:2.0:1783135025.148166:0:6585:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_000: service thread [ffff9fe9f66f1200:6585] 0 exiting: rc = 1 00000100:00100000:0.0:1783135025.148266:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135025.148274:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135025.148296:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135025.148303:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135025.148310:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135025.148318:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135025.148323:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135025.148331:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135025.148337:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135025.148343:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135025.148349:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135025.148355:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135025.148360:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135025.148577:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135025.148585:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135025.148591:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135025.148596:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135025.148602:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135025.148607:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135025.148612:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135025.148622:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135025.148628:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135025.148633:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135025.148638:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135025.148644:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135025.148664:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135025.148672:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135025.148686:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135025.148692:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135025.148699:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135025.148707:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135025.148712:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135025.148717:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135025.148723:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135025.148729:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135025.148736:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135025.148742:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135025.148772:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135025.148779:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135025.148785:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135025.148792:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135025.148797:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135025.148803:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135025.148809:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135025.148814:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135025.148821:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135025.148826:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135025.148831:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135025.148837:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135025.148858:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135025.148867:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135025.148873:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135025.148879:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135025.148885:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135025.148891:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135025.148896:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135025.148901:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135025.148907:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135025.148912:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135025.148917:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135025.148921:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135025.148928:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135025.148950:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135025.148956:0:13178:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:02000400:1.0:1783135025.158384:0:13178:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-OST0001 complete 00000001:02000400:0.0:1783135034.247315:0:13790:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg141-server.virtnet: executing load_modules_local 00000020:01000004:3.0:1783135038.833357:0:14204:0:(obd_mount.c:914:lmd_print()) mount data: 00000020:01000004:3.0:1783135038.833361:0:14204:0:(obd_mount.c:917:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:3.0:1783135038.833467:0:14204:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff9fe9f6f8d000 00000020:01000004:3.0:1783135038.833480:0:14204:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200005, mountfl=0 00000020:01000004:3.0:1783135038.833488:0:14204:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:3.0:1783135038.833501:0:14204:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff9fe9d0e80000) 00000020:00000080:3.0:1783135038.833515:0:14204:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1783135038.848030:0:14204:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:2.0:1783135038.850545:0:14204:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x11:0x0] (8/32) 00100000:10000000:2.0:1783135038.850919:0:14204:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-client under 451: rc = 0 00100000:10000000:2.0:1783135038.851013:0:14204:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0000 under 451: rc = 0 00100000:10000000:2.0:1783135038.851206:0:14204:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:2.0:1783135038.851270:0:14204:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled nodemap under 451: rc = 0 00100000:10000000:2.0:1783135038.851396:0:14204:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-MDT0000 under 451: rc = 0 00100000:10000000:2.0:1783135038.851490:0:14204:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0001 under 451: rc = 0 00100000:10000000:2.0:1783135038.851847:0:14204:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled params under 451: rc = 0 00100000:10000000:2.0:1783135038.852088:0:14204:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre under 453: rc = 0 00100000:10000000:2.0:1783135038.853667:0:14204:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled dt-0x0 under 771: rc = 0 00100000:10000000:2.0:1783135038.853770:0:14204:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled md-0x0 under 771: rc = 0 00100000:10000000:2.0:1783135038.854228:0:14204:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000-MDT0000 under 774: rc = 0 00100000:10000000:2.0:1783135038.854483:0:14204:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 774: rc = 0 00100000:10000000:2.0:1783135038.854743:0:14204:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000-MDT0000 under 774: rc = 0 00100000:10000000:2.0:1783135038.854978:0:14204:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 774: rc = 0 00100000:10000000:2.0:1783135038.855201:0:14204:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000-MDT0000 under 774: rc = 0 00100000:10000000:2.0:1783135038.855442:0:14204:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 774: rc = 0 00100000:10000000:2.0:1783135038.856127:0:14204:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000-MDT0000 under 774: rc = 0 00100000:10000000:2.0:1783135038.856538:0:14204:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 774: rc = 0 00100000:10000000:2.0:1783135038.857071:0:14204:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 774: rc = 0 00100000:10000000:2.0:1783135038.857390:0:14204:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000-MDT0000 under 774: rc = 0 00100000:10000000:2.0:1783135038.857654:0:14204:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000-MDT0000 under 774: rc = 0 00100000:10000000:2.0:1783135038.857895:0:14204:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 774: rc = 0 00100000:10000000:2.0:1783135038.859227:0:14204:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_14 under 593: rc = 0 00100000:10000000:2.0:1783135038.859520:0:14204:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_14 under 593: rc = 0 00100000:10000000:2.0:1783135038.859753:0:14204:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_07 under 593: rc = 0 00100000:10000000:2.0:1783135038.859983:0:14204:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_07 under 593: rc = 0 00100000:10000000:2.0:1783135038.860219:0:14204:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_00 under 593: rc = 0 00100000:10000000:2.0:1783135038.860491:0:14204:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_00 under 593: rc = 0 00100000:10000000:2.0:1783135038.860893:0:14204:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_13 under 593: rc = 0 00100000:10000000:2.0:1783135038.861129:0:14204:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_13 under 593: rc = 0 00100000:10000000:2.0:1783135038.861384:0:14204:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_04 under 593: rc = 0 00100000:10000000:2.0:1783135038.862699:0:14204:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_04 under 593: rc = 0 00100000:10000000:2.0:1783135038.862874:0:14204:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_03 under 593: rc = 0 00100000:10000000:2.0:1783135038.863051:0:14204:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_09 under 593: rc = 0 00100000:10000000:2.0:1783135038.863213:0:14204:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_03 under 593: rc = 0 00100000:10000000:2.0:1783135038.863649:0:14204:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_09 under 593: rc = 0 00100000:10000000:2.0:1783135038.863817:0:14204:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_10 under 593: rc = 0 00100000:10000000:2.0:1783135038.864033:0:14204:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_10 under 593: rc = 0 00100000:10000000:2.0:1783135038.864207:0:14204:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_12 under 593: rc = 0 00100000:10000000:2.0:1783135038.864493:0:14204:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_12 under 593: rc = 0 00100000:10000000:2.0:1783135038.864713:0:14204:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_01 under 593: rc = 0 00100000:10000000:2.0:1783135038.864876:0:14204:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_01 under 593: rc = 0 00100000:10000000:2.0:1783135038.865065:0:14204:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_06 under 593: rc = 0 00100000:10000000:2.0:1783135038.865237:0:14204:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_06 under 593: rc = 0 00100000:10000000:2.0:1783135038.865582:0:14204:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_15 under 593: rc = 0 00100000:10000000:2.0:1783135038.865772:0:14204:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_15 under 593: rc = 0 00100000:10000000:2.0:1783135038.865941:0:14204:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_11 under 593: rc = 0 00100000:10000000:2.0:1783135038.866130:0:14204:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_11 under 593: rc = 0 00100000:10000000:2.0:1783135038.866555:0:14204:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_08 under 593: rc = 0 00100000:10000000:2.0:1783135038.866755:0:14204:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_02 under 593: rc = 0 00100000:10000000:2.0:1783135038.866919:0:14204:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_08 under 593: rc = 0 00100000:10000000:2.0:1783135038.867103:0:14204:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_02 under 593: rc = 0 00100000:10000000:2.0:1783135038.867411:0:14204:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_05 under 593: rc = 0 00100000:10000000:2.0:1783135038.867664:0:14204:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_05 under 593: rc = 0 00100000:10000000:2.0:1783135038.868026:0:14204:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled [0x200000400:0x1:0x0] under 275: rc = 0 00100000:10000000:2.0:1783135038.870092:0:14204:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x20000:0x0] (8/32) 00100000:10000000:2.0:1783135038.870268:0:14204:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 644: rc = 0 00100000:10000000:2.0:1783135038.870501:0:14204:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2020000:0x0] (8/32) 00100000:10000000:2.0:1783135038.870580:0:14204:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 644: rc = 0 00100000:10000000:2.0:1783135038.870751:0:14204:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1020000:0x0] (8/32) 00100000:10000000:2.0:1783135038.870815:0:14204:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 644: rc = 0 00100000:10000000:2.0:1783135038.871148:0:14204:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x10000:0x0] (8/32) 00100000:10000000:2.0:1783135038.871225:0:14204:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 772: rc = 0 00100000:10000000:2.0:1783135038.871433:0:14204:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1010000:0x0] (8/32) 00100000:10000000:2.0:1783135038.871497:0:14204:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 772: rc = 0 00100000:10000000:3.0:1783135038.874767:0:14204:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2010000:0x0] (8/32) 00100000:10000000:3.0:1783135038.874877:0:14204:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 772: rc = 0 00000020:00000080:3.0:1783135038.875166:0:14204:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:3.0:1783135038.875175:0:14204:0:(osd_handler.c:1569:osd_obd_connect()) connect #0 00000020:00000080:3.0:1783135038.875186:0:14204:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xd6c4b8f05867f5b8 00000020:01000004:3.0:1783135038.875194:0:14204:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:3.0:1783135038.875200:0:14204:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:3.0:1783135038.875206:0:14204:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9fe9f6f8d000 from MGS 00000020:01000004:3.0:1783135038.875209:0:14204:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:3.0:1783135038.875220:0:14204:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff9fe9d0e84d40) 00000020:00000080:3.0:1783135038.875230:0:14204:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:3.0:1783135038.875794:0:14204:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9fe9f6f8d000 from MGS, refs=2 00080000:01000000:3.0:1783135038.875802:0:14204:0:(osd_handler.c:1569:osd_obd_connect()) connect #1 00000020:00000080:3.0:1783135038.875809:0:14204:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xd6c4b8f05867f5c6 00000100:00100000:3.0:1783135038.875915:0:14204:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:3.0:1783135038.876035:0:14204:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:3.0:1783135038.876041:0:14204:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:0.0:1783135038.877191:0:14204:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:0.0:1783135038.877200:0:14204:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:0.0:1783135038.878082:0:14204:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1783135038.878227:0:14204:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:0.0:1783135038.878233:0:14204:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:2.0:1783135038.879238:0:14204:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:2.0:1783135038.879246:0:14204:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:2.0:1783135038.879711:0:14204:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:2.0:1783135038.879716:0:14204:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:0.0:1783135038.880622:0:14210:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783135038.880626:0:14210:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783135038.880627:0:14210:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783135038.880912:0:14211:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783135038.880915:0:14211:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783135038.880916:0:14211:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783135038.881823:0:14204:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:0.0:1783135038.887856:0:14210:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:2.0:1783135038.891996:0:14204:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:2.0:1783135038.892012:0:14204:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:2.0:1783135038.892015:0:14204:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:0.0:1783135038.910391:0:14213:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:2.0:1783135038.910671:0:14204:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:2.0:1783135038.910800:0:14204:0:(mgs_llog.c:683:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1783135038.911333:0:14204:0:(mgs_llog.c:683:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:2.0:1783135038.911641:0:14204:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1783135038.911791:0:14204:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:2.0:1783135038.911798:0:14204:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:0.0:1783135038.914431:0:14204:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:0.0:1783135038.914441:0:14204:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:3.0:1783135038.919917:0:14204:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:3.0:1783135038.919932:0:14204:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:0.0:1783135038.921072:0:14204:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:0.0:1783135038.921094:0:14204:0:(obd_mount.c:402:lustre_start_mgc()) Start MGC 'MGC192.168.201.141@tcp' 00000020:01000004:0.0:1783135038.921096:0:14204:0:(obd_mount.c:411:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:0.0:1783135038.921123:0:14204:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD MGC192.168.201.141@tcp (typ=mgc) 00000020:00000080:0.0:1783135038.921135:0:14204:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.201.141@tcp (ffff9fea00c40000) 00000020:00000080:0.0:1783135038.921150:0:14204:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:0.0:1783135038.921225:0:14204:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9fe8c57da800@MGC192.168.201.141@tcp: add connection 192.168.201.141@tcp at head 00010000:00010000:0.0:1783135038.921375:0:14204:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.201.141@tcp-0 is initialized 00000040:01000000:0.0:1783135038.921380:0:14204:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.141@tcp ctxt 1 is initialized 00000100:00080000:3.0:1783135038.921630:0:14218:0:(pinger.c:468:ping_evictor_main()) Starting Ping Evictor 10000000:01000000:0.0:1783135038.921755:0:14219:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:3.0:1783135038.922087:0:14204:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.201.141@tcp (uuid c1fe35bd-99cf-438e-8ada-ed586b673efa) 00000020:00000080:3.0:1783135038.922105:0:14204:0:(genops.c:1406:class_connect()) connect: client c1fe35bd-99cf-438e-8ada-ed586b673efa, cookie 0xd6c4b8f05867f5d4 00000100:00080000:3.0:1783135038.922119:0:14204:0:(import.c:512:import_select_connection()) MGC192.168.201.141@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1783135038.922123:0:14204:0:(import.c:626:import_select_connection()) MGC192.168.201.141@tcp: import ffff9fe8c57da800 using connection 192.168.201.141@tcp/0@lo 00000100:00100000:3.0:1783135038.922153:0:14204:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9fe9fea15c00 x1869752384427520/t0(0) o250->MGC192.168.201.141@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1783135038.922208:0:3285:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9fea15c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c1fe35bd-99cf-438e-8ada-ed586b673efa:3285:1869752384427520:0@lo:250:mount.lustre.0 00000100:00100000:1.0:1783135038.922267:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135038.922372:0:14215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384427520 00000100:00100000:0.0:1783135038.922377:0:14215:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384427520 00000100:00100000:0.0:1783135038.922401:0:14215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1783135038.922407:0:14215:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe8c5d82450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3285:x1869752384427520:12345-0@lo:250:mount.lustre.0 00010000:00080000:0.0:1783135038.922426:0:14215:0:(ldlm_lib.c:1432:target_handle_connect()) MGS: connection from c1fe35bd-99cf-438e-8ada-ed586b673efa@0@lo t0 exp 0000000000000000 cur 321 last 0 00000020:00000080:0.0:1783135038.922456:0:14215:0:(genops.c:1406:class_connect()) connect: client c1fe35bd-99cf-438e-8ada-ed586b673efa, cookie 0xd6c4b8f05867f5db 00000100:00080000:3.0:1783135038.922567:0:14204:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import c1fe35bd-99cf-438e-8ada-ed586b673efa->MGS 00000020:01000004:3.0:1783135038.922584:0:14204:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:3.0:1783135038.922588:0:14204:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:3.0:1783135038.922597:0:14204:0:(genops.c:413:class_newdev()) Allocate new device MDS (ffff9fe9d0e819c0) 00000020:00000080:3.0:1783135038.922606:0:14204:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00080000:0.0:1783135038.922614:0:14215:0:(import.c:65:import_set_state_nolock()) ffff9fe8c57da000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1783135038.922744:0:14215:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe8c5d82450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c1fe35bd-99cf-438e-8ada-ed586b673efa+5:3285:x1869752384427520:12345-0@lo:250:mount.lustre.0 Request processed in 335us (474us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135038.922752:0:14215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1783135038.922952:0:3285:0:(client.c:3111:ptlrpc_free_committed()) MGC192.168.201.141@tcp: committing for last_committed 0 gen 1 00000100:00080000:1.0:1783135038.922962:0:3285:0:(import.c:1134:ptlrpc_connect_interpret()) MGC192.168.201.141@tcp: connect to target with instance 0 00000100:00080000:1.0:1783135038.922969:0:3285:0:(import.c:961:ptlrpc_connect_set_flags()) MGC192.168.201.141@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:1.0:1783135038.922974:0:3285:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:1.0:1783135038.922977:0:3285:0:(import.c:65:import_set_state_nolock()) ffff9fe8c57da800 MGS: changing import state from CONNECTING to FULL 10000000:01000000:1.0:1783135038.922979:0:3285:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:1.0:1783135038.923023:0:3285:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:1.0:1783135038.923030:0:3285:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9fea15c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c1fe35bd-99cf-438e-8ada-ed586b673efa:3285:1869752384427520:0@lo:250:mount.lustre.0 00000100:00100000:3.0:1783135038.931252:0:14204:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1783135038.931537:0:14204:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:3.0:1783135038.931542:0:14204:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:0.0:1783135038.932409:0:14204:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:0.0:1783135038.932415:0:14204:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:0.0:1783135038.932728:0:14204:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:0.0:1783135038.932734:0:14204:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:0.0:1783135038.933422:0:14204:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1783135038.933645:0:14204:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:0.0:1783135038.933652:0:14204:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:0.0:1783135038.934223:0:14204:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:0.0:1783135038.934228:0:14204:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:2.0:1783135038.964257:0:14204:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1783135038.964539:0:14204:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:2.0:1783135038.964547:0:14204:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:2.0:1783135038.966060:0:14204:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:2.0:1783135038.966074:0:14204:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:0.0:1783135038.966920:0:14204:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1783135038.967081:0:14204:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:0.0:1783135038.967088:0:14204:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:0.0:1783135038.967904:0:14204:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:0.0:1783135038.967911:0:14204:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:0.0:1783135038.968447:0:14204:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1783135038.968663:0:14204:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:0.0:1783135038.968669:0:14204:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:0.0:1783135038.969054:0:14204:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:0.0:1783135038.969061:0:14204:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:0.0:1783135038.969902:0:14204:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1783135038.970045:0:14204:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:0.0:1783135038.970049:0:14204:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:0.0:1783135038.970831:0:14204:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:0.0:1783135038.970838:0:14204:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:1.0:1783135038.988873:0:14204:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1783135038.989062:0:14204:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:1.0:1783135038.989069:0:14204:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:1.0:1783135038.990566:0:14204:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:1.0:1783135038.990646:0:14204:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:1.0:1783135038.991479:0:14204:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:1.0:1783135038.991487:0:14204:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:1.0:1783135038.992548:0:14204:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:1.0:1783135038.992649:0:14204:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:1.0:1783135038.992656:0:14204:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.141@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:1.0:1783135038.992810:0:14204:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.141@tcp ctxt 0 is initialized 00000020:01000004:1.0:1783135038.992855:0:14204:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.201.141@tcp, index=0000, flags=0x20005 00000020:01000004:1.0:1783135038.992860:0:14204:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1783135038.992862:0:14204:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1783135038.992863:0:14204:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1783135038.992864:0:14204:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1783135038.992865:0:14204:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1783135038.992867:0:14204:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1783135038.992868:0:14204:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1783135038.992870:0:14204:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1783135038.992871:0:14204:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1783135038.992873:0:14204:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1783135038.992876:0:14204:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:1.0:1783135038.992878:0:14204:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1783135038.992879:0:14204:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1783135038.992880:0:14204:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1783135038.992881:0:14204:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1783135038.992882:0:14204:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1783135038.992883:0:14204:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1783135038.992884:0:14204:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1783135038.992885:0:14204:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1783135038.992886:0:14204:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1783135038.992887:0:14204:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1783135038.992914:0:14204:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:1.0:1783135038.992935:0:14204:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9fe958e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c1fe35bd-99cf-438e-8ada-ed586b673efa:14204:1869752384427648:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1783135038.993005:0:14204:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135038.993110:0:14204:0:(client.c:2701:ptlrpc_set_wait()) set ffff9fe9e2f3b240 going to sleep for 11 seconds 00000100:00100000:3.0:1783135038.993198:0:14217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384427648 00000100:00100000:3.0:1783135038.993205:0:14217:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384427648 00000100:00100000:3.0:1783135038.993314:0:14217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1783135038.993325:0:14217:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe8c5d80450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1fe35bd-99cf-438e-8ada-ed586b673efa+5:14204:x1869752384427648:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1783135038.993367:0:14217:0:(mgs_llog.c:683:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1783135038.993370:0:14217:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:3.0:1783135038.993373:0:14217:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 10000000:01000000:3.0:1783135038.993733:0:14238:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:1.0:1783135038.994064:0:14217:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 5 20000000:01000000:3.0:1783135038.995117:0:14239:0:(mgs_llog.c:341:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:3.0:1783135038.995122:0:14239:0:(mgs_llog.c:325:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:3.0:1783135038.995124:0:14239:0:(mgs_llog.c:325:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:3.0:1783135038.995152:0:14239:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 20000000:01000000:1.0:1783135038.995408:0:14217:0:(mgs_llog.c:683:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1783135038.995417:0:14217:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:1.0:1783135039.010667:0:14217:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe8c5d80450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1fe35bd-99cf-438e-8ada-ed586b673efa+5:14204:x1869752384427648:12345-0@lo:253:mount.lustre.0 Request processed in 17333us (17651us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135039.010686:0:14217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1783135039.010969:0:14204:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9fe958e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c1fe35bd-99cf-438e-8ada-ed586b673efa:14204:1869752384427648:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1783135039.010981:0:14204:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1783135039.010996:0:14204:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1783135039.010997:0:14204:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1783135039.010998:0:14204:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1783135039.010999:0:14204:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1783135039.011000:0:14204:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1783135039.011001:0:14204:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1783135039.011002:0:14204:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1783135039.011003:0:14204:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1783135039.011004:0:14204:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1783135039.011005:0:14204:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1783135039.011020:0:14204:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9fe9f6f8d000 from lustre-MDT0000 10000000:01000000:2.0:1783135039.011041:0:14204:0:(mgc_request.c:1945:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:2.0:1783135039.011043:0:14204:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1783135039.011047:0:14204:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff9fea00c40000 10000000:01000000:2.0:1783135039.011049:0:14204:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1783135039.011055:0:14204:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-sptlrpc-ffff9fea00c40000 from 1 10000000:01000000:2.0:1783135039.011057:0:14204:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1783135039.011087:0:14204:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.141@tcp lock: ffff9fe9c7829a00/0xd6c4b8f05867f5e9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135039.011095:0:14204:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.141@tcp lock: ffff9fe9c7829a00/0xd6c4b8f05867f5e9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135039.011102:0:14204:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.141@tcp lock: ffff9fe9c7829a00/0xd6c4b8f05867f5e9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783135039.011116:0:14204:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9f6cb3800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c1fe35bd-99cf-438e-8ada-ed586b673efa:14204:1869752384427776:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1783135039.011144:0:14204:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135039.011903:0:14204:0:(client.c:2701:ptlrpc_set_wait()) set ffff9fe9cbbbcf00 going to sleep for 11 seconds 00000100:00100000:1.0:1783135039.011943:0:14216:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384427776 00000100:00100000:1.0:1783135039.011950:0:14216:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384427776 00000100:00100000:1.0:1783135039.012036:0:14216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1783135039.012045:0:14216:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe8c5d82050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1fe35bd-99cf-438e-8ada-ed586b673efa+5:14204:x1869752384427776:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1783135039.012055:0:14216:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783135039.012070:0:14216:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fe9fe43e800/0xd6c4b8f05867f5f0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd6c4b8f05867f5e9 expref: -99 pid: 14216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135039.012093:0:14216:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fe9fe43e800/0xd6c4b8f05867f5f0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd6c4b8f05867f5e9 expref: 6 pid: 14216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135039.012103:0:14216:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fe9fe43e800/0xd6c4b8f05867f5f0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd6c4b8f05867f5e9 expref: 6 pid: 14216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135039.012112:0:14216:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fe9fe43e800, rc 0) 00000100:00100000:1.0:1783135039.012192:0:14216:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe8c5d82050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1fe35bd-99cf-438e-8ada-ed586b673efa+6:14204:x1869752384427776:12345-0@lo:101:mount.lustre.0 Request processed in 148us (1046us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135039.012199:0:14216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1783135039.012354:0:14204:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9f6cb3800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c1fe35bd-99cf-438e-8ada-ed586b673efa:14204:1869752384427776:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1783135039.012369:0:14204:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.141@tcp lock: ffff9fe9c7829a00/0xd6c4b8f05867f5e9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd6c4b8f05867f5f0 expref: -99 pid: 14204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135039.012391:0:14204:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.141@tcp lock: ffff9fe9c7829a00/0xd6c4b8f05867f5e9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd6c4b8f05867f5f0 expref: -99 pid: 14204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783135039.012456:0:14204:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9f6cb3800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c1fe35bd-99cf-438e-8ada-ed586b673efa:14204:1869752384427904:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1783135039.012482:0:14204:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135039.012713:0:14204:0:(client.c:2701:ptlrpc_set_wait()) set ffff9fe9cbbbcf00 going to sleep for 11 seconds 00000100:00100000:0.0:1783135039.012803:0:14215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384427904 00000100:00100000:0.0:1783135039.012808:0:14215:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384427904 00000100:00100000:0.0:1783135039.012835:0:14215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1783135039.012848:0:14215:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe8c5d82850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c1fe35bd-99cf-438e-8ada-ed586b673efa+6:14204:x1869752384427904:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1783135039.013126:0:14215:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe8c5d82850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c1fe35bd-99cf-438e-8ada-ed586b673efa+6:14204:x1869752384427904:12345-0@lo:501:mount.lustre.0 Request processed in 278us (642us total) trans 0 rc -2/-2 00000100:00100000:0.0:1783135039.013134:0:14215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1783135039.013213:0:14204:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9f6cb3800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c1fe35bd-99cf-438e-8ada-ed586b673efa:14204:1869752384427904:0@lo:501:mount.lustre.0 10000000:01000000:2.0:1783135039.013238:0:14204:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.201.141@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1783135039.013361:0:14204:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.141@tcp lock: ffff9fe9c7829a00/0xd6c4b8f05867f5e9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd6c4b8f05867f5f0 expref: -99 pid: 14204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135039.013371:0:14204:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.141@tcp lock: ffff9fe9c7829a00/0xd6c4b8f05867f5e9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd6c4b8f05867f5f0 expref: -99 pid: 14204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783135039.013379:0:14204:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9fe9f6f8d000 10000000:01000000:2.0:1783135039.013384:0:14204:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1783135039.013388:0:14204:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff9fe9f6f8d000 10000000:01000000:2.0:1783135039.013390:0:14204:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:2.0:1783135039.013393:0:14204:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-barrier-ffff9fe9f6f8d000 from 1 10000000:01000000:2.0:1783135039.013395:0:14204:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:2.0:1783135039.013416:0:14204:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.141@tcp lock: ffff9fe9c7829200/0xd6c4b8f05867f5f7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135039.013424:0:14204:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.141@tcp lock: ffff9fe9c7829200/0xd6c4b8f05867f5f7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135039.013498:0:14204:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.141@tcp lock: ffff9fe9c7829200/0xd6c4b8f05867f5f7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783135039.013530:0:14204:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9f6cb3800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c1fe35bd-99cf-438e-8ada-ed586b673efa:14204:1869752384428032:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1783135039.013664:0:14204:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135039.013698:0:14204:0:(client.c:2701:ptlrpc_set_wait()) set ffff9fe9cbbbcf00 going to sleep for 11 seconds 00000100:00100000:3.0:1783135039.013702:0:14217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384428032 00000100:00100000:3.0:1783135039.013709:0:14217:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384428032 00000100:00100000:3.0:1783135039.013750:0:14217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1783135039.013758:0:14217:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe8c5d81850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1fe35bd-99cf-438e-8ada-ed586b673efa+6:14204:x1869752384428032:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1783135039.013768:0:14217:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783135039.013782:0:14217:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fe9d2b75000/0xd6c4b8f05867f5fe lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd6c4b8f05867f5f7 expref: -99 pid: 14217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135039.013808:0:14217:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fe9d2b75000/0xd6c4b8f05867f5fe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd6c4b8f05867f5f7 expref: 7 pid: 14217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135039.013819:0:14217:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fe9d2b75000/0xd6c4b8f05867f5fe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd6c4b8f05867f5f7 expref: 7 pid: 14217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135039.013828:0:14217:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fe9d2b75000, rc 0) 00000100:00100000:3.0:1783135039.013869:0:14217:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe8c5d81850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1fe35bd-99cf-438e-8ada-ed586b673efa+7:14204:x1869752384428032:12345-0@lo:101:mount.lustre.0 Request processed in 112us (205us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135039.013876:0:14217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1783135039.013897:0:14204:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9f6cb3800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c1fe35bd-99cf-438e-8ada-ed586b673efa:14204:1869752384428032:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1783135039.013910:0:14204:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.141@tcp lock: ffff9fe9c7829200/0xd6c4b8f05867f5f7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd6c4b8f05867f5fe expref: -99 pid: 14204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135039.013918:0:14204:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.141@tcp lock: ffff9fe9c7829200/0xd6c4b8f05867f5f7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd6c4b8f05867f5fe expref: -99 pid: 14204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783135039.013929:0:14204:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.201.141@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:2.0:1783135039.013943:0:14204:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.141@tcp lock: ffff9fe9c7829200/0xd6c4b8f05867f5f7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd6c4b8f05867f5fe expref: -99 pid: 14204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135039.013951:0:14204:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.141@tcp lock: ffff9fe9c7829200/0xd6c4b8f05867f5f7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd6c4b8f05867f5fe expref: -99 pid: 14204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783135039.013957:0:14204:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1783135039.013961:0:14204:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1783135039.013966:0:14204:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff9fe9f6f8d000 10000000:01000000:2.0:1783135039.013968:0:14204:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:2.0:1783135039.013971:0:14204:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:2.0:1783135039.013973:0:14204:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1783135039.013985:0:14204:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.141@tcp lock: ffff9fe9c7828000/0xd6c4b8f05867f605 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135039.013992:0:14204:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.141@tcp lock: ffff9fe9c7828000/0xd6c4b8f05867f605 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135039.014007:0:14204:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.141@tcp lock: ffff9fe9c7828000/0xd6c4b8f05867f605 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783135039.014019:0:14204:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9f6cb3800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c1fe35bd-99cf-438e-8ada-ed586b673efa:14204:1869752384428160:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1783135039.014044:0:14204:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135039.014065:0:14204:0:(client.c:2701:ptlrpc_set_wait()) set ffff9fe9cbbbcf00 going to sleep for 11 seconds 00000100:00100000:1.0:1783135039.014111:0:14216:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384428160 00000100:00100000:1.0:1783135039.014116:0:14216:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384428160 00000100:00100000:1.0:1783135039.014146:0:14216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1783135039.014154:0:14216:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe8c5d83850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1fe35bd-99cf-438e-8ada-ed586b673efa+7:14204:x1869752384428160:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1783135039.014168:0:14216:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783135039.014176:0:14216:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fe9fe43f000/0xd6c4b8f05867f60c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xd6c4b8f05867f605 expref: -99 pid: 14216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135039.014190:0:14216:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fe9fe43f000/0xd6c4b8f05867f60c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd6c4b8f05867f605 expref: 8 pid: 14216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135039.014198:0:14216:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fe9fe43f000/0xd6c4b8f05867f60c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd6c4b8f05867f605 expref: 8 pid: 14216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135039.014205:0:14216:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fe9fe43f000, rc 0) 00000100:00100000:1.0:1783135039.014243:0:14216:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe8c5d83850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1fe35bd-99cf-438e-8ada-ed586b673efa+8:14204:x1869752384428160:12345-0@lo:101:mount.lustre.0 Request processed in 90us (198us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135039.014249:0:14216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1783135039.014353:0:14204:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9f6cb3800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c1fe35bd-99cf-438e-8ada-ed586b673efa:14204:1869752384428160:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1783135039.014367:0:14204:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.141@tcp lock: ffff9fe9c7828000/0xd6c4b8f05867f605 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd6c4b8f05867f60c expref: -99 pid: 14204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135039.014376:0:14204:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.141@tcp lock: ffff9fe9c7828000/0xd6c4b8f05867f605 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xd6c4b8f05867f60c expref: -99 pid: 14204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783135039.014420:0:14204:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9fea15500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c1fe35bd-99cf-438e-8ada-ed586b673efa:14204:1869752384428288:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1783135039.014446:0:14204:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135039.014476:0:14204:0:(client.c:2701:ptlrpc_set_wait()) set ffff9fe9ca810180 going to sleep for 11 seconds 00000100:00100000:1.0:1783135039.014514:0:14217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384428288 00000100:00100000:1.0:1783135039.014529:0:14217:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384428288 00000100:00100000:1.0:1783135039.014575:0:14217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1783135039.014582:0:14217:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe8c5d81050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1fe35bd-99cf-438e-8ada-ed586b673efa+8:14204:x1869752384428288:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1783135039.014912:0:14217:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe8c5d81050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1fe35bd-99cf-438e-8ada-ed586b673efa+9:14204:x1869752384428288:12345-0@lo:501:mount.lustre.0 Request processed in 330us (464us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135039.014919:0:14217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1783135039.015399:0:14204:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9fea15500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c1fe35bd-99cf-438e-8ada-ed586b673efa:14204:1869752384428288:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1783135039.015464:0:14204:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9f6cb1f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c1fe35bd-99cf-438e-8ada-ed586b673efa:14204:1869752384428416:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1783135039.015515:0:14204:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135039.017725:0:14204:0:(client.c:2701:ptlrpc_set_wait()) set ffff9fe9cbbbccc0 going to sleep for 11 seconds 00000100:00100000:1.0:1783135039.017972:0:14215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384428416 00000100:00100000:1.0:1783135039.017982:0:14215:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384428416 00000100:00100000:1.0:1783135039.018050:0:14215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1783135039.018061:0:14215:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe8c5d80050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c1fe35bd-99cf-438e-8ada-ed586b673efa+9:14204:x1869752384428416:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1783135039.018580:0:14215:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe8c5d80050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c1fe35bd-99cf-438e-8ada-ed586b673efa+9:14204:x1869752384428416:12345-0@lo:503:mount.lustre.0 Request processed in 511us (3054us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135039.018595:0:14215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1783135039.018765:0:14204:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9f6cb1f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c1fe35bd-99cf-438e-8ada-ed586b673efa:14204:1869752384428416:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1783135039.019197:0:14241:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe8c6dfce00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c1fe35bd-99cf-438e-8ada-ed586b673efa:14241:1869752384428544:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783135039.019244:0:14241:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135039.019313:0:14241:0:(client.c:2701:ptlrpc_set_wait()) set ffff9fe9e0436540 going to sleep for 11 seconds 00000100:00100000:2.0:1783135039.019369:0:14216:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384428544 00000100:00100000:2.0:1783135039.019374:0:14216:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384428544 00000100:00100000:2.0:1783135039.019403:0:14216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1783135039.019411:0:14216:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe8c5d83450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1fe35bd-99cf-438e-8ada-ed586b673efa+9:14241:x1869752384428544:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783135039.019783:0:14216:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe8c5d83450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1fe35bd-99cf-438e-8ada-ed586b673efa+9:14241:x1869752384428544:12345-0@lo:502:llog_process_th.0 Request processed in 372us (538us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135039.019790:0:14216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1783135039.020438:0:14241:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe8c6dfce00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c1fe35bd-99cf-438e-8ada-ed586b673efa:14241:1869752384428544:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1783135039.020467:0:14241:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1783135039.020478:0:14241:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783135039.020481:0:14241:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:0.0:1783135039.020488:0:14241:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:0.0:1783135039.020491:0:14241:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1783135039.020504:0:14241:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff9fea00c43380) 00000020:00000080:0.0:1783135039.020531:0:14241:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:0.0:1783135039.020538:0:14241:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00080000:01000000:0.0:1783135039.020677:0:14241:0:(osd_handler.c:1569:osd_obd_connect()) connect #2 00000020:00000080:0.0:1783135039.020687:0:14241:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xd6c4b8f05867f61a 00000020:00000080:0.0:1783135039.020916:0:14241:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:0.0:1783135039.020921:0:14241:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1783135039.020925:0:14241:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783135039.020927:0:14241:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:0.0:1783135039.020930:0:14241:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1783135039.020933:0:14241:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783135039.020934:0:14241:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:0.0:1783135039.020938:0:14241:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1783135039.020945:0:14241:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff9fea00c419c0) 00000020:00000080:0.0:1783135039.020960:0:14241:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:0.0:1783135039.020965:0:14241:0:(obd_config.c:1470:class_process_config()) processing cmd: cf007 00000020:00000080:0.0:1783135039.020968:0:14241:0:(obd_config.c:1514:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:0.0:1783135039.020970:0:14241:0:(obd_config.c:1148:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:0.0:1783135039.020976:0:14241:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1783135039.021032:0:14241:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9fe9f6f8d000 from lustre-MDT0000, refs=3 00000020:00000080:0.0:1783135039.021043:0:14241:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff9fea00c44d40) 00000020:00000080:0.0:1783135039.021050:0:14241:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:0.0:1783135039.021097:0:14241:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:0.0:1783135039.021102:0:14241:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xd6c4b8f05867f62f 00000020:00000080:0.0:1783135039.021183:0:14241:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:0.0:1783135039.021189:0:14241:0:(mdd_device.c:1596:mdd_obd_connect()) connect #0 00000020:00000080:0.0:1783135039.021193:0:14241:0:(genops.c:1406:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0xd6c4b8f05867f636 00080000:01000000:0.0:1783135039.021198:0:14241:0:(osd_handler.c:1569:osd_obd_connect()) connect #3 00000020:00000080:0.0:1783135039.021201:0:14241:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xd6c4b8f05867f63d 00010000:00010000:2.0:1783135039.073506:0:14241:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:00000004:2.0:1783135039.073969:0:14241:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 4294967526 00000001:00080000:2.0:1783135039.074323:0:14241:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:2.0:1783135039.074889:0:14241:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff9fe8c57c19c0) 00000020:00000080:2.0:1783135039.074906:0:14241:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:2.0:1783135039.074971:0:14241:0:(osd_handler.c:1569:osd_obd_connect()) connect #4 00000020:00000080:2.0:1783135039.074977:0:14241:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xd6c4b8f05867f64b 00000020:00000080:3.0:1783135039.077458:0:14241:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:3.0:1783135039.082962:0:14241:0:(genops.c:1406:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0xd6c4b8f05867f652 00000020:00000080:3.0:1783135039.086347:0:14241:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:3.0:1783135039.086361:0:14241:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1783135039.086368:0:14241:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783135039.086370:0:14241:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:3.0:1783135039.086373:0:14241:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1783135039.086381:0:14241:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #8 00000020:01000000:3.0:1783135039.086382:0:14241:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1783135039.086384:0:14241:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1783135039.086385:0:14241:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1783135039.086388:0:14241:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783135039.086389:0:14241:0:(obd_config.c:1561:class_process_config()) marker 8 (0x6) lustre sys.timeout 00000020:01000000:3.0:1783135039.086392:0:14241:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1783135039.086396:0:14241:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783135039.086398:0:14241:0:(obd_config.c:1561:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:3.0:1783135039.086402:0:14241:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000004:01000000:3.0:1783135039.086444:0:14241:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:3.0:1783135039.086459:0:14241:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1783135039.086462:0:14241:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783135039.086463:0:14241:0:(obd_config.c:1561:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:3.0:1783135039.086466:0:14241:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1783135039.086469:0:14241:0:(obd_mount.c:952:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:3.0:1783135039.086473:0:14241:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783135039.086474:0:14241:0:(obd_config.c:1561:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:3.0:1783135039.086477:0:14241:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1783135039.086481:0:14241:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.201.141@tcp to nid 0x20000c0a8c98d (192.168.201.141@tcp) 00000020:01000000:3.0:1783135039.086508:0:14241:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1783135039.086511:0:14241:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1783135039.086536:0:14241:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff9fe9d0e83380) 00000020:00000080:3.0:1783135039.086553:0:14241:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:3.0:1783135039.086558:0:14241:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1783135039.086609:0:14241:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:3.0:1783135039.086614:0:14241:0:(osd_handler.c:1569:osd_obd_connect()) connect #5 00000020:00000080:3.0:1783135039.086620:0:14241:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xd6c4b8f05867f660 00010000:00080000:3.0:1783135039.086649:0:14241:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9fe9c979c800@lustre-OST0000-osc-MDT0000: add connection 192.168.201.141@tcp at head 00010000:00010000:3.0:1783135039.086863:0:14241:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-1 is initialized 00000040:01000000:3.0:1783135039.088686:0:14241:0:(llog_osd.c:2237:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:3.0:1783135039.088737:0:14241:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:3.0:1783135039.092638:0:14241:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1783135039.092719:0:14241:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].2, 64 off8320 00000040:00080000:3.0:1783135039.092799:0:14241:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1, 64 off8256 00000040:00080000:3.0:1783135039.098514:0:14245:0:(llog.c:800:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1783135039.098532:0:14245:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 2 of catalog [0x1:0x2:0x0] 00000020:00000080:2.0:1783135039.099398:0:14241:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1783135039.099410:0:14241:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1783135039.099453:0:14241:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:2.0:1783135039.099471:0:14241:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xd6c4b8f05867f667 00000100:00080000:2.0:1783135039.099482:0:14241:0:(import.c:512:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1783135039.099488:0:14241:0:(import.c:626:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9fe9c979c800 using connection 192.168.201.141@tcp/0@lo 00000100:00100000:2.0:1783135039.099535:0:14241:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9fe9f6cb0380 x1869752384428672/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1783135039.099559:0:14241:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00100000:1.0:1783135039.099598:0:3285:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9f6cb0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3285:1869752384428672:0@lo:8:llog_process_th.0 00000020:01000000:2.0:1783135039.099634:0:14241:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1783135039.099639:0:14241:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783135039.099641:0:14241:0:(obd_config.c:1561:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:2.0:1783135039.099645:0:14241:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1783135039.099648:0:14241:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #14 00000020:01000000:2.0:1783135039.099649:0:14241:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1783135039.099651:0:14241:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1783135039.099653:0:14241:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1783135039.099657:0:14241:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000400:00000100:1.0:1783135039.099657:0:3285:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1869752384428672 offset 0 length 520: 4 00000020:00000080:2.0:1783135039.099660:0:14241:0:(obd_config.c:1561:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:2.0:1783135039.099662:0:14241:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1783135039.099667:0:14241:0:(obd_mount.c:952:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:2.0:1783135039.099672:0:14241:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783135039.099674:0:14241:0:(obd_config.c:1561:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:2.0:1783135039.099677:0:14241:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1783135039.099681:0:14241:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.201.141@tcp to nid 0x20000c0a8c98d (192.168.201.141@tcp) 00000020:01000000:2.0:1783135039.099702:0:14241:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1783135039.099705:0:14241:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1783135039.099716:0:14241:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff9fe8c57c0000) 00000020:00000080:2.0:1783135039.099728:0:14241:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:2.0:1783135039.099738:0:14241:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1783135039.099796:0:14241:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:2.0:1783135039.099801:0:14241:0:(osd_handler.c:1569:osd_obd_connect()) connect #6 00000020:00000080:2.0:1783135039.099807:0:14241:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xd6c4b8f05867f675 00010000:00080000:2.0:1783135039.099833:0:14241:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9fe9f5c91000@lustre-OST0001-osc-MDT0000: add connection 192.168.201.141@tcp at head 00010000:00010000:2.0:1783135039.100014:0:14241:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-2 is initialized 00000040:01000000:2.0:1783135039.100390:0:14241:0:(llog_osd.c:2237:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1783135039.100412:0:14241:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:2.0:1783135039.100691:0:14241:0:(llog_cat.c:1213:llog_cat_set_first_idx()) catlog [0x1:0x5:0x0] first idx 0, last_idx 1 00000040:00080000:2.0:1783135039.101016:0:14241:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1783135039.101759:0:14241:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].2, 64 off8320 00000040:00080000:2.0:1783135039.101854:0:14241:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].1, 64 off8256 00000040:00080000:0.0:1783135039.102868:0:14247:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 2 synced_idx: 0 lgh_last_idx: 2 00000040:00080000:0.0:1783135039.102873:0:14247:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000020:00000080:2.0:1783135039.104539:0:14241:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1783135039.104550:0:14241:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1783135039.104591:0:14241:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:2.0:1783135039.104608:0:14241:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xd6c4b8f05867f67c 00000100:00080000:2.0:1783135039.104619:0:14241:0:(import.c:512:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1783135039.104624:0:14241:0:(import.c:626:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9fe9f5c91000 using connection 192.168.201.141@tcp/0@lo 00000100:00100000:2.0:1783135039.104657:0:14241:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9fe9f6cb0a80 x1869752384428800/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1783135039.104688:0:14241:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00100000:1.0:1783135039.104725:0:3285:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9f6cb0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3285:1869752384428800:0@lo:8:llog_process_th.0 00000020:01000000:2.0:1783135039.104738:0:14241:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1783135039.104744:0:14241:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783135039.104746:0:14241:0:(obd_config.c:1561:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:2.0:1783135039.104748:0:14241:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1783135039.104752:0:14241:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783135039.104753:0:14241:0:(obd_config.c:1561:class_process_config()) marker 21 (0x1) lustre sys.timeout 00000020:00000080:2.0:1783135039.104757:0:14241:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1783135039.104758:0:14241:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1783135039.104760:0:14241:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1783135039.104763:0:14241:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783135039.104777:0:14241:0:(obd_config.c:1561:class_process_config()) marker 21 (0x2) lustre sys.timeout 00000020:01000000:2.0:1783135039.104780:0:14241:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1783135039.104783:0:14241:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000400:00000100:1.0:1783135039.104784:0:3285:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1869752384428800 offset 0 length 520: 4 00000020:00000080:2.0:1783135039.104785:0:14241:0:(obd_config.c:1561:class_process_config()) marker 25 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1783135039.104790:0:14241:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:2.0:1783135039.104821:0:14241:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9f6cb0000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c1fe35bd-99cf-438e-8ada-ed586b673efa:14241:1869752384428928:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783135039.104869:0:14241:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135039.104887:0:14241:0:(client.c:2701:ptlrpc_set_wait()) set ffff9fe9cbbbccc0 going to sleep for 11 seconds 00000100:00100000:2.0:1783135039.104906:0:14215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384428928 00000100:00100000:2.0:1783135039.104912:0:14215:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384428928 00000100:00100000:2.0:1783135039.104948:0:14215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1783135039.104955:0:14215:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe8c5d82c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c1fe35bd-99cf-438e-8ada-ed586b673efa+9:14241:x1869752384428928:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783135039.106444:0:14215:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe8c5d82c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c1fe35bd-99cf-438e-8ada-ed586b673efa+9:14241:x1869752384428928:12345-0@lo:502:llog_process_th.0 Request processed in 480us (566us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135039.106678:0:14215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1783135039.106764:0:14241:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9f6cb0000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c1fe35bd-99cf-438e-8ada-ed586b673efa:14241:1869752384428928:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1783135039.106796:0:14241:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1783135039.106804:0:14241:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783135039.106806:0:14241:0:(obd_config.c:1561:class_process_config()) marker 25 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1783135039.106812:0:14241:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:2.0:1783135039.106939:0:14204:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-36 (rc=0) 10000000:01000000:2.0:1783135039.106960:0:14204:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.201.141@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1783135039.106982:0:14204:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.141@tcp lock: ffff9fe9c7828000/0xd6c4b8f05867f605 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd6c4b8f05867f60c expref: -99 pid: 14204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135039.106993:0:14204:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.141@tcp lock: ffff9fe9c7828000/0xd6c4b8f05867f605 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd6c4b8f05867f60c expref: -99 pid: 14204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783135039.107000:0:14204:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-mdtir-ffff9fe9f6f8d000 from 1 10000000:01000000:2.0:1783135039.107011:0:14204:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1783135039.107357:0:14204:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.141@tcp lock: ffff9fe9c7828800/0xd6c4b8f05867f683 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135039.107367:0:14204:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.141@tcp lock: ffff9fe9c7828800/0xd6c4b8f05867f683 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135039.107376:0:14204:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.141@tcp lock: ffff9fe9c7828800/0xd6c4b8f05867f683 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783135039.107396:0:14204:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9f6cb0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c1fe35bd-99cf-438e-8ada-ed586b673efa:14204:1869752384429056:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1783135039.107601:0:14204:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135039.107640:0:14204:0:(client.c:2701:ptlrpc_set_wait()) set ffff9fe9cbbbccc0 going to sleep for 11 seconds 00000100:00100000:1.0:1783135039.107691:0:14217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384429056 00000100:00100000:1.0:1783135039.107698:0:14217:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384429056 00000100:00100000:1.0:1783135039.107765:0:14217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1783135039.107773:0:14217:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe8c5d81450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1fe35bd-99cf-438e-8ada-ed586b673efa+9:14204:x1869752384429056:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1783135039.107786:0:14217:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783135039.107798:0:14217:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fe9fe43ee00/0xd6c4b8f05867f68a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd6c4b8f05867f683 expref: -99 pid: 14217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135039.107820:0:14217:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fe9fe43ee00/0xd6c4b8f05867f68a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd6c4b8f05867f683 expref: 10 pid: 14217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135039.107830:0:14217:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fe9fe43ee00/0xd6c4b8f05867f68a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd6c4b8f05867f683 expref: 10 pid: 14217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135039.107840:0:14217:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fe9fe43ee00, rc 0) 00000100:00100000:1.0:1783135039.107886:0:14217:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe8c5d81450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1fe35bd-99cf-438e-8ada-ed586b673efa+10:14204:x1869752384429056:12345-0@lo:101:mount.lustre.0 Request processed in 114us (286us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135039.107893:0:14217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1783135039.107969:0:14204:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9f6cb0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c1fe35bd-99cf-438e-8ada-ed586b673efa:14204:1869752384429056:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1783135039.107982:0:14204:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.141@tcp lock: ffff9fe9c7828800/0xd6c4b8f05867f683 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd6c4b8f05867f68a expref: -99 pid: 14204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135039.107990:0:14204:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.141@tcp lock: ffff9fe9c7828800/0xd6c4b8f05867f683 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd6c4b8f05867f68a expref: -99 pid: 14204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783135039.108605:0:14204:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe8c6dfce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c1fe35bd-99cf-438e-8ada-ed586b673efa:14204:1869752384429184:0@lo:256:mount.lustre.0 00000100:00100000:0.0:1783135039.108648:0:14204:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135039.109722:0:14204:0:(client.c:2701:ptlrpc_set_wait()) set ffff9fe9e9d2a900 going to sleep for 11 seconds 00000100:00100000:2.0:1783135039.112443:0:14216:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384429184 00000100:00100000:2.0:1783135039.112458:0:14216:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384429184 00000100:00100000:2.0:1783135039.112513:0:14216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1783135039.112540:0:14216:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe8c5d83050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1fe35bd-99cf-438e-8ada-ed586b673efa+10:14204:x1869752384429184:12345-0@lo:256:mount.lustre.0 20000000:01000000:2.0:1783135039.112628:0:14216:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:2.0:1783135039.112635:0:14216:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:2.0:1783135039.112837:0:14216:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe8c5d83050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1fe35bd-99cf-438e-8ada-ed586b673efa+10:14204:x1869752384429184:12345-0@lo:256:mount.lustre.0 Request processed in 299us (4186us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135039.112846:0:14216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1783135039.113209:0:14204:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe8c6dfce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c1fe35bd-99cf-438e-8ada-ed586b673efa:14204:1869752384429184:0@lo:256:mount.lustre.0 10000000:01000000:0.0:1783135039.113822:0:14204:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.201.141@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1783135039.113855:0:14204:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.141@tcp lock: ffff9fe9c7828800/0xd6c4b8f05867f683 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd6c4b8f05867f68a expref: -99 pid: 14204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135039.113909:0:14204:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.141@tcp lock: ffff9fe9c7828800/0xd6c4b8f05867f683 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd6c4b8f05867f68a expref: -99 pid: 14204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783135039.113919:0:14204:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff9fe9f6f8d000 from 1 10000000:01000000:0.0:1783135039.113922:0:14204:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1783135039.113957:0:14204:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.141@tcp lock: ffff9fe9f68ad600/0xd6c4b8f05867f691 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135039.113966:0:14204:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.141@tcp lock: ffff9fe9f68ad600/0xd6c4b8f05867f691 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135039.113975:0:14204:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.141@tcp lock: ffff9fe9f68ad600/0xd6c4b8f05867f691 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783135039.113996:0:14204:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe8c6dfce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c1fe35bd-99cf-438e-8ada-ed586b673efa:14204:1869752384429312:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1783135039.114038:0:14204:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135039.114067:0:14204:0:(client.c:2701:ptlrpc_set_wait()) set ffff9fe9e9d2a900 going to sleep for 11 seconds 00000100:00100000:2.0:1783135039.114567:0:14216:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384429312 00000100:00100000:2.0:1783135039.114574:0:14216:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384429312 00000100:00100000:2.0:1783135039.114605:0:14216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1783135039.114613:0:14216:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe8c5d83c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1fe35bd-99cf-438e-8ada-ed586b673efa+10:14204:x1869752384429312:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1783135039.114625:0:14216:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783135039.114638:0:14216:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fe9c7829e00/0xd6c4b8f05867f698 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd6c4b8f05867f691 expref: -99 pid: 14216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135039.114672:0:14216:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fe9c7829e00/0xd6c4b8f05867f698 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd6c4b8f05867f691 expref: 11 pid: 14216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135039.114682:0:14216:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fe9c7829e00/0xd6c4b8f05867f698 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd6c4b8f05867f691 expref: 11 pid: 14216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135039.114691:0:14216:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fe9c7829e00, rc 0) 00000100:00100000:2.0:1783135039.114732:0:14216:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe8c5d83c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1fe35bd-99cf-438e-8ada-ed586b673efa+11:14204:x1869752384429312:12345-0@lo:101:mount.lustre.0 Request processed in 120us (694us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135039.114739:0:14216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1783135039.114817:0:14204:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe8c6dfce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c1fe35bd-99cf-438e-8ada-ed586b673efa:14204:1869752384429312:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1783135039.114829:0:14204:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.141@tcp lock: ffff9fe9f68ad600/0xd6c4b8f05867f691 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd6c4b8f05867f698 expref: -99 pid: 14204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135039.114838:0:14204:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.141@tcp lock: ffff9fe9f68ad600/0xd6c4b8f05867f691 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd6c4b8f05867f698 expref: -99 pid: 14204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783135039.114886:0:14204:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe8c6dfce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c1fe35bd-99cf-438e-8ada-ed586b673efa:14204:1869752384429440:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1783135039.114910:0:14204:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135039.114932:0:14204:0:(client.c:2701:ptlrpc_set_wait()) set ffff9fe9e9d2a900 going to sleep for 11 seconds 00000100:00100000:2.0:1783135039.114983:0:14216:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384429440 00000100:00100000:2.0:1783135039.114987:0:14216:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384429440 00000100:00100000:2.0:1783135039.115003:0:14216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1783135039.115008:0:14216:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe8c5d81c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1fe35bd-99cf-438e-8ada-ed586b673efa+11:14204:x1869752384429440:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1783135039.115394:0:14216:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe8c5d81c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1fe35bd-99cf-438e-8ada-ed586b673efa+11:14204:x1869752384429440:12345-0@lo:501:mount.lustre.0 Request processed in 384us (482us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135039.115401:0:14216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1783135039.115478:0:14204:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe8c6dfce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c1fe35bd-99cf-438e-8ada-ed586b673efa:14204:1869752384429440:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1783135039.115503:0:14204:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe8c6dfce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c1fe35bd-99cf-438e-8ada-ed586b673efa:14204:1869752384429568:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1783135039.115550:0:14204:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135039.115570:0:14204:0:(client.c:2701:ptlrpc_set_wait()) set ffff9fe9e9d2a900 going to sleep for 11 seconds 00000100:00100000:2.0:1783135039.115665:0:14216:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384429568 00000100:00100000:2.0:1783135039.115670:0:14216:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384429568 00000100:00100000:2.0:1783135039.115688:0:14216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1783135039.115694:0:14216:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe8c5d80c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1fe35bd-99cf-438e-8ada-ed586b673efa+11:14204:x1869752384429568:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1783135039.115827:0:14216:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe8c5d80c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1fe35bd-99cf-438e-8ada-ed586b673efa+11:14204:x1869752384429568:12345-0@lo:503:mount.lustre.0 Request processed in 133us (276us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135039.115833:0:14216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1783135039.116731:0:14204:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe8c6dfce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c1fe35bd-99cf-438e-8ada-ed586b673efa:14204:1869752384429568:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1783135039.117623:0:14249:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe8c6dfce00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c1fe35bd-99cf-438e-8ada-ed586b673efa:14249:1869752384429696:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783135039.117677:0:14249:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135039.117717:0:14249:0:(client.c:2701:ptlrpc_set_wait()) set ffff9fe9e9d2a900 going to sleep for 11 seconds 00000100:00100000:2.0:1783135039.117765:0:14216:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384429696 00000100:00100000:2.0:1783135039.117771:0:14216:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384429696 00000100:00100000:2.0:1783135039.117818:0:14216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1783135039.117826:0:14216:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fea01d4f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1fe35bd-99cf-438e-8ada-ed586b673efa+11:14249:x1869752384429696:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783135039.118056:0:14216:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fea01d4f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1fe35bd-99cf-438e-8ada-ed586b673efa+11:14249:x1869752384429696:12345-0@lo:502:llog_process_th.0 Request processed in 230us (378us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135039.118063:0:14216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1783135039.118182:0:14249:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe8c6dfce00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c1fe35bd-99cf-438e-8ada-ed586b673efa:14249:1869752384429696:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1783135039.118207:0:14249:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1783135039.118217:0:14249:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783135039.118219:0:14249:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1783135039.118227:0:14249:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9fe9f6f8d000 00000020:00000080:0.0:1783135039.118230:0:14249:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1783135039.118237:0:14249:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1783135039.118240:0:14249:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783135039.118241:0:14249:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:0.0:1783135039.118243:0:14249:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1783135039.118245:0:14249:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783135039.118246:0:14249:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1783135039.118249:0:14249:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9fe9f6f8d000 00000020:00000080:0.0:1783135039.118251:0:14249:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1783135039.118329:0:14249:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1783135039.118334:0:14249:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783135039.118335:0:14249:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:0.0:1783135039.118337:0:14249:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1783135039.118340:0:14249:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783135039.118341:0:14249:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1783135039.118344:0:14249:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9fe9f6f8d000 00000020:00000080:0.0:1783135039.118352:0:14249:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1783135039.118386:0:14249:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe8c6dfce00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c1fe35bd-99cf-438e-8ada-ed586b673efa:14249:1869752384429824:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783135039.118418:0:14249:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135039.118435:0:14249:0:(client.c:2701:ptlrpc_set_wait()) set ffff9fea01d52e40 going to sleep for 11 seconds 00000100:00100000:3.0:1783135039.119380:0:14215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384429824 00000100:00100000:3.0:1783135039.119387:0:14215:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384429824 00000100:00100000:3.0:1783135039.119428:0:14215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1783135039.119438:0:14215:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fea01d4c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c1fe35bd-99cf-438e-8ada-ed586b673efa+11:14249:x1869752384429824:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783135039.119669:0:14215:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fea01d4c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c1fe35bd-99cf-438e-8ada-ed586b673efa+11:14249:x1869752384429824:12345-0@lo:502:llog_process_th.0 Request processed in 233us (1249us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135039.119677:0:14215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1783135039.124917:0:14249:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe8c6dfce00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c1fe35bd-99cf-438e-8ada-ed586b673efa:14249:1869752384429824:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1783135039.124961:0:14249:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1783135039.124970:0:14249:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783135039.124972:0:14249:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:0.0:1783135039.124977:0:14249:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:2.0:1783135039.128621:0:14204:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:2.0:1783135039.128657:0:14204:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.201.141@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1783135039.128678:0:14204:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.141@tcp lock: ffff9fe9f68ad600/0xd6c4b8f05867f691 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd6c4b8f05867f698 expref: -99 pid: 14204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135039.128691:0:14204:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.141@tcp lock: ffff9fe9f68ad600/0xd6c4b8f05867f691 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd6c4b8f05867f698 expref: -99 pid: 14204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783135039.128742:0:14204:0:(mgc_request.c:1945:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1783135039.128747:0:14204:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9fe9f6f8d000 10000000:01000000:2.0:1783135039.128750:0:14204:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9fe9f6f8d000 10000000:01000000:2.0:1783135039.128755:0:14204:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1783135039.128761:0:14204:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff9fe9f6f8d000 from 1 10000000:01000000:2.0:1783135039.128764:0:14204:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1783135039.128803:0:14204:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.141@tcp lock: ffff9fe9c7828c00/0xd6c4b8f05867f69f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135039.128813:0:14204:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.141@tcp lock: ffff9fe9c7828c00/0xd6c4b8f05867f69f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135039.128825:0:14204:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.141@tcp lock: ffff9fe9c7828c00/0xd6c4b8f05867f69f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783135039.128850:0:14204:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9f6cb2680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c1fe35bd-99cf-438e-8ada-ed586b673efa:14204:1869752384429952:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1783135039.128929:0:14204:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135039.128967:0:14204:0:(client.c:2701:ptlrpc_set_wait()) set ffff9fe9fe8a19c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783135039.129260:0:14215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384429952 00000100:00100000:3.0:1783135039.129269:0:14215:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384429952 00000100:00100000:3.0:1783135039.129351:0:14215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1783135039.129362:0:14215:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fea01d4cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c1fe35bd-99cf-438e-8ada-ed586b673efa+11:14204:x1869752384429952:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1783135039.129383:0:14215:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783135039.129398:0:14215:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fe9d2b74400/0xd6c4b8f05867f6a6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xd6c4b8f05867f69f expref: -99 pid: 14215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135039.129424:0:14215:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fe9d2b74400/0xd6c4b8f05867f6a6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd6c4b8f05867f69f expref: 12 pid: 14215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135039.129477:0:14215:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fe9d2b74400/0xd6c4b8f05867f6a6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd6c4b8f05867f69f expref: 12 pid: 14215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135039.129487:0:14215:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fe9d2b74400, rc 0) 00000100:00100000:3.0:1783135039.129555:0:14215:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fea01d4cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c1fe35bd-99cf-438e-8ada-ed586b673efa+12:14204:x1869752384429952:12345-0@lo:101:mount.lustre.0 Request processed in 194us (624us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135039.129572:0:14215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1783135039.129573:0:14204:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9f6cb2680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c1fe35bd-99cf-438e-8ada-ed586b673efa:14204:1869752384429952:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1783135039.129593:0:14204:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.141@tcp lock: ffff9fe9c7828c00/0xd6c4b8f05867f69f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd6c4b8f05867f6a6 expref: -99 pid: 14204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135039.129603:0:14204:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.141@tcp lock: ffff9fe9c7828c00/0xd6c4b8f05867f69f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xd6c4b8f05867f6a6 expref: -99 pid: 14204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783135039.129662:0:14204:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9f6cb2680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c1fe35bd-99cf-438e-8ada-ed586b673efa:14204:1869752384430080:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1783135039.129695:0:14204:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135039.129737:0:14204:0:(client.c:2701:ptlrpc_set_wait()) set ffff9fe9fe8a19c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783135039.130448:0:14217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384430080 00000100:00100000:3.0:1783135039.130453:0:14217:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384430080 00000100:00100000:3.0:1783135039.130486:0:14217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1783135039.130496:0:14217:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fea01d4fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1fe35bd-99cf-438e-8ada-ed586b673efa+12:14204:x1869752384430080:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1783135039.130824:0:14217:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fea01d4fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1fe35bd-99cf-438e-8ada-ed586b673efa+12:14204:x1869752384430080:12345-0@lo:501:mount.lustre.0 Request processed in 329us (1127us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135039.130832:0:14217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1783135039.130854:0:14204:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9f6cb2680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c1fe35bd-99cf-438e-8ada-ed586b673efa:14204:1869752384430080:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1783135039.130892:0:14204:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9f6cb2680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c1fe35bd-99cf-438e-8ada-ed586b673efa:14204:1869752384430208:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1783135039.130933:0:14204:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135039.130964:0:14216:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384430208 00000100:00100000:3.0:1783135039.130969:0:14216:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384430208 00000100:00100000:2.0:1783135039.130970:0:14204:0:(client.c:2701:ptlrpc_set_wait()) set ffff9fe9fe8a19c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783135039.131002:0:14216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1783135039.131011:0:14216:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fea01d4d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1fe35bd-99cf-438e-8ada-ed586b673efa+12:14204:x1869752384430208:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1783135039.131172:0:14216:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fea01d4d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1fe35bd-99cf-438e-8ada-ed586b673efa+12:14204:x1869752384430208:12345-0@lo:503:mount.lustre.0 Request processed in 163us (238us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135039.131180:0:14216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1783135039.131201:0:14204:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9f6cb2680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c1fe35bd-99cf-438e-8ada-ed586b673efa:14204:1869752384430208:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1783135039.133084:0:14254:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9f6cb2680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c1fe35bd-99cf-438e-8ada-ed586b673efa:14254:1869752384430336:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783135039.133150:0:14254:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135039.133185:0:14217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384430336 00000100:00100000:3.0:1783135039.133192:0:14217:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384430336 00000100:00100000:2.0:1783135039.133197:0:14254:0:(client.c:2701:ptlrpc_set_wait()) set ffff9fe9fe8a10c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783135039.133247:0:14217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1783135039.133259:0:14217:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fe8dbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1fe35bd-99cf-438e-8ada-ed586b673efa+12:14254:x1869752384430336:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783135039.133566:0:14217:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fe8dbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1fe35bd-99cf-438e-8ada-ed586b673efa+12:14254:x1869752384430336:12345-0@lo:502:llog_process_th.0 Request processed in 310us (416us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135039.133573:0:14217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1783135039.133608:0:14254:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9f6cb2680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c1fe35bd-99cf-438e-8ada-ed586b673efa:14254:1869752384430336:0@lo:502:llog_process_th.0 00000020:01000004:2.0:1783135039.133668:0:14254:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:2.0:1783135039.133681:0:14254:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff9fe8c57c4d40) 00000020:00000080:2.0:1783135039.133700:0:14254:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type lwp with refcount 2 00000020:01000004:2.0:1783135039.133967:0:14254:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9fe9f6f8d000 from lustre-MDT0000, refs=4 00000020:01000004:2.0:1783135039.133976:0:14254:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9fe9f6f8d000 from lustre-MDT0000, refs=4 00000020:01000004:2.0:1783135039.133979:0:14254:0:(obd_mount.c:701:lustre_put_lsi()) put ffff9fe9f6f8d000 4 00010000:00080000:2.0:1783135039.134007:0:14254:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9fe9f6a13000@lustre-MDT0000-lwp-MDT0000: add connection 192.168.201.141@tcp at head 00010000:00010000:2.0:1783135039.135839:0:14254:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-3 is initialized 00000020:00000080:2.0:1783135039.135970:0:14254:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:2.0:1783135039.136011:0:14254:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1783135039.136025:0:14254:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0xd6c4b8f05867f6b4 00000100:00080000:2.0:1783135039.136036:0:14254:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1783135039.136042:0:14254:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff9fe9f6a13000 using connection 192.168.201.141@tcp/0@lo 00000100:00100000:2.0:1783135039.136078:0:14254:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9fe9f6cb2680 x1869752384430464/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1783135039.136109:0:14254:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1783135039.137152:0:14254:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9f6cb0700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c1fe35bd-99cf-438e-8ada-ed586b673efa:14254:1869752384430592:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783135039.137226:0:14254:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135039.137262:0:14216:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384430592 00000100:00100000:2.0:1783135039.137267:0:14254:0:(client.c:2701:ptlrpc_set_wait()) set ffff9fe9fe8a10c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783135039.137270:0:14216:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384430592 00000100:00100000:3.0:1783135039.137337:0:14216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1783135039.137347:0:14216:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fe8d9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1fe35bd-99cf-438e-8ada-ed586b673efa+12:14254:x1869752384430592:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783135039.137630:0:14216:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fe8d9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1fe35bd-99cf-438e-8ada-ed586b673efa+12:14254:x1869752384430592:12345-0@lo:502:llog_process_th.0 Request processed in 284us (403us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135039.137639:0:14216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1783135039.137716:0:14254:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9f6cb0700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c1fe35bd-99cf-438e-8ada-ed586b673efa:14254:1869752384430592:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1783135039.137742:0:14254:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:2.0:1783135039.138077:0:14204:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:2.0:1783135039.138096:0:14204:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.201.141@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1783135039.138109:0:14204:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.141@tcp lock: ffff9fe9c7828c00/0xd6c4b8f05867f69f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd6c4b8f05867f6a6 expref: -99 pid: 14204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135039.138119:0:14204:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.141@tcp lock: ffff9fe9c7828c00/0xd6c4b8f05867f69f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd6c4b8f05867f6a6 expref: -99 pid: 14204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1783135039.138163:0:14204:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1783135039.138166:0:14204:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1783135039.138168:0:14204:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1783135039.138173:0:14204:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1783135039.138174:0:14204:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1783135039.138175:0:14204:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1783135039.138176:0:14204:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1783135039.138178:0:14204:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1783135039.138179:0:14204:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1783135039.138180:0:14204:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1783135039.138183:0:14204:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:2.0:1783135039.138185:0:14204:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1783135039.138186:0:14204:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1783135039.138187:0:14204:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1783135039.138188:0:14204:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1783135039.138189:0:14204:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1783135039.138190:0:14204:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1783135039.138191:0:14204:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1783135039.138191:0:14204:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1783135039.138192:0:14204:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1783135039.138193:0:14204:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1783135039.138205:0:14204:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1783135039.138215:0:14204:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9f6cb0700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c1fe35bd-99cf-438e-8ada-ed586b673efa:14204:1869752384430720:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1783135039.138248:0:14204:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135039.138271:0:3285:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9f6cb2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3285:1869752384430464:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1783135039.138277:0:14204:0:(client.c:2701:ptlrpc_set_wait()) set ffff9fe9fe8a1840 going to sleep for 11 seconds 00000100:00100000:3.0:1783135039.138501:0:14217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384430720 00000100:00100000:3.0:1783135039.138507:0:14217:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384430720 00000100:00100000:3.0:1783135039.138570:0:14217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1783135039.138580:0:14217:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fe8dac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1fe35bd-99cf-438e-8ada-ed586b673efa+12:14204:x1869752384430720:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1783135039.138603:0:14217:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 00000100:00100000:1.0:1783135039.138607:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 20000000:01000000:3.0:1783135039.138619:0:14217:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:1.0:1783135039.138693:0:14222:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384430464 00000100:00100000:1.0:1783135039.138699:0:14222:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384430464 00000100:00100000:1.0:1783135039.138738:0:14222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1783135039.138745:0:14222:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fe95b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3285:x1869752384430464:12345-0@lo:38:llog_process_th.0 00000100:00100000:1.0:1783135039.138793:0:14222:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fe95b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3285:x1869752384430464:12345-0@lo:38:llog_process_th.0 Request processed in 47us (190us total) trans 0 rc -11/-11 00000100:00100000:1.0:1783135039.138808:0:14222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1783135039.138844:0:3285:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1783135039.138851:0:3285:0:(import.c:65:import_set_state_nolock()) ffff9fe9f6a13000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1783135039.138856:0:3285:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1783135039.138860:0:3285:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9f6cb2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3285:1869752384430464:0@lo:38:llog_process_th.0 20000000:01000000:1.0:1783135039.188952:0:14217:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1783135039.189004:0:14217:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:3.0:1783135039.193394:0:14238:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1783135039.193405:0:14238:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1783135039.193436:0:14238:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9fe9d2b75400/0xd6c4b8f05867f6bb lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135039.193466:0:14238:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9fe9fe43ee00/0xd6c4b8f05867f68a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd6c4b8f05867f683 expref: 12 pid: 14217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135039.193476:0:14238:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9fe9d2b75400/0xd6c4b8f05867f6bb lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135039.193532:0:14238:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9fe9fe43ee00/0xd6c4b8f05867f68a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd6c4b8f05867f683 expref: 12 pid: 14217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135039.193549:0:14238:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9fe9fe43ee00/0xd6c4b8f05867f68a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd6c4b8f05867f683 expref: 12 pid: 14217 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783135039.193564:0:14238:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9fea15500 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14238:1869752384430848:0@lo:104: 00000100:00100000:3.0:1783135039.193635:0:14238:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135039.193708:0:14238:0:(client.c:2701:ptlrpc_set_wait()) set ffff9fe9d29d9cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1783135039.194123:0:14205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384430848 00000100:00100000:0.0:1783135039.194132:0:14205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384430848 00000100:00100000:0.0:1783135039.194188:0:14205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1783135039.194199:0:14205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fea15c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c1fe35bd-99cf-438e-8ada-ed586b673efa+3:14238:x1869752384430848:12345-0@lo:104: 00010000:00010000:0.0:1783135039.194211:0:14205:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.141@tcp lock: ffff9fe9c7828800/0xd6c4b8f05867f683 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xd6c4b8f05867f68a expref: -99 pid: 14204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135039.194295:0:14205:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1783135039.194302:0:14205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fea15c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c1fe35bd-99cf-438e-8ada-ed586b673efa+3:14238:x1869752384430848:12345-0@lo:104: Request processed in 106us (667us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135039.194310:0:14205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:1.0:1783135039.194544:0:14211:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783135039.194552:0:14211:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.141@tcp lock: ffff9fe9c7828800/0xd6c4b8f05867f683 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xd6c4b8f05867f68a expref: -99 pid: 14204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135039.194561:0:14211:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe9c7828800 already unused, calling callback (ffffffffc1b40c20) 10000000:00010000:1.0:1783135039.194565:0:14211:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.141@tcp lock: ffff9fe9c7828800/0xd6c4b8f05867f683 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xd6c4b8f05867f68a expref: -99 pid: 14204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135039.194574:0:14211:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.141@tcp lock: ffff9fe9c7828800/0xd6c4b8f05867f683 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xd6c4b8f05867f68a expref: -99 pid: 14204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783135039.194582:0:14211:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.141@tcp lock: ffff9fe9c7828800/0xd6c4b8f05867f683 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xd6c4b8f05867f68a expref: -99 pid: 14204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783135039.194588:0:14211:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1783135039.194634:0:14211:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.141@tcp lock: ffff9fe9c7828800/0xd6c4b8f05867f683 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd6c4b8f05867f68a expref: -99 pid: 14204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135039.194640:0:14211:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1783135039.194662:0:14211:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.141@tcp lock: ffff9fe9c7828800/0xd6c4b8f05867f683 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd6c4b8f05867f68a expref: -99 pid: 14204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135039.194685:0:14211:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.141@tcp lock: ffff9fe9c7828800/0xd6c4b8f05867f683 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd6c4b8f05867f68a expref: -99 pid: 14204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135039.194705:0:14211:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783135039.194706:0:14211:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783135039.194708:0:14211:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783135039.194736:0:3287:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9fe959180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c1fe35bd-99cf-438e-8ada-ed586b673efa:3287:1869752384430976:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1783135039.194771:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135039.194837:0:14207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384430976 00000100:00100000:1.0:1783135039.194842:0:14207:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384430976 00010000:00010000:1.0:1783135039.194861:0:14207:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9fe9fe43ee00/0xd6c4b8f05867f68a lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd6c4b8f05867f683 expref: 13 pid: 14217 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783135039.194890:0:14207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1783135039.194897:0:14207:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fe95aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c1fe35bd-99cf-438e-8ada-ed586b673efa+13:3287:x1869752384430976:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1783135039.194908:0:14207:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783135039.194913:0:14207:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9fe9fe43ee00/0xd6c4b8f05867f68a lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd6c4b8f05867f683 expref: 13 pid: 14217 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135039.194922:0:14207:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9fe9fe43ee00/0xd6c4b8f05867f68a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd6c4b8f05867f683 expref: 13 pid: 14217 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135039.194937:0:14207:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9fe9d2b75400/0xd6c4b8f05867f6bb lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135039.194944:0:14207:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fe9d2b75400/0xd6c4b8f05867f6bb lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1783135039.194958:0:14207:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001553648s 00010000:00010000:1.0:1783135039.194967:0:14207:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9fe9d2b75400/0xd6c4b8f05867f6bb lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135039.194975:0:14207:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9fe9d2b75400/0xd6c4b8f05867f6bb lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135039.194981:0:14207:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9fe9d2b75400/0xd6c4b8f05867f6bb lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135039.194987:0:14207:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9fe9d2b75400/0xd6c4b8f05867f6bb lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135039.194992:0:14207:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe9d2b75400 already unused, calling callback (ffffffffc1527ce0) 00010000:00010000:1.0:1783135039.194996:0:14207:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9fe9d2b75400/0xd6c4b8f05867f6bb lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135039.195002:0:14207:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9fe9d2b75400/0xd6c4b8f05867f6bb lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135039.195010:0:14207:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9fe9d2b75400/0xd6c4b8f05867f6bb lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135039.195020:0:14207:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783135039.195051:0:14207:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fe95aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c1fe35bd-99cf-438e-8ada-ed586b673efa+13:3287:x1869752384430976:12345-0@lo:103:ldlm_bl.0 Request processed in 154us (278us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135039.195058:0:14207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1783135039.195090:0:3287:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9fe959180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c1fe35bd-99cf-438e-8ada-ed586b673efa:3287:1869752384430976:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1783135039.196701:0:14238:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fe9fe43ee00/0xd6c4b8f05867f68a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd6c4b8f05867f683 expref: 12 pid: 14217 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783135039.196719:0:14238:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9fea15500 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14238:1869752384430848:0@lo:104: 00010000:00010000:3.0:1783135039.196741:0:14238:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9fe9d2b75400/0xd6c4b8f05867f6bb lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135039.196750:0:14238:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9fe9d2b75400/0xd6c4b8f05867f6bb lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135039.196756:0:14238:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9fe9d2b75400/0xd6c4b8f05867f6bb lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135039.196761:0:14238:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fe9d2b75400/0xd6c4b8f05867f6bb lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783135039.206461:0:14217:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fe8dac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1fe35bd-99cf-438e-8ada-ed586b673efa+11:14204:x1869752384430720:12345-0@lo:253:mount.lustre.0 Request processed in 67869us (68197us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135039.206477:0:14217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1783135039.206597:0:14204:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9f6cb0700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c1fe35bd-99cf-438e-8ada-ed586b673efa:14204:1869752384430720:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1783135039.206615:0:14204:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1783135039.206618:0:14204:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1783135039.206620:0:14204:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1783135039.206621:0:14204:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1783135039.206622:0:14204:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1783135039.206624:0:14204:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1783135039.206625:0:14204:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1783135039.206627:0:14204:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1783135039.206628:0:14204:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1783135039.206631:0:14204:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1783135039.206632:0:14204:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1783135039.206647:0:14204:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:3.0:1783135039.215325:0:14204:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:3.0:1783135039.215504:0:14204:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:3.0:1783135039.215895:0:14204:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:3.0:1783135039.216047:0:14204:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:3.0:1783135039.216420:0:14204:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:3.0:1783135039.216798:0:14204:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:3.0:1783135039.217937:0:14204:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:3.0:1783135039.218102:0:14204:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:3.0:1783135039.218913:0:14204:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:3.0:1783135039.219069:0:14204:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:3.0:1783135039.219654:0:14204:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:3.0:1783135039.219890:0:14204:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 00000020:00080000:3.0:1783135039.245651:0:14204:0:(update_trans.c:1487:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 8 00000040:01000000:0.0:1783135039.246078:0:14204:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000040:01000000:0.0:1783135039.246384:0:14262:0:(llog_osd.c:2237:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:00080000:0.0:1783135039.246447:0:14262:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000020:00080000:3.0:1783135039.249672:0:14261:0:(update_trans.c:1530:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 8 00000020:00080000:3.0:1783135039.249679:0:14261:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000040:00080000:0.0:1783135039.251260:0:14262:0:(llog.c:857:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1783135039.251366:0:14262:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:0.0:1783135039.251371:0:14262:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000040:01000000:1.0:1783135039.252083:0:14204:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:1.0:1783135039.252235:0:14204:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:1.0:1783135039.253071:0:14204:0:(mdd_device.c:553:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:1.0:1783135039.253080:0:14204:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:1.0:1783135039.253228:0:14204:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1783135039.254553:0:14204:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:1.0:1783135039.255171:0:14204:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:1.0:1783135039.255202:0:14204:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:1.0:1783135039.255758:0:14204:0:(llog_cat.c:1213:llog_cat_set_first_idx()) catlog [0xa:0x7:0x0] first idx 0, last_idx 1 00080000:10000000:1.0:1783135039.256522:0:14204:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x36:0x0] (8/8/4) registered 00000001:00000004:1.0:1783135039.261159:0:14204:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000001:00080000:2.0:1783135039.299662:0:14204:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:2.0:1783135039.299700:0:14204:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffb1f241b4b988 00100000:10000000:2.0:1783135039.299719:0:14204:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:1.0:1783135039.300560:0:14204:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1783135039.300573:0:14204:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.141@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1783135039.300587:0:14204:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=45 00000080:00000004:1.0:1783135039.300604:0:14204:0:(super25.c:187:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00010000:00010000:3.0:1783135039.940857:0:14210:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1783135040.197443:0:14257:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1783135040.197452:0:14257:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1783135040.198433:0:14257:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 3 00000040:00080000:2.0:1783135040.198442:0:14257:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 10000000:01000000:2.0:1783135040.708724:0:14219:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1783135040.708732:0:14219:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-mdtir-ffff9fe9f6f8d000 from 6 10000000:01000000:2.0:1783135040.708737:0:14219:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1783135040.708787:0:14219:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.141@tcp lock: ffff9fe9c7828a00/0xd6c4b8f05867f6c2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135040.708799:0:14219:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.141@tcp lock: ffff9fe9c7828a00/0xd6c4b8f05867f6c2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135040.708811:0:14219:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.141@tcp lock: ffff9fe9c7828a00/0xd6c4b8f05867f6c2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783135040.708836:0:14219:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9f6cb0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1fe35bd-99cf-438e-8ada-ed586b673efa:14219:1869752384431104:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1783135040.708900:0:14219:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135040.708944:0:14219:0:(client.c:2701:ptlrpc_set_wait()) set ffff9fe9fe8a1300 going to sleep for 11 seconds 00000100:00100000:2.0:1783135040.708965:0:14215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384431104 00000100:00100000:2.0:1783135040.708971:0:14215:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384431104 00000100:00100000:2.0:1783135040.709014:0:14215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1783135040.709023:0:14215:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fe8db450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c1fe35bd-99cf-438e-8ada-ed586b673efa+11:14219:x1869752384431104:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783135040.709037:0:14215:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783135040.709049:0:14215:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fe9c7829400/0xd6c4b8f05867f6c9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd6c4b8f05867f6c2 expref: -99 pid: 14215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135040.709070:0:14215:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fe9c7829400/0xd6c4b8f05867f6c9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd6c4b8f05867f6c2 expref: 12 pid: 14215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135040.709088:0:14215:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fe9c7829400/0xd6c4b8f05867f6c9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd6c4b8f05867f6c2 expref: 12 pid: 14215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135040.709097:0:14215:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fe9c7829400, rc 0) 00000100:00100000:2.0:1783135040.709130:0:14215:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fe8db450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c1fe35bd-99cf-438e-8ada-ed586b673efa+12:14219:x1869752384431104:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 107us (230us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135040.709136:0:14215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1783135040.709184:0:14219:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9f6cb0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1fe35bd-99cf-438e-8ada-ed586b673efa:14219:1869752384431104:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783135040.709198:0:14219:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.141@tcp lock: ffff9fe9c7828a00/0xd6c4b8f05867f6c2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd6c4b8f05867f6c9 expref: -99 pid: 14219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135040.709206:0:14219:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.141@tcp lock: ffff9fe9c7828a00/0xd6c4b8f05867f6c2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd6c4b8f05867f6c9 expref: -99 pid: 14219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783135040.709249:0:14219:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9f6cb0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1fe35bd-99cf-438e-8ada-ed586b673efa:14219:1869752384431232:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1783135040.709275:0:14219:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135040.709565:0:14219:0:(client.c:2701:ptlrpc_set_wait()) set ffff9fe9fe8a1300 going to sleep for 11 seconds 00000100:00100000:2.0:1783135040.709580:0:14217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384431232 00000100:00100000:2.0:1783135040.709585:0:14217:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384431232 00000100:00100000:2.0:1783135040.709608:0:14217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1783135040.709615:0:14217:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fe8d8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1fe35bd-99cf-438e-8ada-ed586b673efa+12:14219:x1869752384431232:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1783135040.709628:0:14217:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1783135040.709643:0:14217:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1783135040.709645:0:14217:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 6 00000100:00100000:2.0:1783135040.709712:0:14217:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fe8d8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1fe35bd-99cf-438e-8ada-ed586b673efa+12:14219:x1869752384431232:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 98us (436us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135040.709727:0:14217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1783135040.709756:0:14219:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9f6cb0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1fe35bd-99cf-438e-8ada-ed586b673efa:14219:1869752384431232:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1783135040.709847:0:14219:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.201.141@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1783135040.709854:0:14219:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.141@tcp lock: ffff9fe9c7828a00/0xd6c4b8f05867f6c2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd6c4b8f05867f6c9 expref: -99 pid: 14219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135040.709862:0:14219:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.141@tcp lock: ffff9fe9c7828a00/0xd6c4b8f05867f6c2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd6c4b8f05867f6c9 expref: -99 pid: 14219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135040.964468:0:14211:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1783135041.222787:0:14257:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1783135041.222796:0:14257:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1783135041.222826:0:14257:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 3 00000040:00080000:3.0:1783135041.222832:0:14257:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:1.0:1783135041.992609:0:14210:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1783135042.295037:0:14504:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg141-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1783135043.011486:0:14211:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783135044.035885:0:14210:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1783135044.154127:0:14656:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffcc7be4360 20000000:00000080:2.0:1783135044.154143:0:14656:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9fe9c8c0c800 uarg=0000000000000000 20000000:01000000:2.0:1783135044.154171:0:14656:0:(mgs_llog.c:6177:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:2.0:1783135044.154178:0:14656:0:(mgs_llog.c:4638:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:2.0:1783135044.154181:0:14656:0:(mgs_llog.c:1376:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:2.0:1783135044.154921:0:14657:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 2 count 10 20000000:00000400:0.0:1783135044.154984:0:14656:0:(mgs_llog.c:1447:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 10000000:01000000:0.0:1783135044.160092:0:14656:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1783135044.160131:0:14656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9fe9f68ad400/0xd6c4b8f05867f6d0 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135044.160146:0:14656:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9fe9c7829e00/0xd6c4b8f05867f698 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd6c4b8f05867f691 expref: 11 pid: 14216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135044.160152:0:14656:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9fe9f68ad400/0xd6c4b8f05867f6d0 lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135044.160186:0:14656:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9fe9c7829e00/0xd6c4b8f05867f698 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd6c4b8f05867f691 expref: 11 pid: 14216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135044.160195:0:14656:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9fe9c7829e00/0xd6c4b8f05867f698 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd6c4b8f05867f691 expref: 11 pid: 14216 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783135044.160206:0:14656:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe8c6dfce00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14656:1869752384431360:0@lo:104: 00000100:00100000:0.0:1783135044.160256:0:14656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135044.160333:0:14656:0:(client.c:2701:ptlrpc_set_wait()) set ffff9fe9ca9306c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783135044.160801:0:14205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384431360 00000100:00100000:3.0:1783135044.160807:0:14205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384431360 00000100:00100000:3.0:1783135044.160876:0:14205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1783135044.160884:0:14205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe8c6dff800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c1fe35bd-99cf-438e-8ada-ed586b673efa+3:14656:x1869752384431360:12345-0@lo:104: 00010000:00010000:3.0:1783135044.160895:0:14205:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.141@tcp lock: ffff9fe9f68ad600/0xd6c4b8f05867f691 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xd6c4b8f05867f698 expref: -99 pid: 14204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135044.160948:0:14205:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1783135044.160954:0:14205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe8c6dff800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c1fe35bd-99cf-438e-8ada-ed586b673efa+3:14656:x1869752384431360:12345-0@lo:104: Request processed in 70us (697us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135044.160960:0:14205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:1.0:1783135044.161088:0:14211:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783135044.161095:0:14211:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.141@tcp lock: ffff9fe9f68ad600/0xd6c4b8f05867f691 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xd6c4b8f05867f698 expref: -99 pid: 14204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783135044.161102:0:14656:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe8c6dfce00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14656:1869752384431360:0@lo:104: 00010000:00010000:1.0:1783135044.161103:0:14211:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe9f68ad600 already unused, calling callback (ffffffffc1b40c20) 10000000:00010000:1.0:1783135044.161107:0:14211:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.141@tcp lock: ffff9fe9f68ad600/0xd6c4b8f05867f691 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xd6c4b8f05867f698 expref: -99 pid: 14204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135044.161115:0:14211:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.141@tcp lock: ffff9fe9f68ad600/0xd6c4b8f05867f691 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xd6c4b8f05867f698 expref: -99 pid: 14204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135044.161120:0:14656:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9fe9f68ad400/0xd6c4b8f05867f6d0 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783135044.161121:0:14211:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.141@tcp lock: ffff9fe9f68ad600/0xd6c4b8f05867f691 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xd6c4b8f05867f698 expref: -99 pid: 14204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783135044.161127:0:14211:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1783135044.161156:0:14211:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.141@tcp lock: ffff9fe9f68ad600/0xd6c4b8f05867f691 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd6c4b8f05867f698 expref: -99 pid: 14204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135044.161173:0:14211:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1783135044.161200:0:14211:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.141@tcp lock: ffff9fe9f68ad600/0xd6c4b8f05867f691 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd6c4b8f05867f698 expref: -99 pid: 14204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135044.161207:0:14211:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.141@tcp lock: ffff9fe9f68ad600/0xd6c4b8f05867f691 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd6c4b8f05867f698 expref: -99 pid: 14204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135044.161222:0:14211:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783135044.161224:0:14211:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783135044.161225:0:14211:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783135044.161232:0:3288:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9fe959180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c1fe35bd-99cf-438e-8ada-ed586b673efa:3288:1869752384431488:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1783135044.161261:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135044.161326:0:14209:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384431488 00000100:00100000:1.0:1783135044.161330:0:14209:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384431488 00010000:00010000:1.0:1783135044.161348:0:14209:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9fe9c7829e00/0xd6c4b8f05867f698 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd6c4b8f05867f691 expref: 12 pid: 14216 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783135044.161369:0:14209:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1783135044.161376:0:14209:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe8c6dfce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c1fe35bd-99cf-438e-8ada-ed586b673efa+12:3288:x1869752384431488:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1783135044.161386:0:14209:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783135044.161391:0:14209:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9fe9c7829e00/0xd6c4b8f05867f698 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd6c4b8f05867f691 expref: 12 pid: 14216 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135044.161401:0:14209:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9fe9c7829e00/0xd6c4b8f05867f698 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd6c4b8f05867f691 expref: 12 pid: 14216 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135044.161413:0:14209:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fe9c7829e00/0xd6c4b8f05867f698 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd6c4b8f05867f691 expref: 12 pid: 14216 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135044.161425:0:14209:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9fe9f68ad400/0xd6c4b8f05867f6d0 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135044.161452:0:14209:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fe9f68ad400/0xd6c4b8f05867f6d0 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135044.161465:0:14209:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9fe9f68ad400/0xd6c4b8f05867f6d0 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135044.161471:0:14209:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9fe9f68ad400/0xd6c4b8f05867f6d0 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135044.161478:0:14209:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9fe9f68ad400/0xd6c4b8f05867f6d0 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135044.161484:0:14209:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9fe9f68ad400/0xd6c4b8f05867f6d0 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135044.161490:0:14209:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe9f68ad400 already unused, calling callback (ffffffffc1527ce0) 00010000:00010000:1.0:1783135044.161494:0:14209:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9fe9f68ad400/0xd6c4b8f05867f6d0 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135044.161501:0:14209:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9fe9f68ad400/0xd6c4b8f05867f6d0 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135044.161513:0:14209:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9fe9f68ad400/0xd6c4b8f05867f6d0 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135044.161522:0:14209:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1783135044.161537:0:14656:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9fe9f68ad400/0xd6c4b8f05867f6d0 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135044.161545:0:14656:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9fe9f68ad400/0xd6c4b8f05867f6d0 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135044.161551:0:14656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fe9f68ad400/0xd6c4b8f05867f6d0 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783135044.161553:0:14209:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe8c6dfce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c1fe35bd-99cf-438e-8ada-ed586b673efa+11:3288:x1869752384431488:12345-0@lo:103:ldlm_bl.0 Request processed in 178us (292us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135044.161559:0:14209:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1783135044.161582:0:3288:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9fe959180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c1fe35bd-99cf-438e-8ada-ed586b673efa:3288:1869752384431488:0@lo:103:ldlm_bl.0 00000100:00080000:3.0:1783135044.228888:0:8:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1783135044.228898:0:8:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1783135044.228902:0:8:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1783135044.228905:0:8:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1783135044.228908:0:8:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1783135044.228911:0:8:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1783135044.228923:0:8:0:(import.c:65:import_set_state_nolock()) ffff9fe9f6a13000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1783135044.228935:0:8:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff9fe9f6a13000 using connection 192.168.201.141@tcp/0@lo 00000100:00100000:3.0:1783135044.228969:0:8:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9fe9fea15500 x1869752384431616/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1783135044.229196:0:3285:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9fea15500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3285:1869752384431616:0@lo:38:kworker.0 00000100:00100000:1.0:1783135044.229265:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135044.229711:0:14224:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384431616 00000100:00100000:0.0:1783135044.229720:0:14224:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384431616 00000100:00100000:0.0:1783135044.229850:0:14224:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1783135044.229867:0:14224:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fe959180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3285:x1869752384431616:12345-0@lo:38:kworker.0 00010000:00080000:0.0:1783135044.229892:0:14224:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 326 last 0 00000020:00000080:0.0:1783135044.229938:0:14224:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0xd6c4b8f05867f6d7 00000004:00100000:0.0:1783135044.230084:0:14224:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1783135044.230208:0:14224:0:(import.c:65:import_set_state_nolock()) ffff9fea01d1a800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1783135044.230276:0:14224:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fe959180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1869752384431616:12345-0@lo:38:kworker.0 Request processed in 408us (1010us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135044.230335:0:14224:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1783135044.230513:0:3285:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9fe9fea15500 x1869752384431616/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1783135054 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1783135044.230525:0:3285:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 2 00000100:00080000:2.0:1783135044.230531:0:3285:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:2.0:1783135044.230535:0:3285:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1783135044.230536:0:3285:0:(import.c:65:import_set_state_nolock()) ffff9fe9f6a13000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1783135044.230540:0:3285:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9fea15500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3285:1869752384431616:0@lo:38:kworker.0 00010000:00010000:1.0:1783135045.059681:0:14210:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1783135045.379419:0:14219:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1783135045.379430:0:14219:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff9fe9f6f8d000 from 10 10000000:01000000:0.0:1783135045.379436:0:14219:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1783135045.379486:0:14219:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.141@tcp lock: ffff9fe9f68ad000/0xd6c4b8f05867f6de lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135045.379498:0:14219:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.141@tcp lock: ffff9fe9f68ad000/0xd6c4b8f05867f6de lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135045.379510:0:14219:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.141@tcp lock: ffff9fe9f68ad000/0xd6c4b8f05867f6de lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783135045.379534:0:14219:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe8c6dfc380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1fe35bd-99cf-438e-8ada-ed586b673efa:14219:1869752384431744:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1783135045.379590:0:14219:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135045.379627:0:14219:0:(client.c:2701:ptlrpc_set_wait()) set ffff9fe9ca9300c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783135045.379634:0:14216:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384431744 00000100:00100000:3.0:1783135045.379643:0:14216:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384431744 00000100:00100000:3.0:1783135045.379708:0:14216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1783135045.379719:0:14216:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fe8d8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1fe35bd-99cf-438e-8ada-ed586b673efa+11:14219:x1869752384431744:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783135045.379733:0:14216:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783135045.379747:0:14216:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fe9d2b75400/0xd6c4b8f05867f6e5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd6c4b8f05867f6de expref: -99 pid: 14216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135045.379771:0:14216:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fe9d2b75400/0xd6c4b8f05867f6e5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd6c4b8f05867f6de expref: 12 pid: 14216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135045.379783:0:14216:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fe9d2b75400/0xd6c4b8f05867f6e5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd6c4b8f05867f6de expref: 12 pid: 14216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135045.379792:0:14216:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fe9d2b75400, rc 0) 00000100:00100000:3.0:1783135045.379833:0:14216:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fe8d8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1fe35bd-99cf-438e-8ada-ed586b673efa+12:14219:x1869752384431744:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 117us (241us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135045.379840:0:14216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1783135045.380434:0:14219:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe8c6dfc380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1fe35bd-99cf-438e-8ada-ed586b673efa:14219:1869752384431744:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783135045.380459:0:14219:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.141@tcp lock: ffff9fe9f68ad000/0xd6c4b8f05867f6de lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd6c4b8f05867f6e5 expref: -99 pid: 14219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135045.380469:0:14219:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.141@tcp lock: ffff9fe9f68ad000/0xd6c4b8f05867f6de lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd6c4b8f05867f6e5 expref: -99 pid: 14219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783135045.380527:0:14219:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe8c6dfc380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1fe35bd-99cf-438e-8ada-ed586b673efa:14219:1869752384431872:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783135045.380555:0:14219:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135045.380585:0:14219:0:(client.c:2701:ptlrpc_set_wait()) set ffff9fe9ca9300c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783135045.380599:0:14215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384431872 00000100:00100000:3.0:1783135045.380605:0:14215:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384431872 00000100:00100000:3.0:1783135045.380641:0:14215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1783135045.380650:0:14215:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fe8db850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c1fe35bd-99cf-438e-8ada-ed586b673efa+12:14219:x1869752384431872:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783135045.380964:0:14215:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fe8db850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c1fe35bd-99cf-438e-8ada-ed586b673efa+12:14219:x1869752384431872:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 315us (407us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135045.380995:0:14215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1783135045.381478:0:14219:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe8c6dfc380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1fe35bd-99cf-438e-8ada-ed586b673efa:14219:1869752384431872:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783135045.381513:0:14219:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe8c6dfc380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1fe35bd-99cf-438e-8ada-ed586b673efa:14219:1869752384432000:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783135045.381551:0:14219:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135045.381580:0:14219:0:(client.c:2701:ptlrpc_set_wait()) set ffff9fe9ca9300c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783135045.381594:0:14217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384432000 00000100:00100000:3.0:1783135045.381600:0:14217:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384432000 00000100:00100000:3.0:1783135045.381634:0:14217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1783135045.381641:0:14217:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fe8d8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1fe35bd-99cf-438e-8ada-ed586b673efa+12:14219:x1869752384432000:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783135045.381862:0:14217:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fe8d8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1fe35bd-99cf-438e-8ada-ed586b673efa+12:14219:x1869752384432000:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 220us (309us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135045.381870:0:14217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1783135045.382135:0:14219:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe8c6dfc380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1fe35bd-99cf-438e-8ada-ed586b673efa:14219:1869752384432000:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1783135045.382996:0:14740:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:3.0:1783135045.383062:0:14219:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:3.0:1783135045.383077:0:14219:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.201.141@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1783135045.383085:0:14219:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.141@tcp lock: ffff9fe9f68ad000/0xd6c4b8f05867f6de lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd6c4b8f05867f6e5 expref: -99 pid: 14219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135045.383093:0:14219:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.141@tcp lock: ffff9fe9f68ad000/0xd6c4b8f05867f6de lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd6c4b8f05867f6e5 expref: -99 pid: 14219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135046.085450:0:14211:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1783135046.614224:0:14857:0:(obd_mount.c:914:lmd_print()) mount data: 00000020:01000004:0.0:1783135046.614228:0:14857:0:(obd_mount.c:917:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:0.0:1783135046.614382:0:14857:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff9fe8c47e2000 00000020:01000004:0.0:1783135046.614411:0:14857:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:0.0:1783135046.614424:0:14857:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:0.0:1783135046.614457:0:14857:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff9fe9c8efcd40) 00000020:00000080:0.0:1783135046.614473:0:14857:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type osd-zfs with refcount 2 00100000:10000000:0.0:1783135046.628149:0:14857:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:0.0:1783135046.628537:0:14857:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:0.0:1783135046.629126:0:14857:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:0.0:1783135046.630172:0:14857:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:0.0:1783135046.630535:0:14857:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:0.0:1783135046.630847:0:14857:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-OST0000 under 451: rc = 0 00100000:10000000:0.0:1783135046.630967:0:14857:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled params under 451: rc = 0 00100000:10000000:0.0:1783135046.631041:0:14857:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-client under 451: rc = 0 00100000:10000000:0.0:1783135046.631636:0:14857:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000-OST0000 under 769: rc = 0 00100000:10000000:0.0:1783135046.631850:0:14857:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000 under 769: rc = 0 00100000:10000000:0.0:1783135046.632076:0:14857:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000-OST0000 under 769: rc = 0 00100000:10000000:0.0:1783135046.633072:0:14857:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000 under 769: rc = 0 00100000:10000000:0.0:1783135046.633316:0:14857:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000 under 769: rc = 0 00100000:10000000:0.0:1783135046.633775:0:14857:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000-OST0000 under 769: rc = 0 00000020:00000080:0.0:1783135046.634523:0:14857:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:0.0:1783135046.634535:0:14857:0:(osd_handler.c:1569:osd_obd_connect()) connect #0 00000020:00000080:0.0:1783135046.634544:0:14857:0:(genops.c:1406:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xd6c4b8f05867f6f3 00000020:01000004:0.0:1783135046.634552:0:14857:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:0.0:1783135046.634572:0:14857:0:(obd_mount.c:394:lustre_start_mgc()) MGC192.168.201.141@tcp:Set MGC reconnect 1 10000000:01000000:0.0:1783135046.634575:0:14857:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.201.141@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:0.0:1783135046.634582:0:14857:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0000 00000020:01000004:0.0:1783135046.634586:0:14857:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:0.0:1783135046.634596:0:14857:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff9fe9c8efb380) 00000020:00000080:0.0:1783135046.634606:0:14857:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type ost with refcount 2 00000100:00100000:0.0:1783135046.636777:0:14857:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1783135046.636936:0:14857:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:0.0:1783135046.636941:0:14857:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:3.0:1783135046.641621:0:14857:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:3.0:1783135046.641633:0:14857:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:0.0:1783135046.641962:0:14857:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:0.0:1783135046.641968:0:14857:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:0.0:1783135046.643164:0:14857:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1783135046.645598:0:14857:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:0.0:1783135046.645607:0:14857:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:3.0:1783135046.647823:0:14857:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:3.0:1783135046.647833:0:14857:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:1.0:1783135046.660697:0:14857:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1783135046.660895:0:14857:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:1.0:1783135046.660901:0:14857:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:1.0:1783135046.662029:0:14857:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:1.0:1783135046.662036:0:14857:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:3.0:1783135046.662812:0:14857:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1783135046.662818:0:14857:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:3.0:1783135046.664806:0:14857:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1783135046.664955:0:14857:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:3.0:1783135046.664959:0:14857:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:3.0:1783135046.665591:0:14857:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:3.0:1783135046.665596:0:14857:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:2.0:1783135046.689168:0:14857:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1783135046.689500:0:14857:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:2.0:1783135046.689512:0:14857:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:2.0:1783135046.690374:0:14857:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:2.0:1783135046.690380:0:14857:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:2.0:1783135046.690724:0:14857:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:2.0:1783135046.690747:0:14857:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:2.0:1783135046.690753:0:14857:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.141@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:2.0:1783135046.696771:0:14857:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.141@tcp ctxt 0 is initialized 00000020:01000004:2.0:1783135046.696806:0:14857:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.201.141@tcp, index=0000, flags=0x20002 00000020:01000004:2.0:1783135046.696810:0:14857:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1783135046.696812:0:14857:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1783135046.696814:0:14857:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1783135046.696815:0:14857:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1783135046.696816:0:14857:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1783135046.696818:0:14857:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1783135046.696819:0:14857:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1783135046.696821:0:14857:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1783135046.696822:0:14857:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1783135046.696825:0:14857:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:2.0:1783135046.696827:0:14857:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1783135046.696828:0:14857:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1783135046.696829:0:14857:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1783135046.696830:0:14857:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1783135046.696831:0:14857:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1783135046.696832:0:14857:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1783135046.696833:0:14857:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1783135046.696834:0:14857:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1783135046.696836:0:14857:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1783135046.696858:0:14857:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1783135046.696877:0:14857:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9f6cb0700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c1fe35bd-99cf-438e-8ada-ed586b673efa:14857:1869752384432128:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1783135046.696946:0:14857:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135046.697079:0:14857:0:(client.c:2701:ptlrpc_set_wait()) set ffff9fe9fe8a1000 going to sleep for 11 seconds 00000100:00100000:0.0:1783135046.697117:0:14216:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384432128 00000100:00100000:0.0:1783135046.697124:0:14216:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384432128 00000100:00100000:0.0:1783135046.697177:0:14216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1783135046.697185:0:14216:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fe8db050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1fe35bd-99cf-438e-8ada-ed586b673efa+12:14857:x1869752384432128:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1783135046.697211:0:14216:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:0.0:1783135046.697213:0:14216:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:0.0:1783135046.697217:0:14216:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:1.0:1783135046.702055:0:14216:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fe8db050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1fe35bd-99cf-438e-8ada-ed586b673efa+12:14857:x1869752384432128:12345-0@lo:253:mount.lustre.0 Request processed in 4863us (5100us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135046.702068:0:14216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1783135046.702157:0:14857:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9f6cb0700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c1fe35bd-99cf-438e-8ada-ed586b673efa:14857:1869752384432128:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1783135046.702171:0:14857:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1783135046.702174:0:14857:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1783135046.702176:0:14857:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1783135046.702189:0:14857:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1783135046.702190:0:14857:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1783135046.702191:0:14857:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1783135046.702193:0:14857:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1783135046.702194:0:14857:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1783135046.702196:0:14857:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1783135046.702197:0:14857:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1783135046.702214:0:14857:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9fe8c47e2000 from lustre-OST0000 10000000:01000000:2.0:1783135046.702236:0:14857:0:(mgc_request.c:1945:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:2.0:1783135046.702238:0:14857:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:2.0:1783135046.702244:0:14857:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9fea00c40000 local copy 00010000:00010000:2.0:1783135046.702254:0:14857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.141@tcp lock: ffff9fe9c7829a00/0xd6c4b8f05867f5e9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd6c4b8f05867f5f0 expref: -99 pid: 14204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783135046.702524:0:14857:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9f6cb0700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c1fe35bd-99cf-438e-8ada-ed586b673efa:14857:1869752384432256:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1783135046.702554:0:14857:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135046.702589:0:14857:0:(client.c:2701:ptlrpc_set_wait()) set ffff9fe9fe8a1cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1783135046.702632:0:14217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384432256 00000100:00100000:0.0:1783135046.702638:0:14217:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384432256 00000100:00100000:0.0:1783135046.702677:0:14217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1783135046.702685:0:14217:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fe8d9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1fe35bd-99cf-438e-8ada-ed586b673efa+12:14857:x1869752384432256:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1783135046.702824:0:14217:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fe8d9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1fe35bd-99cf-438e-8ada-ed586b673efa+12:14857:x1869752384432256:12345-0@lo:501:mount.lustre.0 Request processed in 140us (268us total) trans 0 rc -2/-2 00000100:00100000:0.0:1783135046.702831:0:14217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1783135046.702917:0:14857:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9f6cb0700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c1fe35bd-99cf-438e-8ada-ed586b673efa:14857:1869752384432256:0@lo:501:mount.lustre.0 10000000:01000000:2.0:1783135046.702927:0:14857:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.201.141@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1783135046.703034:0:14857:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.201.141@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1783135046.703041:0:14857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.141@tcp lock: ffff9fe9c7829a00/0xd6c4b8f05867f5e9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd6c4b8f05867f5f0 expref: -99 pid: 14204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135046.703050:0:14857:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.141@tcp lock: ffff9fe9c7829a00/0xd6c4b8f05867f5e9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd6c4b8f05867f5f0 expref: -99 pid: 14204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783135046.703068:0:14857:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9fe8c47e2000 10000000:01000000:2.0:1783135046.703073:0:14857:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1783135046.703077:0:14857:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff9fea00c40000 10000000:01000000:2.0:1783135046.703079:0:14857:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:2.0:1783135046.703083:0:14857:0:(mgc_request.c:1803:mgc_process_log()) Process log nodemap-ffff9fea00c40000 from 1 10000000:01000000:2.0:1783135046.703090:0:14857:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:2.0:1783135046.703110:0:14857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.141@tcp lock: ffff9fe9c7828800/0xd6c4b8f05867f701 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135046.703119:0:14857:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.141@tcp lock: ffff9fe9c7828800/0xd6c4b8f05867f701 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135046.703129:0:14857:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.141@tcp lock: ffff9fe9c7828800/0xd6c4b8f05867f701 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783135046.703139:0:14857:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9f6cb0700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c1fe35bd-99cf-438e-8ada-ed586b673efa:14857:1869752384432384:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1783135046.703160:0:14857:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135046.703180:0:14857:0:(client.c:2701:ptlrpc_set_wait()) set ffff9fe9fe8a1cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1783135046.703220:0:14216:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384432384 00000100:00100000:1.0:1783135046.703223:0:14216:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384432384 00000100:00100000:1.0:1783135046.703249:0:14216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1783135046.703256:0:14216:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fe8da850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1fe35bd-99cf-438e-8ada-ed586b673efa+12:14857:x1869752384432384:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1783135046.703263:0:14216:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783135046.703275:0:14216:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fe9fe43fc00/0xd6c4b8f05867f708 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd6c4b8f05867f701 expref: -99 pid: 14216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135046.703316:0:14216:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fe9fe43fc00/0xd6c4b8f05867f708 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd6c4b8f05867f701 expref: 13 pid: 14216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135046.703326:0:14216:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fe9fe43fc00/0xd6c4b8f05867f708 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd6c4b8f05867f701 expref: 13 pid: 14216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135046.703335:0:14216:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fe9fe43fc00, rc 0) 00000100:00100000:1.0:1783135046.703361:0:14216:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fe8da850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1fe35bd-99cf-438e-8ada-ed586b673efa+13:14857:x1869752384432384:12345-0@lo:101:mount.lustre.0 Request processed in 106us (200us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135046.703376:0:14216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1783135046.703488:0:14857:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9f6cb0700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c1fe35bd-99cf-438e-8ada-ed586b673efa:14857:1869752384432384:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1783135046.703498:0:14857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.141@tcp lock: ffff9fe9c7828800/0xd6c4b8f05867f701 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd6c4b8f05867f708 expref: -99 pid: 14857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135046.703507:0:14857:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.141@tcp lock: ffff9fe9c7828800/0xd6c4b8f05867f701 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd6c4b8f05867f708 expref: -99 pid: 14857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783135046.703520:0:14857:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.201.141@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:2.0:1783135046.703619:0:14857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.141@tcp lock: ffff9fe9c7828800/0xd6c4b8f05867f701 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd6c4b8f05867f708 expref: -99 pid: 14857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135046.703627:0:14857:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.141@tcp lock: ffff9fe9c7828800/0xd6c4b8f05867f701 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd6c4b8f05867f708 expref: -99 pid: 14857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783135046.703633:0:14857:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:2.0:1783135046.703637:0:14857:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1783135046.703645:0:14857:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:2.0:1783135046.703647:0:14857:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:2.0:1783135046.703660:0:14857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.141@tcp lock: ffff9fe9c7829600/0xd6c4b8f05867f70f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135046.703667:0:14857:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.141@tcp lock: ffff9fe9c7829600/0xd6c4b8f05867f70f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135046.703674:0:14857:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.141@tcp lock: ffff9fe9c7829600/0xd6c4b8f05867f70f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783135046.703685:0:14857:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9f6cb0700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c1fe35bd-99cf-438e-8ada-ed586b673efa:14857:1869752384432512:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1783135046.703706:0:14857:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135046.703730:0:14857:0:(client.c:2701:ptlrpc_set_wait()) set ffff9fe9fe8a1cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1783135046.703771:0:14215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384432512 00000100:00100000:1.0:1783135046.703776:0:14215:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384432512 00000100:00100000:1.0:1783135046.703802:0:14215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1783135046.703808:0:14215:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fe8d8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c1fe35bd-99cf-438e-8ada-ed586b673efa+13:14857:x1869752384432512:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1783135046.703814:0:14215:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783135046.703822:0:14215:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fe9fe43e600/0xd6c4b8f05867f716 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xd6c4b8f05867f70f expref: -99 pid: 14215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135046.703835:0:14215:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fe9fe43e600/0xd6c4b8f05867f716 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd6c4b8f05867f70f expref: 14 pid: 14215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135046.703843:0:14215:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fe9fe43e600/0xd6c4b8f05867f716 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd6c4b8f05867f70f expref: 14 pid: 14215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135046.703850:0:14215:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fe9fe43e600, rc 0) 00000100:00100000:1.0:1783135046.703872:0:14215:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fe8d8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c1fe35bd-99cf-438e-8ada-ed586b673efa+14:14857:x1869752384432512:12345-0@lo:101:mount.lustre.0 Request processed in 64us (165us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135046.703878:0:14215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1783135046.703994:0:14857:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9f6cb0700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c1fe35bd-99cf-438e-8ada-ed586b673efa:14857:1869752384432512:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1783135046.704004:0:14857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.141@tcp lock: ffff9fe9c7829600/0xd6c4b8f05867f70f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xd6c4b8f05867f716 expref: -99 pid: 14857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135046.704011:0:14857:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.141@tcp lock: ffff9fe9c7829600/0xd6c4b8f05867f70f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xd6c4b8f05867f716 expref: -99 pid: 14857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1783135046.704586:0:14857:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:2.0:1783135046.705217:0:14857:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1783135046.705459:0:14857:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:2.0:1783135046.705495:0:14857:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:2.0:1783135046.705520:0:14857:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:2.0:1783135046.705554:0:14857:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:2.0:1783135046.705585:0:14857:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:2.0:1783135046.705609:0:14857:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:2.0:1783135046.705656:0:14857:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:2.0:1783135046.705668:0:14857:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:2.0:1783135046.705719:0:14857:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9f6cb0700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c1fe35bd-99cf-438e-8ada-ed586b673efa:14857:1869752384432640:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1783135046.705766:0:14857:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135046.705798:0:14857:0:(client.c:2701:ptlrpc_set_wait()) set ffff9fe9fe8a1e40 going to sleep for 11 seconds 00000100:00100000:1.0:1783135046.705919:0:14217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384432640 00000100:00100000:1.0:1783135046.705924:0:14217:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384432640 00000100:00100000:1.0:1783135046.705959:0:14217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1783135046.705966:0:14217:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fe8da050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1fe35bd-99cf-438e-8ada-ed586b673efa+14:14857:x1869752384432640:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1783135046.706197:0:14217:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fe8da050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1fe35bd-99cf-438e-8ada-ed586b673efa+14:14857:x1869752384432640:12345-0@lo:501:mount.lustre.0 Request processed in 230us (429us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135046.706204:0:14217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1783135046.707643:0:14857:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9f6cb0700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c1fe35bd-99cf-438e-8ada-ed586b673efa:14857:1869752384432640:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1783135046.707686:0:14857:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9f6cb0700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c1fe35bd-99cf-438e-8ada-ed586b673efa:14857:1869752384432768:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1783135046.707742:0:14857:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135046.707814:0:14857:0:(client.c:2701:ptlrpc_set_wait()) set ffff9fe9fe8a1e40 going to sleep for 11 seconds 00000100:00100000:1.0:1783135046.707908:0:14216:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384432768 00000100:00100000:1.0:1783135046.707918:0:14216:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384432768 00000100:00100000:1.0:1783135046.707987:0:14216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1783135046.707995:0:14216:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fe8da450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1fe35bd-99cf-438e-8ada-ed586b673efa+14:14857:x1869752384432768:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1783135046.708494:0:14216:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fe8da450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1fe35bd-99cf-438e-8ada-ed586b673efa+14:14857:x1869752384432768:12345-0@lo:503:mount.lustre.0 Request processed in 498us (751us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135046.708501:0:14216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1783135046.708590:0:14857:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9f6cb0700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c1fe35bd-99cf-438e-8ada-ed586b673efa:14857:1869752384432768:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1783135046.709191:0:14857:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1783135046.709247:0:14857:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9f6cb0700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c1fe35bd-99cf-438e-8ada-ed586b673efa:14857:1869752384432896:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1783135046.709470:0:14857:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135046.709523:0:14857:0:(client.c:2701:ptlrpc_set_wait()) set ffff9fe9fe8a1e40 going to sleep for 11 seconds 00000100:00100000:3.0:1783135046.709554:0:14215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384432896 00000100:00100000:3.0:1783135046.709559:0:14215:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384432896 00000100:00100000:3.0:1783135046.709627:0:14215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1783135046.709634:0:14215:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fe40c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c1fe35bd-99cf-438e-8ada-ed586b673efa+14:14857:x1869752384432896:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1783135046.709833:0:14215:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fe40c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c1fe35bd-99cf-438e-8ada-ed586b673efa+14:14857:x1869752384432896:12345-0@lo:502:mount.lustre.0 Request processed in 199us (362us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135046.709840:0:14215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1783135046.709908:0:14857:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9f6cb0700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c1fe35bd-99cf-438e-8ada-ed586b673efa:14857:1869752384432896:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1783135046.710116:0:14857:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:2.0:1783135046.710154:0:14857:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:2.0:1783135046.710182:0:14857:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:2.0:1783135046.710236:0:14857:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:2.0:1783135046.710267:0:14857:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:2.0:1783135046.710352:0:14857:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:2.0:1783135046.710459:0:14857:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:2.0:1783135046.710497:0:14857:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:2.0:1783135046.710529:0:14857:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 80 off9712 00000040:00080000:2.0:1783135046.710572:0:14857:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9936 00000040:00080000:2.0:1783135046.710604:0:14857:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].11, 224 off10160 00000040:00080000:2.0:1783135046.710643:0:14857:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].12, 120 off10280 00000100:00100000:2.0:1783135046.710669:0:14857:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9f6cb0700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c1fe35bd-99cf-438e-8ada-ed586b673efa:14857:1869752384433024:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1783135046.710708:0:14857:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135046.710736:0:14857:0:(client.c:2701:ptlrpc_set_wait()) set ffff9fe9fe8a1e40 going to sleep for 11 seconds 00000100:00100000:1.0:1783135046.710788:0:14216:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384433024 00000100:00100000:1.0:1783135046.710792:0:14216:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384433024 00000100:00100000:1.0:1783135046.710853:0:14216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1783135046.710861:0:14216:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fe40c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1fe35bd-99cf-438e-8ada-ed586b673efa+14:14857:x1869752384433024:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1783135046.710990:0:14216:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fe40c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1fe35bd-99cf-438e-8ada-ed586b673efa+14:14857:x1869752384433024:12345-0@lo:502:mount.lustre.0 Request processed in 129us (281us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135046.710996:0:14216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1783135046.711139:0:14857:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9f6cb0700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c1fe35bd-99cf-438e-8ada-ed586b673efa:14857:1869752384433024:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1783135046.711189:0:14857:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].13, 224 off10504 00000040:00080000:2.0:1783135046.711197:0:14857:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 14 00000020:01000000:2.0:1783135046.711980:0:14871:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1783135046.711988:0:14871:0:(obd_mount.c:952:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:2.0:1783135046.711994:0:14871:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783135046.711996:0:14871:0:(obd_config.c:1561:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:2.0:1783135046.712001:0:14871:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1783135046.712013:0:14871:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff9fe8c57c3380) 00000020:00000080:2.0:1783135046.712030:0:14871:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type obdfilter with refcount 2 00000020:00000080:2.0:1783135046.712034:0:14871:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1783135046.712094:0:14871:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9fe8c47e2000 from lustre-OST0000, refs=2 00080000:01000000:2.0:1783135046.712100:0:14871:0:(osd_handler.c:1569:osd_obd_connect()) connect #1 00000020:00000080:2.0:1783135046.712106:0:14871:0:(genops.c:1406:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xd6c4b8f05867f724 00010000:00010000:2.0:1783135046.715486:0:14871:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:00000004:2.0:1783135046.715823:0:14871:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 4294967310 00080000:10000000:2.0:1783135046.717043:0:14871:0:(osd_index.c:2102:osd_index_try()) lustre-OST0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00000020:00000080:2.0:1783135046.718681:0:14871:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:2.0:1783135046.718690:0:14871:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1783135046.718694:0:14871:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783135046.718697:0:14871:0:(obd_config.c:1561:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:2.0:1783135046.718699:0:14871:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1783135046.718701:0:14871:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #15 00000020:01000000:2.0:1783135046.718703:0:14871:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1783135046.718705:0:14871:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1783135046.718706:0:14871:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1783135046.718708:0:14871:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783135046.718710:0:14871:0:(obd_config.c:1561:class_process_config()) marker 15 (0x6) lustre sys.timeout 00000020:01000000:2.0:1783135046.718712:0:14871:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1783135046.718719:0:14871:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783135046.718720:0:14871:0:(obd_config.c:1561:class_process_config()) marker 22 (0x1) lustre sys.timeout 00000020:00000080:2.0:1783135046.718723:0:14871:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1783135046.718725:0:14871:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1783135046.718727:0:14871:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1783135046.718730:0:14871:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783135046.718731:0:14871:0:(obd_config.c:1561:class_process_config()) marker 22 (0x2) lustre sys.timeout 00000020:01000000:2.0:1783135046.718733:0:14871:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1783135046.718735:0:14871:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783135046.718736:0:14871:0:(obd_config.c:1561:class_process_config()) marker 26 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1783135046.718739:0:14871:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000020:01000000:2.0:1783135046.718781:0:14871:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1783135046.718784:0:14871:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783135046.718785:0:14871:0:(obd_config.c:1561:class_process_config()) marker 26 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1783135046.718788:0:14871:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 14 count 14 00000020:01000000:3.0:1783135046.718923:0:14857:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:3.0:1783135046.718945:0:14857:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.201.141@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1783135046.718964:0:14857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.141@tcp lock: ffff9fe9c7829600/0xd6c4b8f05867f70f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xd6c4b8f05867f716 expref: -99 pid: 14857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135046.718975:0:14857:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.141@tcp lock: ffff9fe9c7829600/0xd6c4b8f05867f70f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xd6c4b8f05867f716 expref: -99 pid: 14857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783135046.718983:0:14857:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff9fe8c47e2000 from 1 10000000:01000000:3.0:1783135046.718985:0:14857:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1783135046.719017:0:14857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.141@tcp lock: ffff9fe9d2b74c00/0xd6c4b8f05867f72b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135046.719025:0:14857:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.141@tcp lock: ffff9fe9d2b74c00/0xd6c4b8f05867f72b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135046.719035:0:14857:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.141@tcp lock: ffff9fe9d2b74c00/0xd6c4b8f05867f72b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783135046.719056:0:14857:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9fea17800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c1fe35bd-99cf-438e-8ada-ed586b673efa:14857:1869752384433152:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1783135046.719113:0:14857:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135046.719149:0:14857:0:(client.c:2701:ptlrpc_set_wait()) set ffff9fe9f615c300 going to sleep for 11 seconds 00000100:00100000:2.0:1783135046.719227:0:14216:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384433152 00000100:00100000:2.0:1783135046.719233:0:14216:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384433152 00000100:00100000:2.0:1783135046.719269:0:14216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1783135046.719276:0:14216:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fe40f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1fe35bd-99cf-438e-8ada-ed586b673efa+14:14857:x1869752384433152:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1783135046.719303:0:14216:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783135046.719313:0:14216:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fe9c7828600/0xd6c4b8f05867f732 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xd6c4b8f05867f72b expref: -99 pid: 14216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135046.719334:0:14216:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fe9c7828600/0xd6c4b8f05867f732 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd6c4b8f05867f72b expref: 15 pid: 14216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135046.719344:0:14216:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fe9c7828600/0xd6c4b8f05867f732 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd6c4b8f05867f72b expref: 15 pid: 14216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135046.719353:0:14216:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fe9c7828600, rc 0) 00000100:00100000:2.0:1783135046.719471:0:14216:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fe40f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1fe35bd-99cf-438e-8ada-ed586b673efa+15:14857:x1869752384433152:12345-0@lo:101:mount.lustre.0 Request processed in 195us (357us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135046.719485:0:14216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1783135046.720598:0:14857:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9fea17800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c1fe35bd-99cf-438e-8ada-ed586b673efa:14857:1869752384433152:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1783135046.720613:0:14857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.141@tcp lock: ffff9fe9d2b74c00/0xd6c4b8f05867f72b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd6c4b8f05867f732 expref: -99 pid: 14857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135046.720622:0:14857:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.141@tcp lock: ffff9fe9d2b74c00/0xd6c4b8f05867f72b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xd6c4b8f05867f732 expref: -99 pid: 14857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1783135046.721043:0:14857:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:0.0:1783135046.722146:0:14857:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1783135046.722508:0:14857:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:0.0:1783135046.722549:0:14857:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:0.0:1783135046.722604:0:14857:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:0.0:1783135046.722612:0:14857:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:0.0:1783135046.722669:0:14857:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe8c6dfc380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c1fe35bd-99cf-438e-8ada-ed586b673efa:14857:1869752384433280:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1783135046.722719:0:14857:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135046.722752:0:14857:0:(client.c:2701:ptlrpc_set_wait()) set ffff9fe8c4fb9c00 going to sleep for 11 seconds 00000100:00100000:1.0:1783135046.722830:0:14217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384433280 00000100:00100000:1.0:1783135046.722836:0:14217:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384433280 00000100:00100000:1.0:1783135046.722872:0:14217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1783135046.722879:0:14217:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fe40e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1fe35bd-99cf-438e-8ada-ed586b673efa+15:14857:x1869752384433280:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1783135046.723037:0:14217:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fe40e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1fe35bd-99cf-438e-8ada-ed586b673efa+15:14857:x1869752384433280:12345-0@lo:501:mount.lustre.0 Request processed in 158us (317us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135046.723045:0:14217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1783135046.723133:0:14857:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe8c6dfc380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c1fe35bd-99cf-438e-8ada-ed586b673efa:14857:1869752384433280:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1783135046.723158:0:14857:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe8c6dfc380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c1fe35bd-99cf-438e-8ada-ed586b673efa:14857:1869752384433408:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1783135046.723188:0:14857:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135046.723208:0:14857:0:(client.c:2701:ptlrpc_set_wait()) set ffff9fe8c4fb9c00 going to sleep for 11 seconds 00000100:00100000:1.0:1783135046.723249:0:14215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384433408 00000100:00100000:1.0:1783135046.723252:0:14215:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384433408 00000100:00100000:1.0:1783135046.723276:0:14215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1783135046.723357:0:14215:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fe40d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c1fe35bd-99cf-438e-8ada-ed586b673efa+15:14857:x1869752384433408:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1783135046.723495:0:14215:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fe40d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c1fe35bd-99cf-438e-8ada-ed586b673efa+15:14857:x1869752384433408:12345-0@lo:503:mount.lustre.0 Request processed in 139us (305us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135046.723541:0:14857:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe8c6dfc380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c1fe35bd-99cf-438e-8ada-ed586b673efa:14857:1869752384433408:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1783135046.723878:0:14857:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1783135046.723924:0:14857:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9f6cb0700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c1fe35bd-99cf-438e-8ada-ed586b673efa:14857:1869752384433536:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1783135046.723954:0:14857:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135046.723976:0:14216:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384433536 00000100:00100000:2.0:1783135046.723979:0:14216:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384433536 00000100:00100000:1.0:1783135046.725943:0:14215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1783135046.727903:0:14216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1783135046.727917:0:14216:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fe40c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1fe35bd-99cf-438e-8ada-ed586b673efa+15:14857:x1869752384433536:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1783135046.728132:0:14216:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fe40c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1fe35bd-99cf-438e-8ada-ed586b673efa+15:14857:x1869752384433536:12345-0@lo:502:mount.lustre.0 Request processed in 220us (4177us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135046.728140:0:14216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1783135046.728223:0:14857:0:(client.c:2701:ptlrpc_set_wait()) set ffff9fe9fe8a1c00 going to sleep for 11 seconds 00000100:00100000:2.0:1783135046.728245:0:14857:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9f6cb0700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c1fe35bd-99cf-438e-8ada-ed586b673efa:14857:1869752384433536:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1783135046.728652:0:14857:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:2.0:1783135046.728696:0:14857:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:2.0:1783135046.728735:0:14857:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:2.0:1783135046.728764:0:14857:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:2.0:1783135046.728790:0:14857:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:2.0:1783135046.728833:0:14857:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:2.0:1783135046.728867:0:14857:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:2.0:1783135046.728897:0:14857:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000100:00100000:2.0:1783135046.728930:0:14857:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9f6cb0700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c1fe35bd-99cf-438e-8ada-ed586b673efa:14857:1869752384433664:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1783135046.728972:0:14857:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135046.729030:0:14857:0:(client.c:2701:ptlrpc_set_wait()) set ffff9fe9fe8a1c00 going to sleep for 11 seconds 00000100:00100000:1.0:1783135046.729061:0:14215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384433664 00000100:00100000:1.0:1783135046.729066:0:14215:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384433664 00000100:00100000:1.0:1783135046.729123:0:14215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1783135046.729130:0:14215:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fe40dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c1fe35bd-99cf-438e-8ada-ed586b673efa+15:14857:x1869752384433664:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1783135046.729257:0:14215:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fe40dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c1fe35bd-99cf-438e-8ada-ed586b673efa+15:14857:x1869752384433664:12345-0@lo:502:mount.lustre.0 Request processed in 127us (284us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135046.729263:0:14215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1783135046.729349:0:14857:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9f6cb0700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c1fe35bd-99cf-438e-8ada-ed586b673efa:14857:1869752384433664:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1783135046.729456:0:14857:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:2.0:1783135046.729464:0:14857:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:3.0:1783135046.730187:0:14875:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1783135046.730196:0:14875:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783135046.730203:0:14875:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1783135046.730209:0:14875:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9fe8c47e2000 00000020:00000080:3.0:1783135046.730211:0:14875:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1783135046.730218:0:14875:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1783135046.730221:0:14875:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783135046.730222:0:14875:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1783135046.730225:0:14875:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1783135046.730227:0:14875:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783135046.730228:0:14875:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1783135046.730232:0:14875:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9fe8c47e2000 00000020:00000080:3.0:1783135046.730233:0:14875:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1783135046.730309:0:14875:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1783135046.730313:0:14875:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783135046.730315:0:14875:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:3.0:1783135046.730317:0:14875:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1783135046.730319:0:14875:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783135046.730320:0:14875:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1783135046.730323:0:14875:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9fe8c47e2000 00000020:00000080:3.0:1783135046.730325:0:14875:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1783135046.730358:0:14875:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1783135046.730362:0:14875:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783135046.730364:0:14875:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:3.0:1783135046.730366:0:14875:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 10 00000020:01000000:3.0:1783135046.731335:0:14857:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:3.0:1783135046.731359:0:14857:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.201.141@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1783135046.731376:0:14857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.141@tcp lock: ffff9fe9d2b74c00/0xd6c4b8f05867f72b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd6c4b8f05867f732 expref: -99 pid: 14857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135046.731399:0:14857:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.141@tcp lock: ffff9fe9d2b74c00/0xd6c4b8f05867f72b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd6c4b8f05867f732 expref: -99 pid: 14857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783135046.731439:0:14857:0:(mgc_request.c:1945:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1783135046.731442:0:14857:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9fe8c47e2000 10000000:01000000:3.0:1783135046.731450:0:14857:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9fe8c47e2000 10000000:01000000:3.0:1783135046.731454:0:14857:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1783135046.731460:0:14857:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff9fe8c47e2000 from 1 10000000:01000000:3.0:1783135046.731463:0:14857:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1783135046.731493:0:14857:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.141@tcp lock: ffff9fe9d2b75c00/0xd6c4b8f05867f739 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135046.731503:0:14857:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.141@tcp lock: ffff9fe9d2b75c00/0xd6c4b8f05867f739 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135046.731514:0:14857:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.141@tcp lock: ffff9fe9d2b75c00/0xd6c4b8f05867f739 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783135046.731536:0:14857:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9fea14380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c1fe35bd-99cf-438e-8ada-ed586b673efa:14857:1869752384433792:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1783135046.731590:0:14857:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135046.733913:0:14217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384433792 00000100:00100000:0.0:1783135046.733926:0:14217:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384433792 00000100:00100000:3.0:1783135046.733934:0:14857:0:(client.c:2701:ptlrpc_set_wait()) set ffff9fe9ca930240 going to sleep for 11 seconds 00000100:00100000:0.0:1783135046.733968:0:14217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1783135046.733979:0:14217:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fe40e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1fe35bd-99cf-438e-8ada-ed586b673efa+15:14857:x1869752384433792:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1783135046.733995:0:14217:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783135046.734010:0:14217:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fe9f68ad600/0xd6c4b8f05867f740 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xd6c4b8f05867f739 expref: -99 pid: 14217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135046.734037:0:14217:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fe9f68ad600/0xd6c4b8f05867f740 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd6c4b8f05867f739 expref: 16 pid: 14217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135046.734050:0:14217:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fe9f68ad600/0xd6c4b8f05867f740 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd6c4b8f05867f739 expref: 16 pid: 14217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135046.734061:0:14217:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fe9f68ad600, rc 0) 00000100:00100000:0.0:1783135046.734310:0:14217:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fe40e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1fe35bd-99cf-438e-8ada-ed586b673efa+16:14857:x1869752384433792:12345-0@lo:101:mount.lustre.0 Request processed in 331us (2718us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135046.734314:0:14857:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9fea14380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c1fe35bd-99cf-438e-8ada-ed586b673efa:14857:1869752384433792:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1783135046.734333:0:14857:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.141@tcp lock: ffff9fe9d2b75c00/0xd6c4b8f05867f739 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xd6c4b8f05867f740 expref: -99 pid: 14857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135046.734340:0:14857:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.141@tcp lock: ffff9fe9d2b75c00/0xd6c4b8f05867f739 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xd6c4b8f05867f740 expref: -99 pid: 14857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1783135046.734997:0:14857:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000100:00100000:0.0:1783135046.735634:0:14217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000040:00080000:3.0:1783135046.735810:0:14857:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1783135046.736641:0:14857:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:3.0:1783135046.736699:0:14857:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:3.0:1783135046.736744:0:14857:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:3.0:1783135046.736847:0:14857:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:3.0:1783135046.736913:0:14857:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:3.0:1783135046.736955:0:14857:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:3.0:1783135046.736983:0:14857:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:3.0:1783135046.737016:0:14857:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:3.0:1783135046.737070:0:14857:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:3.0:1783135046.737127:0:14857:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:3.0:1783135046.737205:0:14857:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:3.0:1783135046.737310:0:14857:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:3.0:1783135046.737372:0:14857:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:3.0:1783135046.737445:0:14857:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:3.0:1783135046.737542:0:14857:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:3.0:1783135046.737687:0:14857:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:3.0:1783135046.737752:0:14857:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:3.0:1783135046.737822:0:14857:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:3.0:1783135046.737877:0:14857:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:3.0:1783135046.737926:0:14857:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:3.0:1783135046.737999:0:14857:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:3.0:1783135046.738045:0:14857:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:3.0:1783135046.738091:0:14857:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:3.0:1783135046.738163:0:14857:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:3.0:1783135046.738218:0:14857:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 128 off12440 00000040:00080000:3.0:1783135046.738275:0:14857:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12664 00000040:00080000:3.0:1783135046.738397:0:14857:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12888 00000040:00080000:3.0:1783135046.738462:0:14857:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off12968 00000040:00080000:3.0:1783135046.738587:0:14857:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13192 00000040:00080000:3.0:1783135046.738599:0:14857:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 29 count 30 00000100:00100000:3.0:1783135046.738684:0:14857:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9fea14380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c1fe35bd-99cf-438e-8ada-ed586b673efa:14857:1869752384433920:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1783135046.738749:0:14857:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135046.738783:0:14215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384433920 00000100:00100000:1.0:1783135046.738790:0:14215:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384433920 00000100:00100000:3.0:1783135046.738792:0:14857:0:(client.c:2701:ptlrpc_set_wait()) set ffff9fe9ca930240 going to sleep for 11 seconds 00000100:00100000:1.0:1783135046.738834:0:14215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1783135046.738845:0:14215:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fe40cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c1fe35bd-99cf-438e-8ada-ed586b673efa+16:14857:x1869752384433920:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1783135046.739071:0:14215:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fe40cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c1fe35bd-99cf-438e-8ada-ed586b673efa+16:14857:x1869752384433920:12345-0@lo:501:mount.lustre.0 Request processed in 227us (322us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135046.739079:0:14215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1783135046.739536:0:14857:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9fea14380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c1fe35bd-99cf-438e-8ada-ed586b673efa:14857:1869752384433920:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1783135046.739746:0:14857:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe8c6dfed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c1fe35bd-99cf-438e-8ada-ed586b673efa:14857:1869752384434048:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1783135046.739856:0:14857:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135046.739878:0:14217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384434048 00000100:00100000:0.0:1783135046.739882:0:14857:0:(client.c:2701:ptlrpc_set_wait()) set ffff9fe8c4fb9000 going to sleep for 11 seconds 00000100:00100000:1.0:1783135046.739884:0:14217:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384434048 00000100:00100000:1.0:1783135046.739919:0:14217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1783135046.739928:0:14217:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fe40d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1fe35bd-99cf-438e-8ada-ed586b673efa+16:14857:x1869752384434048:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1783135046.740092:0:14217:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fe40d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1fe35bd-99cf-438e-8ada-ed586b673efa+16:14857:x1869752384434048:12345-0@lo:503:mount.lustre.0 Request processed in 166us (297us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135046.740100:0:14217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1783135046.740179:0:14857:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe8c6dfed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c1fe35bd-99cf-438e-8ada-ed586b673efa:14857:1869752384434048:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1783135046.740761:0:14857:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1783135046.740811:0:14857:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe8c6dfed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c1fe35bd-99cf-438e-8ada-ed586b673efa:14857:1869752384434176:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1783135046.740847:0:14857:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135046.740870:0:14857:0:(client.c:2701:ptlrpc_set_wait()) set ffff9fe8c4fb9000 going to sleep for 11 seconds 00000100:00100000:1.0:1783135046.741425:0:14215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384434176 00000100:00100000:1.0:1783135046.741431:0:14215:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384434176 00000100:00100000:1.0:1783135046.741456:0:14215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1783135046.741463:0:14215:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9ca9ba050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c1fe35bd-99cf-438e-8ada-ed586b673efa+16:14857:x1869752384434176:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1783135046.741628:0:14215:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9ca9ba050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c1fe35bd-99cf-438e-8ada-ed586b673efa+16:14857:x1869752384434176:12345-0@lo:502:mount.lustre.0 Request processed in 165us (780us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135046.741636:0:14215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1783135046.741741:0:14857:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe8c6dfed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c1fe35bd-99cf-438e-8ada-ed586b673efa:14857:1869752384434176:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1783135046.741967:0:14857:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:0.0:1783135046.742007:0:14857:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:0.0:1783135046.742035:0:14857:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:0.0:1783135046.742078:0:14857:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:0.0:1783135046.742115:0:14857:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:0.0:1783135046.742155:0:14857:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:0.0:1783135046.742181:0:14857:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:0.0:1783135046.742205:0:14857:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:0.0:1783135046.742241:0:14857:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:0.0:1783135046.742268:0:14857:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:0.0:1783135046.745531:0:14857:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:0.0:1783135046.745616:0:14857:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:0.0:1783135046.745647:0:14857:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:0.0:1783135046.745674:0:14857:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:0.0:1783135046.745713:0:14857:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:0.0:1783135046.745740:0:14857:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:0.0:1783135046.745767:0:14857:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:0.0:1783135046.745804:0:14857:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:0.0:1783135046.745832:0:14857:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:0.0:1783135046.745859:0:14857:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:0.0:1783135046.745897:0:14857:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:0.0:1783135046.745925:0:14857:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:0.0:1783135046.745951:0:14857:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:0.0:1783135046.746000:0:14857:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:0.0:1783135046.746031:0:14857:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 128 off12440 00000040:00080000:0.0:1783135046.746066:0:14857:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12664 00000040:00080000:0.0:1783135046.746116:0:14857:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12888 00000040:00080000:0.0:1783135046.746145:0:14857:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off12968 00000040:00080000:0.0:1783135046.746172:0:14857:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13192 00000040:00080000:0.0:1783135046.746208:0:14857:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13416 00000040:00080000:0.0:1783135046.746236:0:14857:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13504 00000040:00080000:0.0:1783135046.746263:0:14857:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13632 00000040:00080000:0.0:1783135046.746312:0:14857:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13776 00000040:00080000:0.0:1783135046.746360:0:14857:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13904 00000040:00080000:0.0:1783135046.746410:0:14857:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14128 00000040:00080000:0.0:1783135046.746455:0:14857:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14352 00000040:00080000:0.0:1783135046.746490:0:14857:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14432 00000040:00080000:0.0:1783135046.746524:0:14857:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14656 00000040:00080000:0.0:1783135046.746564:0:14857:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14880 00000040:00080000:0.0:1783135046.746595:0:14857:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 120 off15000 00000100:00100000:0.0:1783135046.746637:0:14857:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe8c6dfed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c1fe35bd-99cf-438e-8ada-ed586b673efa:14857:1869752384434304:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1783135046.746702:0:14857:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135046.746733:0:14857:0:(client.c:2701:ptlrpc_set_wait()) set ffff9fe8c4fb9000 going to sleep for 11 seconds 00000100:00100000:1.0:1783135046.746818:0:14216:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384434304 00000100:00100000:1.0:1783135046.746825:0:14216:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384434304 00000100:00100000:1.0:1783135046.746870:0:14216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1783135046.746878:0:14216:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9ca9b8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1fe35bd-99cf-438e-8ada-ed586b673efa+16:14857:x1869752384434304:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1783135046.747078:0:14216:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9ca9b8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1fe35bd-99cf-438e-8ada-ed586b673efa+16:14857:x1869752384434304:12345-0@lo:502:mount.lustre.0 Request processed in 200us (375us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135046.747086:0:14216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1783135046.747170:0:14857:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe8c6dfed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c1fe35bd-99cf-438e-8ada-ed586b673efa:14857:1869752384434304:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1783135046.747237:0:14857:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 224 off15224 00000040:00080000:0.0:1783135046.747250:0:14857:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:0.0:1783135046.751685:0:14880:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:0.0:1783135046.751699:0:14880:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff9fe9c8ef99c0) 00000020:00000080:0.0:1783135046.751718:0:14880:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type lwp with refcount 2 00000020:01000004:0.0:1783135046.751832:0:14880:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9fe8c47e2000 from lustre-OST0000, refs=3 00000020:01000004:0.0:1783135046.751835:0:14880:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9fe8c47e2000 from lustre-OST0000, refs=3 00000020:01000004:0.0:1783135046.751838:0:14880:0:(obd_mount.c:701:lustre_put_lsi()) put ffff9fe8c47e2000 3 00010000:00080000:0.0:1783135046.751862:0:14880:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9fe9e0d13000@lustre-MDT0000-lwp-OST0000: add connection 192.168.201.141@tcp at head 00010000:00010000:0.0:1783135046.753744:0:14880:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-4 is initialized 00000020:00000080:0.0:1783135046.753826:0:14880:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:0.0:1783135046.753864:0:14880:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1783135046.753875:0:14880:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0xd6c4b8f05867f74e 00000100:00080000:0.0:1783135046.753884:0:14880:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1783135046.753890:0:14880:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9fe9e0d13000 using connection 192.168.201.141@tcp/0@lo 00000100:00100000:0.0:1783135046.753922:0:14880:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9fe8c6dfed80 x1869752384434432/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1783135046.753981:0:3285:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe8c6dfed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3285:1869752384434432:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1783135046.754042:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1783135046.754121:0:14880:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1783135046.754140:0:36:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1783135046.754145:0:36:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1783135046.754147:0:36:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1783135046.754151:0:36:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1783135046.754248:0:14223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384434432 00000100:00100000:1.0:1783135046.754255:0:14223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384434432 00000100:00100000:1.0:1783135046.754309:0:14223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1783135046.754317:0:14223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9f6cb0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3285:x1869752384434432:12345-0@lo:38:llog_process_th.0 00010000:00080000:1.0:1783135046.754337:0:14223:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 329 last 0 00000020:00000080:1.0:1783135046.754367:0:14223:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0xd6c4b8f05867f755 00000004:00100000:1.0:1783135046.754380:0:14223:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1783135046.754420:0:14223:0:(import.c:65:import_set_state_nolock()) ffff9fe8c5ff9000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1783135046.754614:0:14223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9f6cb0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3285:x1869752384434432:12345-0@lo:38:llog_process_th.0 Request processed in 296us (570us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135046.754621:0:14223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1783135046.754645:0:3288:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1783135046.754653:0:3288:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe8c6dfca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3288:1869752384434560:0@lo:400:kworker.0 00000100:00100000:1.0:1783135046.754676:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135046.754752:0:14224:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384434560 00000100:00100000:0.0:1783135046.754756:0:14224:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384434560 00000100:00100000:0.0:1783135046.754784:0:14224:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1783135046.754791:0:14224:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fe958380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3288:x1869752384434560:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783135046.754828:0:14224:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fe958380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3288:x1869752384434560:12345-0@lo:400:kworker.0 Request processed in 38us (150us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135046.754834:0:14224:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1783135046.754897:0:3288:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9fe8c6dfca80 x1869752384434560/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783135062 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783135046.754922:0:3288:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe8c6dfca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3288:1869752384434560:0@lo:400:kworker.0 00010000:00080000:2.0:1783135046.754966:0:3285:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9fe8c6dfed80 x1869752384434432/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1783135056 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783135046.754975:0:3285:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1783135046.754981:0:3285:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 2 00000100:00080000:2.0:1783135046.754987:0:3285:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1783135046.754991:0:3285:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1783135046.754993:0:3285:0:(import.c:65:import_set_state_nolock()) ffff9fe9e0d13000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1783135046.754998:0:3285:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe8c6dfed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3285:1869752384434432:0@lo:38:llog_process_th.0 00000040:00080000:0.0:1783135046.755844:0:14880:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00000020:01000000:1.0:1783135046.755999:0:14857:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:1.0:1783135046.756023:0:14857:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.201.141@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1783135046.756062:0:14857:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.141@tcp lock: ffff9fe9d2b75c00/0xd6c4b8f05867f739 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xd6c4b8f05867f740 expref: -99 pid: 14857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135046.756073:0:14857:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.141@tcp lock: ffff9fe9d2b75c00/0xd6c4b8f05867f739 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xd6c4b8f05867f740 expref: -99 pid: 14857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1783135046.756116:0:14857:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1783135046.756119:0:14857:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1783135046.756120:0:14857:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1783135046.756122:0:14857:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1783135046.756123:0:14857:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1783135046.756124:0:14857:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1783135046.756126:0:14857:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1783135046.756128:0:14857:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1783135046.756129:0:14857:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1783135046.756132:0:14857:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:1.0:1783135046.756135:0:14857:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1783135046.756137:0:14857:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1783135046.756138:0:14857:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1783135046.756139:0:14857:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1783135046.756140:0:14857:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1783135046.756141:0:14857:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1783135046.756142:0:14857:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1783135046.756144:0:14857:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1783135046.756145:0:14857:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1783135046.756166:0:14857:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:1.0:1783135046.756178:0:14857:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9fe958a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c1fe35bd-99cf-438e-8ada-ed586b673efa:14857:1869752384434688:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1783135046.756212:0:14857:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135046.756244:0:14857:0:(client.c:2701:ptlrpc_set_wait()) set ffff9fe9cb3e9900 going to sleep for 11 seconds 00000100:00100000:2.0:1783135046.756307:0:14217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384434688 00000100:00100000:2.0:1783135046.756311:0:14217:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384434688 00000100:00100000:2.0:1783135046.756338:0:14217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1783135046.756345:0:14217:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9ca9b9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1fe35bd-99cf-438e-8ada-ed586b673efa+16:14857:x1869752384434688:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1783135046.756363:0:14217:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:2.0:1783135046.756375:0:14217:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1783135046.772880:0:14217:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1783135046.772957:0:14217:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:3.0:1783135046.772989:0:14238:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1783135046.772994:0:14238:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1783135046.773014:0:14238:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9fe9d2b75800/0xd6c4b8f05867f75c lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135046.773044:0:14238:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9fe9c7829400/0xd6c4b8f05867f6c9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd6c4b8f05867f6c2 expref: 16 pid: 14215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135046.773053:0:14238:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9fe9d2b75800/0xd6c4b8f05867f75c lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135046.773085:0:14238:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9fe9c7829400/0xd6c4b8f05867f6c9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd6c4b8f05867f6c2 expref: 16 pid: 14215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135046.773096:0:14238:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9fe9c7829400/0xd6c4b8f05867f6c9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd6c4b8f05867f6c2 expref: 16 pid: 14215 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783135046.773110:0:14238:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9fea16d80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14238:1869752384434816:0@lo:104: 00000100:00100000:3.0:1783135046.773164:0:14238:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135046.773203:0:14238:0:(client.c:2701:ptlrpc_set_wait()) set ffff9fe9ca930f00 going to sleep for 11 seconds 00000100:00100000:2.0:1783135046.773222:0:14206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384434816 00000100:00100000:2.0:1783135046.773231:0:14206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384434816 00000100:00100000:2.0:1783135046.773299:0:14206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1783135046.773310:0:14206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fea16680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c1fe35bd-99cf-438e-8ada-ed586b673efa+3:14238:x1869752384434816:12345-0@lo:104: 00010000:00010000:2.0:1783135046.773322:0:14206:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.141@tcp lock: ffff9fe9c7828a00/0xd6c4b8f05867f6c2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xd6c4b8f05867f6c9 expref: -99 pid: 14219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135046.773395:0:14206:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1783135046.773417:0:14206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fea16680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c1fe35bd-99cf-438e-8ada-ed586b673efa+3:14238:x1869752384434816:12345-0@lo:104: Request processed in 110us (252us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135046.773426:0:14206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:2.0:1783135046.773457:0:14210:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783135046.773462:0:14210:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.141@tcp lock: ffff9fe9c7828a00/0xd6c4b8f05867f6c2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xd6c4b8f05867f6c9 expref: -99 pid: 14219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135046.773470:0:14210:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe9c7828a00 already unused, calling callback (ffffffffc1b40c20) 10000000:00010000:2.0:1783135046.773474:0:14210:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.141@tcp lock: ffff9fe9c7828a00/0xd6c4b8f05867f6c2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xd6c4b8f05867f6c9 expref: -99 pid: 14219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135046.773482:0:14210:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.141@tcp lock: ffff9fe9c7828a00/0xd6c4b8f05867f6c2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xd6c4b8f05867f6c9 expref: -99 pid: 14219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783135046.773490:0:14210:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.141@tcp lock: ffff9fe9c7828a00/0xd6c4b8f05867f6c2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xd6c4b8f05867f6c9 expref: -99 pid: 14219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783135046.773497:0:14210:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1783135046.773526:0:14210:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.141@tcp lock: ffff9fe9c7828a00/0xd6c4b8f05867f6c2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd6c4b8f05867f6c9 expref: -99 pid: 14219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135046.773533:0:14210:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1783135046.773553:0:14210:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.141@tcp lock: ffff9fe9c7828a00/0xd6c4b8f05867f6c2 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd6c4b8f05867f6c9 expref: -99 pid: 14219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135046.773561:0:14210:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.141@tcp lock: ffff9fe9c7828a00/0xd6c4b8f05867f6c2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd6c4b8f05867f6c9 expref: -99 pid: 14219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783135046.773569:0:3286:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9f6cb3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c1fe35bd-99cf-438e-8ada-ed586b673efa:3286:1869752384434944:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1783135046.773578:0:14210:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783135046.773582:0:14210:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783135046.773585:0:14210:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783135046.773599:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135046.773651:0:14208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384434944 00000100:00100000:3.0:1783135046.773655:0:14208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384434944 00010000:00010000:3.0:1783135046.773670:0:14208:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9fe9c7829400/0xd6c4b8f05867f6c9 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd6c4b8f05867f6c2 expref: 17 pid: 14215 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783135046.773689:0:14208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1783135046.773694:0:14208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fea15880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c1fe35bd-99cf-438e-8ada-ed586b673efa+17:3286:x1869752384434944:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1783135046.773703:0:14208:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783135046.773707:0:14208:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9fe9c7829400/0xd6c4b8f05867f6c9 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd6c4b8f05867f6c2 expref: 17 pid: 14215 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135046.773726:0:14208:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9fe9c7829400/0xd6c4b8f05867f6c9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd6c4b8f05867f6c2 expref: 17 pid: 14215 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135046.773740:0:14208:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9fe9d2b75800/0xd6c4b8f05867f75c lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135046.773748:0:14208:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fe9d2b75800/0xd6c4b8f05867f75c lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1783135046.773758:0:14208:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001553648s 00010000:00010000:3.0:1783135046.773762:0:14208:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9fe9d2b75800/0xd6c4b8f05867f75c lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135046.773769:0:14208:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9fe9d2b75800/0xd6c4b8f05867f75c lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135046.773776:0:14208:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9fe9d2b75800/0xd6c4b8f05867f75c lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135046.773783:0:14208:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9fe9d2b75800/0xd6c4b8f05867f75c lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135046.773788:0:14208:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe9d2b75800 already unused, calling callback (ffffffffc1527ce0) 00010000:00010000:3.0:1783135046.773792:0:14208:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9fe9d2b75800/0xd6c4b8f05867f75c lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135046.773799:0:14208:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9fe9d2b75800/0xd6c4b8f05867f75c lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135046.773806:0:14208:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9fe9d2b75800/0xd6c4b8f05867f75c lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135046.773819:0:14208:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783135046.773848:0:14208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fea15880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c1fe35bd-99cf-438e-8ada-ed586b673efa+17:3286:x1869752384434944:12345-0@lo:103:ldlm_bl.0 Request processed in 154us (249us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135046.773857:0:14208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1783135046.773884:0:3286:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9f6cb3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c1fe35bd-99cf-438e-8ada-ed586b673efa:3286:1869752384434944:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1783135046.773928:0:14238:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fe9c7829400/0xd6c4b8f05867f6c9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd6c4b8f05867f6c2 expref: 16 pid: 14215 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783135046.773944:0:14238:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9fea16d80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14238:1869752384434816:0@lo:104: 00010000:00010000:1.0:1783135046.773958:0:14238:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9fe9d2b75800/0xd6c4b8f05867f75c lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135046.773966:0:14238:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9fe9d2b75800/0xd6c4b8f05867f75c lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135046.773973:0:14238:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9fe9d2b75800/0xd6c4b8f05867f75c lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135046.773980:0:14238:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fe9d2b75800/0xd6c4b8f05867f75c lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783135046.778176:0:14217:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9ca9b9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1fe35bd-99cf-438e-8ada-ed586b673efa+15:14857:x1869752384434688:12345-0@lo:253:mount.lustre.0 Request processed in 21824us (21955us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135046.778189:0:14217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1783135046.778307:0:14857:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9fe958a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c1fe35bd-99cf-438e-8ada-ed586b673efa:14857:1869752384434688:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1783135046.778323:0:14857:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:1.0:1783135046.778327:0:14857:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1783135046.778329:0:14857:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1783135046.778331:0:14857:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1783135046.778333:0:14857:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1783135046.778334:0:14857:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1783135046.778336:0:14857:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1783135046.778338:0:14857:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1783135046.778340:0:14857:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1783135046.778342:0:14857:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1783135046.778355:0:14857:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:0.0:1783135046.781963:0:14857:0:(osd_index.c:2102:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:0.0:1783135046.782132:0:14857:0:(osd_index.c:2102:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:0.0:1783135046.782396:0:14857:0:(osd_index.c:2102:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:0.0:1783135046.782610:0:14857:0:(osd_index.c:2102:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:0.0:1783135046.782749:0:14857:0:(osd_index.c:2102:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:0.0:1783135046.782940:0:14857:0:(osd_index.c:2102:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:0.0:1783135046.783739:0:14857:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:0.0:1783135046.811636:0:14857:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:0.0:1783135046.811645:0:14857:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:0.0:1783135046.811675:0:14857:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1783135046.811718:0:14857:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.141@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1783135046.811728:0:14857:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=48 00000080:00000004:0.0:1783135046.811753:0:14857:0:(super25.c:187:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00010000:00010000:1.0:1783135047.107561:0:14211:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783135048.132484:0:14210:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1783135048.387404:0:14219:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1783135048.387412:0:14219:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-mdtir-ffff9fe9f6f8d000 from 7 10000000:01000000:3.0:1783135048.387417:0:14219:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1783135048.387478:0:14219:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.141@tcp lock: ffff9fe9d2b75800/0xd6c4b8f05867f763 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135048.387491:0:14219:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.141@tcp lock: ffff9fe9d2b75800/0xd6c4b8f05867f763 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135048.387511:0:14219:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.141@tcp lock: ffff9fe9d2b75800/0xd6c4b8f05867f763 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783135048.387539:0:14219:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9fea16a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1fe35bd-99cf-438e-8ada-ed586b673efa:14219:1869752384435072:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1783135048.387620:0:14219:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135048.387677:0:14219:0:(client.c:2701:ptlrpc_set_wait()) set ffff9fe9f615c300 going to sleep for 11 seconds 00000100:00100000:0.0:1783135048.387697:0:14215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384435072 00000100:00100000:0.0:1783135048.387706:0:14215:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384435072 00000100:00100000:0.0:1783135048.387759:0:14215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1783135048.387768:0:14215:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9ca9ba450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c1fe35bd-99cf-438e-8ada-ed586b673efa+15:14219:x1869752384435072:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783135048.387780:0:14215:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783135048.387791:0:14215:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fe9f68ad800/0xd6c4b8f05867f76a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd6c4b8f05867f763 expref: -99 pid: 14215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135048.387809:0:14215:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fe9f68ad800/0xd6c4b8f05867f76a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd6c4b8f05867f763 expref: 16 pid: 14215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135048.387817:0:14215:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fe9f68ad800/0xd6c4b8f05867f76a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd6c4b8f05867f763 expref: 16 pid: 14215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135048.387825:0:14215:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fe9f68ad800, rc 0) 00000100:00100000:0.0:1783135048.387869:0:14215:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9ca9ba450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c1fe35bd-99cf-438e-8ada-ed586b673efa+16:14219:x1869752384435072:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 102us (249us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135048.387876:0:14215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1783135048.388034:0:14219:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9fea16a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1fe35bd-99cf-438e-8ada-ed586b673efa:14219:1869752384435072:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783135048.388049:0:14219:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.141@tcp lock: ffff9fe9d2b75800/0xd6c4b8f05867f763 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd6c4b8f05867f76a expref: -99 pid: 14219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135048.388058:0:14219:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.141@tcp lock: ffff9fe9d2b75800/0xd6c4b8f05867f763 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd6c4b8f05867f76a expref: -99 pid: 14219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783135048.388115:0:14219:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9fea16a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1fe35bd-99cf-438e-8ada-ed586b673efa:14219:1869752384435200:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1783135048.388151:0:14219:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135048.388164:0:14219:0:(client.c:2701:ptlrpc_set_wait()) set ffff9fe9f615c300 going to sleep for 11 seconds 00000100:00100000:0.0:1783135048.388444:0:14217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384435200 00000100:00100000:0.0:1783135048.388456:0:14217:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384435200 00000100:00100000:0.0:1783135048.388483:0:14217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1783135048.388490:0:14217:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9ca9b8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1fe35bd-99cf-438e-8ada-ed586b673efa+16:14219:x1869752384435200:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1783135048.388505:0:14217:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1783135048.388530:0:14217:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1783135048.388533:0:14217:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 7 00000100:00100000:0.0:1783135048.388985:0:14217:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9ca9b8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1fe35bd-99cf-438e-8ada-ed586b673efa+16:14219:x1869752384435200:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 494us (830us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135048.389005:0:14217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1783135048.389014:0:14219:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9fea16a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1fe35bd-99cf-438e-8ada-ed586b673efa:14219:1869752384435200:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1783135048.389065:0:14219:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.201.141@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1783135048.389070:0:14219:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.141@tcp lock: ffff9fe9d2b75800/0xd6c4b8f05867f763 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd6c4b8f05867f76a expref: -99 pid: 14219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135048.389076:0:14219:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.141@tcp lock: ffff9fe9d2b75800/0xd6c4b8f05867f763 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd6c4b8f05867f76a expref: -99 pid: 14219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135049.155748:0:14211:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783135049.860769:0:3285:0:(client.c:2489:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1783135039/real 1783135039] req@ffff9fe9f6cb0a80 x1869752384428800/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1783135049 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783135049.860802:0:3285:0:(client.c:2520:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9fe9f6cb0a80 x1869752384428800/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1783135049 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783135049.860813:0:3285:0:(client.c:2489:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1783135039/real 1783135039] req@ffff9fe9f6cb0380 x1869752384428672/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1783135049 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783135049.860824:0:3285:0:(client.c:2520:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9fe9f6cb0380 x1869752384428672/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1783135049 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1783135049.860845:0:3285:0:(import.c:65:import_set_state_nolock()) ffff9fe9f5c91000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1783135049.860987:0:3285:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1783135049.860993:0:3285:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9f6cb0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3285:1869752384428800:0@lo:8:llog_process_th.0 00000100:00080000:3.0:1783135049.861000:0:3285:0:(import.c:65:import_set_state_nolock()) ffff9fe9c979c800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1783135049.861006:0:3285:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1783135049.861009:0:3285:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9f6cb0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3285:1869752384428672:0@lo:8:llog_process_th.0 00000100:00080000:2.0:1783135049.861215:0:8:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1783135049.861220:0:8:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1783135049.861223:0:8:0:(import.c:65:import_set_state_nolock()) ffff9fe9c979c800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1783135049.861228:0:8:0:(import.c:512:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 321 00000100:00080000:2.0:1783135049.861233:0:8:0:(import.c:591:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1783135049.861239:0:8:0:(import.c:626:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9fe9c979c800 using connection 192.168.201.141@tcp/0@lo 00000100:00100000:2.0:1783135049.861258:0:8:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9fe9f6cb1500 x1869752384435456/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1783135049.861272:0:8:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1783135049.861275:0:8:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1783135049.861301:0:8:0:(import.c:65:import_set_state_nolock()) ffff9fe9f5c91000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1783135049.861305:0:8:0:(import.c:512:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 321 00000100:00080000:2.0:1783135049.861308:0:8:0:(import.c:591:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1783135049.861311:0:8:0:(import.c:626:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9fe9f5c91000 using connection 192.168.201.141@tcp/0@lo 00000100:00100000:2.0:1783135049.861323:0:8:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9fe9f6cb1180 x1869752384435584/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1783135049.861443:0:3287:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9f6cb3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c1fe35bd-99cf-438e-8ada-ed586b673efa:3287:1869752384435328:0@lo:400:kworker.0 00000100:00100000:2.0:1783135049.861505:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135049.861555:0:3288:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9f6cb1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3288:1869752384435712:0@lo:400:kworker.0 00000100:00100000:2.0:1783135049.861575:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135049.861588:0:3288:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1783135049.861591:0:3288:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9f6cb2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3288:1869752384435840:0@lo:400:kworker.0 00000100:00100000:2.0:1783135049.861603:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135049.861623:0:14215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384435328 00000100:00100000:2.0:1783135049.861628:0:14215:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384435328 00000100:00100000:2.0:1783135049.861656:0:14215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1783135049.861662:0:14215:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9ca9ba850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c1fe35bd-99cf-438e-8ada-ed586b673efa+16:3287:x1869752384435328:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783135049.861692:0:14215:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9ca9ba850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c1fe35bd-99cf-438e-8ada-ed586b673efa+16:3287:x1869752384435328:12345-0@lo:400:kworker.0 Request processed in 30us (190us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135049.861697:0:14215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1783135049.861721:0:14223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384435712 00000100:00100000:2.0:1783135049.861724:0:14223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384435712 00000100:00100000:2.0:1783135049.861737:0:14223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384435840 00000100:00100000:2.0:1783135049.861738:0:14223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384435840 00000100:00100000:2.0:1783135049.861751:0:14223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1783135049.861755:0:14223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9f6cb3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3288:x1869752384435712:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783135049.861774:0:14223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9f6cb3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3288:x1869752384435712:12345-0@lo:400:kworker.0 Request processed in 19us (199us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135049.861778:0:14223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1783135049.861784:0:14223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1783135049.861787:0:14223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9f6cb0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3288:x1869752384435840:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783135049.861810:0:14223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9f6cb0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3288:x1869752384435840:12345-0@lo:400:kworker.0 Request processed in 23us (206us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135049.861814:0:14223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1783135049.861839:0:3288:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9fe9f6cb2300 x1869752384435840/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783135065 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783135049.861847:0:3288:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9f6cb2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3288:1869752384435840:0@lo:400:kworker.0 00010000:00080000:2.0:1783135049.861852:0:3288:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9fe9f6cb1880 x1869752384435712/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783135065 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783135049.861857:0:3288:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9f6cb1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3288:1869752384435712:0@lo:400:kworker.0 00000100:00100000:2.0:1783135049.861875:0:3287:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9f6cb3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c1fe35bd-99cf-438e-8ada-ed586b673efa:3287:1869752384435328:0@lo:400:kworker.0 00000100:00100000:2.0:1783135049.861888:0:3285:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9f6cb1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3285:1869752384435456:0@lo:8:kworker.0 00000100:00080000:3.0:1783135049.862185:0:14218:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1783135049.862241:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135049.862307:0:3285:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9f6cb1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3285:1869752384435584:0@lo:8:kworker.0 00000100:00100000:2.0:1783135049.862328:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135049.864746:0:14858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384435456 00000100:00100000:3.0:1783135049.864759:0:14858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384435456 00000100:00100000:1.0:1783135049.864809:0:14860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384435584 00000100:00100000:1.0:1783135049.864815:0:14860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384435584 00000100:00100000:1.0:1783135049.864854:0:14860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1783135049.864870:0:14860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9f6cb3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3285:x1869752384435456:12345-0@lo:8:kworker.0 00010000:00080000:1.0:1783135049.864900:0:14860:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 332 last 0 00000020:00000080:1.0:1783135049.864928:0:14860:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xd6c4b8f05867f771 00002000:00100000:1.0:1783135049.864943:0:14860:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff9fe9f6a11800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113653 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:1.0:1783135049.864947:0:14860:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:1.0:1783135049.864949:0:14860:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1783135049.865244:0:14860:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1783135049.865267:0:14860:0:(import.c:65:import_set_state_nolock()) ffff9fe9f6a10800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1783135049.865373:0:14860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9f6cb3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3285:x1869752384435456:12345-0@lo:8:kworker.0 Request processed in 504us (3131us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135049.865381:0:14860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1783135049.865398:0:14860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1783135049.865403:0:14860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9f6cb1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3285:x1869752384435584:12345-0@lo:8:kworker.0 00010000:00020000:1.0:1783135049.865414:0:14860:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1783135049.865439:0:14860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9f6cb1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3285:x1869752384435584:12345-0@lo:8:kworker.0 Request processed in 35us (3111us total) trans 0 rc -19/-19 00000100:00100000:1.0:1783135049.865446:0:14860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1783135049.865762:0:3285:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9fe9f6cb1500 x1869752384435456/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1783135064 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783135049.865774:0:3285:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1783135049.865781:0:3285:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 2 00000100:00080000:2.0:1783135049.865789:0:3285:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1783135049.865793:0:3285:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:2.0:1783135049.865796:0:3285:0:(import.c:65:import_set_state_nolock()) ffff9fe9c979c800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1783135049.865817:0:3285:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1783135049.865824:0:3285:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9f6cb1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3285:1869752384435456:0@lo:8:kworker.0 00000100:00080000:2.0:1783135049.865849:0:3285:0:(import.c:65:import_set_state_nolock()) ffff9fe9f5c91000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1783135049.865853:0:3285:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1783135049.865857:0:3285:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9f6cb1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3285:1869752384435584:0@lo:8:kworker.0 00000004:00080000:1.0:1783135049.865943:0:14246:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x240000400:0x5:0x0] 00000100:00100000:1.0:1783135049.865965:0:14246:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9fe95bb80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14246:1869752384436096:0@lo:5:osp-pre-0-0.0 00000100:00100000:1.0:1783135049.865999:0:14246:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135049.866017:0:14246:0:(client.c:2701:ptlrpc_set_wait()) set ffff9fe9c9d15b40 going to sleep for 11 seconds 00000100:00100000:1.0:1783135049.866038:0:14860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384436096 00000100:00100000:1.0:1783135049.866041:0:14860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384436096 00000100:00100000:1.0:1783135049.866075:0:14860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1783135049.866082:0:14860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fe95ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:14246:x1869752384436096:12345-0@lo:5:osp-pre-0-0.0 00000100:00100000:2.0:1783135049.866580:0:3286:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9fe958a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1869752384435968:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1783135049.866607:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:2.0:1783135049.867347:0:14245:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1783135049.867561:0:14245:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 332263279970ns, next at 0ns, rc = 0 00002000:00080000:1.0:1783135049.870045:0:14860:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:1.0:1783135049.870055:0:14860:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -28 00002000:02000040:1.0:1783135049.870061:0:14860:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x240000400:6 to 0x240000400:33) 00000100:00080000:2.0:1783135049.870622:0:14218:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1783135049.874539:0:14862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384435968 00000100:00100000:0.0:1783135049.874558:0:14862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384435968 00000100:00100000:0.0:1783135049.874618:0:14862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1783135049.874630:0:14862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9f6cb1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3286:x1869752384435968:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1783135049.874671:0:14862:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1783135049.874761:0:14862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9f6cb1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3286:x1869752384435968:12345-0@lo:13:osp-pre-0-0.0 Request processed in 133us (8151us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135049.874769:0:14862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1783135049.874843:0:3286:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9fe9fe958a80 x1869752384435968/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783135065 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783135049.876650:0:3286:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9fe958a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1869752384435968:0@lo:13:osp-pre-0-0.0 00002000:00010000:1.0:1783135049.880721:0:14860:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1783135049.880733:0:14860:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001afe611e/0xd6c4b8f05867f778 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135049.880751:0:14860:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=332s v=(0 0) 00010000:00010000:1.0:1783135049.880756:0:14860:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783135049.880762:0:14860:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001afe611e/0xd6c4b8f05867f778 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135049.880779:0:14860:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001afe611e/0xd6c4b8f05867f778 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135049.880790:0:14860:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001afe611e/0xd6c4b8f05867f778 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135049.880799:0:14860:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001afe611e/0xd6c4b8f05867f778 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135049.880821:0:14860:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1783135049.880836:0:14210:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783135049.880844:0:14210:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001afe611e/0xd6c4b8f05867f778 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135049.880851:0:14210:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe9fe43e200 already unused, calling callback (ffffffffc1527ce0) 00010000:00010000:0.0:1783135049.880855:0:14210:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001afe611e/0xd6c4b8f05867f778 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135049.880881:0:14210:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001afe611e/0xd6c4b8f05867f778 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135049.880897:0:14210:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001afe611e/0xd6c4b8f05867f778 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135049.880902:0:14210:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001afe611e/0xd6c4b8f05867f778 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135049.880917:0:14210:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783135049.880919:0:14210:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783135049.880920:0:14210:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1783135049.881241:0:14860:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1783135049.881247:0:14860:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a7a79ae1/0xd6c4b8f05867f77f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135049.881257:0:14860:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=332s v=(0 0) 00010000:00010000:1.0:1783135049.881265:0:14860:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783135049.881269:0:14860:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a7a79ae1/0xd6c4b8f05867f77f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135049.881303:0:14860:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a7a79ae1/0xd6c4b8f05867f77f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135049.881312:0:14860:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a7a79ae1/0xd6c4b8f05867f77f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135049.881320:0:14860:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a7a79ae1/0xd6c4b8f05867f77f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135049.881353:0:14860:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1783135049.881370:0:14211:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783135049.881377:0:14211:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a7a79ae1/0xd6c4b8f05867f77f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135049.881386:0:14211:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe9fe43ee00 already unused, calling callback (ffffffffc1527ce0) 00010000:00010000:0.0:1783135049.881390:0:14211:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a7a79ae1/0xd6c4b8f05867f77f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135049.881399:0:14211:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a7a79ae1/0xd6c4b8f05867f77f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135049.881412:0:14211:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a7a79ae1/0xd6c4b8f05867f77f lrc: 1/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135049.881431:0:14211:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a7a79ae1/0xd6c4b8f05867f77f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135049.881447:0:14211:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783135049.881449:0:14211:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783135049.881451:0:14211:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1783135049.881747:0:14860:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1783135049.881753:0:14860:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000757d0a52/0xd6c4b8f05867f786 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135049.881761:0:14860:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=332s v=(0 0) 00010000:00010000:1.0:1783135049.881763:0:14860:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783135049.881767:0:14860:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000757d0a52/0xd6c4b8f05867f786 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135049.881776:0:14860:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000757d0a52/0xd6c4b8f05867f786 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135049.881784:0:14860:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000757d0a52/0xd6c4b8f05867f786 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135049.881796:0:14860:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000757d0a52/0xd6c4b8f05867f786 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135049.881812:0:14860:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1783135049.881833:0:14210:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783135049.881839:0:14210:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000757d0a52/0xd6c4b8f05867f786 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135049.881846:0:14210:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe9fe43ea00 already unused, calling callback (ffffffffc1527ce0) 00010000:00010000:0.0:1783135049.881850:0:14210:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000757d0a52/0xd6c4b8f05867f786 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135049.881863:0:14210:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000757d0a52/0xd6c4b8f05867f786 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135049.881877:0:14210:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000757d0a52/0xd6c4b8f05867f786 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135049.881884:0:14210:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000757d0a52/0xd6c4b8f05867f786 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135049.881900:0:14210:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783135049.881902:0:14210:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783135049.881904:0:14210:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1783135049.882209:0:14860:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1783135049.882215:0:14860:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000df406bb1/0xd6c4b8f05867f78d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135049.882223:0:14860:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=332s v=(0 0) 00010000:00010000:1.0:1783135049.882226:0:14860:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783135049.882230:0:14860:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000df406bb1/0xd6c4b8f05867f78d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135049.882239:0:14860:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000df406bb1/0xd6c4b8f05867f78d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135049.882246:0:14860:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000df406bb1/0xd6c4b8f05867f78d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135049.882254:0:14860:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000df406bb1/0xd6c4b8f05867f78d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135049.882275:0:14860:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1783135049.882354:0:14211:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783135049.882360:0:14211:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000df406bb1/0xd6c4b8f05867f78d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135049.882369:0:14211:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe9fe43f800 already unused, calling callback (ffffffffc1527ce0) 00010000:00010000:0.0:1783135049.882373:0:14211:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000df406bb1/0xd6c4b8f05867f78d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135049.882382:0:14211:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000df406bb1/0xd6c4b8f05867f78d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135049.882395:0:14211:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000df406bb1/0xd6c4b8f05867f78d lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135049.882403:0:14211:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000df406bb1/0xd6c4b8f05867f78d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135049.882424:0:14211:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783135049.882427:0:14211:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783135049.882429:0:14211:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1783135049.883034:0:14860:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1783135049.883041:0:14860:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000083f2968d/0xd6c4b8f05867f794 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135049.883056:0:14860:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=332s v=(0 0) 00010000:00010000:1.0:1783135049.883059:0:14860:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783135049.883063:0:14860:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000083f2968d/0xd6c4b8f05867f794 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135049.883072:0:14860:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000083f2968d/0xd6c4b8f05867f794 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135049.883080:0:14860:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000083f2968d/0xd6c4b8f05867f794 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135049.883087:0:14860:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000083f2968d/0xd6c4b8f05867f794 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135049.884607:0:14210:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783135049.884618:0:14210:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000083f2968d/0xd6c4b8f05867f794 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135049.884627:0:14210:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe9fe43fa00 already unused, calling callback (ffffffffc1527ce0) 00010000:00010000:0.0:1783135049.884631:0:14210:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000083f2968d/0xd6c4b8f05867f794 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135049.884648:0:14210:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000083f2968d/0xd6c4b8f05867f794 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135049.884662:0:14210:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000083f2968d/0xd6c4b8f05867f794 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135049.884680:0:14210:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783135049.884683:0:14210:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783135049.884685:0:14210:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783135049.889270:0:14860:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1783135049.889299:0:14860:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000083f2968d/0xd6c4b8f05867f794 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1783135049.890655:0:14860:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1783135049.890667:0:14860:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000000b836c3/0xd6c4b8f05867f79b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135049.890682:0:14860:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=332s v=(0 0) 00010000:00010000:1.0:1783135049.890687:0:14860:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783135049.890693:0:14860:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000000b836c3/0xd6c4b8f05867f79b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135049.890721:0:14860:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000000b836c3/0xd6c4b8f05867f79b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135049.890732:0:14860:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000000b836c3/0xd6c4b8f05867f79b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135049.890740:0:14860:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000000b836c3/0xd6c4b8f05867f79b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135049.890758:0:14860:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783135049.890769:0:14211:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783135049.890774:0:14211:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000000b836c3/0xd6c4b8f05867f79b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135049.890781:0:14211:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe9fe43e000 already unused, calling callback (ffffffffc1527ce0) 00010000:00010000:1.0:1783135049.890785:0:14211:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000000b836c3/0xd6c4b8f05867f79b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135049.890794:0:14211:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000000b836c3/0xd6c4b8f05867f79b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135049.890810:0:14211:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000000b836c3/0xd6c4b8f05867f79b lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135049.890817:0:14211:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000000b836c3/0xd6c4b8f05867f79b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135049.890840:0:14211:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783135049.890842:0:14211:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783135049.890844:0:14211:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1783135049.891247:0:14860:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1783135049.891254:0:14860:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e08b3987/0xd6c4b8f05867f7a2 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135049.891263:0:14860:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=332s v=(0 0) 00010000:00010000:1.0:1783135049.891266:0:14860:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783135049.891270:0:14860:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e08b3987/0xd6c4b8f05867f7a2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135049.891340:0:14860:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e08b3987/0xd6c4b8f05867f7a2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135049.891350:0:14860:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e08b3987/0xd6c4b8f05867f7a2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135049.891357:0:14860:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e08b3987/0xd6c4b8f05867f7a2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135049.891388:0:14860:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783135049.891396:0:14210:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783135049.891401:0:14210:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e08b3987/0xd6c4b8f05867f7a2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135049.891421:0:14210:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe9fe43e400 already unused, calling callback (ffffffffc1527ce0) 00010000:00010000:1.0:1783135049.891424:0:14210:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e08b3987/0xd6c4b8f05867f7a2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135049.891433:0:14210:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e08b3987/0xd6c4b8f05867f7a2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135049.891445:0:14210:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e08b3987/0xd6c4b8f05867f7a2 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135049.891452:0:14210:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e08b3987/0xd6c4b8f05867f7a2 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135049.891466:0:14210:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783135049.891468:0:14210:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783135049.891470:0:14210:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1783135049.891941:0:14860:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1783135049.891948:0:14860:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e6e89c8f/0xd6c4b8f05867f7a9 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135049.891958:0:14860:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=332s v=(0 0) 00010000:00010000:1.0:1783135049.891961:0:14860:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783135049.891965:0:14860:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e6e89c8f/0xd6c4b8f05867f7a9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135049.891974:0:14860:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e6e89c8f/0xd6c4b8f05867f7a9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135049.891989:0:14860:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e6e89c8f/0xd6c4b8f05867f7a9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135049.891996:0:14860:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e6e89c8f/0xd6c4b8f05867f7a9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135049.892012:0:14860:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783135049.892020:0:14211:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783135049.892024:0:14211:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e6e89c8f/0xd6c4b8f05867f7a9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135049.892031:0:14211:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe9fe43ec00 already unused, calling callback (ffffffffc1527ce0) 00010000:00010000:1.0:1783135049.892034:0:14211:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e6e89c8f/0xd6c4b8f05867f7a9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135049.892042:0:14211:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e6e89c8f/0xd6c4b8f05867f7a9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135049.892053:0:14211:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e6e89c8f/0xd6c4b8f05867f7a9 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135049.892061:0:14211:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e6e89c8f/0xd6c4b8f05867f7a9 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135049.892076:0:14211:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783135049.892084:0:14211:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783135049.892085:0:14211:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1783135049.894609:0:14860:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1783135049.894624:0:14860:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001afe611e/0xd6c4b8f05867f7b0 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135049.894640:0:14860:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=332s v=(0 0) 00010000:00010000:1.0:1783135049.894644:0:14860:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783135049.894651:0:14860:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001afe611e/0xd6c4b8f05867f7b0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135049.894665:0:14860:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001afe611e/0xd6c4b8f05867f7b0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135049.894676:0:14860:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001afe611e/0xd6c4b8f05867f7b0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135049.894685:0:14860:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001afe611e/0xd6c4b8f05867f7b0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135049.894702:0:14860:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783135049.894713:0:14210:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783135049.894718:0:14210:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001afe611e/0xd6c4b8f05867f7b0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135049.894727:0:14210:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe9fe43e200 already unused, calling callback (ffffffffc1527ce0) 00010000:00010000:1.0:1783135049.894732:0:14210:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001afe611e/0xd6c4b8f05867f7b0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135049.894754:0:14210:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001afe611e/0xd6c4b8f05867f7b0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135049.894770:0:14210:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001afe611e/0xd6c4b8f05867f7b0 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135049.894778:0:14210:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001afe611e/0xd6c4b8f05867f7b0 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135049.894798:0:14210:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783135049.894800:0:14210:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783135049.894802:0:14210:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1783135049.895247:0:14860:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1783135049.895254:0:14860:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009979a75f/0xd6c4b8f05867f7b7 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135049.895263:0:14860:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=332s v=(0 0) 00010000:00010000:1.0:1783135049.895267:0:14860:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783135049.895270:0:14860:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009979a75f/0xd6c4b8f05867f7b7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135049.895312:0:14860:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009979a75f/0xd6c4b8f05867f7b7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135049.895322:0:14860:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009979a75f/0xd6c4b8f05867f7b7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135049.895348:0:14860:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009979a75f/0xd6c4b8f05867f7b7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135049.895362:0:14860:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783135049.895372:0:14211:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783135049.895376:0:14211:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009979a75f/0xd6c4b8f05867f7b7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135049.895384:0:14211:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe9fe43f600 already unused, calling callback (ffffffffc1527ce0) 00010000:00010000:1.0:1783135049.895388:0:14211:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009979a75f/0xd6c4b8f05867f7b7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135049.895395:0:14211:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009979a75f/0xd6c4b8f05867f7b7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135049.895407:0:14211:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009979a75f/0xd6c4b8f05867f7b7 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135049.895415:0:14211:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009979a75f/0xd6c4b8f05867f7b7 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135049.895430:0:14211:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783135049.895432:0:14211:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783135049.895433:0:14211:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1783135049.895837:0:14860:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1783135049.895851:0:14860:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000040bebb14/0xd6c4b8f05867f7be lrc: 3/0,1 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135049.895860:0:14860:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=332s v=(0 0) 00010000:00010000:1.0:1783135049.895864:0:14860:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783135049.895869:0:14860:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000040bebb14/0xd6c4b8f05867f7be lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135049.895879:0:14860:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000040bebb14/0xd6c4b8f05867f7be lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135049.895887:0:14860:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000040bebb14/0xd6c4b8f05867f7be lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135049.895894:0:14860:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000040bebb14/0xd6c4b8f05867f7be lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135049.895908:0:14860:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783135049.895917:0:14210:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783135049.895922:0:14210:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000040bebb14/0xd6c4b8f05867f7be lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135049.895930:0:14210:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe9fe43fe00 already unused, calling callback (ffffffffc1527ce0) 00010000:00010000:1.0:1783135049.895933:0:14210:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000040bebb14/0xd6c4b8f05867f7be lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135049.895942:0:14210:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000040bebb14/0xd6c4b8f05867f7be lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135049.895961:0:14210:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000040bebb14/0xd6c4b8f05867f7be lrc: 1/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135049.895970:0:14210:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000040bebb14/0xd6c4b8f05867f7be lrc: 0/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135049.895985:0:14210:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783135049.895987:0:14210:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783135049.895990:0:14210:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1783135049.896456:0:14860:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1783135049.896463:0:14860:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c791f1a1/0xd6c4b8f05867f7c5 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135049.896471:0:14860:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=332s v=(0 0) 00010000:00010000:1.0:1783135049.896474:0:14860:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783135049.896478:0:14860:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c791f1a1/0xd6c4b8f05867f7c5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135049.896487:0:14860:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c791f1a1/0xd6c4b8f05867f7c5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135049.896495:0:14860:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c791f1a1/0xd6c4b8f05867f7c5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135049.896503:0:14860:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c791f1a1/0xd6c4b8f05867f7c5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135049.896526:0:14860:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783135049.896535:0:14211:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783135049.896544:0:14211:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c791f1a1/0xd6c4b8f05867f7c5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135049.896551:0:14211:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe9fe43f400 already unused, calling callback (ffffffffc1527ce0) 00010000:00010000:1.0:1783135049.896554:0:14211:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c791f1a1/0xd6c4b8f05867f7c5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135049.896561:0:14211:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c791f1a1/0xd6c4b8f05867f7c5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135049.896573:0:14211:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c791f1a1/0xd6c4b8f05867f7c5 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135049.896581:0:14211:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c791f1a1/0xd6c4b8f05867f7c5 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135049.896594:0:14211:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783135049.896595:0:14211:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783135049.896597:0:14211:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1783135049.896966:0:14860:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1783135049.896972:0:14860:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008683403b/0xd6c4b8f05867f7cc lrc: 3/0,1 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135049.896981:0:14860:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=332s v=(0 0) 00010000:00010000:1.0:1783135049.896990:0:14860:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783135049.896995:0:14860:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008683403b/0xd6c4b8f05867f7cc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135049.897005:0:14860:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008683403b/0xd6c4b8f05867f7cc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135049.897013:0:14860:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008683403b/0xd6c4b8f05867f7cc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135049.897021:0:14860:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008683403b/0xd6c4b8f05867f7cc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135049.897035:0:14860:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783135049.897044:0:14210:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783135049.897048:0:14210:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008683403b/0xd6c4b8f05867f7cc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135049.897056:0:14210:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe8c5551a00 already unused, calling callback (ffffffffc1527ce0) 00010000:00010000:1.0:1783135049.897059:0:14210:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008683403b/0xd6c4b8f05867f7cc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135049.897067:0:14210:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008683403b/0xd6c4b8f05867f7cc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135049.897078:0:14210:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008683403b/0xd6c4b8f05867f7cc lrc: 1/0,0 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135049.897096:0:14210:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008683403b/0xd6c4b8f05867f7cc lrc: 0/0,0 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135049.897110:0:14210:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783135049.897111:0:14210:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783135049.897113:0:14210:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1783135049.899913:0:14860:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1783135049.899926:0:14860:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000da6daee8/0xd6c4b8f05867f7d3 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135049.899939:0:14860:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=332s v=(0 0) 00010000:00010000:1.0:1783135049.899942:0:14860:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783135049.899946:0:14860:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000da6daee8/0xd6c4b8f05867f7d3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135049.899956:0:14860:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000da6daee8/0xd6c4b8f05867f7d3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135049.899962:0:14860:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000da6daee8/0xd6c4b8f05867f7d3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135049.899967:0:14860:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000da6daee8/0xd6c4b8f05867f7d3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135049.899981:0:14860:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783135049.899990:0:14211:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783135049.899998:0:14211:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000da6daee8/0xd6c4b8f05867f7d3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135049.900003:0:14211:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe8c5550c00 already unused, calling callback (ffffffffc1527ce0) 00010000:00010000:1.0:1783135049.900006:0:14211:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000da6daee8/0xd6c4b8f05867f7d3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135049.900012:0:14211:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000da6daee8/0xd6c4b8f05867f7d3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135049.900023:0:14211:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000da6daee8/0xd6c4b8f05867f7d3 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135049.900027:0:14211:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000da6daee8/0xd6c4b8f05867f7d3 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135049.900039:0:14211:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783135049.900041:0:14211:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783135049.900042:0:14211:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1783135049.900575:0:14860:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1783135049.900581:0:14860:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d9dc33b9/0xd6c4b8f05867f7da lrc: 3/0,1 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135049.900590:0:14860:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=332s v=(0 0) 00010000:00010000:1.0:1783135049.900593:0:14860:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783135049.900596:0:14860:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d9dc33b9/0xd6c4b8f05867f7da lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135049.900617:0:14860:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d9dc33b9/0xd6c4b8f05867f7da lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135049.900624:0:14860:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d9dc33b9/0xd6c4b8f05867f7da lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135049.900631:0:14860:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d9dc33b9/0xd6c4b8f05867f7da lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135049.900644:0:14860:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783135049.900653:0:14210:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783135049.900657:0:14210:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d9dc33b9/0xd6c4b8f05867f7da lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135049.900663:0:14210:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe8c5551400 already unused, calling callback (ffffffffc1527ce0) 00010000:00010000:1.0:1783135049.900666:0:14210:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d9dc33b9/0xd6c4b8f05867f7da lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135049.900674:0:14210:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d9dc33b9/0xd6c4b8f05867f7da lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135049.900686:0:14210:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d9dc33b9/0xd6c4b8f05867f7da lrc: 1/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135049.900694:0:14210:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d9dc33b9/0xd6c4b8f05867f7da lrc: 0/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135049.900713:0:14210:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783135049.900715:0:14210:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783135049.900716:0:14210:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1783135049.901126:0:14860:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1783135049.901133:0:14860:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000030170102/0xd6c4b8f05867f7e1 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135049.901142:0:14860:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=332s v=(0 0) 00010000:00010000:1.0:1783135049.901144:0:14860:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783135049.901148:0:14860:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000030170102/0xd6c4b8f05867f7e1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135049.901158:0:14860:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000030170102/0xd6c4b8f05867f7e1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135049.901167:0:14860:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000030170102/0xd6c4b8f05867f7e1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135049.901175:0:14860:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000030170102/0xd6c4b8f05867f7e1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135049.901189:0:14860:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783135049.901196:0:14211:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783135049.901199:0:14211:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000030170102/0xd6c4b8f05867f7e1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135049.901217:0:14211:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe8c5550000 already unused, calling callback (ffffffffc1527ce0) 00010000:00010000:1.0:1783135049.901221:0:14211:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000030170102/0xd6c4b8f05867f7e1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135049.901229:0:14211:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000030170102/0xd6c4b8f05867f7e1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135049.901240:0:14211:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000030170102/0xd6c4b8f05867f7e1 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135049.901247:0:14211:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000030170102/0xd6c4b8f05867f7e1 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135049.901262:0:14211:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783135049.901264:0:14211:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783135049.901265:0:14211:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1783135049.901869:0:14860:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1783135049.901876:0:14860:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000086a0872a/0xd6c4b8f05867f7e8 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135049.901886:0:14860:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=332s v=(0 0) 00010000:00010000:1.0:1783135049.901889:0:14860:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783135049.901893:0:14860:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000086a0872a/0xd6c4b8f05867f7e8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135049.901903:0:14860:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000086a0872a/0xd6c4b8f05867f7e8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135049.901917:0:14860:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000086a0872a/0xd6c4b8f05867f7e8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135049.901925:0:14860:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000086a0872a/0xd6c4b8f05867f7e8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135049.901947:0:14860:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1783135049.902250:0:14210:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783135049.902257:0:14210:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000086a0872a/0xd6c4b8f05867f7e8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135049.902268:0:14210:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe8c5550a00 already unused, calling callback (ffffffffc1527ce0) 00010000:00010000:0.0:1783135049.902272:0:14210:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000086a0872a/0xd6c4b8f05867f7e8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135049.902304:0:14210:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000086a0872a/0xd6c4b8f05867f7e8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135049.902319:0:14210:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000086a0872a/0xd6c4b8f05867f7e8 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135049.902434:0:14210:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000086a0872a/0xd6c4b8f05867f7e8 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1783135049.903190:0:14860:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1783135049.903198:0:14860:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e1c63d3a/0xd6c4b8f05867f7ef lrc: 3/0,1 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135049.903208:0:14860:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=332s v=(0 0) 00010000:00010000:1.0:1783135049.903211:0:14860:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783135049.903216:0:14860:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e1c63d3a/0xd6c4b8f05867f7ef lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135049.903226:0:14860:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e1c63d3a/0xd6c4b8f05867f7ef lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135049.903234:0:14860:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e1c63d3a/0xd6c4b8f05867f7ef lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135049.903241:0:14860:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e1c63d3a/0xd6c4b8f05867f7ef lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135049.903266:0:14860:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783135049.903275:0:14211:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00002000:00010000:1.0:1783135049.903997:0:14860:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1783135049.904065:0:14860:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007530f934/0xd6c4b8f05867f7f6 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135049.904075:0:14860:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=332s v=(0 0) 00010000:00010000:1.0:1783135049.904078:0:14860:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783135049.904082:0:14860:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007530f934/0xd6c4b8f05867f7f6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135049.904092:0:14860:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007530f934/0xd6c4b8f05867f7f6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135049.904100:0:14860:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007530f934/0xd6c4b8f05867f7f6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135049.904108:0:14860:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007530f934/0xd6c4b8f05867f7f6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135049.904118:0:14860:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1783135049.904248:0:14210:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783135049.904255:0:14210:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007530f934/0xd6c4b8f05867f7f6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135049.904266:0:14210:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe8c5551000 already unused, calling callback (ffffffffc1527ce0) 00010000:00010000:0.0:1783135049.904271:0:14210:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007530f934/0xd6c4b8f05867f7f6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135049.904295:0:14210:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007530f934/0xd6c4b8f05867f7f6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135049.904312:0:14210:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007530f934/0xd6c4b8f05867f7f6 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135049.904320:0:14210:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007530f934/0xd6c4b8f05867f7f6 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135049.904405:0:14210:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783135049.904407:0:14210:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783135049.904409:0:14210:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783135049.904560:0:15220:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783135049.904568:0:14211:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e1c63d3a/0xd6c4b8f05867f7ef lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135049.904577:0:14211:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe8c5551e00 already unused, calling callback (ffffffffc1527ce0) 00010000:00010000:1.0:1783135049.904587:0:14211:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e1c63d3a/0xd6c4b8f05867f7ef lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135049.904595:0:14211:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e1c63d3a/0xd6c4b8f05867f7ef lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135049.904607:0:14211:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e1c63d3a/0xd6c4b8f05867f7ef lrc: 1/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135049.904613:0:14211:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e1c63d3a/0xd6c4b8f05867f7ef lrc: 0/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1783135049.904624:0:14860:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1783135049.904628:0:14211:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783135049.904631:0:14211:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783135049.904632:0:14860:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cfe4c1c6/0xd6c4b8f05867f7fd lrc: 3/0,1 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135049.904633:0:14211:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783135049.904639:0:15220:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783135049.904643:0:15220:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783135049.904644:0:14860:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=332s v=(0 0) 00010000:00010000:0.0:1783135049.904649:0:14860:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783135049.904658:0:14860:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cfe4c1c6/0xd6c4b8f05867f7fd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135049.904668:0:14860:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cfe4c1c6/0xd6c4b8f05867f7fd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135049.904674:0:14860:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cfe4c1c6/0xd6c4b8f05867f7fd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135049.904681:0:14860:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cfe4c1c6/0xd6c4b8f05867f7fd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135049.904702:0:14860:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783135049.904785:0:14210:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783135049.904790:0:14210:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cfe4c1c6/0xd6c4b8f05867f7fd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135049.904798:0:14210:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe9f68ac600 already unused, calling callback (ffffffffc1527ce0) 00010000:00010000:1.0:1783135049.904803:0:14210:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cfe4c1c6/0xd6c4b8f05867f7fd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135049.904812:0:14210:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cfe4c1c6/0xd6c4b8f05867f7fd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135049.904834:0:14210:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cfe4c1c6/0xd6c4b8f05867f7fd lrc: 1/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135049.904842:0:14210:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cfe4c1c6/0xd6c4b8f05867f7fd lrc: 0/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135049.904861:0:14210:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783135049.904864:0:14210:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783135049.904867:0:14210:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1783135049.905082:0:14860:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1783135049.905087:0:14860:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fa01f675/0xd6c4b8f05867f804 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135049.905095:0:14860:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=332s v=(0 0) 00010000:00010000:0.0:1783135049.905098:0:14860:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783135049.905102:0:14860:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fa01f675/0xd6c4b8f05867f804 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135049.905111:0:14860:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fa01f675/0xd6c4b8f05867f804 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135049.905118:0:14860:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fa01f675/0xd6c4b8f05867f804 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135049.905135:0:14860:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fa01f675/0xd6c4b8f05867f804 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135049.906419:0:14860:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1783135049.906978:0:14860:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1783135049.906987:0:14860:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ccdebaec/0xd6c4b8f05867f80b lrc: 3/0,1 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135049.907000:0:14860:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=332s v=(0 0) 00010000:00010000:0.0:1783135049.907004:0:14860:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783135049.907009:0:14860:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ccdebaec/0xd6c4b8f05867f80b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135049.907021:0:14860:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ccdebaec/0xd6c4b8f05867f80b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135049.907031:0:14860:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ccdebaec/0xd6c4b8f05867f80b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135049.907038:0:14860:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ccdebaec/0xd6c4b8f05867f80b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135049.909604:0:14860:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1783135049.910598:0:14211:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1783135049.910611:0:14211:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fa01f675/0xd6c4b8f05867f804 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135049.910626:0:14211:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe9f68ade00 already unused, calling callback (ffffffffc1527ce0) 00010000:00010000:1.0:1783135049.910632:0:14211:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fa01f675/0xd6c4b8f05867f804 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135049.910644:0:14211:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fa01f675/0xd6c4b8f05867f804 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135049.910668:0:14211:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fa01f675/0xd6c4b8f05867f804 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135049.910677:0:14211:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fa01f675/0xd6c4b8f05867f804 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135049.910709:0:14211:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783135049.910713:0:14211:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ccdebaec/0xd6c4b8f05867f80b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135049.910719:0:14211:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe9f68ac200 already unused, calling callback (ffffffffc1527ce0) 00010000:00010000:1.0:1783135049.910723:0:14211:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ccdebaec/0xd6c4b8f05867f80b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135049.910731:0:14211:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ccdebaec/0xd6c4b8f05867f80b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135049.910747:0:14211:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ccdebaec/0xd6c4b8f05867f80b lrc: 1/0,0 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135049.910755:0:14211:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ccdebaec/0xd6c4b8f05867f80b lrc: 0/0,0 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135049.910767:0:14211:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783135049.910769:0:14211:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783135049.910770:0:14211:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783135049.910794:0:15220:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1783135049.912068:0:14860:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1783135049.912078:0:14860:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008683403b/0xd6c4b8f05867f812 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135049.912091:0:14860:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=332s v=(0 0) 00010000:00010000:1.0:1783135049.912102:0:14860:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783135049.912109:0:14860:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008683403b/0xd6c4b8f05867f812 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135049.912121:0:14860:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008683403b/0xd6c4b8f05867f812 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135049.912132:0:14860:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008683403b/0xd6c4b8f05867f812 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135049.912140:0:14860:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008683403b/0xd6c4b8f05867f812 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135049.912168:0:14860:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783135049.912179:0:14210:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783135049.912183:0:14210:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008683403b/0xd6c4b8f05867f812 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135049.912192:0:14210:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe8c5551a00 already unused, calling callback (ffffffffc1527ce0) 00010000:00010000:1.0:1783135049.912196:0:14210:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008683403b/0xd6c4b8f05867f812 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135049.912455:0:14210:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008683403b/0xd6c4b8f05867f812 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135049.912473:0:14210:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008683403b/0xd6c4b8f05867f812 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135049.912492:0:14210:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008683403b/0xd6c4b8f05867f812 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135049.912507:0:14210:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783135049.912509:0:14210:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783135049.912510:0:14210:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1783135049.913802:0:14860:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1783135049.913810:0:14860:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b20f7290/0xd6c4b8f05867f819 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135049.913953:0:14860:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=332s v=(0 0) 00010000:00010000:1.0:1783135049.913959:0:14860:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783135049.913966:0:14860:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b20f7290/0xd6c4b8f05867f819 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135049.913979:0:14860:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b20f7290/0xd6c4b8f05867f819 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135049.913989:0:14860:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b20f7290/0xd6c4b8f05867f819 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135049.913997:0:14860:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b20f7290/0xd6c4b8f05867f819 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135049.914014:0:14860:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783135049.914024:0:14211:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783135049.914034:0:14211:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b20f7290/0xd6c4b8f05867f819 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135049.914043:0:14211:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe8c5550400 already unused, calling callback (ffffffffc1527ce0) 00010000:00010000:1.0:1783135049.914046:0:14211:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b20f7290/0xd6c4b8f05867f819 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135049.914056:0:14211:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b20f7290/0xd6c4b8f05867f819 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135049.914071:0:14211:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b20f7290/0xd6c4b8f05867f819 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135049.914079:0:14211:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b20f7290/0xd6c4b8f05867f819 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135049.914095:0:14211:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783135049.914097:0:14211:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783135049.914099:0:14211:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1783135049.914706:0:14860:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1783135049.914713:0:14860:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005e9c636d/0xd6c4b8f05867f820 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135049.915064:0:14860:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=332s v=(0 0) 00010000:00010000:1.0:1783135049.915070:0:14860:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783135049.915076:0:14860:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005e9c636d/0xd6c4b8f05867f820 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135049.915098:0:14860:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005e9c636d/0xd6c4b8f05867f820 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135049.915106:0:14860:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005e9c636d/0xd6c4b8f05867f820 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135049.915114:0:14860:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005e9c636d/0xd6c4b8f05867f820 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135049.915133:0:14860:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1783135049.915160:0:15220:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783135049.915167:0:15220:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005e9c636d/0xd6c4b8f05867f820 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135049.915183:0:15220:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe8c5551c00 already unused, calling callback (ffffffffc1527ce0) 00010000:00010000:0.0:1783135049.915188:0:15220:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005e9c636d/0xd6c4b8f05867f820 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135049.915197:0:15220:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005e9c636d/0xd6c4b8f05867f820 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135049.915211:0:15220:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005e9c636d/0xd6c4b8f05867f820 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135049.915219:0:15220:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005e9c636d/0xd6c4b8f05867f820 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135049.915237:0:15220:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783135049.915240:0:15220:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783135049.915242:0:15220:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1783135049.915709:0:14860:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1783135049.915716:0:14860:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e1c63d3a/0xd6c4b8f05867f827 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135049.915726:0:14860:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=332s v=(0 0) 00010000:00010000:1.0:1783135049.915730:0:14860:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783135049.915735:0:14860:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e1c63d3a/0xd6c4b8f05867f827 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135049.915744:0:14860:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e1c63d3a/0xd6c4b8f05867f827 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135049.915754:0:14860:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e1c63d3a/0xd6c4b8f05867f827 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135049.915774:0:14860:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e1c63d3a/0xd6c4b8f05867f827 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135049.915997:0:14860:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1783135049.915999:0:14210:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783135049.916006:0:14210:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e1c63d3a/0xd6c4b8f05867f827 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135049.916014:0:14210:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe8c5551e00 already unused, calling callback (ffffffffc1527ce0) 00010000:00010000:0.0:1783135049.916019:0:14210:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e1c63d3a/0xd6c4b8f05867f827 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135049.916028:0:14210:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e1c63d3a/0xd6c4b8f05867f827 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135049.916047:0:14210:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e1c63d3a/0xd6c4b8f05867f827 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135049.916055:0:14210:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e1c63d3a/0xd6c4b8f05867f827 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135049.916074:0:14210:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783135049.916076:0:14210:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783135049.916080:0:14210:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1783135049.916482:0:14860:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1783135049.916489:0:14860:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000030170102/0xd6c4b8f05867f82e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135049.916497:0:14860:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=332s v=(0 0) 00010000:00010000:1.0:1783135049.916501:0:14860:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783135049.916505:0:14860:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000030170102/0xd6c4b8f05867f82e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135049.916515:0:14860:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000030170102/0xd6c4b8f05867f82e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135049.916524:0:14860:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000030170102/0xd6c4b8f05867f82e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135049.916532:0:14860:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000030170102/0xd6c4b8f05867f82e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135049.916551:0:14860:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1783135049.916576:0:14211:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783135049.916583:0:14211:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000030170102/0xd6c4b8f05867f82e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135049.916592:0:14211:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe8c5550000 already unused, calling callback (ffffffffc1527ce0) 00010000:00010000:0.0:1783135049.916596:0:14211:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000030170102/0xd6c4b8f05867f82e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135049.916604:0:14211:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000030170102/0xd6c4b8f05867f82e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135049.916618:0:14211:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000030170102/0xd6c4b8f05867f82e lrc: 1/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135049.916626:0:14211:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000030170102/0xd6c4b8f05867f82e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135049.916657:0:14211:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783135049.916660:0:14211:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783135049.916663:0:14211:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1783135049.917207:0:14860:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1783135049.917214:0:14860:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d9dc33b9/0xd6c4b8f05867f835 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135049.917229:0:14860:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=332s v=(0 0) 00010000:00010000:1.0:1783135049.917232:0:14860:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783135049.917237:0:14860:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d9dc33b9/0xd6c4b8f05867f835 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135049.917245:0:14860:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d9dc33b9/0xd6c4b8f05867f835 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135049.917254:0:14860:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d9dc33b9/0xd6c4b8f05867f835 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135049.917262:0:14860:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d9dc33b9/0xd6c4b8f05867f835 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135049.917304:0:14860:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00080000:1.0:1783135049.917499:0:14860:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x240000400:5 00000100:00100000:1.0:1783135049.917598:0:14860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fe95ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:14246:x1869752384436096:12345-0@lo:5:osp-pre-0-0.0 Request processed in 51513us (51594us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135049.917609:0:14860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:0.0:1783135049.920444:0:15220:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783135049.920456:0:15220:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d9dc33b9/0xd6c4b8f05867f835 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135049.920469:0:15220:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe8c5551400 already unused, calling callback (ffffffffc1527ce0) 00010000:00010000:0.0:1783135049.920474:0:15220:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d9dc33b9/0xd6c4b8f05867f835 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135049.920485:0:15220:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d9dc33b9/0xd6c4b8f05867f835 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135049.920503:0:15220:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d9dc33b9/0xd6c4b8f05867f835 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135049.920510:0:15220:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d9dc33b9/0xd6c4b8f05867f835 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135049.920527:0:15220:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783135049.920529:0:15220:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783135049.920530:0:15220:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783135049.921582:0:14246:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9fe95bb80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14246:1869752384436096:0@lo:5:osp-pre-0-0.0 00000004:00080000:3.0:1783135049.921596:0:14246:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x240000400:0x21:0x0] from OST, last_created [0x240000400:0x21:0x0]last_used is [0x240000400:0x5:0x0] 00000100:00100000:3.0:1783135049.921639:0:14246:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9fea17b80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14246:1869752384436224:0@lo:5:osp-pre-0-0.0 00000100:00100000:3.0:1783135049.921697:0:14246:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135049.921748:0:14246:0:(client.c:2701:ptlrpc_set_wait()) set ffff9fe9e2f3b600 going to sleep for 11 seconds 00000100:00100000:3.0:1783135049.921998:0:14858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384436224 00000100:00100000:3.0:1783135049.922004:0:14858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384436224 00000100:00100000:3.0:1783135049.922153:0:14858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1783135049.922165:0:14858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fea15180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:14246:x1869752384436224:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:3.0:1783135049.922210:0:14858:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 34 00000004:00080000:1.0:1783135049.924551:0:5791:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000100:00100000:3.0:1783135049.931356:0:14858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fea15180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:14246:x1869752384436224:12345-0@lo:5:osp-pre-0-0.0 Request processed in 9184us (9649us total) trans 8589934593 rc 0/0 00000100:00100000:3.0:1783135049.931371:0:14858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1783135049.931393:0:14246:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9fea17b80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14246:1869752384436224:0@lo:5:osp-pre-0-0.0 00000004:00080000:2.0:1783135049.931408:0:14246:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x21:0x0]-[0x240000400:0x41:0x0] 00000001:02000400:1.0:1783135049.936966:0:15224:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg141-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1783135050.179942:0:14210:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783135051.205152:0:14211:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1783135051.460561:0:14257:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1783135051.460570:0:14257:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1783135051.460603:0:14257:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 3 00000040:00080000:2.0:1783135051.460609:0:14257:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000001:00100000:1.0:1783135051.939563:0:6602:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:1.0:1783135051.939577:0:6602:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934593 is committed 00010000:00010000:0.0:1783135052.227566:0:15220:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1783135053.188488:0:15525:0:(obd_mount.c:914:lmd_print()) mount data: 00000020:01000004:3.0:1783135053.188492:0:15525:0:(obd_mount.c:917:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:3.0:1783135053.188631:0:15525:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff9fe9f6724800 00000020:01000004:3.0:1783135053.188648:0:15525:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:3.0:1783135053.188661:0:15525:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:3.0:1783135053.188683:0:15525:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff9fe8c562cd40) 00000020:00000080:3.0:1783135053.188700:0:15525:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type osd-zfs with refcount 2 00100000:10000000:3.0:1783135053.203136:0:15525:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:3.0:1783135053.203495:0:15525:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:3.0:1783135053.204231:0:15525:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:3.0:1783135053.205136:0:15525:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:3.0:1783135053.205409:0:15525:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:3.0:1783135053.205761:0:15525:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-client under 403: rc = 0 00100000:10000000:3.0:1783135053.205856:0:15525:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-OST0001 under 403: rc = 0 00100000:10000000:3.0:1783135053.205999:0:15525:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled params under 403: rc = 0 00100000:10000000:3.0:1783135053.208585:0:15525:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000 under 770: rc = 0 00100000:10000000:3.0:1783135053.209029:0:15525:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000-OST0001 under 770: rc = 0 00100000:10000000:3.0:1783135053.209265:0:15525:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000 under 770: rc = 0 00100000:10000000:3.0:1783135053.210418:0:15525:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000-OST0001 under 770: rc = 0 00100000:10000000:3.0:1783135053.210681:0:15525:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000 under 770: rc = 0 00100000:10000000:3.0:1783135053.211077:0:15525:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000-OST0001 under 770: rc = 0 00000020:00000080:3.0:1783135053.211851:0:15525:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:3.0:1783135053.211863:0:15525:0:(osd_handler.c:1569:osd_obd_connect()) connect #0 00000020:00000080:3.0:1783135053.211872:0:15525:0:(genops.c:1406:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xd6c4b8f05867f843 00000020:01000004:3.0:1783135053.211880:0:15525:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:3.0:1783135053.211900:0:15525:0:(obd_mount.c:394:lustre_start_mgc()) MGC192.168.201.141@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1783135053.211904:0:15525:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.201.141@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1783135053.211910:0:15525:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0001 00000020:01000004:3.0:1783135053.211988:0:15525:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:3.0:1783135053.211993:0:15525:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.141@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:3.0:1783135053.220446:0:15525:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.141@tcp ctxt 0 is initialized 00000020:01000004:3.0:1783135053.220482:0:15525:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.201.141@tcp, index=0001, flags=0x20002 00000020:01000004:3.0:1783135053.220488:0:15525:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1783135053.220489:0:15525:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1783135053.220491:0:15525:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1783135053.220492:0:15525:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1783135053.220493:0:15525:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1783135053.220495:0:15525:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1783135053.220496:0:15525:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1783135053.220499:0:15525:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1783135053.220500:0:15525:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1783135053.220503:0:15525:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020002 00000020:01000004:3.0:1783135053.220506:0:15525:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1783135053.220507:0:15525:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1783135053.220508:0:15525:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1783135053.220509:0:15525:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1783135053.220510:0:15525:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1783135053.220512:0:15525:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1783135053.220513:0:15525:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1783135053.220514:0:15525:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1783135053.220515:0:15525:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1783135053.220540:0:15525:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:3.0:1783135053.220560:0:15525:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9fea16300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c1fe35bd-99cf-438e-8ada-ed586b673efa:15525:1869752384436352:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1783135053.220628:0:15525:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135053.220695:0:15525:0:(client.c:2701:ptlrpc_set_wait()) set ffff9fe9c9d15480 going to sleep for 11 seconds 00000100:00100000:2.0:1783135053.220995:0:14217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384436352 00000100:00100000:2.0:1783135053.221002:0:14217:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384436352 00000100:00100000:2.0:1783135053.221054:0:14217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1783135053.221064:0:14217:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9ca9b9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1fe35bd-99cf-438e-8ada-ed586b673efa+16:15525:x1869752384436352:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1783135053.221091:0:14217:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:2.0:1783135053.221094:0:14217:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0001 is running on 0@lo 20000000:01000000:2.0:1783135053.221097:0:14217:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:0.0:1783135053.229656:0:14217:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9ca9b9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1fe35bd-99cf-438e-8ada-ed586b673efa+16:15525:x1869752384436352:12345-0@lo:253:mount.lustre.0 Request processed in 8584us (9019us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135053.229672:0:14217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1783135053.229754:0:15525:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9fea16300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c1fe35bd-99cf-438e-8ada-ed586b673efa:15525:1869752384436352:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1783135053.229770:0:15525:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:3.0:1783135053.229774:0:15525:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1783135053.229776:0:15525:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1783135053.229777:0:15525:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1783135053.229779:0:15525:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1783135053.229780:0:15525:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1783135053.229782:0:15525:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1783135053.229783:0:15525:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1783135053.229785:0:15525:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1783135053.229786:0:15525:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1783135053.229809:0:15525:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9fe9f6724800 from lustre-OST0001 10000000:01000000:3.0:1783135053.229833:0:15525:0:(mgc_request.c:1945:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:3.0:1783135053.229836:0:15525:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:3.0:1783135053.229843:0:15525:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9fea00c40000 local copy 00010000:00010000:3.0:1783135053.229854:0:15525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.141@tcp lock: ffff9fe9c7829a00/0xd6c4b8f05867f5e9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xd6c4b8f05867f5f0 expref: -99 pid: 14204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783135053.230128:0:15525:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9fea16300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c1fe35bd-99cf-438e-8ada-ed586b673efa:15525:1869752384436480:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1783135053.230164:0:15525:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135053.230234:0:15525:0:(client.c:2701:ptlrpc_set_wait()) set ffff9fe9c9d150c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783135053.230451:0:14216:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384436480 00000100:00100000:2.0:1783135053.230457:0:14216:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384436480 00000100:00100000:2.0:1783135053.230530:0:14216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1783135053.230540:0:14216:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9ca9bb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1fe35bd-99cf-438e-8ada-ed586b673efa+16:15525:x1869752384436480:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1783135053.230684:0:14216:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9ca9bb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1fe35bd-99cf-438e-8ada-ed586b673efa+16:15525:x1869752384436480:12345-0@lo:501:mount.lustre.0 Request processed in 146us (519us total) trans 0 rc -2/-2 00000100:00100000:2.0:1783135053.230697:0:14216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1783135053.230755:0:15525:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9fea16300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c1fe35bd-99cf-438e-8ada-ed586b673efa:15525:1869752384436480:0@lo:501:mount.lustre.0 10000000:01000000:3.0:1783135053.230767:0:15525:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.201.141@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1783135053.230907:0:15525:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.201.141@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1783135053.230915:0:15525:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.141@tcp lock: ffff9fe9c7829a00/0xd6c4b8f05867f5e9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xd6c4b8f05867f5f0 expref: -99 pid: 14204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135053.230925:0:15525:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.141@tcp lock: ffff9fe9c7829a00/0xd6c4b8f05867f5e9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xd6c4b8f05867f5f0 expref: -99 pid: 14204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783135053.230962:0:15525:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9fe9f6724800 10000000:01000000:3.0:1783135053.230967:0:15525:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1783135053.230972:0:15525:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:3.0:1783135053.230974:0:15525:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1783135053.230978:0:15525:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:3.0:1783135053.230981:0:15525:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:3.0:1783135053.231002:0:15525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.141@tcp lock: ffff9fe9d2b75600/0xd6c4b8f05867f84a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135053.231010:0:15525:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.141@tcp lock: ffff9fe9d2b75600/0xd6c4b8f05867f84a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135053.231018:0:15525:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.141@tcp lock: ffff9fe9d2b75600/0xd6c4b8f05867f84a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783135053.231029:0:15525:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9fea16300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c1fe35bd-99cf-438e-8ada-ed586b673efa:15525:1869752384436608:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1783135053.231053:0:15525:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135053.231187:0:15525:0:(client.c:2701:ptlrpc_set_wait()) set ffff9fe9c9d150c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783135053.231258:0:14215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384436608 00000100:00100000:0.0:1783135053.231262:0:14215:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384436608 00000100:00100000:0.0:1783135053.231309:0:14215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1783135053.231315:0:14215:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9ca9b9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c1fe35bd-99cf-438e-8ada-ed586b673efa+16:15525:x1869752384436608:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1783135053.231323:0:14215:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783135053.231334:0:14215:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fe9f68ac600/0xd6c4b8f05867f851 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xd6c4b8f05867f84a expref: -99 pid: 14215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135053.231352:0:14215:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fe9f68ac600/0xd6c4b8f05867f851 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd6c4b8f05867f84a expref: 17 pid: 14215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135053.231361:0:14215:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fe9f68ac600/0xd6c4b8f05867f851 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd6c4b8f05867f84a expref: 17 pid: 14215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135053.231368:0:14215:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fe9f68ac600, rc 0) 00000100:00100000:0.0:1783135053.231404:0:14215:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9ca9b9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c1fe35bd-99cf-438e-8ada-ed586b673efa+17:15525:x1869752384436608:12345-0@lo:101:mount.lustre.0 Request processed in 89us (350us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135053.231410:0:14215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1783135053.231486:0:15525:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9fea16300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c1fe35bd-99cf-438e-8ada-ed586b673efa:15525:1869752384436608:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1783135053.231497:0:15525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.141@tcp lock: ffff9fe9d2b75600/0xd6c4b8f05867f84a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xd6c4b8f05867f851 expref: -99 pid: 15525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135053.231505:0:15525:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.141@tcp lock: ffff9fe9d2b75600/0xd6c4b8f05867f84a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xd6c4b8f05867f851 expref: -99 pid: 15525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1783135053.232764:0:15525:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:3.0:1783135053.233543:0:15525:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1783135053.233739:0:15525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:3.0:1783135053.233786:0:15525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:3.0:1783135053.233817:0:15525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:3.0:1783135053.233859:0:15525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:3.0:1783135053.233889:0:15525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:3.0:1783135053.233920:0:15525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:3.0:1783135053.233982:0:15525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:3.0:1783135053.233990:0:15525:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:3.0:1783135053.234052:0:15525:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9fea16300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c1fe35bd-99cf-438e-8ada-ed586b673efa:15525:1869752384436736:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1783135053.234104:0:15525:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135053.234135:0:15525:0:(client.c:2701:ptlrpc_set_wait()) set ffff9fe9c9d159c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783135053.234255:0:14215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384436736 00000100:00100000:0.0:1783135053.234261:0:14215:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384436736 00000100:00100000:0.0:1783135053.234319:0:14215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1783135053.234327:0:14215:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9ca9b8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c1fe35bd-99cf-438e-8ada-ed586b673efa+17:15525:x1869752384436736:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1783135053.234567:0:14215:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9ca9b8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c1fe35bd-99cf-438e-8ada-ed586b673efa+17:15525:x1869752384436736:12345-0@lo:501:mount.lustre.0 Request processed in 240us (461us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135053.234574:0:14215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1783135053.234682:0:15525:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9fea16300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c1fe35bd-99cf-438e-8ada-ed586b673efa:15525:1869752384436736:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1783135053.234708:0:15525:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9fea16300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c1fe35bd-99cf-438e-8ada-ed586b673efa:15525:1869752384436864:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1783135053.234738:0:15525:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135053.234761:0:15525:0:(client.c:2701:ptlrpc_set_wait()) set ffff9fe9c9d159c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783135053.234798:0:14215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384436864 00000100:00100000:0.0:1783135053.234801:0:14215:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384436864 00000100:00100000:0.0:1783135053.234816:0:14215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1783135053.234821:0:14215:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9ca9bb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c1fe35bd-99cf-438e-8ada-ed586b673efa+17:15525:x1869752384436864:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1783135053.235144:0:14215:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9ca9bb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c1fe35bd-99cf-438e-8ada-ed586b673efa+17:15525:x1869752384436864:12345-0@lo:503:mount.lustre.0 Request processed in 321us (404us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135053.235151:0:14215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1783135053.235340:0:15525:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9fea16300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c1fe35bd-99cf-438e-8ada-ed586b673efa:15525:1869752384436864:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1783135053.236491:0:15525:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1783135053.236550:0:15525:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9fea16300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c1fe35bd-99cf-438e-8ada-ed586b673efa:15525:1869752384436992:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1783135053.236598:0:15525:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135053.236665:0:15525:0:(client.c:2701:ptlrpc_set_wait()) set ffff9fe9c9d159c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783135053.236698:0:14215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384436992 00000100:00100000:0.0:1783135053.236704:0:14215:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384436992 00000100:00100000:0.0:1783135053.236764:0:14215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1783135053.236772:0:14215:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9ca9bac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c1fe35bd-99cf-438e-8ada-ed586b673efa+17:15525:x1869752384436992:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1783135053.237009:0:14215:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9ca9bac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c1fe35bd-99cf-438e-8ada-ed586b673efa+17:15525:x1869752384436992:12345-0@lo:502:mount.lustre.0 Request processed in 237us (409us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135053.237017:0:14215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1783135053.237148:0:15525:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9fea16300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c1fe35bd-99cf-438e-8ada-ed586b673efa:15525:1869752384436992:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1783135053.237375:0:15525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:3.0:1783135053.237420:0:15525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:3.0:1783135053.237454:0:15525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:3.0:1783135053.237500:0:15525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:3.0:1783135053.237547:0:15525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:3.0:1783135053.237579:0:15525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:3.0:1783135053.237627:0:15525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:3.0:1783135053.237672:0:15525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:3.0:1783135053.237719:0:15525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 120 off9752 00000100:00100000:3.0:1783135053.237741:0:15525:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9fea16300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c1fe35bd-99cf-438e-8ada-ed586b673efa:15525:1869752384437120:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1783135053.237776:0:15525:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135053.237955:0:15525:0:(client.c:2701:ptlrpc_set_wait()) set ffff9fe9c9d159c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783135053.238063:0:14216:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384437120 00000100:00100000:2.0:1783135053.238069:0:14216:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384437120 00000100:00100000:2.0:1783135053.238093:0:14216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1783135053.238100:0:14216:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9ca9b9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1fe35bd-99cf-438e-8ada-ed586b673efa+17:15525:x1869752384437120:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1783135053.238232:0:14216:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9ca9b9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1fe35bd-99cf-438e-8ada-ed586b673efa+17:15525:x1869752384437120:12345-0@lo:502:mount.lustre.0 Request processed in 131us (455us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135053.238239:0:14216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1783135053.238349:0:15525:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9fea16300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c1fe35bd-99cf-438e-8ada-ed586b673efa:15525:1869752384437120:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1783135053.238407:0:15525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9976 00000040:00080000:3.0:1783135053.238416:0:15525:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 10 count 11 00000020:01000000:3.0:1783135053.239139:0:15526:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1783135053.239146:0:15526:0:(obd_mount.c:952:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:3.0:1783135053.239152:0:15526:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783135053.239154:0:15526:0:(obd_config.c:1561:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:3.0:1783135053.239159:0:15526:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1783135053.239171:0:15526:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff9fe8c562b380) 00000020:00000080:3.0:1783135053.239190:0:15526:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type obdfilter with refcount 2 00000020:00000080:3.0:1783135053.239196:0:15526:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1783135053.239245:0:15526:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9fe9f6724800 from lustre-OST0001, refs=2 00080000:01000000:3.0:1783135053.239251:0:15526:0:(osd_handler.c:1569:osd_obd_connect()) connect #1 00000020:00000080:3.0:1783135053.239259:0:15526:0:(genops.c:1406:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xd6c4b8f05867f85f 00010000:00010000:3.0:1783135053.243138:0:15526:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:00000004:3.0:1783135053.243790:0:15526:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 4294967325 00080000:10000000:3.0:1783135053.245680:0:15526:0:(osd_index.c:2102:osd_index_try()) lustre-OST0001: index object [0x200000003:0xb:0x0] (8/8/4) registered 00000020:00000080:2.0:1783135053.246924:0:15526:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:2.0:1783135053.246996:0:15526:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1783135053.247002:0:15526:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783135053.247004:0:15526:0:(obd_config.c:1561:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:2.0:1783135053.247007:0:15526:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1783135053.247011:0:15526:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783135053.247012:0:15526:0:(obd_config.c:1561:class_process_config()) marker 20 (0x1) lustre sys.timeout 00000020:00000080:2.0:1783135053.247016:0:15526:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1783135053.247018:0:15526:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1783135053.247020:0:15526:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1783135053.247022:0:15526:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783135053.247023:0:15526:0:(obd_config.c:1561:class_process_config()) marker 20 (0x2) lustre sys.timeout 00000020:01000000:2.0:1783135053.247025:0:15526:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1783135053.247027:0:15526:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783135053.247028:0:15526:0:(obd_config.c:1561:class_process_config()) marker 24 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1783135053.247031:0:15526:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000020:01000000:2.0:1783135053.247073:0:15526:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1783135053.247076:0:15526:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783135053.247077:0:15526:0:(obd_config.c:1561:class_process_config()) marker 24 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1783135053.247080:0:15526:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 11 count 11 00000020:01000000:0.0:1783135053.247223:0:15525:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-10 (rc=0) 10000000:01000000:0.0:1783135053.247252:0:15525:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.201.141@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:0.0:1783135053.247303:0:15525:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.141@tcp lock: ffff9fe9d2b75600/0xd6c4b8f05867f84a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xd6c4b8f05867f851 expref: -99 pid: 15525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135053.247314:0:15525:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.141@tcp lock: ffff9fe9d2b75600/0xd6c4b8f05867f84a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xd6c4b8f05867f851 expref: -99 pid: 15525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783135053.247322:0:15525:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff9fe9f6724800 from 1 10000000:01000000:0.0:1783135053.247325:0:15525:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1783135053.247358:0:15525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.141@tcp lock: ffff9fe9f68ace00/0xd6c4b8f05867f866 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135053.247367:0:15525:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.141@tcp lock: ffff9fe9f68ace00/0xd6c4b8f05867f866 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135053.247385:0:15525:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.141@tcp lock: ffff9fe9f68ace00/0xd6c4b8f05867f866 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783135053.247409:0:15525:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe8c6dfc000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c1fe35bd-99cf-438e-8ada-ed586b673efa:15525:1869752384437248:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1783135053.247475:0:15525:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135053.247518:0:15525:0:(client.c:2701:ptlrpc_set_wait()) set ffff9fe9fe8a1b40 going to sleep for 11 seconds 00000100:00100000:1.0:1783135053.247617:0:14216:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384437248 00000100:00100000:1.0:1783135053.247623:0:14216:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384437248 00000100:00100000:1.0:1783135053.247671:0:14216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1783135053.247679:0:14216:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9ca9bbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1fe35bd-99cf-438e-8ada-ed586b673efa+17:15525:x1869752384437248:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1783135053.247691:0:14216:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783135053.247702:0:14216:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fe8c5550a00/0xd6c4b8f05867f86d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xd6c4b8f05867f866 expref: -99 pid: 14216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135053.247724:0:14216:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fe8c5550a00/0xd6c4b8f05867f86d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd6c4b8f05867f866 expref: 18 pid: 14216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135053.247735:0:14216:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fe8c5550a00/0xd6c4b8f05867f86d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd6c4b8f05867f866 expref: 18 pid: 14216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135053.247744:0:14216:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fe8c5550a00, rc 0) 00000100:00100000:1.0:1783135053.247789:0:14216:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9ca9bbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1fe35bd-99cf-438e-8ada-ed586b673efa+18:15525:x1869752384437248:12345-0@lo:101:mount.lustre.0 Request processed in 111us (315us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135053.247795:0:14216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1783135053.247872:0:15525:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe8c6dfc000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c1fe35bd-99cf-438e-8ada-ed586b673efa:15525:1869752384437248:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1783135053.247887:0:15525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.141@tcp lock: ffff9fe9f68ace00/0xd6c4b8f05867f866 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd6c4b8f05867f86d expref: -99 pid: 15525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135053.247901:0:15525:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.141@tcp lock: ffff9fe9f68ace00/0xd6c4b8f05867f866 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xd6c4b8f05867f86d expref: -99 pid: 15525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1783135053.248438:0:15525:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:2.0:1783135053.249028:0:15525:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1783135053.249253:0:15525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:2.0:1783135053.249335:0:15525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:2.0:1783135053.249400:0:15525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:2.0:1783135053.249408:0:15525:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:2.0:1783135053.249462:0:15525:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9f6cb1500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c1fe35bd-99cf-438e-8ada-ed586b673efa:15525:1869752384437376:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1783135053.249504:0:15525:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135053.249533:0:15525:0:(client.c:2701:ptlrpc_set_wait()) set ffff9fe9d9b6fc00 going to sleep for 11 seconds 00000100:00100000:0.0:1783135053.249626:0:14215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384437376 00000100:00100000:0.0:1783135053.249633:0:14215:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384437376 00000100:00100000:0.0:1783135053.249663:0:14215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1783135053.249671:0:14215:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9f5ceb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c1fe35bd-99cf-438e-8ada-ed586b673efa+18:15525:x1869752384437376:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1783135053.249855:0:14215:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9f5ceb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c1fe35bd-99cf-438e-8ada-ed586b673efa+18:15525:x1869752384437376:12345-0@lo:501:mount.lustre.0 Request processed in 184us (350us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135053.249862:0:14215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1783135053.250054:0:15525:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9f6cb1500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c1fe35bd-99cf-438e-8ada-ed586b673efa:15525:1869752384437376:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1783135053.250079:0:15525:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9f6cb1500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c1fe35bd-99cf-438e-8ada-ed586b673efa:15525:1869752384437504:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1783135053.250113:0:15525:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135053.250169:0:15525:0:(client.c:2701:ptlrpc_set_wait()) set ffff9fe9d9b6fc00 going to sleep for 11 seconds 00010000:00010000:2.0:1783135053.252087:0:14210:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783135053.254264:0:14215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384437504 00000100:00100000:0.0:1783135053.254302:0:14215:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384437504 00000100:00100000:0.0:1783135053.254350:0:14215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1783135053.254360:0:14215:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9f5ce9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c1fe35bd-99cf-438e-8ada-ed586b673efa+18:15525:x1869752384437504:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1783135053.254574:0:14215:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9f5ce9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c1fe35bd-99cf-438e-8ada-ed586b673efa+18:15525:x1869752384437504:12345-0@lo:503:mount.lustre.0 Request processed in 215us (4459us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135053.254583:0:14215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1783135053.254711:0:15525:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9f6cb1500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c1fe35bd-99cf-438e-8ada-ed586b673efa:15525:1869752384437504:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1783135053.255195:0:15525:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1783135053.255265:0:15525:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9f6cb1500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c1fe35bd-99cf-438e-8ada-ed586b673efa:15525:1869752384437632:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1783135053.255431:0:15525:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135053.255460:0:15525:0:(client.c:2701:ptlrpc_set_wait()) set ffff9fe9cbbbc6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783135053.255526:0:14216:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384437632 00000100:00100000:1.0:1783135053.255531:0:14216:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384437632 00000100:00100000:1.0:1783135053.255566:0:14216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1783135053.255574:0:14216:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9f5cea850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1fe35bd-99cf-438e-8ada-ed586b673efa+18:15525:x1869752384437632:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1783135053.255716:0:14216:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9f5cea850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1fe35bd-99cf-438e-8ada-ed586b673efa+18:15525:x1869752384437632:12345-0@lo:502:mount.lustre.0 Request processed in 142us (284us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135053.255723:0:14216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1783135053.255851:0:15525:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9f6cb1500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c1fe35bd-99cf-438e-8ada-ed586b673efa:15525:1869752384437632:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1783135053.256118:0:15525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:2.0:1783135053.256173:0:15525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:2.0:1783135053.256226:0:15525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:2.0:1783135053.256258:0:15525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:2.0:1783135053.256340:0:15525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:2.0:1783135053.256391:0:15525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:2.0:1783135053.256428:0:15525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:2.0:1783135053.256463:0:15525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000100:00100000:2.0:1783135053.256489:0:15525:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9f6cb1500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c1fe35bd-99cf-438e-8ada-ed586b673efa:15525:1869752384437760:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1783135053.256525:0:15525:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135053.256551:0:15525:0:(client.c:2701:ptlrpc_set_wait()) set ffff9fe9cbbbc6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783135053.256608:0:14216:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384437760 00000100:00100000:1.0:1783135053.256614:0:14216:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384437760 00000100:00100000:1.0:1783135053.256649:0:14216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1783135053.256656:0:14216:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9f5ce9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1fe35bd-99cf-438e-8ada-ed586b673efa+18:15525:x1869752384437760:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1783135053.256785:0:14216:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9f5ce9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1fe35bd-99cf-438e-8ada-ed586b673efa+18:15525:x1869752384437760:12345-0@lo:502:mount.lustre.0 Request processed in 129us (259us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135053.256796:0:14216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1783135053.256868:0:15525:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9f6cb1500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c1fe35bd-99cf-438e-8ada-ed586b673efa:15525:1869752384437760:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1783135053.256999:0:15525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:0.0:1783135053.257009:0:15525:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:1.0:1783135053.257824:0:15530:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1783135053.257833:0:15530:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783135053.257835:0:15530:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1783135053.257843:0:15530:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9fe9f6724800 00000020:00000080:1.0:1783135053.257845:0:15530:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1783135053.257852:0:15530:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1783135053.257855:0:15530:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783135053.257856:0:15530:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:1.0:1783135053.257858:0:15530:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1783135053.257860:0:15530:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783135053.257861:0:15530:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1783135053.257864:0:15530:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9fe9f6724800 00000020:00000080:1.0:1783135053.257865:0:15530:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1783135053.259710:0:15530:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1783135053.259720:0:15530:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783135053.259723:0:15530:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:1.0:1783135053.259726:0:15530:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1783135053.259730:0:15530:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783135053.259731:0:15530:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1783135053.259735:0:15530:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9fe9f6724800 00000020:00000080:1.0:1783135053.259738:0:15530:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1783135053.270478:0:15530:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1783135053.270489:0:15530:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783135053.270491:0:15530:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:1.0:1783135053.270496:0:15530:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 10 00000020:01000000:0.0:1783135053.270635:0:15525:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:0.0:1783135053.270664:0:15525:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.201.141@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1783135053.270687:0:15525:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.141@tcp lock: ffff9fe9f68ace00/0xd6c4b8f05867f866 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd6c4b8f05867f86d expref: -99 pid: 15525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135053.270699:0:15525:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.141@tcp lock: ffff9fe9f68ace00/0xd6c4b8f05867f866 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd6c4b8f05867f86d expref: -99 pid: 15525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783135053.270743:0:15525:0:(mgc_request.c:1945:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1783135053.270746:0:15525:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9fe9f6724800 10000000:01000000:0.0:1783135053.270750:0:15525:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9fe9f6724800 10000000:01000000:0.0:1783135053.270757:0:15525:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1783135053.270762:0:15525:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff9fe9f6724800 from 1 10000000:01000000:0.0:1783135053.270765:0:15525:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1783135053.270797:0:15525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.141@tcp lock: ffff9fe9f68adc00/0xd6c4b8f05867f874 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135053.270806:0:15525:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.141@tcp lock: ffff9fe9f68adc00/0xd6c4b8f05867f874 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135053.270816:0:15525:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.141@tcp lock: ffff9fe9f68adc00/0xd6c4b8f05867f874 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783135053.270841:0:15525:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe8c6dfe680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c1fe35bd-99cf-438e-8ada-ed586b673efa:15525:1869752384437888:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1783135053.270903:0:15525:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135053.270936:0:15525:0:(client.c:2701:ptlrpc_set_wait()) set ffff9fe9fe8a1b40 going to sleep for 11 seconds 00000100:00100000:2.0:1783135053.271197:0:14215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384437888 00000100:00100000:2.0:1783135053.271205:0:14215:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384437888 00000100:00100000:2.0:1783135053.271244:0:14215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1783135053.271253:0:14215:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9f5ceb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c1fe35bd-99cf-438e-8ada-ed586b673efa+18:15525:x1869752384437888:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1783135053.271267:0:14215:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783135053.271315:0:14215:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fe9c7828e00/0xd6c4b8f05867f87b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xd6c4b8f05867f874 expref: -99 pid: 14215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135053.271339:0:14215:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fe9c7828e00/0xd6c4b8f05867f87b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd6c4b8f05867f874 expref: 19 pid: 14215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135053.271349:0:14215:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fe9c7828e00/0xd6c4b8f05867f87b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd6c4b8f05867f874 expref: 19 pid: 14215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135053.271359:0:14215:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fe9c7828e00, rc 0) 00000100:00100000:2.0:1783135053.271408:0:14215:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9f5ceb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c1fe35bd-99cf-438e-8ada-ed586b673efa+19:15525:x1869752384437888:12345-0@lo:101:mount.lustre.0 Request processed in 155us (504us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135053.271415:0:14215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1783135053.272343:0:15525:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe8c6dfe680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c1fe35bd-99cf-438e-8ada-ed586b673efa:15525:1869752384437888:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1783135053.272361:0:15525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.141@tcp lock: ffff9fe9f68adc00/0xd6c4b8f05867f874 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xd6c4b8f05867f87b expref: -99 pid: 15525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135053.272372:0:15525:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.141@tcp lock: ffff9fe9f68adc00/0xd6c4b8f05867f874 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xd6c4b8f05867f87b expref: -99 pid: 15525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1783135053.272956:0:15525:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000040:00080000:0.0:1783135053.273402:0:15525:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1783135053.273645:0:15525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:0.0:1783135053.273689:0:15525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:0.0:1783135053.273722:0:15525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:0.0:1783135053.273768:0:15525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:0.0:1783135053.273805:0:15525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:0.0:1783135053.273851:0:15525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:0.0:1783135053.273885:0:15525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:0.0:1783135053.273914:0:15525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:0.0:1783135053.273959:0:15525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:0.0:1783135053.273994:0:15525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:0.0:1783135053.274026:0:15525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:0.0:1783135053.274071:0:15525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:0.0:1783135053.274105:0:15525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:0.0:1783135053.274138:0:15525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:0.0:1783135053.274185:0:15525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:0.0:1783135053.274221:0:15525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:0.0:1783135053.274253:0:15525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:0.0:1783135053.274355:0:15525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:0.0:1783135053.274410:0:15525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:0.0:1783135053.274441:0:15525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:0.0:1783135053.274504:0:15525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:0.0:1783135053.274539:0:15525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:0.0:1783135053.274567:0:15525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:0.0:1783135053.274605:0:15525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:0.0:1783135053.274636:0:15525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 128 off12440 00000040:00080000:0.0:1783135053.274665:0:15525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12664 00000040:00080000:0.0:1783135053.274710:0:15525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12888 00000040:00080000:0.0:1783135053.274743:0:15525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off12968 00000040:00080000:0.0:1783135053.274771:0:15525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13192 00000040:00080000:0.0:1783135053.274829:0:15525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13416 00000040:00080000:0.0:1783135053.274865:0:15525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 88 off13504 00000040:00080000:0.0:1783135053.274898:0:15525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 128 off13632 00000040:00080000:0.0:1783135053.274931:0:15525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 144 off13776 00000040:00080000:0.0:1783135053.274978:0:15525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 128 off13904 00000040:00080000:0.0:1783135053.275016:0:15525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 224 off14128 00000040:00080000:0.0:1783135053.275058:0:15525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 224 off14352 00000040:00080000:0.0:1783135053.275092:0:15525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 80 off14432 00000040:00080000:0.0:1783135053.275166:0:15525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 224 off14656 00000040:00080000:0.0:1783135053.275173:0:15525:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 38 count 39 00000100:00100000:0.0:1783135053.275257:0:15525:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe8c6dfe680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c1fe35bd-99cf-438e-8ada-ed586b673efa:15525:1869752384438016:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1783135053.275343:0:15525:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135053.275384:0:14217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384438016 00000100:00100000:0.0:1783135053.275387:0:15525:0:(client.c:2701:ptlrpc_set_wait()) set ffff9fe9fe8a1b40 going to sleep for 11 seconds 00000100:00100000:2.0:1783135053.275391:0:14217:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384438016 00000100:00100000:2.0:1783135053.275429:0:14217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1783135053.275444:0:14217:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9f5ceb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1fe35bd-99cf-438e-8ada-ed586b673efa+19:15525:x1869752384438016:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1783135053.275712:0:14217:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9f5ceb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1fe35bd-99cf-438e-8ada-ed586b673efa+19:15525:x1869752384438016:12345-0@lo:501:mount.lustre.0 Request processed in 268us (367us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135053.275719:0:14217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1783135053.276979:0:15525:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe8c6dfe680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c1fe35bd-99cf-438e-8ada-ed586b673efa:15525:1869752384438016:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1783135053.277018:0:15525:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe8c6dfe680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c1fe35bd-99cf-438e-8ada-ed586b673efa:15525:1869752384438144:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1783135053.277062:0:15525:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135053.277087:0:15525:0:(client.c:2701:ptlrpc_set_wait()) set ffff9fe9fe8a1b40 going to sleep for 11 seconds 00000100:00100000:2.0:1783135053.277243:0:14215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384438144 00000100:00100000:2.0:1783135053.277248:0:14215:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384438144 00000100:00100000:2.0:1783135053.277398:0:14215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1783135053.277406:0:14215:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe8c5d82450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c1fe35bd-99cf-438e-8ada-ed586b673efa+19:15525:x1869752384438144:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1783135053.277557:0:14215:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe8c5d82450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c1fe35bd-99cf-438e-8ada-ed586b673efa+19:15525:x1869752384438144:12345-0@lo:503:mount.lustre.0 Request processed in 152us (494us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135053.277564:0:14215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1783135053.277623:0:15525:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe8c6dfe680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c1fe35bd-99cf-438e-8ada-ed586b673efa:15525:1869752384438144:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1783135053.278240:0:15525:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1783135053.278372:0:15525:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9fe958000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c1fe35bd-99cf-438e-8ada-ed586b673efa:15525:1869752384438272:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1783135053.278411:0:15525:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135053.278552:0:15525:0:(client.c:2701:ptlrpc_set_wait()) set ffff9fe9fe8a1b40 going to sleep for 11 seconds 00000100:00100000:0.0:1783135053.279815:0:14216:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384438272 00000100:00100000:0.0:1783135053.279823:0:14216:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384438272 00000100:00100000:0.0:1783135053.279867:0:14216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1783135053.279875:0:14216:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe8c5d80450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1fe35bd-99cf-438e-8ada-ed586b673efa+19:15525:x1869752384438272:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1783135053.280123:0:14216:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe8c5d80450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1fe35bd-99cf-438e-8ada-ed586b673efa+19:15525:x1869752384438272:12345-0@lo:502:mount.lustre.0 Request processed in 247us (1710us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135053.280129:0:14216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1783135053.280259:0:15525:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9fe958000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c1fe35bd-99cf-438e-8ada-ed586b673efa:15525:1869752384438272:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1783135053.280770:0:15525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:0.0:1783135053.280803:0:15525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:0.0:1783135053.280820:0:15525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:0.0:1783135053.280843:0:15525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:0.0:1783135053.280870:0:15525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:0.0:1783135053.280894:0:15525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:0.0:1783135053.280911:0:15525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:0.0:1783135053.280927:0:15525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:0.0:1783135053.280960:0:15525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:0.0:1783135053.280980:0:15525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:0.0:1783135053.281000:0:15525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:0.0:1783135053.281047:0:15525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:0.0:1783135053.281076:0:15525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:0.0:1783135053.281093:0:15525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:0.0:1783135053.281118:0:15525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:0.0:1783135053.281137:0:15525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:0.0:1783135053.281612:0:15525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:0.0:1783135053.281671:0:15525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:0.0:1783135053.281708:0:15525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:0.0:1783135053.281749:0:15525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:0.0:1783135053.281789:0:15525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:0.0:1783135053.281817:0:15525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:0.0:1783135053.281844:0:15525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:0.0:1783135053.281883:0:15525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:0.0:1783135053.281913:0:15525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 128 off12440 00000040:00080000:0.0:1783135053.281946:0:15525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12664 00000040:00080000:0.0:1783135053.281989:0:15525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12888 00000040:00080000:0.0:1783135053.282022:0:15525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off12968 00000040:00080000:0.0:1783135053.282039:0:15525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13192 00000040:00080000:0.0:1783135053.282063:0:15525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13416 00000040:00080000:0.0:1783135053.282080:0:15525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13504 00000040:00080000:0.0:1783135053.282095:0:15525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13632 00000040:00080000:0.0:1783135053.282111:0:15525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13776 00000040:00080000:0.0:1783135053.282145:0:15525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13904 00000040:00080000:0.0:1783135053.282165:0:15525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14128 00000040:00080000:0.0:1783135053.282201:0:15525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14352 00000040:00080000:0.0:1783135053.282219:0:15525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14432 00000040:00080000:0.0:1783135053.282243:0:15525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14656 00000040:00080000:0.0:1783135053.282268:0:15525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14880 00000040:00080000:0.0:1783135053.282540:0:15525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 120 off15000 00000100:00100000:0.0:1783135053.282574:0:15525:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe8c6dfc700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c1fe35bd-99cf-438e-8ada-ed586b673efa:15525:1869752384438400:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1783135053.282626:0:15525:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135053.282660:0:15525:0:(client.c:2701:ptlrpc_set_wait()) set ffff9fe9d25b3240 going to sleep for 11 seconds 00000100:00100000:1.0:1783135053.282664:0:14216:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384438400 00000100:00100000:1.0:1783135053.282671:0:14216:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384438400 00000100:00100000:1.0:1783135053.282711:0:14216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1783135053.282719:0:14216:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe8c5d82050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1fe35bd-99cf-438e-8ada-ed586b673efa+19:15525:x1869752384438400:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1783135053.282872:0:14216:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe8c5d82050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1fe35bd-99cf-438e-8ada-ed586b673efa+19:15525:x1869752384438400:12345-0@lo:502:mount.lustre.0 Request processed in 153us (244us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135053.282880:0:14216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1783135053.282899:0:15525:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe8c6dfc700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c1fe35bd-99cf-438e-8ada-ed586b673efa:15525:1869752384438400:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1783135053.282957:0:15525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 224 off15224 00000040:00080000:0.0:1783135053.282963:0:15525:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:2.0:1783135053.283700:0:15535:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:2.0:1783135053.283715:0:15535:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff9fe9ca89cd40) 00000020:00000080:2.0:1783135053.283733:0:15535:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type lwp with refcount 2 00000020:01000004:2.0:1783135053.283856:0:15535:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9fe9f6724800 from lustre-OST0001, refs=3 00000020:01000004:2.0:1783135053.283860:0:15535:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9fe9f6724800 from lustre-OST0001, refs=3 00000020:01000004:2.0:1783135053.283863:0:15535:0:(obd_mount.c:701:lustre_put_lsi()) put ffff9fe9f6724800 3 00010000:00080000:2.0:1783135053.283887:0:15535:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9fe8c5f1f000@lustre-MDT0000-lwp-OST0001: add connection 192.168.201.141@tcp at head 00010000:00010000:2.0:1783135053.285424:0:15535:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-5 is initialized 00000020:00000080:2.0:1783135053.285502:0:15535:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:2.0:1783135053.285534:0:15535:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1783135053.285544:0:15535:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0xd6c4b8f05867f889 00000100:00080000:2.0:1783135053.285554:0:15535:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1783135053.285560:0:15535:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9fe8c5f1f000 using connection 192.168.201.141@tcp/0@lo 00000100:00100000:2.0:1783135053.285590:0:15535:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9fe9f6cb2300 x1869752384438528/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1783135053.285618:0:15535:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1783135053.285673:0:8:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1783135053.285677:0:8:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1783135053.285679:0:8:0:(import.c:65:import_set_state_nolock()) ffff9fe9f5c91000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1783135053.285683:0:8:0:(import.c:512:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 332 00000100:00100000:3.0:1783135053.285684:0:3287:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9f6cb0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1869752384438656:0@lo:400:kworker.0 00000100:00080000:2.0:1783135053.285686:0:8:0:(import.c:591:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1783135053.285689:0:8:0:(import.c:626:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9fe9f5c91000 using connection 192.168.201.141@tcp/0@lo 00000100:00100000:2.0:1783135053.285699:0:8:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9fe9f6cb2680 x1869752384438784/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1783135053.285740:0:3288:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9f6cb0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3288:1869752384438912:0@lo:400:kworker.0 00000100:00100000:3.0:1783135053.285741:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135053.285768:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135053.285786:0:3288:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1783135053.285791:0:3288:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9f6cb1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3288:1869752384439040:0@lo:400:kworker.0 00000100:00100000:2.0:1783135053.285811:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135053.285850:0:14223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384438912 00000100:00100000:2.0:1783135053.285855:0:14223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384438912 00000100:00100000:2.0:1783135053.285889:0:14223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384439040 00000100:00100000:2.0:1783135053.285892:0:14223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384439040 00000100:00100000:2.0:1783135053.285914:0:14223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1783135053.285920:0:14223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9f6cb3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3288:x1869752384438912:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783135053.285964:0:14223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9f6cb3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3288:x1869752384438912:12345-0@lo:400:kworker.0 Request processed in 44us (195us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135053.285971:0:14223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1783135053.285983:0:14223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1783135053.285989:0:14223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9f6cb2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3288:x1869752384439040:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783135053.286014:0:14223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9f6cb2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3288:x1869752384439040:12345-0@lo:400:kworker.0 Request processed in 25us (202us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135053.286029:0:14223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:2.0:1783135053.286046:0:14218:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1783135053.286075:0:3288:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fe9f6cb1f80 x1869752384439040/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783135069 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783135053.286086:0:3288:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9f6cb1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3288:1869752384439040:0@lo:400:kworker.0 00010000:00080000:2.0:1783135053.286096:0:3288:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fe9f6cb0000 x1869752384438912/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783135069 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783135053.286103:0:3288:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9f6cb0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3288:1869752384438912:0@lo:400:kworker.0 00000100:00100000:1.0:1783135053.286361:0:3285:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9f6cb2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3285:1869752384438528:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1783135053.286391:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135053.286418:0:3285:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9f6cb2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3285:1869752384438784:0@lo:8:kworker.0 00000100:00100000:1.0:1783135053.286439:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135053.286475:0:14860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384438656 00000100:00100000:1.0:1783135053.286479:0:14860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384438656 00000100:00100000:3.0:1783135053.286481:0:14861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384438784 00000100:00100000:3.0:1783135053.286484:0:14861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384438784 00000100:00100000:3.0:1783135053.286502:0:14861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1783135053.286509:0:14861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fea16300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3287:x1869752384438656:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783135053.286549:0:14861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fea16300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3287:x1869752384438656:12345-0@lo:400:kworker.0 Request processed in 41us (808us total) trans 0 rc 0/0 00000040:00080000:2.0:1783135053.287752:0:15535:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00000020:01000000:0.0:1783135053.287897:0:15525:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:0.0:1783135053.287917:0:15525:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.201.141@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1783135053.287933:0:15525:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.141@tcp lock: ffff9fe9f68adc00/0xd6c4b8f05867f874 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xd6c4b8f05867f87b expref: -99 pid: 15525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135053.287941:0:15525:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.141@tcp lock: ffff9fe9f68adc00/0xd6c4b8f05867f874 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xd6c4b8f05867f87b expref: -99 pid: 15525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1783135053.287971:0:15525:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1783135053.287972:0:15525:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1783135053.287973:0:15525:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1783135053.287974:0:15525:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1783135053.287974:0:15525:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1783135053.287975:0:15525:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1783135053.287977:0:15525:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1783135053.287978:0:15525:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1783135053.287979:0:15525:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1783135053.287981:0:15525:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020002 00000020:01000004:0.0:1783135053.287983:0:15525:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1783135053.287984:0:15525:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1783135053.287984:0:15525:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1783135053.287985:0:15525:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1783135053.287986:0:15525:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1783135053.287986:0:15525:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1783135053.287989:0:15525:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1783135053.287990:0:15525:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1783135053.287990:0:15525:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1783135053.288009:0:15525:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:0.0:1783135053.288022:0:15525:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe8c6dfc700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c1fe35bd-99cf-438e-8ada-ed586b673efa:15525:1869752384439168:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1783135053.288063:0:15525:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135053.288085:0:15525:0:(client.c:2701:ptlrpc_set_wait()) set ffff9fe9c9d15480 going to sleep for 11 seconds 00000100:00100000:2.0:1783135053.288392:0:14217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384439168 00000100:00100000:2.0:1783135053.288398:0:14217:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384439168 00000100:00100000:2.0:1783135053.288432:0:14217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1783135053.288441:0:14217:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe8c5d82850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1fe35bd-99cf-438e-8ada-ed586b673efa+19:15525:x1869752384439168:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1783135053.288461:0:14217:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:2.0:1783135053.288474:0:14217:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:2.0:1783135053.289391:0:14858:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:2.0:1783135053.289399:0:14858:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:2.0:1783135053.289434:0:3287:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000100:00100000:2.0:1783135053.289448:0:3287:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9f6cb0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1869752384438656:0@lo:400:kworker.0 00000100:00100000:1.0:1783135053.291238:0:14860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1783135053.291249:0:14860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fe95bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3285:x1869752384438784:12345-0@lo:8:kworker.0 00000100:00100000:1.0:1783135053.291359:0:14860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fe95bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3285:x1869752384438784:12345-0@lo:8:kworker.0 Request processed in 109us (4917us total) trans 0 rc -11/-11 00000100:00100000:1.0:1783135053.291366:0:14860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:1.0:1783135053.291390:0:14218:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1783135053.291402:0:14224:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384438528 00000100:00100000:1.0:1783135053.291408:0:14224:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384438528 00000100:00100000:1.0:1783135053.291434:0:14224:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1783135053.291438:0:14224:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fe958000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3285:x1869752384438528:12345-0@lo:38:llog_process_th.0 00010000:00080000:1.0:1783135053.291454:0:14224:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 335 last 0 00000020:00000080:1.0:1783135053.291491:0:14224:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0xd6c4b8f05867f890 00000004:00100000:1.0:1783135053.291512:0:14224:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00100000:3.0:1783135053.291527:0:14861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:1.0:1783135053.291540:0:14224:0:(import.c:65:import_set_state_nolock()) ffff9fe9fe494800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1783135053.291577:0:14224:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fe958000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3285:x1869752384438528:12345-0@lo:38:llog_process_th.0 Request processed in 136us (5184us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135053.291582:0:14224:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1783135053.291617:0:3285:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fe9f6cb2300 x1869752384438528/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1783135063 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783135053.291628:0:3285:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1783135053.291635:0:3285:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 2 00000100:00080000:1.0:1783135053.291641:0:3285:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1783135053.291645:0:3285:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1783135053.291648:0:3285:0:(import.c:65:import_set_state_nolock()) ffff9fe8c5f1f000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1783135053.291653:0:3285:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9f6cb2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3285:1869752384438528:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1783135053.291664:0:3285:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1783135053.291667:0:3285:0:(import.c:65:import_set_state_nolock()) ffff9fe9f5c91000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1783135053.291670:0:3285:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1783135053.291673:0:3285:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9f6cb2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3285:1869752384438784:0@lo:8:kworker.0 20000000:01000000:3.0:1783135053.305671:0:14217:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1783135053.305682:0:14217:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:1.0:1783135053.305691:0:14238:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1783135053.305696:0:14238:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1783135053.305717:0:14238:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9fe8c5551000/0xd6c4b8f05867f897 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135053.305735:0:14238:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9fe9f68ad800/0xd6c4b8f05867f76a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd6c4b8f05867f763 expref: 19 pid: 14215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135053.305745:0:14238:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9fe8c5551000/0xd6c4b8f05867f897 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135053.305797:0:14238:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9fe9f68ad800/0xd6c4b8f05867f76a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd6c4b8f05867f763 expref: 19 pid: 14215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135053.305809:0:14238:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9fe9f68ad800/0xd6c4b8f05867f76a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd6c4b8f05867f763 expref: 19 pid: 14215 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783135053.305823:0:14238:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9fe958a80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14238:1869752384439296:0@lo:104: 00000100:00100000:1.0:1783135053.305883:0:14238:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135053.305920:0:14238:0:(client.c:2701:ptlrpc_set_wait()) set ffff9fe9fe8a1480 going to sleep for 11 seconds 00000100:00100000:1.0:1783135053.305944:0:14205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384439296 00000100:00100000:1.0:1783135053.305950:0:14205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384439296 00000100:00100000:1.0:1783135053.305996:0:14205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1783135053.306005:0:14205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fe958e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c1fe35bd-99cf-438e-8ada-ed586b673efa+3:14238:x1869752384439296:12345-0@lo:104: 00010000:00010000:1.0:1783135053.306016:0:14205:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.141@tcp lock: ffff9fe9d2b75800/0xd6c4b8f05867f763 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xd6c4b8f05867f76a expref: -99 pid: 14219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135053.306075:0:14205:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1783135053.306081:0:14205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fe958e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c1fe35bd-99cf-438e-8ada-ed586b673efa+3:14238:x1869752384439296:12345-0@lo:104: Request processed in 77us (198us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135053.306087:0:14205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1783135053.306095:0:14238:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9fe958a80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14238:1869752384439296:0@lo:104: 00010000:00010000:1.0:1783135053.306105:0:14211:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783135053.306110:0:14211:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.141@tcp lock: ffff9fe9d2b75800/0xd6c4b8f05867f763 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xd6c4b8f05867f76a expref: -99 pid: 14219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135053.306112:0:14238:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9fe8c5551000/0xd6c4b8f05867f897 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135053.306118:0:14211:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe9d2b75800 already unused, calling callback (ffffffffc1b40c20) 10000000:00010000:1.0:1783135053.306121:0:14211:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.141@tcp lock: ffff9fe9d2b75800/0xd6c4b8f05867f763 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xd6c4b8f05867f76a expref: -99 pid: 14219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135053.306140:0:14211:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.141@tcp lock: ffff9fe9d2b75800/0xd6c4b8f05867f763 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xd6c4b8f05867f76a expref: -99 pid: 14219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783135053.306147:0:14211:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.141@tcp lock: ffff9fe9d2b75800/0xd6c4b8f05867f763 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xd6c4b8f05867f76a expref: -99 pid: 14219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783135053.306153:0:14211:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1783135053.306184:0:14211:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.141@tcp lock: ffff9fe9d2b75800/0xd6c4b8f05867f763 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd6c4b8f05867f76a expref: -99 pid: 14219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135053.306190:0:14211:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1783135053.306212:0:14211:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.141@tcp lock: ffff9fe9d2b75800/0xd6c4b8f05867f763 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd6c4b8f05867f76a expref: -99 pid: 14219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783135053.306218:0:3287:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00010000:00010000:1.0:1783135053.306219:0:14211:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.141@tcp lock: ffff9fe9d2b75800/0xd6c4b8f05867f763 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd6c4b8f05867f76a expref: -99 pid: 14219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783135053.306228:0:3287:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9fe95a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c1fe35bd-99cf-438e-8ada-ed586b673efa:3287:1869752384439424:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1783135053.306232:0:14211:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783135053.306234:0:14211:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783135053.306236:0:14211:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783135053.306265:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135053.306393:0:14208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384439424 00000100:00100000:2.0:1783135053.306398:0:14208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384439424 00010000:00010000:2.0:1783135053.306416:0:14208:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9fe9f68ad800/0xd6c4b8f05867f76a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd6c4b8f05867f763 expref: 20 pid: 14215 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783135053.306438:0:14208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1783135053.306445:0:14208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9f6cb0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c1fe35bd-99cf-438e-8ada-ed586b673efa+20:3287:x1869752384439424:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1783135053.306454:0:14208:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783135053.306459:0:14208:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9fe9f68ad800/0xd6c4b8f05867f76a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd6c4b8f05867f763 expref: 20 pid: 14215 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135053.306467:0:14208:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9fe9f68ad800/0xd6c4b8f05867f76a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd6c4b8f05867f763 expref: 20 pid: 14215 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135053.306478:0:14208:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fe9f68ad800/0xd6c4b8f05867f76a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd6c4b8f05867f763 expref: 20 pid: 14215 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135053.306490:0:14208:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9fe8c5551000/0xd6c4b8f05867f897 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135053.306498:0:14208:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fe8c5551000/0xd6c4b8f05867f897 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1783135053.306510:0:14208:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001553648s 00010000:00010000:2.0:1783135053.306514:0:14208:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9fe8c5551000/0xd6c4b8f05867f897 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135053.306521:0:14208:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9fe8c5551000/0xd6c4b8f05867f897 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135053.306537:0:14208:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9fe8c5551000/0xd6c4b8f05867f897 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135053.306543:0:14208:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9fe8c5551000/0xd6c4b8f05867f897 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135053.306548:0:14208:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe8c5551000 already unused, calling callback (ffffffffc1527ce0) 00010000:00010000:2.0:1783135053.306552:0:14208:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9fe8c5551000/0xd6c4b8f05867f897 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135053.306560:0:14208:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9fe8c5551000/0xd6c4b8f05867f897 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135053.306570:0:14208:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9fe8c5551000/0xd6c4b8f05867f897 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135053.306579:0:14208:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783135053.306616:0:14208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9f6cb0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c1fe35bd-99cf-438e-8ada-ed586b673efa+19:3287:x1869752384439424:12345-0@lo:103:ldlm_bl.0 Request processed in 172us (350us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135053.306623:0:14208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1783135053.306661:0:3287:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9fe95a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c1fe35bd-99cf-438e-8ada-ed586b673efa:3287:1869752384439424:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1783135053.306755:0:14238:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9fe8c5551000/0xd6c4b8f05867f897 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135053.306763:0:14238:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9fe8c5551000/0xd6c4b8f05867f897 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135053.306770:0:14238:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fe8c5551000/0xd6c4b8f05867f897 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783135053.311528:0:14217:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe8c5d82850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1fe35bd-99cf-438e-8ada-ed586b673efa+18:15525:x1869752384439168:12345-0@lo:253:mount.lustre.0 Request processed in 23080us (23454us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135053.311555:0:14217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1783135053.311658:0:15525:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe8c6dfc700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c1fe35bd-99cf-438e-8ada-ed586b673efa:15525:1869752384439168:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1783135053.311673:0:15525:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:0.0:1783135053.311676:0:15525:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1783135053.311678:0:15525:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1783135053.311679:0:15525:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1783135053.311680:0:15525:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1783135053.311681:0:15525:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1783135053.311682:0:15525:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1783135053.311683:0:15525:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1783135053.311685:0:15525:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1783135053.311686:0:15525:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1783135053.311701:0:15525:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:0.0:1783135053.312103:0:15525:0:(osd_index.c:2102:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:0.0:1783135053.312265:0:15525:0:(osd_index.c:2102:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:0.0:1783135053.312708:0:15525:0:(osd_index.c:2102:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:0.0:1783135053.312837:0:15525:0:(osd_index.c:2102:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:0.0:1783135053.312961:0:15525:0:(osd_index.c:2102:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:0.0:1783135053.313179:0:15525:0:(osd_index.c:2102:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:0.0:1783135053.313806:0:15525:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:0.0:1783135053.352161:0:15525:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:0.0:1783135053.352170:0:15525:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:0.0:1783135053.352198:0:15525:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1783135053.352247:0:15525:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.141@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1783135053.352262:0:15525:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=49 00000080:00000004:0.0:1783135053.352418:0:15525:0:(super25.c:187:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00010000:00010000:0.0:1783135054.276378:0:15220:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783135054.979595:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1783135054.979617:0:3286:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9fea15f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1869752384439552:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1783135054.979698:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135054.979769:0:14863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384439552 00000100:00100000:3.0:1783135054.979777:0:14863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384439552 00000100:00100000:3.0:1783135054.979818:0:14863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1783135054.979826:0:14863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fea14e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1869752384439552:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1783135054.979859:0:14863:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1783135054.979899:0:14863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fea14e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1869752384439552:12345-0@lo:13:osp-pre-0-0.0 Request processed in 73us (201us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135054.979906:0:14863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1783135054.979960:0:3286:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9fea15f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1869752384439552:0@lo:13:osp-pre-0-0.0 10000000:01000000:2.0:1783135055.108534:0:14219:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1783135055.108542:0:14219:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-mdtir-ffff9fe9f6f8d000 from 8 10000000:01000000:2.0:1783135055.108548:0:14219:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1783135055.108596:0:14219:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.141@tcp lock: ffff9fe9c7828200/0xd6c4b8f05867f89e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135055.108608:0:14219:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.141@tcp lock: ffff9fe9c7828200/0xd6c4b8f05867f89e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135055.108619:0:14219:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.141@tcp lock: ffff9fe9c7828200/0xd6c4b8f05867f89e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783135055.108653:0:14219:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9f6cb0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1fe35bd-99cf-438e-8ada-ed586b673efa:14219:1869752384439680:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1783135055.108720:0:14219:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135055.108772:0:14219:0:(client.c:2701:ptlrpc_set_wait()) set ffff9fe9d1552480 going to sleep for 11 seconds 00000100:00100000:3.0:1783135055.108880:0:14215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384439680 00000100:00100000:3.0:1783135055.108888:0:14215:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384439680 00000100:00100000:3.0:1783135055.108941:0:14215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1783135055.108950:0:14215:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe8c5d81850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c1fe35bd-99cf-438e-8ada-ed586b673efa+18:14219:x1869752384439680:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783135055.108963:0:14215:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783135055.108977:0:14215:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fe9d2b75200/0xd6c4b8f05867f8a5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd6c4b8f05867f89e expref: -99 pid: 14215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135055.109001:0:14215:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fe9d2b75200/0xd6c4b8f05867f8a5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd6c4b8f05867f89e expref: 19 pid: 14215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135055.109012:0:14215:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fe9d2b75200/0xd6c4b8f05867f8a5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd6c4b8f05867f89e expref: 19 pid: 14215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135055.109027:0:14215:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fe9d2b75200, rc 0) 00000100:00100000:3.0:1783135055.109065:0:14215:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe8c5d81850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c1fe35bd-99cf-438e-8ada-ed586b673efa+19:14219:x1869752384439680:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 116us (345us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135055.109072:0:14215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1783135055.109699:0:14219:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9f6cb0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1fe35bd-99cf-438e-8ada-ed586b673efa:14219:1869752384439680:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783135055.109716:0:14219:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.141@tcp lock: ffff9fe9c7828200/0xd6c4b8f05867f89e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd6c4b8f05867f8a5 expref: -99 pid: 14219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135055.109726:0:14219:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.141@tcp lock: ffff9fe9c7828200/0xd6c4b8f05867f89e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd6c4b8f05867f8a5 expref: -99 pid: 14219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783135055.109773:0:14219:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9f6cb0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1fe35bd-99cf-438e-8ada-ed586b673efa:14219:1869752384439808:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1783135055.109804:0:14219:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135055.109834:0:14219:0:(client.c:2701:ptlrpc_set_wait()) set ffff9fe9d1552480 going to sleep for 11 seconds 00000100:00100000:1.0:1783135055.109879:0:14217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384439808 00000100:00100000:1.0:1783135055.109884:0:14217:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384439808 00000100:00100000:1.0:1783135055.109913:0:14217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1783135055.109920:0:14217:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe8c5d83850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1fe35bd-99cf-438e-8ada-ed586b673efa+19:14219:x1869752384439808:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1783135055.109934:0:14217:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1783135055.109949:0:14217:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1783135055.109952:0:14217:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 8 00000100:00100000:1.0:1783135055.110104:0:14217:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe8c5d83850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1fe35bd-99cf-438e-8ada-ed586b673efa+19:14219:x1869752384439808:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 184us (299us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135055.110111:0:14217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1783135055.110176:0:14219:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9f6cb0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1fe35bd-99cf-438e-8ada-ed586b673efa:14219:1869752384439808:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1783135055.110228:0:14219:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.201.141@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1783135055.110234:0:14219:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.141@tcp lock: ffff9fe9c7828200/0xd6c4b8f05867f89e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd6c4b8f05867f8a5 expref: -99 pid: 14219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135055.110253:0:14219:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.141@tcp lock: ffff9fe9c7828200/0xd6c4b8f05867f89e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd6c4b8f05867f8a5 expref: -99 pid: 14219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135055.299417:0:14210:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783135056.326069:0:14211:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1783135056.702904:0:15881:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg141-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1783135057.349296:0:15220:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783135057.910702:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:2.0:1783135057.910817:0:14216:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373973376 00000100:00100000:2.0:1783135057.910827:0:14216:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373973376 00000100:00100000:2.0:1783135057.910903:0:14216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 70 00000100:00100000:2.0:1783135057.910911:0:14216:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe8c5d81050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0+-99:2366:x1869752373973376:12345-192.168.201.41@tcp:250:mount.lustre.0 00010000:00080000:2.0:1783135057.910954:0:14216:0:(ldlm_lib.c:1432:target_handle_connect()) MGS: connection from 58985142-d56f-4f22-9f82-f587934b3bed@192.168.201.41@tcp t0 exp 0000000000000000 cur 340 last 0 00000020:00000080:2.0:1783135057.910982:0:14216:0:(genops.c:1406:class_connect()) connect: client 58985142-d56f-4f22-9f82-f587934b3bed, cookie 0xd6c4b8f05867f8ac 00000100:00080000:2.0:1783135057.911106:0:14216:0:(import.c:65:import_set_state_nolock()) ffff9fe8c5f1e000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1783135057.911181:0:14216:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe8c5d81050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58985142-d56f-4f22-9f82-f587934b3bed+5:2366:x1869752373973376:12345-192.168.201.41@tcp:250:mount.lustre.0 Request processed in 267us (487us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135057.911202:0:14216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 70 00000100:00100000:3.0:1783135057.912670:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:1.0:1783135057.912770:0:14217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373973504 00000100:00100000:1.0:1783135057.912778:0:14217:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373973504 00000100:00100000:1.0:1783135057.912855:0:14217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 71 00000100:00100000:1.0:1783135057.912864:0:14217:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe8c5d80050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58985142-d56f-4f22-9f82-f587934b3bed+5:13700:x1869752373973504:12345-192.168.201.41@tcp:101:mount.lustre.0 00010000:00010000:1.0:1783135057.912878:0:14217:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783135057.912894:0:14217:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fe8c5550400/0xd6c4b8f05867f8b3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x4428da03f5eb7567 expref: -99 pid: 14217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135057.912919:0:14217:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fe8c5550400/0xd6c4b8f05867f8b3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb7567 expref: 6 pid: 14217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135057.912929:0:14217:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fe8c5550400/0xd6c4b8f05867f8b3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb7567 expref: 6 pid: 14217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135057.912938:0:14217:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fe8c5550400, rc 0) 00000100:00100000:1.0:1783135057.912995:0:14217:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe8c5d80050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58985142-d56f-4f22-9f82-f587934b3bed+6:13700:x1869752373973504:12345-192.168.201.41@tcp:101:mount.lustre.0 Request processed in 132us (329us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135057.913003:0:14217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 71 00000100:00100000:2.0:1783135057.922602:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:1.0:1783135057.922704:0:14216:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373973632 00000100:00100000:1.0:1783135057.922714:0:14216:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373973632 00000100:00100000:1.0:1783135057.922767:0:14216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 72 00000100:00100000:1.0:1783135057.922777:0:14216:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe8c5d83450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58985142-d56f-4f22-9f82-f587934b3bed+6:13700:x1869752373973632:12345-192.168.201.41@tcp:501:mount.lustre.0 00000100:00100000:1.0:1783135057.923118:0:14216:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe8c5d83450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58985142-d56f-4f22-9f82-f587934b3bed+6:13700:x1869752373973632:12345-192.168.201.41@tcp:501:mount.lustre.0 Request processed in 340us (523us total) trans 0 rc -2/-2 00000100:00100000:1.0:1783135057.923126:0:14216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 72 00000100:00100000:2.0:1783135057.926764:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:1.0:1783135057.926877:0:14217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373973760 00000100:00100000:1.0:1783135057.926886:0:14217:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373973760 00000100:00100000:1.0:1783135057.926963:0:14217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 73 00000100:00100000:1.0:1783135057.926984:0:14217:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe8c5d82c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58985142-d56f-4f22-9f82-f587934b3bed+6:13700:x1869752373973760:12345-192.168.201.41@tcp:101:mount.lustre.0 00010000:00010000:1.0:1783135057.927013:0:14217:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783135057.927044:0:14217:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fe8c5551400/0xd6c4b8f05867f8ba lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x4428da03f5eb756e expref: -99 pid: 14217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135057.927091:0:14217:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fe8c5551400/0xd6c4b8f05867f8ba lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb756e expref: 7 pid: 14217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135057.927109:0:14217:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fe8c5551400/0xd6c4b8f05867f8ba lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb756e expref: 7 pid: 14217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135057.927123:0:14217:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fe8c5551400, rc 0) 00000100:00100000:1.0:1783135057.927923:0:14217:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe8c5d82c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58985142-d56f-4f22-9f82-f587934b3bed+7:13700:x1869752373973760:12345-192.168.201.41@tcp:101:mount.lustre.0 Request processed in 944us (1169us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135057.927946:0:14217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 73 00000100:00100000:2.0:1783135057.930475:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:3.0:1783135057.930568:0:14215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373973888 00000100:00100000:3.0:1783135057.930582:0:14215:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373973888 00000100:00100000:3.0:1783135057.930878:0:14215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 74 00000100:00100000:3.0:1783135057.930890:0:14215:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe8c5d81450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:58985142-d56f-4f22-9f82-f587934b3bed+7:13700:x1869752373973888:12345-192.168.201.41@tcp:501:mount.lustre.0 00000100:00100000:3.0:1783135057.932134:0:14215:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe8c5d81450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:58985142-d56f-4f22-9f82-f587934b3bed+8:13700:x1869752373973888:12345-192.168.201.41@tcp:501:mount.lustre.0 Request processed in 1242us (1662us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135057.932144:0:14215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 74 00000100:00100000:2.0:1783135057.935366:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:1.0:1783135057.935508:0:14217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373974016 00000100:00100000:1.0:1783135057.935517:0:14217:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373974016 00000100:00100000:1.0:1783135057.935620:0:14217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 75 00000100:00100000:1.0:1783135057.935631:0:14217:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe8c5d83050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58985142-d56f-4f22-9f82-f587934b3bed+8:13700:x1869752373974016:12345-192.168.201.41@tcp:503:mount.lustre.0 00000100:00100000:1.0:1783135057.935948:0:14217:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe8c5d83050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58985142-d56f-4f22-9f82-f587934b3bed+8:13700:x1869752373974016:12345-192.168.201.41@tcp:503:mount.lustre.0 Request processed in 318us (592us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135057.935957:0:14217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 75 00000100:00100000:2.0:1783135057.941769:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:3.0:1783135057.941876:0:14215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373974144 00000100:00100000:3.0:1783135057.941886:0:14215:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373974144 00000100:00100000:3.0:1783135057.941942:0:14215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 76 00000100:00100000:3.0:1783135057.941952:0:14215:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe8c5d83c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:58985142-d56f-4f22-9f82-f587934b3bed+8:13719:x1869752373974144:12345-192.168.201.41@tcp:502:llog_process_th.0 00000100:00100000:3.0:1783135057.942425:0:14215:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe8c5d83c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:58985142-d56f-4f22-9f82-f587934b3bed+8:13719:x1869752373974144:12345-192.168.201.41@tcp:502:llog_process_th.0 Request processed in 419us (612us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135057.942433:0:14215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 76 00000100:00100000:3.0:1783135057.957530:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:1.0:1783135057.961480:0:14217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373974272 00000100:00100000:1.0:1783135057.961502:0:14217:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373974272 00000100:00100000:1.0:1783135057.961592:0:14217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 77 00000100:00100000:1.0:1783135057.961604:0:14217:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe8c5d81c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58985142-d56f-4f22-9f82-f587934b3bed+8:13719:x1869752373974272:12345-192.168.201.41@tcp:502:llog_process_th.0 00000100:00100000:1.0:1783135057.962001:0:14217:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe8c5d81c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58985142-d56f-4f22-9f82-f587934b3bed+8:13719:x1869752373974272:12345-192.168.201.41@tcp:502:llog_process_th.0 Request processed in 398us (4487us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135057.962010:0:14217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 77 00000100:00100000:0.0:1783135057.967619:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:2.0:1783135057.967792:0:14216:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373974400 00000100:00100000:2.0:1783135057.967805:0:14216:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373974400 00000100:00100000:2.0:1783135057.967930:0:14216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 78 00000100:00100000:2.0:1783135057.967942:0:14216:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe8c5d80c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58985142-d56f-4f22-9f82-f587934b3bed+8:13700:x1869752373974400:12345-192.168.201.41@tcp:101:mount.lustre.0 00010000:00010000:2.0:1783135057.967965:0:14216:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783135057.967988:0:14216:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fe9c7828a00/0xd6c4b8f05867f8c1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x4428da03f5eb7598 expref: -99 pid: 14216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135057.968025:0:14216:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fe9c7828a00/0xd6c4b8f05867f8c1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb7598 expref: 9 pid: 14216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135057.968052:0:14216:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fe9c7828a00/0xd6c4b8f05867f8c1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb7598 expref: 9 pid: 14216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135057.968065:0:14216:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fe9c7828a00, rc 0) 00000100:00100000:2.0:1783135057.968138:0:14216:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe8c5d80c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58985142-d56f-4f22-9f82-f587934b3bed+9:13700:x1869752373974400:12345-192.168.201.41@tcp:101:mount.lustre.0 Request processed in 198us (534us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135057.968163:0:14216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 78 00000100:00100000:2.0:1783135057.971984:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:3.0:1783135057.972268:0:14215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373974528 00000100:00100000:3.0:1783135057.972394:0:14215:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373974528 00000100:00100000:3.0:1783135057.972514:0:14215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 79 00000100:00100000:3.0:1783135057.972527:0:14215:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fea01d4f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:58985142-d56f-4f22-9f82-f587934b3bed+9:13700:x1869752373974528:12345-192.168.201.41@tcp:256:mount.lustre.0 20000000:01000000:3.0:1783135057.972579:0:14215:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:3.0:1783135057.972602:0:14215:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1783135057.972606:0:14215:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:3.0:1783135057.972610:0:14215:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:3.0:1783135057.972612:0:14215:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 8 00000100:00100000:2.0:1783135057.976873:0:14215:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fea01d4f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:58985142-d56f-4f22-9f82-f587934b3bed+9:13700:x1869752373974528:12345-192.168.201.41@tcp:256:mount.lustre.0 Request processed in 4332us (4885us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135057.976892:0:14215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 79 00000100:00100000:0.0:1783135057.979369:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:2.0:1783135057.979473:0:14216:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373974656 00000100:00100000:2.0:1783135057.979485:0:14216:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373974656 00000100:00100000:2.0:1783135057.979595:0:14216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 80 00000100:00100000:2.0:1783135057.979605:0:14216:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fea01d4c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58985142-d56f-4f22-9f82-f587934b3bed+9:13700:x1869752373974656:12345-192.168.201.41@tcp:101:mount.lustre.0 00010000:00010000:2.0:1783135057.979626:0:14216:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783135057.979646:0:14216:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fe9c7829800/0xd6c4b8f05867f8c8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x4428da03f5eb759f expref: -99 pid: 14216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135057.979680:0:14216:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fe9c7829800/0xd6c4b8f05867f8c8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb759f expref: 10 pid: 14216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135057.979692:0:14216:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fe9c7829800/0xd6c4b8f05867f8c8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb759f expref: 10 pid: 14216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135057.979703:0:14216:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fe9c7829800, rc 0) 00000100:00100000:2.0:1783135057.979791:0:14216:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fea01d4c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58985142-d56f-4f22-9f82-f587934b3bed+10:13700:x1869752373974656:12345-192.168.201.41@tcp:101:mount.lustre.0 Request processed in 187us (433us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135057.979798:0:14216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 80 00000100:00100000:3.0:1783135057.984772:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:2.0:1783135057.984855:0:14215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373974784 00000100:00100000:2.0:1783135057.984867:0:14215:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373974784 00000100:00100000:2.0:1783135057.984992:0:14215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 81 00000100:00100000:2.0:1783135057.985005:0:14215:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fea01d4cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:58985142-d56f-4f22-9f82-f587934b3bed+10:13700:x1869752373974784:12345-192.168.201.41@tcp:501:mount.lustre.0 00000100:00100000:2.0:1783135057.985495:0:14215:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fea01d4cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:58985142-d56f-4f22-9f82-f587934b3bed+10:13700:x1869752373974784:12345-192.168.201.41@tcp:501:mount.lustre.0 Request processed in 492us (736us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135057.985505:0:14215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 81 00000100:00100000:3.0:1783135057.991268:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:1.0:1783135057.991665:0:14217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373974912 00000100:00100000:1.0:1783135057.991677:0:14217:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373974912 00000100:00100000:0.0:1783135057.991961:0:14217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 82 00000100:00100000:0.0:1783135057.991973:0:14217:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fea01d4fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58985142-d56f-4f22-9f82-f587934b3bed+10:13700:x1869752373974912:12345-192.168.201.41@tcp:503:mount.lustre.0 00000100:00100000:0.0:1783135057.992524:0:14217:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fea01d4fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58985142-d56f-4f22-9f82-f587934b3bed+10:13700:x1869752373974912:12345-192.168.201.41@tcp:503:mount.lustre.0 Request processed in 551us (1269us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135057.992535:0:14217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 82 00000100:00100000:0.0:1783135057.994982:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:2.0:1783135057.995339:0:14215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373975040 00000100:00100000:2.0:1783135057.995351:0:14215:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373975040 00000100:00100000:2.0:1783135057.995425:0:14215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 83 00000100:00100000:2.0:1783135057.995436:0:14215:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fea01d4d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:58985142-d56f-4f22-9f82-f587934b3bed+10:13723:x1869752373975040:12345-192.168.201.41@tcp:502:llog_process_th.0 00000100:00100000:2.0:1783135057.995838:0:14215:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fea01d4d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:58985142-d56f-4f22-9f82-f587934b3bed+10:13723:x1869752373975040:12345-192.168.201.41@tcp:502:llog_process_th.0 Request processed in 401us (867us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135057.995846:0:14215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 83 00000100:00100000:3.0:1783135058.004094:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:0.0:1783135058.004313:0:14217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373975168 00000100:00100000:0.0:1783135058.004326:0:14217:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373975168 00000100:00100000:0.0:1783135058.004395:0:14217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 84 00000100:00100000:0.0:1783135058.004406:0:14217:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fe8dbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58985142-d56f-4f22-9f82-f587934b3bed+10:13723:x1869752373975168:12345-192.168.201.41@tcp:502:llog_process_th.0 00000100:00100000:0.0:1783135058.004851:0:14217:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fe8dbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58985142-d56f-4f22-9f82-f587934b3bed+10:13723:x1869752373975168:12345-192.168.201.41@tcp:502:llog_process_th.0 Request processed in 445us (771us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135058.004861:0:14217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 84 00000100:00100000:3.0:1783135058.010613:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:2.0:1783135058.010727:0:14222:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373975296 00000100:00100000:2.0:1783135058.010740:0:14222:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373975296 00000100:00100000:2.0:1783135058.010836:0:14222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 4 00000100:00100000:2.0:1783135058.010844:0:14222:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fea15f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2366:x1869752373975296:12345-192.168.201.41@tcp:38:mount.lustre.0 00010000:00080000:2.0:1783135058.010881:0:14222:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from 2b138366-7a70-4ff2-909d-348210e4a0a2@192.168.201.41@tcp t0 exp 0000000000000000 cur 340 last 0 00000020:00000080:2.0:1783135058.010934:0:14222:0:(genops.c:1406:class_connect()) connect: client 2b138366-7a70-4ff2-909d-348210e4a0a2, cookie 0xd6c4b8f05867f8cf 00000004:00100000:2.0:1783135058.010965:0:14222:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000001:00000004:2.0:1783135058.010971:0:14222:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000100:00080000:3.0:1783135058.047514:0:14222:0:(import.c:65:import_set_state_nolock()) ffff9fe8c6041800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1783135058.047599:0:14222:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fea15f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2b138366-7a70-4ff2-909d-348210e4a0a2+6:2366:x1869752373975296:12345-192.168.201.41@tcp:38:mount.lustre.0 Request processed in 36753us (37000us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135058.047615:0:14222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 4 00000100:00100000:2.0:1783135058.049660:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:1.0:1783135058.049799:0:14223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373975552 00000100:00100000:1.0:1783135058.049808:0:14223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373975552 00000100:00080000:3.0:1783135058.049897:0:14218:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783135058.050102:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:3.0:1783135058.050168:0:14224:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373975424 00000100:00100000:3.0:1783135058.050179:0:14224:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373975424 00000100:00100000:1.0:1783135058.050223:0:14223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 5 00000100:00100000:1.0:1783135058.050355:0:14223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9f6cb0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2b138366-7a70-4ff2-909d-348210e4a0a2+7:13700:x1869752373975552:12345-192.168.201.41@tcp:41:mount.lustre.0 00000004:00000024:1.0:1783135058.050397:0:14223:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1783135058.050660:0:14223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9f6cb0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2b138366-7a70-4ff2-909d-348210e4a0a2+7:13700:x1869752373975552:12345-192.168.201.41@tcp:41:mount.lustre.0 Request processed in 424us (1006us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135058.050669:0:14223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 5 00000100:00100000:1.0:1783135058.050717:0:14223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 6 00000100:00100000:1.0:1783135058.050726:0:14223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe8c6dfc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2b138366-7a70-4ff2-909d-348210e4a0a2+6:0:x1869752373975424:12345-192.168.201.41@tcp:41:mount.lustre.0 00000004:00000024:1.0:1783135058.050740:0:14223:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1783135058.050767:0:14223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe8c6dfc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2b138366-7a70-4ff2-909d-348210e4a0a2+6:0:x1869752373975424:12345-192.168.201.41@tcp:41:mount.lustre.0 Request processed in 42us (666us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135058.050773:0:14223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 6 00000100:00100000:2.0:1783135058.052097:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:3.0:1783135058.052157:0:14224:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373975680 00000100:00100000:3.0:1783135058.052169:0:14224:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373975680 00000100:00100000:3.0:1783135058.052244:0:14224:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 7 00000100:00100000:3.0:1783135058.052258:0:14224:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9f6cb1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2b138366-7a70-4ff2-909d-348210e4a0a2+6:13700:x1869752373975680:12345-192.168.201.41@tcp:40:mount.lustre.0 00000100:00100000:3.0:1783135058.052406:0:14224:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9f6cb1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2b138366-7a70-4ff2-909d-348210e4a0a2+6:13700:x1869752373975680:12345-192.168.201.41@tcp:40:mount.lustre.0 Request processed in 152us (312us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135058.052414:0:14224:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 7 00000100:00100000:2.0:1783135058.055126:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:2.0:1783135058.055235:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:2.0:1783135058.055402:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:0.0:1783135058.055537:0:14225:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373976064 00000100:00100000:0.0:1783135058.055547:0:14225:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373976064 00000100:00100000:0.0:1783135058.055603:0:14225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 0 00000100:00100000:0.0:1783135058.055613:0:14225:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9f6cb3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2b138366-7a70-4ff2-909d-348210e4a0a2+6:13700:x1869752373976064:12345-192.168.201.41@tcp:33:mount.lustre.0 00000004:00080000:0.0:1783135058.056408:0:14225:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 671us 00000100:00100000:1.0:1783135058.059967:0:14860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373975808 00000100:00100000:1.0:1783135058.059981:0:14860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373975808 00000100:00100000:3.0:1783135058.060001:0:14858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373975936 00000100:00100000:1.0:1783135058.060042:0:14860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 5 00000100:00100000:1.0:1783135058.060053:0:14860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9f6cb1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2366:x1869752373975808:12345-192.168.201.41@tcp:8:mount.lustre.0 00010000:00080000:1.0:1783135058.060088:0:14860:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0000: connection from 2b138366-7a70-4ff2-909d-348210e4a0a2@192.168.201.41@tcp t0 exp 0000000000000000 cur 340 last 0 00000100:00100000:3.0:1783135058.060110:0:14858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373975936 00000020:00000080:1.0:1783135058.060121:0:14860:0:(genops.c:1406:class_connect()) connect: client 2b138366-7a70-4ff2-909d-348210e4a0a2, cookie 0xd6c4b8f05867f8d6 00002000:00100000:1.0:1783135058.060138:0:14860:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 2b138366-7a70-4ff2-909d-348210e4a0a2/ffff9fe9c8f8d000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113653 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1783135058.060165:0:14860:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00000100:00100000:2.0:1783135058.060503:0:14858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 6 00000100:00100000:2.0:1783135058.060512:0:14858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9f6cb2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2366:x1869752373975936:12345-192.168.201.41@tcp:8:mount.lustre.0 00010000:00080000:2.0:1783135058.060551:0:14858:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0001: connection from 2b138366-7a70-4ff2-909d-348210e4a0a2@192.168.201.41@tcp t0 exp 0000000000000000 cur 340 last 0 00000020:00000080:2.0:1783135058.060578:0:14858:0:(genops.c:1406:class_connect()) connect: client 2b138366-7a70-4ff2-909d-348210e4a0a2, cookie 0xd6c4b8f05867f8dd 00002000:00100000:2.0:1783135058.060590:0:14858:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 2b138366-7a70-4ff2-909d-348210e4a0a2/ffff9fe8c5f1d000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113653 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1783135058.060615:0:14858:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1783135058.061023:0:14858:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1783135058.061076:0:14858:0:(import.c:65:import_set_state_nolock()) ffff9fe8c5f1d800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1783135058.061169:0:14858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9f6cb2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2b138366-7a70-4ff2-909d-348210e4a0a2+6:2366:x1869752373975936:12345-192.168.201.41@tcp:8:mount.lustre.0 Request processed in 654us (5931us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135058.061179:0:14858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 6 00002000:00080000:1.0:1783135058.061792:0:14860:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1783135058.061828:0:14860:0:(import.c:65:import_set_state_nolock()) ffff9fe9c8f8c800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1783135058.062024:0:14860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9f6cb1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2b138366-7a70-4ff2-909d-348210e4a0a2+6:2366:x1869752373975808:12345-192.168.201.41@tcp:8:mount.lustre.0 Request processed in 1969us (6906us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135058.062033:0:14860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 5 00000004:00200000:0.0:1783135058.067437:0:14225:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000100:00100000:0.0:1783135058.067640:0:14225:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9f6cb3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2b138366-7a70-4ff2-909d-348210e4a0a2+6:13700:x1869752373976064:12345-192.168.201.41@tcp:33:mount.lustre.0 Request processed in 12023us (12235us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135058.067652:0:14225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 0 00000100:00100000:2.0:1783135058.194574:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:1.0:1783135058.194741:0:14223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373976192 00000100:00100000:1.0:1783135058.194755:0:14223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373976192 00000100:00100000:1.0:1783135058.194839:0:14223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 8 00000100:00100000:1.0:1783135058.194852:0:14223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9f6cb0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2b138366-7a70-4ff2-909d-348210e4a0a2+6:13744:x1869752373976192:12345-192.168.201.41@tcp:101:mkdir.0 00010000:00010000:1.0:1783135058.194881:0:14223:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783135058.195044:0:14223:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe8c5550000/0xd6c4b8f05867f8e4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4428da03f5eb75c9 expref: -99 pid: 14223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135058.195148:0:14223:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe8c5551e00/0xd6c4b8f05867f8eb lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135058.195163:0:14223:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fe8c5551e00/0xd6c4b8f05867f8eb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135058.195181:0:14223:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe8c5551e00/0xd6c4b8f05867f8eb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783135058.195419:0:14223:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:1.0:1783135058.195423:0:14223:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:1.0:1783135058.195524:0:14223:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fe8c5551e00/0xd6c4b8f05867f8eb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135058.195548:0:14223:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe8c5550000/0xd6c4b8f05867f8e4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb75c9 expref: 8 pid: 14223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135058.195560:0:14223:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe8c5551e00/0xd6c4b8f05867f8eb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb75c9 expref: 7 pid: 14223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135058.195567:0:14223:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fe9e1c2b500) 00010000:00010000:1.0:1783135058.195569:0:14223:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1783135058.195572:0:14223:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fe8c5551e00, rc 0) 00000100:00100000:1.0:1783135058.195712:0:14223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9f6cb0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2b138366-7a70-4ff2-909d-348210e4a0a2+7:13744:x1869752373976192:12345-192.168.201.41@tcp:101:mkdir.0 Request processed in 862us (1150us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135058.195721:0:14223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 8 00010000:00010000:2.0:1783135058.371524:0:14210:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1783135058.563573:0:8:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1783135058.563583:0:8:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1783135058.563588:0:8:0:(import.c:65:import_set_state_nolock()) ffff9fe9f5c91000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1783135058.563604:0:8:0:(import.c:626:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9fe9f5c91000 using connection 192.168.201.141@tcp/0@lo 00000100:00100000:2.0:1783135058.563633:0:8:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9fe9f6cb1500 x1869752384440192/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1783135058.563731:0:3287:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9fe828e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3287:1869752384440448:0@lo:400:kworker.0 00000100:00100000:0.0:1783135058.563892:0:3288:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9f6cb2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c1fe35bd-99cf-438e-8ada-ed586b673efa:3288:1869752384439936:0@lo:400:kworker.0 00000100:00100000:0.0:1783135058.563951:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135058.564073:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135058.564110:0:14215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384439936 00000100:00100000:2.0:1783135058.564119:0:14215:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384439936 00000100:00100000:1.0:1783135058.564210:0:3285:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9f6cb1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3285:1869752384440192:0@lo:8:kworker.0 00000100:00100000:1.0:1783135058.564246:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135058.564366:0:3288:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9fe82a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3288:1869752384440576:0@lo:400:kworker.0 00000100:00100000:0.0:1783135058.564398:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135058.564420:0:3288:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1783135058.564426:0:3288:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9f6cb2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1869752384440064:0@lo:400:kworker.0 00000100:00100000:0.0:1783135058.564448:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135058.564475:0:14222:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384440448 00000100:00100000:0.0:1783135058.564479:0:14222:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384440448 00000100:00100000:2.0:1783135058.564568:0:14215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1783135058.564580:0:14215:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fe8d9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c1fe35bd-99cf-438e-8ada-ed586b673efa+19:3288:x1869752384439936:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783135058.564594:0:3286:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9fe82aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3286:1869752384440320:0@lo:400:kworker.0 00000100:00100000:3.0:1783135058.564644:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135058.564648:0:14215:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fe8d9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c1fe35bd-99cf-438e-8ada-ed586b673efa+19:3288:x1869752384439936:12345-0@lo:400:kworker.0 Request processed in 68us (695us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135058.564665:0:14215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1783135058.564731:0:15538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384440192 00000100:00100000:1.0:1783135058.564735:0:15538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384440192 00000100:00100000:1.0:1783135058.564762:0:15538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384440064 00000100:00100000:1.0:1783135058.564765:0:15538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384440064 00000100:00100000:1.0:1783135058.564858:0:15538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1783135058.564866:0:15538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe8c6dfd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3288:x1869752384440064:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783135058.564902:0:15538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe8c6dfd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3288:x1869752384440064:12345-0@lo:400:kworker.0 Request processed in 37us (452us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135058.564908:0:15538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1783135058.564923:0:15538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1783135058.564928:0:15538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fe959c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3285:x1869752384440192:12345-0@lo:8:kworker.0 00010000:00080000:1.0:1783135058.564954:0:15538:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 340 last 0 00000020:00000080:1.0:1783135058.564991:0:15538:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xd6c4b8f05867f8f2 00000100:00100000:2.0:1783135058.565579:0:14224:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384440576 00000100:00100000:2.0:1783135058.565584:0:14224:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384440576 00002000:00100000:1.0:1783135058.565637:0:15538:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff9fe9c8f8d800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113653 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:1.0:1783135058.565644:0:15538:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:1.0:1783135058.565647:0:15538:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1783135058.565964:0:15538:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1783135058.565994:0:15538:0:(import.c:65:import_set_state_nolock()) ffff9fe9c8f8f000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1783135058.566060:0:15538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fe959c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3285:x1869752384440192:12345-0@lo:8:kworker.0 Request processed in 1129us (1812us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135058.566068:0:15538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:1.0:1783135058.566123:0:3285:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fe9f6cb1500 x1869752384440192/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1783135078 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1783135058.566141:0:3285:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 2 00000100:00080000:1.0:1783135058.566150:0:3285:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1783135058.566156:0:3285:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:1.0:1783135058.566158:0:3285:0:(import.c:65:import_set_state_nolock()) ffff9fe9f5c91000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1783135058.566240:0:14222:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384440320 00000100:00100000:0.0:1783135058.566246:0:14222:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384440320 00000100:00080000:3.0:1783135058.567734:0:14218:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1783135058.567744:0:14218:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1783135058.568390:0:14224:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1783135058.568408:0:14224:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fe829500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3287:x1869752384440448:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783135058.568516:0:14224:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fe829500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3287:x1869752384440448:12345-0@lo:400:kworker.0 Request processed in 114us (4441us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135058.568524:0:14224:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1783135058.568546:0:14224:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1783135058.569120:0:14224:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe8c6dffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3288:x1869752384440576:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783135058.569166:0:14224:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe8c6dffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3288:x1869752384440576:12345-0@lo:400:kworker.0 Request processed in 611us (4765us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135058.569173:0:14224:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1783135058.569273:0:3287:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9fe828e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3287:1869752384440448:0@lo:400:kworker.0 00000100:00100000:2.0:1783135058.569357:0:3288:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9f6cb2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1869752384440064:0@lo:400:kworker.0 00000100:00100000:2.0:1783135058.569370:0:3288:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9f6cb2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c1fe35bd-99cf-438e-8ada-ed586b673efa:3288:1869752384439936:0@lo:400:kworker.0 00000100:00100000:2.0:1783135058.569388:0:3288:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9fe82a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3288:1869752384440576:0@lo:400:kworker.0 00000004:00080000:1.0:1783135058.569513:0:3285:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1783135058.569524:0:3285:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9f6cb1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3285:1869752384440192:0@lo:8:kworker.0 00000100:00100000:0.0:1783135058.569626:0:14222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1783135058.569639:0:14222:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fea14a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3286:x1869752384440320:12345-0@lo:400:kworker.0 00000004:00080000:3.0:1783135058.569717:0:14248:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x280000400:0x6:0x0] 00000100:00100000:3.0:1783135058.569746:0:14248:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9fea17100 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14248:1869752384440832:0@lo:5:osp-pre-1-0.0 00000100:00100000:3.0:1783135058.569797:0:14248:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135058.569817:0:14248:0:(client.c:2701:ptlrpc_set_wait()) set ffff9fe9fe8a1600 going to sleep for 11 seconds 00000100:00100000:3.0:1783135058.569834:0:3289:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9fea14000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1869752384440704:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1783135058.569862:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135058.569903:0:14863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384440704 00000100:00100000:3.0:1783135058.569911:0:14863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384440704 00000100:00100000:3.0:1783135058.569957:0:14863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1783135058.569965:0:14863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fea17480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3289:x1869752384440704:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1783135058.569983:0:14863:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44367872 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1783135058.570026:0:14863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fea17480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3289:x1869752384440704:12345-0@lo:13:osp-pre-1-0.0 Request processed in 62us (163us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135058.570033:0:14863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:3.0:1783135058.570050:0:14218:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1783135058.570071:0:3289:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fe9fea14000 x1869752384440704/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783135074 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783135058.570088:0:3289:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9fea14000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1869752384440704:0@lo:13:osp-pre-1-0.0 00000040:00080000:2.0:1783135058.570314:0:14247:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x6:0x0] index 9 count 2 00000100:00100000:3.0:1783135058.570347:0:3286:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9fe82a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1869752384440960:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1783135058.570379:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135058.570425:0:14861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384440832 00000100:00100000:3.0:1783135058.570429:0:14861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384440832 00000100:00100000:3.0:1783135058.570458:0:14861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384440960 00000100:00100000:3.0:1783135058.570461:0:14861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384440960 00000100:00100000:3.0:1783135058.570486:0:14861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1783135058.570505:0:14861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fea14700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:14248:x1869752384440832:12345-0@lo:5:osp-pre-1-0.0 00000040:00080000:2.0:1783135058.570517:0:14247:0:(llog.c:800:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1783135058.570523:0:14247:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0xc:0x0] at index 2 of catalog [0x1:0x5:0x0] 00000004:00080000:2.0:1783135058.570672:0:14247:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000100:00100000:1.0:1783135058.571327:0:14222:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fea14a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3286:x1869752384440320:12345-0@lo:400:kworker.0 Request processed in 1691us (6682us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135058.571338:0:14222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1783135058.571370:0:14860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1783135058.571381:0:14860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fea14000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3286:x1869752384440960:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1783135058.571452:0:3286:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9fe82aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3286:1869752384440320:0@lo:400:kworker.0 00000004:00080000:2.0:1783135058.571961:0:14247:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 340967679598ns, next at 0ns, rc = 0 00002000:00080000:3.0:1783135058.574800:0:14861:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:3.0:1783135058.574811:0:14861:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -27 00002000:02000040:3.0:1783135058.574817:0:14861:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000400:7 to 0x280000400:33) 00002000:00010000:3.0:1783135058.590946:0:14861:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1783135058.590962:0:14861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000661940ac/0xd6c4b8f05867f8f9 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135058.590982:0:14861:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=340s v=(0 0) 00010000:00010000:3.0:1783135058.590987:0:14861:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783135058.590995:0:14861:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000661940ac/0xd6c4b8f05867f8f9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135058.591542:0:14861:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000661940ac/0xd6c4b8f05867f8f9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135058.591556:0:14861:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000661940ac/0xd6c4b8f05867f8f9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135058.591565:0:14861:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000661940ac/0xd6c4b8f05867f8f9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135058.591591:0:14861:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1783135058.591622:0:14211:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783135058.591632:0:14211:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000661940ac/0xd6c4b8f05867f8f9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135058.591644:0:14211:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe9d2b74a00 already unused, calling callback (ffffffffc1527ce0) 00010000:00010000:0.0:1783135058.591650:0:14211:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000661940ac/0xd6c4b8f05867f8f9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135058.591661:0:14211:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000661940ac/0xd6c4b8f05867f8f9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135058.591695:0:14211:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000661940ac/0xd6c4b8f05867f8f9 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135058.591703:0:14211:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000661940ac/0xd6c4b8f05867f8f9 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135058.591730:0:14211:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783135058.591733:0:14211:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783135058.591735:0:14211:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1783135058.593191:0:14861:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1783135058.593204:0:14861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f55becc5/0xd6c4b8f05867f900 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135058.593234:0:14861:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=340s v=(0 0) 00010000:00010000:3.0:1783135058.593238:0:14861:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783135058.593245:0:14861:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f55becc5/0xd6c4b8f05867f900 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135058.593258:0:14861:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f55becc5/0xd6c4b8f05867f900 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135058.593268:0:14861:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f55becc5/0xd6c4b8f05867f900 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135058.593277:0:14861:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f55becc5/0xd6c4b8f05867f900 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135058.593367:0:14861:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1783135058.593448:0:15220:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783135058.593456:0:15220:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f55becc5/0xd6c4b8f05867f900 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135058.593466:0:15220:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe9d2b74800 already unused, calling callback (ffffffffc1527ce0) 00010000:00010000:0.0:1783135058.593533:0:15220:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f55becc5/0xd6c4b8f05867f900 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135058.593546:0:15220:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f55becc5/0xd6c4b8f05867f900 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135058.593564:0:15220:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f55becc5/0xd6c4b8f05867f900 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135058.593572:0:15220:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f55becc5/0xd6c4b8f05867f900 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135058.593603:0:15220:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783135058.593605:0:15220:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783135058.593607:0:15220:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1783135058.594737:0:14861:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1783135058.594745:0:14861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000043bf3fc8/0xd6c4b8f05867f907 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135058.594757:0:14861:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=340s v=(0 0) 00010000:00010000:3.0:1783135058.594760:0:14861:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783135058.594766:0:14861:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000043bf3fc8/0xd6c4b8f05867f907 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135058.594776:0:14861:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000043bf3fc8/0xd6c4b8f05867f907 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135058.594797:0:14861:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000043bf3fc8/0xd6c4b8f05867f907 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135058.594804:0:14861:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000043bf3fc8/0xd6c4b8f05867f907 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135058.594822:0:14861:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1783135058.594846:0:14210:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783135058.594853:0:14210:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000043bf3fc8/0xd6c4b8f05867f907 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135058.594861:0:14210:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe9d2b75e00 already unused, calling callback (ffffffffc1527ce0) 00010000:00010000:0.0:1783135058.594864:0:14210:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000043bf3fc8/0xd6c4b8f05867f907 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135058.594870:0:14210:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000043bf3fc8/0xd6c4b8f05867f907 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135058.594881:0:14210:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000043bf3fc8/0xd6c4b8f05867f907 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135058.594887:0:14210:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000043bf3fc8/0xd6c4b8f05867f907 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135058.594901:0:14210:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783135058.594903:0:14210:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783135058.594904:0:14210:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1783135058.595853:0:14861:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1783135058.595861:0:14861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000061135695/0xd6c4b8f05867f90e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135058.595871:0:14861:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=340s v=(0 0) 00010000:00010000:3.0:1783135058.595875:0:14861:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783135058.595880:0:14861:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000061135695/0xd6c4b8f05867f90e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135058.595889:0:14861:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000061135695/0xd6c4b8f05867f90e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135058.595898:0:14861:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000061135695/0xd6c4b8f05867f90e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135058.595906:0:14861:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000061135695/0xd6c4b8f05867f90e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135058.595932:0:14861:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1783135058.595943:0:14211:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783135058.595951:0:14211:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000061135695/0xd6c4b8f05867f90e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135058.595970:0:14211:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe9d2b75a00 already unused, calling callback (ffffffffc1527ce0) 00010000:00010000:0.0:1783135058.595973:0:14211:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000061135695/0xd6c4b8f05867f90e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135058.595980:0:14211:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000061135695/0xd6c4b8f05867f90e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135058.595990:0:14211:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000061135695/0xd6c4b8f05867f90e lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135058.595995:0:14211:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000061135695/0xd6c4b8f05867f90e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135058.596006:0:14211:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783135058.596007:0:14211:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783135058.596009:0:14211:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1783135058.596370:0:14861:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1783135058.596375:0:14861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e4e233eb/0xd6c4b8f05867f915 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135058.596381:0:14861:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=340s v=(0 0) 00010000:00010000:3.0:1783135058.596383:0:14861:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783135058.596386:0:14861:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e4e233eb/0xd6c4b8f05867f915 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135058.596391:0:14861:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e4e233eb/0xd6c4b8f05867f915 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135058.596396:0:14861:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e4e233eb/0xd6c4b8f05867f915 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135058.596401:0:14861:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e4e233eb/0xd6c4b8f05867f915 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135058.596413:0:14861:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1783135058.596447:0:15220:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783135058.596454:0:15220:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e4e233eb/0xd6c4b8f05867f915 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135058.596463:0:15220:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe9d2b74e00 already unused, calling callback (ffffffffc1527ce0) 00010000:00010000:0.0:1783135058.596467:0:15220:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e4e233eb/0xd6c4b8f05867f915 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135058.596486:0:15220:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e4e233eb/0xd6c4b8f05867f915 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135058.596509:0:15220:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e4e233eb/0xd6c4b8f05867f915 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135058.596517:0:15220:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e4e233eb/0xd6c4b8f05867f915 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135058.596538:0:15220:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783135058.596541:0:15220:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783135058.596543:0:15220:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1783135058.596815:0:14861:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1783135058.596821:0:14861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009047988e/0xd6c4b8f05867f91c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135058.596827:0:14861:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=340s v=(0 0) 00010000:00010000:3.0:1783135058.596833:0:14861:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783135058.596836:0:14861:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009047988e/0xd6c4b8f05867f91c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135058.596843:0:14861:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009047988e/0xd6c4b8f05867f91c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135058.596848:0:14861:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009047988e/0xd6c4b8f05867f91c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135058.596852:0:14861:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009047988e/0xd6c4b8f05867f91c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135058.596863:0:14861:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1783135058.596874:0:14210:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783135058.596880:0:14210:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009047988e/0xd6c4b8f05867f91c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135058.596888:0:14210:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe9d2b74600 already unused, calling callback (ffffffffc1527ce0) 00010000:00010000:0.0:1783135058.596892:0:14210:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009047988e/0xd6c4b8f05867f91c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135058.596901:0:14210:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009047988e/0xd6c4b8f05867f91c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135058.596915:0:14210:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009047988e/0xd6c4b8f05867f91c lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135058.596923:0:14210:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009047988e/0xd6c4b8f05867f91c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135058.596953:0:14210:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783135058.596957:0:14210:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783135058.596959:0:14210:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1783135058.597269:0:14861:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1783135058.597275:0:14861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000944749e8/0xd6c4b8f05867f923 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135058.597303:0:14861:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=340s v=(0 0) 00010000:00010000:3.0:1783135058.597306:0:14861:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783135058.597310:0:14861:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000944749e8/0xd6c4b8f05867f923 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135058.597319:0:14861:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000944749e8/0xd6c4b8f05867f923 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135058.597328:0:14861:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000944749e8/0xd6c4b8f05867f923 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135058.597341:0:14861:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000944749e8/0xd6c4b8f05867f923 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135058.597355:0:14861:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783135058.597364:0:14211:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783135058.597368:0:14211:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000944749e8/0xd6c4b8f05867f923 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135058.597375:0:14211:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe9d2b74000 already unused, calling callback (ffffffffc1527ce0) 00010000:00010000:3.0:1783135058.597378:0:14211:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000944749e8/0xd6c4b8f05867f923 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135058.597386:0:14211:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000944749e8/0xd6c4b8f05867f923 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135058.597398:0:14211:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000944749e8/0xd6c4b8f05867f923 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135058.597406:0:14211:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000944749e8/0xd6c4b8f05867f923 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135058.597427:0:14211:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783135058.597429:0:14211:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783135058.597430:0:14211:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1783135058.597896:0:14861:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1783135058.597904:0:14861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000064578bf3/0xd6c4b8f05867f92a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135058.597917:0:14861:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=340s v=(0 0) 00010000:00010000:2.0:1783135058.597920:0:14861:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783135058.597924:0:14861:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000064578bf3/0xd6c4b8f05867f92a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135058.597935:0:14861:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000064578bf3/0xd6c4b8f05867f92a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135058.597943:0:14861:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000064578bf3/0xd6c4b8f05867f92a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135058.597951:0:14861:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000064578bf3/0xd6c4b8f05867f92a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135058.597970:0:14861:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783135058.598045:0:15220:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783135058.598057:0:15220:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000064578bf3/0xd6c4b8f05867f92a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135058.598066:0:15220:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe9c7828400 already unused, calling callback (ffffffffc1527ce0) 00010000:00010000:3.0:1783135058.598070:0:15220:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000064578bf3/0xd6c4b8f05867f92a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135058.598078:0:15220:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000064578bf3/0xd6c4b8f05867f92a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135058.598090:0:15220:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000064578bf3/0xd6c4b8f05867f92a lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135058.598097:0:15220:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000064578bf3/0xd6c4b8f05867f92a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135058.598114:0:15220:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783135058.598116:0:15220:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783135058.598118:0:15220:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1783135058.598722:0:14861:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1783135058.598728:0:14861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b1cb05b0/0xd6c4b8f05867f931 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135058.598737:0:14861:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=340s v=(0 0) 00010000:00010000:2.0:1783135058.598740:0:14861:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783135058.598744:0:14861:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b1cb05b0/0xd6c4b8f05867f931 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135058.598752:0:14861:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b1cb05b0/0xd6c4b8f05867f931 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135058.598770:0:14861:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b1cb05b0/0xd6c4b8f05867f931 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135058.598778:0:14861:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b1cb05b0/0xd6c4b8f05867f931 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135058.598791:0:14861:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1783135058.598805:0:14210:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783135058.598814:0:14210:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b1cb05b0/0xd6c4b8f05867f931 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135058.598824:0:14210:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe9c7829e00 already unused, calling callback (ffffffffc1527ce0) 00010000:00010000:0.0:1783135058.598829:0:14210:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b1cb05b0/0xd6c4b8f05867f931 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135058.598838:0:14210:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b1cb05b0/0xd6c4b8f05867f931 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135058.598852:0:14210:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b1cb05b0/0xd6c4b8f05867f931 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135058.598860:0:14210:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b1cb05b0/0xd6c4b8f05867f931 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135058.598878:0:14210:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783135058.598881:0:14210:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783135058.598885:0:14210:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1783135058.599198:0:14861:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1783135058.599204:0:14861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001733b7a5/0xd6c4b8f05867f938 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135058.599212:0:14861:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=340s v=(0 0) 00010000:00010000:2.0:1783135058.599215:0:14861:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783135058.599220:0:14861:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001733b7a5/0xd6c4b8f05867f938 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135058.599231:0:14861:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001733b7a5/0xd6c4b8f05867f938 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135058.599239:0:14861:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001733b7a5/0xd6c4b8f05867f938 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135058.599329:0:14861:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001733b7a5/0xd6c4b8f05867f938 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135058.599357:0:14861:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783135058.599426:0:14211:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783135058.599435:0:14211:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001733b7a5/0xd6c4b8f05867f938 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135058.599446:0:14211:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe9c7829c00 already unused, calling callback (ffffffffc1527ce0) 00010000:00010000:1.0:1783135058.599451:0:14211:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001733b7a5/0xd6c4b8f05867f938 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135058.599462:0:14211:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001733b7a5/0xd6c4b8f05867f938 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135058.599481:0:14211:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001733b7a5/0xd6c4b8f05867f938 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135058.599490:0:14211:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001733b7a5/0xd6c4b8f05867f938 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135058.599511:0:14211:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783135058.599519:0:14211:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783135058.599523:0:14211:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1783135058.599713:0:7470:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00100000:3.0:1783135058.599729:0:7470:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 2b138366-7a70-4ff2-909d-348210e4a0a2 00002000:00010000:2.0:1783135058.599802:0:14861:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1783135058.599809:0:14861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000044a84fc3/0xd6c4b8f05867f93f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135058.599819:0:14861:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=340s v=(0 0) 00010000:00010000:2.0:1783135058.599822:0:14861:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783135058.599826:0:14861:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000044a84fc3/0xd6c4b8f05867f93f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135058.599836:0:14861:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000044a84fc3/0xd6c4b8f05867f93f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135058.599844:0:14861:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000044a84fc3/0xd6c4b8f05867f93f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135058.599852:0:14861:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000044a84fc3/0xd6c4b8f05867f93f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135058.599870:0:14861:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783135058.599879:0:15220:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783135058.599887:0:15220:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000044a84fc3/0xd6c4b8f05867f93f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135058.599897:0:15220:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe9c7829000 already unused, calling callback (ffffffffc1527ce0) 00010000:00010000:1.0:1783135058.599901:0:15220:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000044a84fc3/0xd6c4b8f05867f93f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135058.599912:0:15220:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000044a84fc3/0xd6c4b8f05867f93f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135058.599928:0:15220:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000044a84fc3/0xd6c4b8f05867f93f lrc: 1/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135058.599937:0:15220:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000044a84fc3/0xd6c4b8f05867f93f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135058.599959:0:15220:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783135058.599962:0:15220:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783135058.599966:0:15220:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1783135058.600219:0:5791:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000001:00100000:1.0:1783135058.600309:0:5791:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 2b138366-7a70-4ff2-909d-348210e4a0a2 00002000:00010000:3.0:1783135058.600755:0:14861:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1783135058.600764:0:14861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000661940ac/0xd6c4b8f05867f946 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135058.600776:0:14861:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=340s v=(0 0) 00010000:00010000:3.0:1783135058.600779:0:14861:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783135058.600790:0:14861:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000661940ac/0xd6c4b8f05867f946 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135058.600800:0:14861:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000661940ac/0xd6c4b8f05867f946 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135058.600809:0:14861:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000661940ac/0xd6c4b8f05867f946 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135058.600818:0:14861:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000661940ac/0xd6c4b8f05867f946 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135058.600840:0:14861:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1783135058.601410:0:14861:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1783135058.601416:0:14861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000016bbd289/0xd6c4b8f05867f94d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135058.601426:0:14861:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=340s v=(0 0) 00010000:00010000:3.0:1783135058.601428:0:14861:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783135058.601432:0:14861:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000016bbd289/0xd6c4b8f05867f94d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135058.601443:0:14861:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000016bbd289/0xd6c4b8f05867f94d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135058.601457:0:14861:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000016bbd289/0xd6c4b8f05867f94d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135058.601477:0:14861:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000016bbd289/0xd6c4b8f05867f94d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135058.601502:0:14861:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1783135058.601514:0:14210:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1783135058.601523:0:14210:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000661940ac/0xd6c4b8f05867f946 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135058.601548:0:14210:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe9d2b74a00 already unused, calling callback (ffffffffc1527ce0) 00010000:00010000:0.0:1783135058.601552:0:14210:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000661940ac/0xd6c4b8f05867f946 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135058.601562:0:14210:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000661940ac/0xd6c4b8f05867f946 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135058.601580:0:14210:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000661940ac/0xd6c4b8f05867f946 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135058.601588:0:14210:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000661940ac/0xd6c4b8f05867f946 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135058.601612:0:14210:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783135058.601616:0:14210:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000016bbd289/0xd6c4b8f05867f94d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135058.601624:0:14210:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe9d2b75800 already unused, calling callback (ffffffffc1527ce0) 00010000:00010000:0.0:1783135058.601628:0:14210:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000016bbd289/0xd6c4b8f05867f94d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135058.601636:0:14210:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000016bbd289/0xd6c4b8f05867f94d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135058.601647:0:14210:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000016bbd289/0xd6c4b8f05867f94d lrc: 1/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135058.601663:0:14210:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000016bbd289/0xd6c4b8f05867f94d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135058.601684:0:14210:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783135058.601686:0:14210:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783135058.601690:0:14210:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783135058.601792:0:14211:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1783135058.602081:0:14861:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1783135058.602088:0:14861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000027056a73/0xd6c4b8f05867f954 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135058.602098:0:14861:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=340s v=(0 0) 00010000:00010000:3.0:1783135058.602101:0:14861:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783135058.602106:0:14861:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000027056a73/0xd6c4b8f05867f954 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135058.602115:0:14861:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000027056a73/0xd6c4b8f05867f954 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135058.602124:0:14861:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000027056a73/0xd6c4b8f05867f954 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135058.602132:0:14861:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000027056a73/0xd6c4b8f05867f954 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135058.602146:0:14861:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783135058.602154:0:15220:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783135058.602158:0:15220:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000027056a73/0xd6c4b8f05867f954 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135058.602171:0:15220:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe9c0030200 already unused, calling callback (ffffffffc1527ce0) 00010000:00010000:3.0:1783135058.602175:0:15220:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000027056a73/0xd6c4b8f05867f954 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135058.602194:0:15220:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000027056a73/0xd6c4b8f05867f954 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135058.602206:0:15220:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000027056a73/0xd6c4b8f05867f954 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135058.602214:0:15220:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000027056a73/0xd6c4b8f05867f954 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135058.602227:0:15220:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783135058.602229:0:15220:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783135058.602230:0:15220:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1783135058.602698:0:14861:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1783135058.602704:0:14861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000069027ef1/0xd6c4b8f05867f95b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135058.602713:0:14861:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=340s v=(0 0) 00010000:00010000:3.0:1783135058.602717:0:14861:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783135058.602721:0:14861:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000069027ef1/0xd6c4b8f05867f95b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135058.602731:0:14861:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000069027ef1/0xd6c4b8f05867f95b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135058.602745:0:14861:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000069027ef1/0xd6c4b8f05867f95b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135058.602752:0:14861:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000069027ef1/0xd6c4b8f05867f95b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135058.602799:0:14861:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1783135058.603241:0:14861:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1783135058.603246:0:14861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000095441e9c/0xd6c4b8f05867f962 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135058.603255:0:14861:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=340s v=(0 0) 00010000:00010000:3.0:1783135058.603258:0:14861:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783135058.603262:0:14861:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000095441e9c/0xd6c4b8f05867f962 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135058.603275:0:14861:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000095441e9c/0xd6c4b8f05867f962 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135058.603305:0:14861:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000095441e9c/0xd6c4b8f05867f962 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135058.603313:0:14861:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000095441e9c/0xd6c4b8f05867f962 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135058.603551:0:14210:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1783135058.603559:0:14210:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000069027ef1/0xd6c4b8f05867f95b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135058.603567:0:14210:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe9c0030800 already unused, calling callback (ffffffffc1527ce0) 00010000:00010000:2.0:1783135058.603577:0:14210:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000069027ef1/0xd6c4b8f05867f95b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135058.603587:0:14210:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000069027ef1/0xd6c4b8f05867f95b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135058.603602:0:14210:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000069027ef1/0xd6c4b8f05867f95b lrc: 1/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135058.603609:0:14210:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000069027ef1/0xd6c4b8f05867f95b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135058.603627:0:14210:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783135058.603630:0:14210:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000095441e9c/0xd6c4b8f05867f962 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135058.603636:0:14210:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe9c0030c00 already unused, calling callback (ffffffffc1527ce0) 00010000:00010000:2.0:1783135058.603640:0:14210:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000095441e9c/0xd6c4b8f05867f962 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135058.603648:0:14210:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000095441e9c/0xd6c4b8f05867f962 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135058.603659:0:14210:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000095441e9c/0xd6c4b8f05867f962 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135058.603669:0:14210:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783135058.603677:0:14210:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783135058.603679:0:14210:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783135058.603743:0:14861:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1783135058.603748:0:14861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000095441e9c/0xd6c4b8f05867f962 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1783135058.604353:0:14861:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1783135058.604361:0:14861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000e0141ce/0xd6c4b8f05867f969 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135058.604372:0:14861:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=340s v=(0 0) 00010000:00010000:3.0:1783135058.604376:0:14861:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783135058.604381:0:14861:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000e0141ce/0xd6c4b8f05867f969 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135058.604392:0:14861:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000e0141ce/0xd6c4b8f05867f969 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135058.604402:0:14861:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000e0141ce/0xd6c4b8f05867f969 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135058.604410:0:14861:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000e0141ce/0xd6c4b8f05867f969 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135058.604515:0:14211:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783135058.604522:0:14211:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000e0141ce/0xd6c4b8f05867f969 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135058.604531:0:14211:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe9c0031000 already unused, calling callback (ffffffffc1527ce0) 00010000:00010000:2.0:1783135058.604535:0:14211:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000e0141ce/0xd6c4b8f05867f969 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135058.604544:0:14211:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000e0141ce/0xd6c4b8f05867f969 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135058.604559:0:14211:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000e0141ce/0xd6c4b8f05867f969 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135058.604748:0:14211:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783135058.604752:0:14211:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783135058.604755:0:14211:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783135058.604795:0:14861:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1783135058.604801:0:14861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000e0141ce/0xd6c4b8f05867f969 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135058.605135:0:15220:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1783135058.605584:0:14861:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1783135058.605591:0:14861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e4a9a24a/0xd6c4b8f05867f970 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135058.605601:0:14861:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=341s v=(0 0) 00010000:00010000:3.0:1783135058.605605:0:14861:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783135058.605610:0:14861:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e4a9a24a/0xd6c4b8f05867f970 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135058.605622:0:14861:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e4a9a24a/0xd6c4b8f05867f970 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135058.605631:0:14861:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e4a9a24a/0xd6c4b8f05867f970 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135058.605639:0:14861:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e4a9a24a/0xd6c4b8f05867f970 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135058.605656:0:14861:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1783135058.606218:0:14861:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1783135058.606224:0:14861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003d1ec7ff/0xd6c4b8f05867f977 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135058.606232:0:14861:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=341s v=(0 0) 00010000:00010000:3.0:1783135058.606235:0:14861:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783135058.606244:0:14861:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003d1ec7ff/0xd6c4b8f05867f977 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135058.606253:0:14861:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003d1ec7ff/0xd6c4b8f05867f977 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135058.606263:0:14861:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003d1ec7ff/0xd6c4b8f05867f977 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135058.606270:0:14861:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003d1ec7ff/0xd6c4b8f05867f977 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135058.606303:0:14861:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:3.0:1783135058.606771:0:14861:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1783135058.606777:0:14861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bbd0d110/0xd6c4b8f05867f97e lrc: 3/0,1 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135058.606786:0:14861:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=341s v=(0 0) 00010000:00010000:3.0:1783135058.606789:0:14861:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783135058.606793:0:14861:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bbd0d110/0xd6c4b8f05867f97e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135058.606802:0:14861:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bbd0d110/0xd6c4b8f05867f97e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135058.606811:0:14861:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bbd0d110/0xd6c4b8f05867f97e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135058.606830:0:14861:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000bbd0d110/0xd6c4b8f05867f97e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135058.606859:0:14861:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:0.0:1783135058.607223:0:15220:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1783135058.607233:0:15220:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e4a9a24a/0xd6c4b8f05867f970 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135058.607244:0:15220:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe9c0030600 already unused, calling callback (ffffffffc1527ce0) 00010000:00010000:0.0:1783135058.607250:0:15220:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e4a9a24a/0xd6c4b8f05867f970 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135058.607261:0:15220:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e4a9a24a/0xd6c4b8f05867f970 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135058.607330:0:15220:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e4a9a24a/0xd6c4b8f05867f970 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135058.607341:0:15220:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e4a9a24a/0xd6c4b8f05867f970 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135058.607365:0:15220:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1783135058.607370:0:15220:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003d1ec7ff/0xd6c4b8f05867f977 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135058.607387:0:15220:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe9c0030a00 already unused, calling callback (ffffffffc1527ce0) 00010000:00010000:0.0:1783135058.607392:0:15220:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003d1ec7ff/0xd6c4b8f05867f977 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135058.607400:0:15220:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003d1ec7ff/0xd6c4b8f05867f977 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135058.607413:0:15220:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003d1ec7ff/0xd6c4b8f05867f977 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135058.607421:0:15220:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003d1ec7ff/0xd6c4b8f05867f977 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135058.607438:0:15220:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783135058.607441:0:15220:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000bbd0d110/0xd6c4b8f05867f97e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135058.607448:0:15220:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe9c0031400 already unused, calling callback (ffffffffc1527ce0) 00010000:00010000:0.0:1783135058.607452:0:15220:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000bbd0d110/0xd6c4b8f05867f97e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135058.607460:0:15220:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000bbd0d110/0xd6c4b8f05867f97e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135058.607471:0:15220:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000bbd0d110/0xd6c4b8f05867f97e lrc: 1/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135058.607488:0:15220:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bbd0d110/0xd6c4b8f05867f97e lrc: 0/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135058.607508:0:15220:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783135058.607510:0:15220:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783135058.607513:0:15220:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783135058.607529:0:14210:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783135058.607538:0:14211:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1783135058.607909:0:14861:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1783135058.607916:0:14861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007a6c42c4/0xd6c4b8f05867f985 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135058.607926:0:14861:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=341s v=(0 0) 00010000:00010000:3.0:1783135058.607930:0:14861:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783135058.607934:0:14861:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007a6c42c4/0xd6c4b8f05867f985 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135058.607943:0:14861:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007a6c42c4/0xd6c4b8f05867f985 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135058.607952:0:14861:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007a6c42c4/0xd6c4b8f05867f985 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135058.607959:0:14861:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007a6c42c4/0xd6c4b8f05867f985 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135058.609216:0:14861:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1783135058.609472:0:15220:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783135058.609483:0:15220:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007a6c42c4/0xd6c4b8f05867f985 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135058.609495:0:15220:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe9c0030400 already unused, calling callback (ffffffffc1527ce0) 00010000:00010000:0.0:1783135058.609499:0:15220:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007a6c42c4/0xd6c4b8f05867f985 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135058.609510:0:15220:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007a6c42c4/0xd6c4b8f05867f985 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135058.609529:0:15220:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007a6c42c4/0xd6c4b8f05867f985 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135058.609538:0:15220:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007a6c42c4/0xd6c4b8f05867f985 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135058.609561:0:15220:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783135058.609563:0:15220:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783135058.609565:0:15220:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1783135058.609759:0:14861:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1783135058.609767:0:14861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001f613943/0xd6c4b8f05867f98c lrc: 3/0,1 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135058.609786:0:14861:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=341s v=(0 0) 00010000:00010000:3.0:1783135058.609789:0:14861:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783135058.609795:0:14861:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001f613943/0xd6c4b8f05867f98c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135058.609807:0:14861:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001f613943/0xd6c4b8f05867f98c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135058.609817:0:14861:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001f613943/0xd6c4b8f05867f98c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135058.609825:0:14861:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001f613943/0xd6c4b8f05867f98c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135058.609853:0:14861:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1783135058.610153:0:14210:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783135058.610159:0:14210:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001f613943/0xd6c4b8f05867f98c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135058.610169:0:14210:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe9c0030000 already unused, calling callback (ffffffffc1527ce0) 00010000:00010000:0.0:1783135058.610172:0:14210:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001f613943/0xd6c4b8f05867f98c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135058.610193:0:14210:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001f613943/0xd6c4b8f05867f98c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135058.610270:0:14210:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001f613943/0xd6c4b8f05867f98c lrc: 1/0,0 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135058.610311:0:14210:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001f613943/0xd6c4b8f05867f98c lrc: 0/0,0 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135058.610331:0:14210:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783135058.610333:0:14210:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783135058.610335:0:14210:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1783135058.610545:0:14861:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1783135058.610551:0:14861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000039f945ae/0xd6c4b8f05867f993 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135058.610560:0:14861:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=341s v=(0 0) 00010000:00010000:3.0:1783135058.610563:0:14861:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783135058.610568:0:14861:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000039f945ae/0xd6c4b8f05867f993 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135058.610576:0:14861:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000039f945ae/0xd6c4b8f05867f993 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135058.610594:0:14861:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000039f945ae/0xd6c4b8f05867f993 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135058.610601:0:14861:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000039f945ae/0xd6c4b8f05867f993 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135058.611858:0:14211:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783135058.611870:0:14211:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000039f945ae/0xd6c4b8f05867f993 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135058.611885:0:14211:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe9c0031600 already unused, calling callback (ffffffffc1527ce0) 00010000:00010000:0.0:1783135058.611890:0:14211:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000039f945ae/0xd6c4b8f05867f993 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135058.611918:0:14211:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000039f945ae/0xd6c4b8f05867f993 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135058.611937:0:14211:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000039f945ae/0xd6c4b8f05867f993 lrc: 2/0,0 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135058.611945:0:14211:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783135058.611947:0:14211:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783135058.611949:0:14211:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783135058.613438:0:14861:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1783135058.613453:0:14861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000039f945ae/0xd6c4b8f05867f993 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1783135058.614408:0:14861:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1783135058.614419:0:14861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000095441e9c/0xd6c4b8f05867f99a lrc: 3/0,1 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135058.614565:0:14861:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=341s v=(0 0) 00010000:00010000:3.0:1783135058.614572:0:14861:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783135058.614581:0:14861:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000095441e9c/0xd6c4b8f05867f99a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135058.614600:0:14861:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000095441e9c/0xd6c4b8f05867f99a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135058.614613:0:14861:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000095441e9c/0xd6c4b8f05867f99a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135058.614634:0:14861:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000095441e9c/0xd6c4b8f05867f99a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135058.614706:0:14861:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1783135058.615272:0:14861:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1783135058.615298:0:14861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000027056a73/0xd6c4b8f05867f9a1 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135058.615308:0:14861:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=341s v=(0 0) 00010000:00010000:3.0:1783135058.615312:0:14861:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783135058.615316:0:14861:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000027056a73/0xd6c4b8f05867f9a1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135058.615325:0:14861:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000027056a73/0xd6c4b8f05867f9a1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135058.615334:0:14861:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000027056a73/0xd6c4b8f05867f9a1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135058.615342:0:14861:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000027056a73/0xd6c4b8f05867f9a1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135058.615402:0:15220:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1783135058.615412:0:15220:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000095441e9c/0xd6c4b8f05867f99a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135058.615421:0:15220:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe9c0030c00 already unused, calling callback (ffffffffc1527ce0) 00010000:00010000:2.0:1783135058.615426:0:15220:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000095441e9c/0xd6c4b8f05867f99a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135058.615444:0:15220:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000095441e9c/0xd6c4b8f05867f99a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135058.615465:0:15220:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000095441e9c/0xd6c4b8f05867f99a lrc: 1/0,0 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135058.615474:0:15220:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000095441e9c/0xd6c4b8f05867f99a lrc: 0/0,0 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135058.615510:0:15220:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783135058.615515:0:15220:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000027056a73/0xd6c4b8f05867f9a1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135058.615521:0:15220:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe9c0030200 already unused, calling callback (ffffffffc1527ce0) 00010000:00010000:2.0:1783135058.615525:0:15220:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000027056a73/0xd6c4b8f05867f9a1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135058.615533:0:15220:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000027056a73/0xd6c4b8f05867f9a1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135058.615544:0:15220:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000027056a73/0xd6c4b8f05867f9a1 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135058.615553:0:15220:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783135058.615555:0:15220:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783135058.615562:0:15220:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783135058.615709:0:14861:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1783135058.615714:0:14861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000027056a73/0xd6c4b8f05867f9a1 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1783135058.616326:0:14861:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1783135058.616334:0:14861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000e0141ce/0xd6c4b8f05867f9a8 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135058.616351:0:14861:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=341s v=(0 0) 00010000:00010000:3.0:1783135058.616355:0:14861:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783135058.616361:0:14861:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000e0141ce/0xd6c4b8f05867f9a8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135058.616372:0:14861:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000e0141ce/0xd6c4b8f05867f9a8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135058.616382:0:14861:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000e0141ce/0xd6c4b8f05867f9a8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135058.616390:0:14861:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000e0141ce/0xd6c4b8f05867f9a8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135058.616442:0:14210:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783135058.616448:0:14210:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000e0141ce/0xd6c4b8f05867f9a8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135058.616462:0:14210:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe9c0031000 already unused, calling callback (ffffffffc1527ce0) 00010000:00010000:2.0:1783135058.616466:0:14210:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000e0141ce/0xd6c4b8f05867f9a8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135058.616475:0:14210:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000e0141ce/0xd6c4b8f05867f9a8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135058.616503:0:14210:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000e0141ce/0xd6c4b8f05867f9a8 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135058.616512:0:14210:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783135058.616514:0:14210:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783135058.616516:0:14210:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783135058.616676:0:14861:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1783135058.616681:0:14861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000e0141ce/0xd6c4b8f05867f9a8 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1783135058.617223:0:14861:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1783135058.617229:0:14861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000069027ef1/0xd6c4b8f05867f9af lrc: 3/0,1 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135058.617250:0:14861:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=341s v=(0 0) 00010000:00010000:3.0:1783135058.617253:0:14861:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783135058.617258:0:14861:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000069027ef1/0xd6c4b8f05867f9af lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135058.617269:0:14861:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000069027ef1/0xd6c4b8f05867f9af lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135058.617299:0:14861:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000069027ef1/0xd6c4b8f05867f9af lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135058.617309:0:14861:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000069027ef1/0xd6c4b8f05867f9af lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135058.617361:0:14211:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783135058.617368:0:14211:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000069027ef1/0xd6c4b8f05867f9af lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135058.617376:0:14211:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe9c0030800 already unused, calling callback (ffffffffc1527ce0) 00010000:00010000:2.0:1783135058.617380:0:14211:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000069027ef1/0xd6c4b8f05867f9af lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135058.617388:0:14211:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000069027ef1/0xd6c4b8f05867f9af lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135058.617413:0:14211:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000069027ef1/0xd6c4b8f05867f9af lrc: 2/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135058.617422:0:14211:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783135058.617425:0:14211:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783135058.617428:0:14211:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783135058.617464:0:14861:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1783135058.617469:0:14861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000069027ef1/0xd6c4b8f05867f9af lrc: 0/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135058.617801:0:15220:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:3.0:1783135058.618076:0:14861:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x280000400:6 00000100:00100000:3.0:1783135058.618217:0:14861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fea14700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:14248:x1869752384440832:12345-0@lo:5:osp-pre-1-0.0 Request processed in 47710us (48414us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135058.618229:0:14861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1783135058.618337:0:14248:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9fea17100 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14248:1869752384440832:0@lo:5:osp-pre-1-0.0 00000004:00080000:3.0:1783135058.618359:0:14248:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x280000400:0x21:0x0] from OST, last_created [0x280000400:0x21:0x0]last_used is [0x280000400:0x6:0x0] 00000100:00100000:3.0:1783135058.618426:0:14248:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9fea17100 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14248:1869752384441088:0@lo:5:osp-pre-1-0.0 00000100:00100000:3.0:1783135058.618467:0:14248:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135058.618663:0:14248:0:(client.c:2701:ptlrpc_set_wait()) set ffff9fea01d52840 going to sleep for 11 seconds 00000100:00100000:3.0:1783135058.618685:0:15538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384441088 00000100:00100000:3.0:1783135058.618692:0:15538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384441088 00000100:00100000:3.0:1783135058.618778:0:15538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1783135058.618792:0:15538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fea17b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:14248:x1869752384441088:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:3.0:1783135058.618842:0:15538:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 34 00000100:00100000:3.0:1783135058.637270:0:15538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fea17b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+8:14248:x1869752384441088:12345-0@lo:5:osp-pre-1-0.0 Request processed in 18466us (18786us total) trans 8589934594 rc 0/0 00000100:00100000:3.0:1783135058.637326:0:15538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1783135058.637372:0:14248:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9fea17100 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14248:1869752384441088:0@lo:5:osp-pre-1-0.0 00000004:00080000:0.0:1783135058.637395:0:14248:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x21:0x0]-[0x280000400:0x41:0x0] 00000100:00100000:3.0:1783135058.656955:0:14860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fea14000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3286:x1869752384440960:12345-0@lo:2:osp-syn-1-0.0 Request processed in 85560us (86557us total) trans 8589934593 rc 0/0 00000100:00100000:3.0:1783135058.656975:0:14860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000004:00080000:1.0:1783135058.656992:0:3286:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9fe9fe82a300/2, rc 0, transno 8589934593 00000100:00100000:1.0:1783135058.657002:0:3286:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9fe82a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1869752384440960:0@lo:2:osp-syn-1-0.0 00000001:00080000:2.0:1783135058.657070:0:7470:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934593 is committed 00010000:00010000:2.0:1783135059.395510:0:14210:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783135059.816969:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:2.0:1783135059.817116:0:14223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373976320 00000100:00100000:2.0:1783135059.817129:0:14223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373976320 00000100:00100000:2.0:1783135059.817225:0:14223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 9 00000100:00100000:2.0:1783135059.817237:0:14223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fea16a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2b138366-7a70-4ff2-909d-348210e4a0a2+6:13796:x1869752373976320:12345-192.168.201.41@tcp:41:lfs.0 00000004:00000024:2.0:1783135059.817345:0:14223:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1783135059.817469:0:14223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fea16a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2b138366-7a70-4ff2-909d-348210e4a0a2+6:13796:x1869752373976320:12345-192.168.201.41@tcp:41:lfs.0 Request processed in 234us (518us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135059.817477:0:14223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 9 00000100:00100000:3.0:1783135059.823547:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:0.0:1783135059.826434:0:14863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373976448 00000100:00100000:0.0:1783135059.826453:0:14863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373976448 00000100:00100000:0.0:1783135059.826652:0:14863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 3 00000100:00100000:0.0:1783135059.826666:0:14863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fea16d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:2b138366-7a70-4ff2-909d-348210e4a0a2+6:13796:x1869752373976448:12345-192.168.201.41@tcp:13:lfs.0 00002000:00000024:0.0:1783135059.826722:0:14863:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1783135059.826843:0:14863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fea16d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:2b138366-7a70-4ff2-909d-348210e4a0a2+6:13796:x1869752373976448:12345-192.168.201.41@tcp:13:lfs.0 Request processed in 179us (3313us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135059.826851:0:14863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 3 00000100:00080000:3.0:1783135059.830306:0:14218:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1783135059.830904:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:3.0:1783135059.830999:0:14863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373976576 00000100:00100000:3.0:1783135059.831011:0:14863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373976576 00000100:00100000:3.0:1783135059.831102:0:14863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 4 00000100:00100000:3.0:1783135059.831114:0:14863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fe828e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:2b138366-7a70-4ff2-909d-348210e4a0a2+5:13796:x1869752373976576:12345-192.168.201.41@tcp:13:lfs.0 00002000:00000024:3.0:1783135059.831149:0:14863:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1783135059.831264:0:14863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fe828e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:2b138366-7a70-4ff2-909d-348210e4a0a2+5:13796:x1869752373976576:12345-192.168.201.41@tcp:13:lfs.0 Request processed in 151us (367us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135059.831272:0:14863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 4 00000100:00080000:1.0:1783135059.831871:0:14218:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1783135059.973713:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:0.0:1783135059.973837:0:14217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373976704 00000100:00100000:0.0:1783135059.973850:0:14217:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373976704 00000100:00100000:0.0:1783135059.974064:0:14217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 86 00000100:00100000:0.0:1783135059.974078:0:14217:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fe8dac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58985142-d56f-4f22-9f82-f587934b3bed+10:13831:x1869752373976704:12345-192.168.201.41@tcp:101:mount.lustre.0 00010000:00010000:0.0:1783135059.974102:0:14217:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783135059.974141:0:14217:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fe9f68acc00/0xd6c4b8f05867f9b6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x4428da03f5eb75d0 expref: -99 pid: 14217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135059.974197:0:14217:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fe9f68acc00/0xd6c4b8f05867f9b6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb75d0 expref: 11 pid: 14217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135059.974210:0:14217:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fe9f68acc00/0xd6c4b8f05867f9b6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb75d0 expref: 11 pid: 14217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135059.974221:0:14217:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fe9f68acc00, rc 0) 00000100:00100000:0.0:1783135059.974361:0:14217:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fe8dac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58985142-d56f-4f22-9f82-f587934b3bed+11:13831:x1869752373976704:12345-192.168.201.41@tcp:101:mount.lustre.0 Request processed in 285us (663us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135059.974373:0:14217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 86 00000100:00100000:3.0:1783135059.983802:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:1.0:1783135059.983952:0:14216:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373976832 00000100:00100000:1.0:1783135059.983971:0:14216:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373976832 00000100:00100000:1.0:1783135059.984041:0:14216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 87 00000100:00100000:1.0:1783135059.984054:0:14216:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fe8db450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58985142-d56f-4f22-9f82-f587934b3bed+11:13831:x1869752373976832:12345-192.168.201.41@tcp:501:mount.lustre.0 00000100:00100000:1.0:1783135059.984482:0:14216:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fe8db450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58985142-d56f-4f22-9f82-f587934b3bed+11:13831:x1869752373976832:12345-192.168.201.41@tcp:501:mount.lustre.0 Request processed in 430us (694us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135059.984492:0:14216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 87 00000100:00100000:3.0:1783135059.992037:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:0.0:1783135059.992121:0:14217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373976960 00000100:00100000:0.0:1783135059.992134:0:14217:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373976960 00000100:00100000:0.0:1783135059.994141:0:14217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 88 00000100:00100000:0.0:1783135059.994176:0:14217:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fe8d8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58985142-d56f-4f22-9f82-f587934b3bed+11:13831:x1869752373976960:12345-192.168.201.41@tcp:503:mount.lustre.0 00000100:00100000:0.0:1783135059.996760:0:14217:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fe8d8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58985142-d56f-4f22-9f82-f587934b3bed+11:13831:x1869752373976960:12345-192.168.201.41@tcp:503:mount.lustre.0 Request processed in 2594us (4728us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135059.996776:0:14217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 88 00000100:00100000:3.0:1783135059.998987:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:2.0:1783135059.999954:0:14215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373977088 00000100:00100000:2.0:1783135059.999968:0:14215:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373977088 00000100:00100000:2.0:1783135060.000045:0:14215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 89 00000100:00100000:2.0:1783135060.000058:0:14215:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fe8d8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:58985142-d56f-4f22-9f82-f587934b3bed+11:13835:x1869752373977088:12345-192.168.201.41@tcp:502:llog_process_th.0 00000100:00100000:2.0:1783135060.000807:0:14215:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fe8d8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:58985142-d56f-4f22-9f82-f587934b3bed+11:13835:x1869752373977088:12345-192.168.201.41@tcp:502:llog_process_th.0 Request processed in 751us (1827us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135060.000815:0:14215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 89 00000100:00100000:3.0:1783135060.018005:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:0.0:1783135060.018233:0:14217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373977216 00000100:00100000:0.0:1783135060.018247:0:14217:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373977216 00000100:00100000:0.0:1783135060.018361:0:14217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 90 00000100:00100000:0.0:1783135060.018374:0:14217:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fe8db850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58985142-d56f-4f22-9f82-f587934b3bed+11:13835:x1869752373977216:12345-192.168.201.41@tcp:502:llog_process_th.0 00000100:00100000:0.0:1783135060.018875:0:14217:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fe8db850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58985142-d56f-4f22-9f82-f587934b3bed+11:13835:x1869752373977216:12345-192.168.201.41@tcp:502:llog_process_th.0 Request processed in 501us (882us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135060.018885:0:14217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 90 00000100:00100000:3.0:1783135060.026260:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:1.0:1783135060.026625:0:14216:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373977344 00000100:00100000:1.0:1783135060.026639:0:14216:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373977344 00000100:00100000:1.0:1783135060.026716:0:14216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 91 00000100:00100000:1.0:1783135060.026729:0:14216:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fe8d8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58985142-d56f-4f22-9f82-f587934b3bed+11:13831:x1869752373977344:12345-192.168.201.41@tcp:101:mount.lustre.0 00010000:00010000:1.0:1783135060.026752:0:14216:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783135060.026777:0:14216:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fe8c5550000/0xd6c4b8f05867f9bd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x4428da03f5eb75fa expref: -99 pid: 14216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135060.026813:0:14216:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fe8c5550000/0xd6c4b8f05867f9bd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb75fa expref: 12 pid: 14216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135060.026826:0:14216:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fe8c5550000/0xd6c4b8f05867f9bd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb75fa expref: 12 pid: 14216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135060.026836:0:14216:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fe8c5550000, rc 0) 00000100:00100000:1.0:1783135060.026914:0:14216:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fe8d8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58985142-d56f-4f22-9f82-f587934b3bed+12:13831:x1869752373977344:12345-192.168.201.41@tcp:101:mount.lustre.0 Request processed in 187us (667us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135060.026922:0:14216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 91 00000100:00100000:3.0:1783135060.033085:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:0.0:1783135060.033217:0:14217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373977472 00000100:00100000:0.0:1783135060.033231:0:14217:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373977472 00000100:00100000:0.0:1783135060.033349:0:14217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 92 00000100:00100000:0.0:1783135060.033362:0:14217:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fe8db050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58985142-d56f-4f22-9f82-f587934b3bed+12:13831:x1869752373977472:12345-192.168.201.41@tcp:256:mount.lustre.0 20000000:01000000:0.0:1783135060.033395:0:14217:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:0.0:1783135060.033427:0:14217:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1783135060.033432:0:14217:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1783135060.033435:0:14217:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1783135060.033438:0:14217:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 8 00000100:00100000:0.0:1783135060.035554:0:14217:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fe8db050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58985142-d56f-4f22-9f82-f587934b3bed+12:13831:x1869752373977472:12345-192.168.201.41@tcp:256:mount.lustre.0 Request processed in 2181us (2472us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135060.035571:0:14217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 92 00000100:00100000:3.0:1783135060.038084:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:2.0:1783135060.038494:0:14215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373977600 00000100:00100000:2.0:1783135060.038507:0:14215:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373977600 00000100:00100000:2.0:1783135060.038588:0:14215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 93 00000100:00100000:2.0:1783135060.038601:0:14215:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fe8d9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:58985142-d56f-4f22-9f82-f587934b3bed+12:13831:x1869752373977600:12345-192.168.201.41@tcp:101:mount.lustre.0 00010000:00010000:2.0:1783135060.038624:0:14215:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783135060.038647:0:14215:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fe9c7829400/0xd6c4b8f05867f9c4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x4428da03f5eb7601 expref: -99 pid: 14215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135060.038685:0:14215:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fe9c7829400/0xd6c4b8f05867f9c4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb7601 expref: 13 pid: 14215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135060.038698:0:14215:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fe9c7829400/0xd6c4b8f05867f9c4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb7601 expref: 13 pid: 14215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135060.038708:0:14215:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fe9c7829400, rc 0) 00000100:00100000:2.0:1783135060.038781:0:14215:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fe8d9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:58985142-d56f-4f22-9f82-f587934b3bed+13:13831:x1869752373977600:12345-192.168.201.41@tcp:101:mount.lustre.0 Request processed in 182us (710us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135060.038789:0:14215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 93 00000100:00100000:3.0:1783135060.040374:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:0.0:1783135060.040467:0:14217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373977728 00000100:00100000:0.0:1783135060.040477:0:14217:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373977728 00000100:00100000:0.0:1783135060.040526:0:14217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 94 00000100:00100000:0.0:1783135060.040534:0:14217:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fe8da850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58985142-d56f-4f22-9f82-f587934b3bed+13:13831:x1869752373977728:12345-192.168.201.41@tcp:501:mount.lustre.0 00000100:00100000:0.0:1783135060.040873:0:14217:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fe8da850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58985142-d56f-4f22-9f82-f587934b3bed+13:13831:x1869752373977728:12345-192.168.201.41@tcp:501:mount.lustre.0 Request processed in 338us (505us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135060.040879:0:14217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 94 00000100:00100000:3.0:1783135060.042391:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:1.0:1783135060.042513:0:14216:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373977856 00000100:00100000:1.0:1783135060.042526:0:14216:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373977856 00000100:00100000:1.0:1783135060.042592:0:14216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 95 00000100:00100000:1.0:1783135060.042603:0:14216:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fe8d8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58985142-d56f-4f22-9f82-f587934b3bed+13:13831:x1869752373977856:12345-192.168.201.41@tcp:503:mount.lustre.0 00000100:00100000:1.0:1783135060.042975:0:14216:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fe8d8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58985142-d56f-4f22-9f82-f587934b3bed+13:13831:x1869752373977856:12345-192.168.201.41@tcp:503:mount.lustre.0 Request processed in 373us (592us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135060.042982:0:14216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 95 00000100:00100000:3.0:1783135060.045366:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:2.0:1783135060.045431:0:14215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373977984 00000100:00100000:2.0:1783135060.045443:0:14215:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373977984 00000100:00100000:2.0:1783135060.045511:0:14215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 96 00000100:00100000:2.0:1783135060.045521:0:14215:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fe8da050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:58985142-d56f-4f22-9f82-f587934b3bed+13:13839:x1869752373977984:12345-192.168.201.41@tcp:502:llog_process_th.0 00000100:00100000:2.0:1783135060.045882:0:14215:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fe8da050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:58985142-d56f-4f22-9f82-f587934b3bed+13:13839:x1869752373977984:12345-192.168.201.41@tcp:502:llog_process_th.0 Request processed in 360us (529us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135060.045892:0:14215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 96 00000100:00100000:3.0:1783135060.047919:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:1.0:1783135060.047992:0:14216:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373978112 00000100:00100000:1.0:1783135060.048002:0:14216:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373978112 00000100:00100000:1.0:1783135060.048072:0:14216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 97 00000100:00100000:1.0:1783135060.048083:0:14216:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fe8da450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58985142-d56f-4f22-9f82-f587934b3bed+13:13839:x1869752373978112:12345-192.168.201.41@tcp:502:llog_process_th.0 00000100:00100000:1.0:1783135060.048726:0:14216:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fe8da450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58985142-d56f-4f22-9f82-f587934b3bed+13:13839:x1869752373978112:12345-192.168.201.41@tcp:502:llog_process_th.0 Request processed in 642us (817us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135060.048736:0:14216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 97 00000100:00100000:3.0:1783135060.051647:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:1.0:1783135060.052007:0:14222:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373978240 00000100:00100000:1.0:1783135060.052021:0:14222:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373978240 00000100:00100000:1.0:1783135060.052276:0:14222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 10 00000100:00100000:1.0:1783135060.052317:0:14222:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fea14380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2366:x1869752373978240:12345-192.168.201.41@tcp:38:mount.lustre.0 00010000:00080000:1.0:1783135060.052355:0:14222:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from aa2f4fd1-78f9-41b4-ba50-d28d753ff635@192.168.201.41@tcp t0 exp 0000000000000000 cur 342 last 0 00000020:00000080:1.0:1783135060.052404:0:14222:0:(genops.c:1406:class_connect()) connect: client aa2f4fd1-78f9-41b4-ba50-d28d753ff635, cookie 0xd6c4b8f05867f9cb 00000004:00100000:1.0:1783135060.052696:0:14222:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:1.0:1783135060.053051:0:14222:0:(import.c:65:import_set_state_nolock()) ffff9fe9c8f88800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1783135060.053163:0:14222:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fea14380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa2f4fd1-78f9-41b4-ba50-d28d753ff635+6:2366:x1869752373978240:12345-192.168.201.41@tcp:38:mount.lustre.0 Request processed in 835us (1519us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135060.053173:0:14222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 10 00000100:00100000:3.0:1783135060.059474:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:1.0:1783135060.059574:0:14224:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373978368 00000100:00100000:1.0:1783135060.059587:0:14224:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373978368 00000100:00100000:3.0:1783135060.059603:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:1.0:1783135060.059741:0:14224:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373978496 00000100:00100000:1.0:1783135060.059746:0:14224:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373978496 00000100:00100000:1.0:1783135060.059790:0:14224:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 11 00000100:00100000:1.0:1783135060.059800:0:14224:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fea17800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aa2f4fd1-78f9-41b4-ba50-d28d753ff635+7:0:x1869752373978368:12345-192.168.201.41@tcp:41:mount.lustre.0 00000004:00000024:1.0:1783135060.059842:0:14224:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1783135060.059945:0:14224:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fea17800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aa2f4fd1-78f9-41b4-ba50-d28d753ff635+7:0:x1869752373978368:12345-192.168.201.41@tcp:41:mount.lustre.0 Request processed in 144us (484us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135060.059952:0:14224:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 11 00000100:00100000:1.0:1783135060.059975:0:14224:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 12 00000100:00100000:1.0:1783135060.059981:0:14224:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fea15500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aa2f4fd1-78f9-41b4-ba50-d28d753ff635+6:13831:x1869752373978496:12345-192.168.201.41@tcp:41:mount.lustre.0 00000004:00000024:1.0:1783135060.059994:0:14224:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1783135060.060016:0:14224:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fea15500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aa2f4fd1-78f9-41b4-ba50-d28d753ff635+6:13831:x1869752373978496:12345-192.168.201.41@tcp:41:mount.lustre.0 Request processed in 35us (412us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135060.060022:0:14224:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 12 00000100:00080000:0.0:1783135060.063836:0:14218:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1783135060.064944:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:1.0:1783135060.065092:0:14222:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373978624 00000100:00100000:1.0:1783135060.065105:0:14222:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373978624 00000100:00100000:1.0:1783135060.065398:0:14222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 13 00000100:00100000:1.0:1783135060.065411:0:14222:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fe90fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa2f4fd1-78f9-41b4-ba50-d28d753ff635+6:13831:x1869752373978624:12345-192.168.201.41@tcp:40:mount.lustre.0 00000100:00100000:1.0:1783135060.065533:0:14222:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fe90fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa2f4fd1-78f9-41b4-ba50-d28d753ff635+6:13831:x1869752373978624:12345-192.168.201.41@tcp:40:mount.lustre.0 Request processed in 124us (600us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135060.065541:0:14222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 13 00000100:00100000:3.0:1783135060.068686:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:2.0:1783135060.068762:0:14858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373978752 00000100:00100000:2.0:1783135060.068775:0:14858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373978752 00000100:00100000:2.0:1783135060.068915:0:14858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 11 00000100:00100000:2.0:1783135060.068925:0:14858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fe90c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2366:x1869752373978752:12345-192.168.201.41@tcp:8:mount.lustre.0 00010000:00080000:2.0:1783135060.068966:0:14858:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0000: connection from aa2f4fd1-78f9-41b4-ba50-d28d753ff635@192.168.201.41@tcp t0 exp 0000000000000000 cur 342 last 0 00000020:00000080:2.0:1783135060.069013:0:14858:0:(genops.c:1406:class_connect()) connect: client aa2f4fd1-78f9-41b4-ba50-d28d753ff635, cookie 0xd6c4b8f05867f9d2 00002000:00100000:2.0:1783135060.069028:0:14858:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli aa2f4fd1-78f9-41b4-ba50-d28d753ff635/ffff9fe8c5f18800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113653 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1783135060.069056:0:14858:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1783135060.069443:0:14858:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1783135060.069487:0:14858:0:(import.c:65:import_set_state_nolock()) ffff9fe8c5f1b000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1783135060.069639:0:14858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fe90c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:aa2f4fd1-78f9-41b4-ba50-d28d753ff635+6:2366:x1869752373978752:12345-192.168.201.41@tcp:8:mount.lustre.0 Request processed in 713us (965us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135060.069648:0:14858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 11 00000100:00100000:3.0:1783135060.070422:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:3.0:1783135060.070472:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:0.0:1783135060.070480:0:15538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373978880 00000100:00100000:0.0:1783135060.070490:0:15538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373978880 00000100:00100000:0.0:1783135060.070528:0:15538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 12 00000100:00100000:0.0:1783135060.070536:0:15538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fe90df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2366:x1869752373978880:12345-192.168.201.41@tcp:8:mount.lustre.0 00010000:00080000:0.0:1783135060.070566:0:15538:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0001: connection from aa2f4fd1-78f9-41b4-ba50-d28d753ff635@192.168.201.41@tcp t0 exp 0000000000000000 cur 342 last 0 00000100:00100000:2.0:1783135060.070569:0:14226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373979008 00000100:00100000:2.0:1783135060.070575:0:14226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373979008 00000020:00000080:0.0:1783135060.070603:0:15538:0:(genops.c:1406:class_connect()) connect: client aa2f4fd1-78f9-41b4-ba50-d28d753ff635, cookie 0xd6c4b8f05867f9d9 00002000:00100000:0.0:1783135060.070613:0:15538:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli aa2f4fd1-78f9-41b4-ba50-d28d753ff635/ffff9fe9f6a11000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113653 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00000100:00100000:2.0:1783135060.070624:0:14226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 1 00000100:00100000:2.0:1783135060.070637:0:14226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fe90ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:aa2f4fd1-78f9-41b4-ba50-d28d753ff635+6:13831:x1869752373979008:12345-192.168.201.41@tcp:33:mount.lustre.0 00002000:00100000:0.0:1783135060.070640:0:15538:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00000100:00100000:3.0:1783135060.070643:0:14225:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 2 min 2 max 80 00000100:00100000:3.0:1783135060.070692:0:14225:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_002' 00002000:00080000:0.0:1783135060.070804:0:15538:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1783135060.070833:0:15538:0:(import.c:65:import_set_state_nolock()) ffff9fe9f6723000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1783135060.070878:0:15538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fe90df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:aa2f4fd1-78f9-41b4-ba50-d28d753ff635+6:2366:x1869752373978880:12345-192.168.201.41@tcp:8:mount.lustre.0 Request processed in 341us (457us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135060.070886:0:15538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 12 00000004:00200000:2.0:1783135060.070999:0:14226:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000100:00100000:2.0:1783135060.071312:0:14226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fe90ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:aa2f4fd1-78f9-41b4-ba50-d28d753ff635+6:13831:x1869752373979008:12345-192.168.201.41@tcp:33:mount.lustre.0 Request processed in 677us (839us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135060.071322:0:14226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 1 00000100:00100000:2.0:1783135060.099749:0:3287:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9fe90c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1869752384441216:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1783135060.099850:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135060.100044:0:14863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384441216 00000100:00100000:3.0:1783135060.100056:0:14863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384441216 00000100:00080000:0.0:1783135060.100210:0:14218:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1783135060.100380:0:14863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1783135060.100393:0:14863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fe828380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3287:x1869752384441216:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1783135060.100430:0:14863:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1783135060.100501:0:14863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fe828380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3287:x1869752384441216:12345-0@lo:13:osp-pre-0-0.0 Request processed in 111us (652us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135060.100509:0:14863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1783135060.101375:0:3287:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9fe90c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1869752384441216:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1783135060.168785:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:2.0:1783135060.168979:0:14223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373979136 00000100:00100000:2.0:1783135060.168992:0:14223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373979136 00000100:00100000:2.0:1783135060.169192:0:14223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 14 00000100:00100000:2.0:1783135060.169226:0:14223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe8c6dfea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa2f4fd1-78f9-41b4-ba50-d28d753ff635+6:13860:x1869752373979136:12345-192.168.201.41@tcp:101:mkdir.0 00010000:00010000:2.0:1783135060.169257:0:14223:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783135060.169322:0:14223:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828400/0xd6c4b8f05867f9e0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4428da03f5eb762b expref: -99 pid: 14223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135060.169410:0:14223:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829e00/0xd6c4b8f05867f9e7 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135060.169442:0:14223:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829e00/0xd6c4b8f05867f9e7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135060.169458:0:14223:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829e00/0xd6c4b8f05867f9e7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783135060.169739:0:14223:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:2.0:1783135060.169744:0:14223:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:2.0:1783135060.169854:0:14223:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829e00/0xd6c4b8f05867f9e7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135060.170213:0:14223:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828400/0xd6c4b8f05867f9e0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb762b expref: 8 pid: 14223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135060.170242:0:14223:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829e00/0xd6c4b8f05867f9e7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb762b expref: 7 pid: 14223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135060.170254:0:14223:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fe9e1c2b500) 00010000:00010000:2.0:1783135060.170257:0:14223:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1783135060.170262:0:14223:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fe9c7829e00, rc 0) 00000100:00100000:2.0:1783135060.170463:0:14223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe8c6dfea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa2f4fd1-78f9-41b4-ba50-d28d753ff635+7:13860:x1869752373979136:12345-192.168.201.41@tcp:101:mkdir.0 Request processed in 1240us (1691us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135060.170483:0:14223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 14 00010000:00010000:2.0:1783135060.419578:0:14211:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783135061.443472:0:15220:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1783135061.704850:0:14257:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1783135061.704864:0:14257:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1783135061.711040:0:14257:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 1 00000040:00080000:3.0:1783135061.711156:0:14257:0:(llog_cat.c:1256:llog_cat_cleanup()) cancel plain log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1783135061.711203:0:14257:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 1 count 1 00000001:02000400:0.0:1783135061.957758:0:16087:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000001:00100000:1.0:1783135062.172215:0:6602:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 2b138366-7a70-4ff2-909d-348210e4a0a2 00000001:00100000:1.0:1783135062.172233:0:6602:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of aa2f4fd1-78f9-41b4-ba50-d28d753ff635 00010000:00010000:0.0:1783135062.468169:0:14210:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783135063.492344:0:14211:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783135063.684673:0:3289:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1783135063.684697:0:3289:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9fe90ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1869752384441344:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1783135063.684772:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135063.684853:0:14862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384441344 00000100:00100000:3.0:1783135063.684862:0:14862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384441344 00000100:00100000:3.0:1783135063.684927:0:14862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1783135063.684937:0:14862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fe90c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3289:x1869752384441344:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1783135063.684976:0:14862:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1783135063.685039:0:14862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fe90c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3289:x1869752384441344:12345-0@lo:13:osp-pre-1-0.0 Request processed in 103us (267us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135063.685047:0:14862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00080000:3.0:1783135063.685072:0:14218:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1783135063.685128:0:3289:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000004:00080000:3.0:1783135063.685137:0:3289:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9fe9fe82a300, transno 8589934593 00000100:00100000:3.0:1783135063.685154:0:3289:0:(client.c:3155:ptlrpc_free_committed()) @@@ stopping search req@ffff9fe9fea17100 x1869752384441088/t8589934594(8589934594) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1783135074 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783135063.685174:0:3289:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9fe90ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1869752384441344:0@lo:13:osp-pre-1-0.0 00000040:00080000:3.0:1783135063.685785:0:14247:0:(llog_cat.c:1213:llog_cat_set_first_idx()) catlog [0x1:0x5:0x0] first idx 1, last_idx 2 00000040:00080000:3.0:1783135063.685845:0:14247:0:(llog_cat.c:1256:llog_cat_cleanup()) cancel plain log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000100:00100000:2.0:1783135063.686173:0:3288:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9fe959880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3288:1869752384441856:0@lo:400:kworker.0 00000100:00100000:1.0:1783135063.686174:0:3286:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9fe959f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1869752384441600:0@lo:400:kworker.0 00000100:00100000:1.0:1783135063.686235:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135063.686236:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135063.686298:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1783135063.686314:0:3286:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9fe959500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3286:1869752384441728:0@lo:400:kworker.0 00000100:00100000:1.0:1783135063.686340:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135063.686368:0:14861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384441600 00000100:00100000:1.0:1783135063.686373:0:14861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384441600 00000100:00080000:3.0:1783135063.686750:0:14218:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1783135063.688940:0:3288:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1783135063.689743:0:14222:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384441856 00000100:00100000:0.0:1783135063.689773:0:14222:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384441856 00000100:00100000:2.0:1783135063.690685:0:3288:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9fe95b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c1fe35bd-99cf-438e-8ada-ed586b673efa:3288:1869752384441472:0@lo:400:kworker.0 00000100:00100000:0.0:1783135063.690732:0:14222:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384441728 00000100:00100000:0.0:1783135063.690736:0:14222:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384441728 00000100:00100000:0.0:1783135063.690762:0:14222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1783135063.690769:0:14222:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fe828a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3288:x1869752384441856:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783135063.690815:0:14222:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fe828a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3288:x1869752384441856:12345-0@lo:400:kworker.0 Request processed in 48us (4585us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135063.690820:0:14222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1783135063.690832:0:14222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1783135063.690838:0:14222:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fe958700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3286:x1869752384441728:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783135063.690864:0:14861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1783135063.690869:0:14222:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fe958700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3286:x1869752384441728:12345-0@lo:400:kworker.0 Request processed in 28us (4526us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135063.690874:0:14222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1783135063.690908:0:3286:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9fe959500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3286:1869752384441728:0@lo:400:kworker.0 00000100:00100000:1.0:1783135063.690951:0:14861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fe95b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3286:x1869752384441600:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783135063.691002:0:14861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fe95b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3286:x1869752384441600:12345-0@lo:400:kworker.0 Request processed in 125us (4770us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135063.691010:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135063.691010:0:14861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1783135063.691040:0:14217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384441472 00000100:00100000:0.0:1783135063.691044:0:14217:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384441472 00000100:00100000:1.0:1783135063.691051:0:3286:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9fe959f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1869752384441600:0@lo:400:kworker.0 00000100:00100000:0.0:1783135063.691072:0:14217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1783135063.691083:0:14217:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fe40c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1fe35bd-99cf-438e-8ada-ed586b673efa+19:3288:x1869752384441472:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783135063.691129:0:14217:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fe40c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1fe35bd-99cf-438e-8ada-ed586b673efa+19:3288:x1869752384441472:12345-0@lo:400:kworker.0 Request processed in 46us (370us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135063.691136:0:14217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1783135063.692952:0:3288:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9fe95a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3288:1869752384441984:0@lo:400:kworker.0 00000100:00100000:2.0:1783135063.693004:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135063.693084:0:14222:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384441984 00000100:00100000:2.0:1783135063.693146:0:14222:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384441984 00000100:00100000:1.0:1783135063.693219:0:14224:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1783135063.693232:0:14224:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fe829180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3288:x1869752384441984:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783135063.693311:0:14224:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fe829180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3288:x1869752384441984:12345-0@lo:400:kworker.0 Request processed in 81us (305us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135063.693320:0:14224:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1783135063.694387:0:3288:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9fe95a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3288:1869752384441984:0@lo:400:kworker.0 00000100:00100000:2.0:1783135063.694409:0:3288:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9fe959880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3288:1869752384441856:0@lo:400:kworker.0 00000100:00100000:2.0:1783135063.694554:0:3288:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9fe95b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c1fe35bd-99cf-438e-8ada-ed586b673efa:3288:1869752384441472:0@lo:400:kworker.0 00000100:00080000:0.0:1783135063.695242:0:14218:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00100000:2.0:1783135063.710813:0:5791:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of aa2f4fd1-78f9-41b4-ba50-d28d753ff635 00000001:00100000:2.0:1783135063.738030:0:7470:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of aa2f4fd1-78f9-41b4-ba50-d28d753ff635 00000001:00080000:2.0:1783135063.738052:0:7470:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934594 is committed 00000020:00000080:3.0:1783135064.129879:0:16235:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fff0905efe0 20000000:00000080:3.0:1783135064.129892:0:16235:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9fe8c5f20800 uarg=0000000000000000 20000000:01000000:3.0:1783135064.129924:0:16235:0:(mgs_llog.c:6177:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:3.0:1783135064.129935:0:16235:0:(mgs_llog.c:4638:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:3.0:1783135064.129939:0:16235:0:(mgs_llog.c:1376:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:3.0:1783135064.130725:0:16236:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 10 20000000:00000400:0.0:1783135064.131071:0:16235:0:(mgs_llog.c:1447:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:0.0:1783135064.136883:0:16235:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1783135064.136916:0:16235:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9fe9f68ad200/0xd6c4b8f05867f9ee lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135064.136937:0:16235:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9fe9d2b75400/0xd6c4b8f05867f6e5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd6c4b8f05867f6de expref: 18 pid: 14216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135064.136946:0:16235:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9fe9c7828600/0xd6c4b8f05867f732 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd6c4b8f05867f72b expref: 18 pid: 14216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135064.136953:0:16235:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9fe8c5550a00/0xd6c4b8f05867f86d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd6c4b8f05867f866 expref: 18 pid: 14216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135064.136963:0:16235:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9fe9c7829800/0xd6c4b8f05867f8c8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb759f expref: 12 pid: 14216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135064.136970:0:16235:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9fe9c7829400/0xd6c4b8f05867f9c4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb7601 expref: 12 pid: 14215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135064.136978:0:16235:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9fe9f68ad200/0xd6c4b8f05867f9ee lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 16235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135064.137022:0:16235:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9fe9c7829400/0xd6c4b8f05867f9c4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb7601 expref: 12 pid: 14215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135064.137055:0:16235:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9fe9c7829400/0xd6c4b8f05867f9c4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb7601 expref: 12 pid: 14215 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783135064.137070:0:16235:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe8c6dfd500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16235:1869752384442112:192.168.201.41@tcp:104: 00010000:00010000:0.0:1783135064.137207:0:16235:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9fe9c7829800/0xd6c4b8f05867f8c8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb759f expref: 12 pid: 14216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135064.137216:0:16235:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9fe9c7829800/0xd6c4b8f05867f8c8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb759f expref: 12 pid: 14216 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783135064.137225:0:16235:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe8c6dfdc00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16235:1869752384442240:192.168.201.41@tcp:104: 00010000:00010000:0.0:1783135064.137260:0:16235:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9fe8c5550a00/0xd6c4b8f05867f86d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd6c4b8f05867f866 expref: 18 pid: 14216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135064.137269:0:16235:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9fe8c5550a00/0xd6c4b8f05867f86d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd6c4b8f05867f866 expref: 18 pid: 14216 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783135064.137310:0:16235:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe8c6dfd880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16235:1869752384442368:0@lo:104: 00000100:00100000:0.0:1783135064.137355:0:16235:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1783135064.137398:0:16235:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9fe9c7828600/0xd6c4b8f05867f732 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd6c4b8f05867f72b expref: 18 pid: 14216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135064.137407:0:16235:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9fe9c7828600/0xd6c4b8f05867f732 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd6c4b8f05867f72b expref: 18 pid: 14216 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783135064.137416:0:16235:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe8c6dfe680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16235:1869752384442496:0@lo:104: 00000100:00100000:0.0:1783135064.137440:0:16235:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1783135064.137474:0:16235:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9fe9d2b75400/0xd6c4b8f05867f6e5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd6c4b8f05867f6de expref: 18 pid: 14216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135064.137484:0:16235:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9fe9d2b75400/0xd6c4b8f05867f6e5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd6c4b8f05867f6de expref: 18 pid: 14216 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783135064.137492:0:16235:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe8c6dfed80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16235:1869752384442624:0@lo:104: 00000100:00100000:0.0:1783135064.137520:0:16235:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135064.137531:0:16235:0:(client.c:2701:ptlrpc_set_wait()) set ffff9fe8c4fb9480 going to sleep for 11 seconds 00000100:00100000:2.0:1783135064.137649:0:14206:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1783135064.137672:0:14206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384442368 00000100:00100000:2.0:1783135064.137678:0:14206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384442368 00000100:00100000:2.0:1783135064.137715:0:14206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384442496 00000100:00100000:2.0:1783135064.137718:0:14206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384442496 00000100:00100000:2.0:1783135064.137742:0:14206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384442624 00000100:00100000:2.0:1783135064.137745:0:14206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384442624 00000100:00100000:2.0:1783135064.137764:0:14206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1783135064.137782:0:14206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe8c6dfe300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c1fe35bd-99cf-438e-8ada-ed586b673efa+5:16235:x1869752384442368:12345-0@lo:104: 00010000:00010000:2.0:1783135064.137795:0:14206:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.141@tcp lock: ffff9fe9f68ace00/0xd6c4b8f05867f866 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xd6c4b8f05867f86d expref: -99 pid: 15525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135064.137856:0:14206:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1783135064.137862:0:14206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe8c6dfe300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c1fe35bd-99cf-438e-8ada-ed586b673efa+5:16235:x1869752384442368:12345-0@lo:104: Request processed in 83us (508us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135064.137867:0:14206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:1.0:1783135064.137874:0:15220:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783135064.137883:0:15220:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.141@tcp lock: ffff9fe9f68ace00/0xd6c4b8f05867f866 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xd6c4b8f05867f86d expref: -99 pid: 15525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783135064.137884:0:14206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1783135064.137892:0:14206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe8c6dfc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c1fe35bd-99cf-438e-8ada-ed586b673efa+4:16235:x1869752384442496:12345-0@lo:104: 00010000:00010000:2.0:1783135064.137901:0:14206:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.141@tcp lock: ffff9fe9d2b74c00/0xd6c4b8f05867f72b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xd6c4b8f05867f732 expref: -99 pid: 14857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135064.137901:0:15220:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe9f68ace00 already unused, calling callback (ffffffffc1b40c20) 10000000:00010000:1.0:1783135064.137908:0:15220:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.141@tcp lock: ffff9fe9f68ace00/0xd6c4b8f05867f866 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xd6c4b8f05867f86d expref: -99 pid: 15525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135064.137920:0:15220:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.141@tcp lock: ffff9fe9f68ace00/0xd6c4b8f05867f866 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xd6c4b8f05867f86d expref: -99 pid: 15525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135064.137938:0:14206:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 10000000:00010000:1.0:1783135064.137941:0:15220:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.141@tcp lock: ffff9fe9f68ace00/0xd6c4b8f05867f866 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xd6c4b8f05867f86d expref: -99 pid: 15525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783135064.137946:0:14206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe8c6dfc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c1fe35bd-99cf-438e-8ada-ed586b673efa+4:16235:x1869752384442496:12345-0@lo:104: Request processed in 53us (504us total) trans 0 rc 0/0 10000000:01000000:1.0:1783135064.137955:0:15220:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00000100:00100000:2.0:1783135064.137960:0:14206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1783135064.137974:0:14206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1783135064.137980:0:14206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9f6e1a050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c1fe35bd-99cf-438e-8ada-ed586b673efa+3:16235:x1869752384442624:12345-0@lo:104: 00010000:00010000:2.0:1783135064.137988:0:14206:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.141@tcp lock: ffff9fe9f68ad000/0xd6c4b8f05867f6de lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xd6c4b8f05867f6e5 expref: -99 pid: 14219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135064.137990:0:15220:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.141@tcp lock: ffff9fe9f68ace00/0xd6c4b8f05867f866 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd6c4b8f05867f86d expref: -99 pid: 15525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135064.138005:0:15220:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1783135064.138026:0:15220:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.141@tcp lock: ffff9fe9f68ace00/0xd6c4b8f05867f866 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd6c4b8f05867f86d expref: -99 pid: 15525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135064.138035:0:15220:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.141@tcp lock: ffff9fe9f68ace00/0xd6c4b8f05867f866 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd6c4b8f05867f86d expref: -99 pid: 15525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135064.138041:0:14206:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1783135064.138049:0:14206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9f6e1a050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c1fe35bd-99cf-438e-8ada-ed586b673efa+3:16235:x1869752384442624:12345-0@lo:104: Request processed in 68us (528us total) trans 0 rc 0/0 00010000:00010000:1.0:1783135064.138049:0:15220:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1783135064.138056:0:15220:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.141@tcp lock: ffff9fe9d2b74c00/0xd6c4b8f05867f72b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xd6c4b8f05867f732 expref: -99 pid: 14857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783135064.138061:0:14206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:1.0:1783135064.138070:0:15220:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe9d2b74c00 already unused, calling callback (ffffffffc1b40c20) 10000000:00010000:1.0:1783135064.138074:0:15220:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.141@tcp lock: ffff9fe9d2b74c00/0xd6c4b8f05867f72b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xd6c4b8f05867f732 expref: -99 pid: 14857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135064.138094:0:15220:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.141@tcp lock: ffff9fe9d2b74c00/0xd6c4b8f05867f72b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xd6c4b8f05867f732 expref: -99 pid: 14857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783135064.138105:0:15220:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.141@tcp lock: ffff9fe9d2b74c00/0xd6c4b8f05867f72b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xd6c4b8f05867f732 expref: -99 pid: 14857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783135064.138120:0:15220:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1783135064.138131:0:14210:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783135064.138146:0:15220:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.141@tcp lock: ffff9fe9d2b74c00/0xd6c4b8f05867f72b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd6c4b8f05867f732 expref: -99 pid: 14857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135064.138152:0:14210:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.141@tcp lock: ffff9fe9f68ad000/0xd6c4b8f05867f6de lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xd6c4b8f05867f6e5 expref: -99 pid: 14219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135064.138153:0:15220:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1783135064.138163:0:15220:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.141@tcp lock: ffff9fe9d2b74c00/0xd6c4b8f05867f72b lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd6c4b8f05867f732 expref: -99 pid: 14857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135064.138164:0:14210:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe9f68ad000 already unused, calling callback (ffffffffc1b40c20) 10000000:00010000:2.0:1783135064.138169:0:14210:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.141@tcp lock: ffff9fe9f68ad000/0xd6c4b8f05867f6de lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xd6c4b8f05867f6e5 expref: -99 pid: 14219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135064.138178:0:15220:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.141@tcp lock: ffff9fe9d2b74c00/0xd6c4b8f05867f72b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd6c4b8f05867f732 expref: -99 pid: 14857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135064.138181:0:14210:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.141@tcp lock: ffff9fe9f68ad000/0xd6c4b8f05867f6de lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xd6c4b8f05867f6e5 expref: -99 pid: 14219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783135064.138195:0:14210:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.141@tcp lock: ffff9fe9f68ad000/0xd6c4b8f05867f6de lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xd6c4b8f05867f6e5 expref: -99 pid: 14219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135064.138199:0:15220:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1783135064.138201:0:14210:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1783135064.138203:0:15220:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783135064.138208:0:15220:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783135064.138219:0:14210:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.141@tcp lock: ffff9fe9f68ad000/0xd6c4b8f05867f6de lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd6c4b8f05867f6e5 expref: -99 pid: 14219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783135064.138223:0:3286:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9fe959f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c1fe35bd-99cf-438e-8ada-ed586b673efa:3286:1869752384442752:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1783135064.138230:0:14210:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1783135064.138248:0:14210:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.141@tcp lock: ffff9fe9f68ad000/0xd6c4b8f05867f6de lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd6c4b8f05867f6e5 expref: -99 pid: 14219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135064.138256:0:14210:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.141@tcp lock: ffff9fe9f68ad000/0xd6c4b8f05867f6de lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd6c4b8f05867f6e5 expref: -99 pid: 14219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783135064.138264:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1783135064.138268:0:14210:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783135064.138271:0:14210:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783135064.138273:0:14210:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783135064.138297:0:14211:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783135064.138308:0:3287:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9fe959500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c1fe35bd-99cf-438e-8ada-ed586b673efa:3287:1869752384442880:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1783135064.138497:0:3288:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9fe828000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c1fe35bd-99cf-438e-8ada-ed586b673efa:3288:1869752384443008:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1783135064.138530:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135064.138661:0:14207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384442752 00000100:00100000:1.0:1783135064.138665:0:14207:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384442752 00010000:00010000:1.0:1783135064.138683:0:14207:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9fe8c5550a00/0xd6c4b8f05867f86d lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd6c4b8f05867f866 expref: 19 pid: 14216 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783135064.138706:0:14207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384443008 00000100:00100000:1.0:1783135064.138708:0:14207:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384443008 00010000:00010000:1.0:1783135064.138719:0:14207:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9fe9d2b75400/0xd6c4b8f05867f6e5 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd6c4b8f05867f6de expref: 20 pid: 14216 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783135064.138732:0:14207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1783135064.138738:0:14207:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fe958e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c1fe35bd-99cf-438e-8ada-ed586b673efa+20:3286:x1869752384442752:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1783135064.138748:0:14207:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783135064.138753:0:14207:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9fe8c5550a00/0xd6c4b8f05867f86d lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd6c4b8f05867f866 expref: 20 pid: 14216 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135064.138772:0:14207:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9fe8c5550a00/0xd6c4b8f05867f86d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd6c4b8f05867f866 expref: 20 pid: 14216 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135064.138787:0:14207:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783135064.138814:0:14208:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:2.0:1783135064.138822:0:14208:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00000100:00100000:3.0:1783135064.138874:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135064.139602:0:14208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384442880 00000100:00100000:2.0:1783135064.139607:0:14208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384442880 00010000:00010000:2.0:1783135064.139623:0:14208:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9fe9c7828600/0xd6c4b8f05867f732 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd6c4b8f05867f72b expref: 21 pid: 14216 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783135064.139639:0:14208:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:2.0:1783135064.139646:0:14208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1783135064.139652:0:14208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fe828700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c1fe35bd-99cf-438e-8ada-ed586b673efa+21:3288:x1869752384443008:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1783135064.139659:0:14208:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783135064.139664:0:14208:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9fe9d2b75400/0xd6c4b8f05867f6e5 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd6c4b8f05867f6de expref: 21 pid: 14216 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135064.139671:0:14208:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9fe9d2b75400/0xd6c4b8f05867f6e5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd6c4b8f05867f6de expref: 21 pid: 14216 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135064.139680:0:14208:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1783135064.140448:0:16235:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fe8c5550a00/0xd6c4b8f05867f86d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd6c4b8f05867f866 expref: 21 pid: 14216 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783135064.140462:0:16235:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe8c6dfd880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16235:1869752384442368:0@lo:104: 00000100:00100000:0.0:1783135064.140476:0:16235:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe8c6dfe680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16235:1869752384442496:0@lo:104: 00000100:00100000:1.0:1783135064.140487:0:14207:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fe958e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c1fe35bd-99cf-438e-8ada-ed586b673efa+20:3286:x1869752384442752:12345-0@lo:103:ldlm_bl.0 Request processed in 1746us (2221us total) trans 0 rc 0/0 00010000:00010000:0.0:1783135064.140490:0:16235:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fe9d2b75400/0xd6c4b8f05867f6e5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd6c4b8f05867f6de expref: 20 pid: 14216 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783135064.140503:0:14207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1783135064.140507:0:16235:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe8c6dfed80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16235:1869752384442624:0@lo:104: 00000100:00100000:1.0:1783135064.140525:0:14207:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:1.0:1783135064.140534:0:14207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1783135064.140541:0:14207:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fe69c450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c1fe35bd-99cf-438e-8ada-ed586b673efa+18:3287:x1869752384442880:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1783135064.140550:0:14207:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783135064.140556:0:14207:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9fe9c7828600/0xd6c4b8f05867f732 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd6c4b8f05867f72b expref: 18 pid: 14216 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135064.140565:0:14207:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9fe9c7828600/0xd6c4b8f05867f732 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd6c4b8f05867f72b expref: 18 pid: 14216 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783135064.140573:0:3286:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9fe959f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c1fe35bd-99cf-438e-8ada-ed586b673efa:3286:1869752384442752:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1783135064.140577:0:14207:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fe9c7828600/0xd6c4b8f05867f732 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd6c4b8f05867f72b expref: 18 pid: 14216 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135064.140592:0:14207:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783135064.140629:0:14207:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fe69c450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c1fe35bd-99cf-438e-8ada-ed586b673efa+17:3287:x1869752384442880:12345-0@lo:103:ldlm_bl.0 Request processed in 88us (1754us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135064.140637:0:14207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1783135064.140643:0:3287:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9fe959500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c1fe35bd-99cf-438e-8ada-ed586b673efa:3287:1869752384442880:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1783135064.140703:0:16235:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe8c6dfd500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16235:1869752384442112:192.168.201.41@tcp:104: 00000100:00100000:0.0:1783135064.140717:0:16235:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe8c6dfdc00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16235:1869752384442240:192.168.201.41@tcp:104: 00000100:00100000:2.0:1783135064.140735:0:14208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fe828700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c1fe35bd-99cf-438e-8ada-ed586b673efa+16:3288:x1869752384443008:12345-0@lo:103:ldlm_bl.0 Request processed in 1080us (2202us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135064.140743:0:14208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:0.0:1783135064.140749:0:16235:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9fe9f68ad200/0xd6c4b8f05867f9ee lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 16235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783135064.140799:0:3288:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9fe828000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c1fe35bd-99cf-438e-8ada-ed586b673efa:3288:1869752384443008:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1783135064.141239:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:0.0:1783135064.141269:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:1.0:1783135064.141421:0:14209:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373979264 00000100:00100000:1.0:1783135064.141426:0:14209:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373979264 00010000:00010000:1.0:1783135064.141444:0:14209:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9fe9c7829400/0xd6c4b8f05867f9c4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb7601 expref: 13 pid: 14215 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783135064.141478:0:14209:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373979392 00000100:00100000:1.0:1783135064.141481:0:14209:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373979392 00010000:00010000:1.0:1783135064.141493:0:14209:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9fe9c7829800/0xd6c4b8f05867f8c8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb759f expref: 14 pid: 14216 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783135064.141513:0:14209:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 7 00000100:00100000:1.0:1783135064.141519:0:14209:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe8c6dfdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:58985142-d56f-4f22-9f82-f587934b3bed+14:2369:x1869752373979264:12345-192.168.201.41@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1783135064.141532:0:14209:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783135064.141536:0:14209:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9fe9c7829400/0xd6c4b8f05867f9c4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb7601 expref: 14 pid: 14215 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135064.141546:0:14209:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9fe9c7829400/0xd6c4b8f05867f9c4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb7601 expref: 14 pid: 14215 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783135064.141549:0:16237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 8 00000100:00100000:0.0:1783135064.141556:0:16237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe8c6dfd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:58985142-d56f-4f22-9f82-f587934b3bed+14:2369:x1869752373979392:12345-192.168.201.41@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1783135064.141557:0:14209:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fe9c7829400/0xd6c4b8f05867f9c4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb7601 expref: 14 pid: 14215 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135064.141563:0:16237:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783135064.141565:0:14209:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1783135064.141567:0:16237:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9fe9c7829800/0xd6c4b8f05867f8c8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb759f expref: 13 pid: 14216 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135064.141575:0:16237:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9fe9c7829800/0xd6c4b8f05867f8c8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb759f expref: 13 pid: 14216 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135064.141583:0:16237:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fe9c7829800/0xd6c4b8f05867f8c8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb759f expref: 13 pid: 14216 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783135064.141598:0:14209:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe8c6dfdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:58985142-d56f-4f22-9f82-f587934b3bed+13:2369:x1869752373979264:12345-192.168.201.41@tcp:103:ldlm_bl.0 Request processed in 79us (360us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135064.141604:0:14209:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 7 00010000:00010000:0.0:1783135064.141672:0:16237:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9fe9f68ad200/0xd6c4b8f05867f9ee lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 16235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135064.141682:0:16237:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fe9f68ad200/0xd6c4b8f05867f9ee lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 16235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135064.141695:0:16237:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9fe9f68ad200/0xd6c4b8f05867f9ee lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 16235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135064.141703:0:16237:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9fe9f68ad200/0xd6c4b8f05867f9ee lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 16235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135064.141709:0:16237:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9fe9f68ad200/0xd6c4b8f05867f9ee lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 16235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135064.141716:0:16237:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9fe9f68ad200/0xd6c4b8f05867f9ee lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 16235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135064.141721:0:16237:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe9f68ad200 already unused, calling callback (ffffffffc1527ce0) 00010000:00010000:0.0:1783135064.141740:0:16237:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9fe9f68ad200/0xd6c4b8f05867f9ee lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 16235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135064.141748:0:16237:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9fe9f68ad200/0xd6c4b8f05867f9ee lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 16235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135064.141774:0:16237:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9fe9f68ad200/0xd6c4b8f05867f9ee lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135064.141789:0:16237:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1783135064.141980:0:16235:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9fe9f68ad200/0xd6c4b8f05867f9ee lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135064.141989:0:16235:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9fe9f68ad200/0xd6c4b8f05867f9ee lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135064.141996:0:16235:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fe9f68ad200/0xd6c4b8f05867f9ee lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783135064.142198:0:16237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe8c6dfd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:58985142-d56f-4f22-9f82-f587934b3bed+11:2369:x1869752373979392:12345-192.168.201.41@tcp:103:ldlm_bl.0 Request processed in 641us (926us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135064.142205:0:16237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 8 00010000:00010000:1.0:1783135064.515495:0:15220:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783135065.219437:0:3289:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9fe828000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1869752384443136:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1783135065.219507:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135065.219669:0:14862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384443136 00000100:00100000:1.0:1783135065.219677:0:14862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384443136 00000100:00100000:1.0:1783135065.219886:0:14862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1783135065.219898:0:14862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe8c6dfed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3289:x1869752384443136:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1783135065.219973:0:14862:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1783135065.220100:0:14862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe8c6dfed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3289:x1869752384443136:12345-0@lo:13:osp-pre-0-0.0 Request processed in 204us (593us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135065.220108:0:14862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00080000:0.0:1783135065.220503:0:14218:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1783135065.220574:0:3289:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9fe828000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1869752384443136:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1783135065.260666:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:1.0:1783135065.262006:0:14216:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373979520 00000100:00100000:1.0:1783135065.262015:0:14216:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373979520 00000100:00100000:1.0:1783135065.262111:0:14216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 99 00000100:00100000:1.0:1783135065.262122:0:14216:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fe40c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58985142-d56f-4f22-9f82-f587934b3bed+11:13714:x1869752373979520:12345-192.168.201.41@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783135065.262138:0:14216:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783135065.262156:0:14216:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fe8c5551000/0xd6c4b8f05867f9f5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x4428da03f5eb7632 expref: -99 pid: 14216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135065.262184:0:14216:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fe8c5551000/0xd6c4b8f05867f9f5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb7632 expref: 12 pid: 14216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135065.262193:0:14216:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fe8c5551000/0xd6c4b8f05867f9f5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb7632 expref: 12 pid: 14216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135065.262202:0:14216:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fe8c5551000, rc 0) 00000100:00100000:1.0:1783135065.262262:0:14216:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fe40c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58985142-d56f-4f22-9f82-f587934b3bed+12:13714:x1869752373979520:12345-192.168.201.41@tcp:101:ll_cfg_requeue.0 Request processed in 142us (1606us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135065.262269:0:14216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 99 00000100:00100000:1.0:1783135065.264757:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:0.0:1783135065.264997:0:14215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373979648 00000100:00100000:0.0:1783135065.265005:0:14215:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373979648 00000100:00100000:2.0:1783135065.265111:0:14217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 100 00000100:00100000:2.0:1783135065.265134:0:14217:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fe40f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58985142-d56f-4f22-9f82-f587934b3bed+12:13714:x1869752373979648:12345-192.168.201.41@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783135065.265420:0:14217:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fe40f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58985142-d56f-4f22-9f82-f587934b3bed+12:13714:x1869752373979648:12345-192.168.201.41@tcp:501:ll_cfg_requeue.0 Request processed in 287us (668us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135065.265428:0:14217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 100 00000100:00100000:3.0:1783135065.269729:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:1.0:1783135065.269813:0:14216:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373979776 00000100:00100000:1.0:1783135065.269821:0:14216:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373979776 00000100:00100000:1.0:1783135065.269858:0:14216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 101 00000100:00100000:1.0:1783135065.269864:0:14216:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fe40e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58985142-d56f-4f22-9f82-f587934b3bed+12:13714:x1869752373979776:12345-192.168.201.41@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783135065.270046:0:14216:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fe40e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58985142-d56f-4f22-9f82-f587934b3bed+12:13714:x1869752373979776:12345-192.168.201.41@tcp:503:ll_cfg_requeue.0 Request processed in 180us (324us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135065.270056:0:14216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 101 00000100:00100000:3.0:1783135065.279423:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:0.0:1783135065.279613:0:14215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373979904 00000100:00100000:0.0:1783135065.279624:0:14215:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373979904 00000100:00100000:0.0:1783135065.279685:0:14215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 102 00000100:00100000:0.0:1783135065.279694:0:14215:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fe40d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:58985142-d56f-4f22-9f82-f587934b3bed+12:13714:x1869752373979904:12345-192.168.201.41@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783135065.279711:0:14215:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783135065.279728:0:14215:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fe9f68ad200/0xd6c4b8f05867f9fc lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x4428da03f5eb7639 expref: -99 pid: 14215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135065.279755:0:14215:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fe9f68ad200/0xd6c4b8f05867f9fc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb7639 expref: 13 pid: 14215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135065.279778:0:14215:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fe9f68ad200/0xd6c4b8f05867f9fc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb7639 expref: 13 pid: 14215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135065.279908:0:14215:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fe9f68ad200, rc 0) 00000100:00100000:0.0:1783135065.279965:0:14215:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fe40d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:58985142-d56f-4f22-9f82-f587934b3bed+13:13714:x1869752373979904:12345-192.168.201.41@tcp:101:ll_cfg_requeue.0 Request processed in 272us (552us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135065.279973:0:14215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 102 00000100:00100000:1.0:1783135065.286098:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:3.0:1783135065.286647:0:14216:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373980032 00000100:00100000:3.0:1783135065.286656:0:14216:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373980032 00000100:00100000:3.0:1783135065.286706:0:14216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 103 00000100:00100000:3.0:1783135065.286716:0:14216:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fe40c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58985142-d56f-4f22-9f82-f587934b3bed+13:13714:x1869752373980032:12345-192.168.201.41@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783135065.287925:0:14216:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fe40c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58985142-d56f-4f22-9f82-f587934b3bed+13:13714:x1869752373980032:12345-192.168.201.41@tcp:501:ll_cfg_requeue.0 Request processed in 1209us (1834us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135065.287934:0:14216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 103 00000100:00100000:0.0:1783135065.291429:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:1.0:1783135065.294159:0:14215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373980160 00000100:00100000:1.0:1783135065.294172:0:14215:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373980160 00000100:00100000:1.0:1783135065.294237:0:14215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 104 00000100:00100000:1.0:1783135065.294248:0:14215:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fe40dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:58985142-d56f-4f22-9f82-f587934b3bed+13:13714:x1869752373980160:12345-192.168.201.41@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783135065.294508:0:14215:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fe40dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:58985142-d56f-4f22-9f82-f587934b3bed+13:13714:x1869752373980160:12345-192.168.201.41@tcp:503:ll_cfg_requeue.0 Request processed in 261us (3084us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135065.294519:0:14215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 104 00000100:00100000:2.0:1783135065.382608:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:2.0:1783135065.382651:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:2.0:1783135065.382680:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:2.0:1783135065.382697:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:2.0:1783135065.382717:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:2.0:1783135065.382738:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:2.0:1783135065.382764:0:14224:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373980672 00000100:00100000:2.0:1783135065.382775:0:14224:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373980672 00000100:00100000:2.0:1783135065.382834:0:14224:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373980288 00000100:00100000:2.0:1783135065.382838:0:14224:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373980288 00000100:00100000:2.0:1783135065.382858:0:14224:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 11 00000100:00100000:2.0:1783135065.382869:0:14224:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fe82bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aa2f4fd1-78f9-41b4-ba50-d28d753ff635+6:2370:x1869752373980672:12345-192.168.201.41@tcp:400:kworker.0 00000100:00100000:2.0:1783135065.382946:0:14224:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fe82bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aa2f4fd1-78f9-41b4-ba50-d28d753ff635+6:2370:x1869752373980672:12345-192.168.201.41@tcp:400:kworker.0 Request processed in 79us (295us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135065.382954:0:14224:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 11 00000100:00100000:2.0:1783135065.382971:0:14224:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 12 00000100:00100000:2.0:1783135065.382977:0:14224:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fe829f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2b138366-7a70-4ff2-909d-348210e4a0a2+6:2370:x1869752373980288:12345-192.168.201.41@tcp:400:kworker.0 00000100:00100000:2.0:1783135065.383003:0:14224:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fe829f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2b138366-7a70-4ff2-909d-348210e4a0a2+6:2370:x1869752373980288:12345-192.168.201.41@tcp:400:kworker.0 Request processed in 26us (304us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135065.383010:0:14224:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 12 00000100:00100000:2.0:1783135065.383027:0:14861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373980416 00000100:00100000:2.0:1783135065.383040:0:14861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373980416 00000100:00100000:2.0:1783135065.383075:0:14861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373980928 00000100:00100000:2.0:1783135065.383077:0:14861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373980928 00000100:00100000:2.0:1783135065.383090:0:14861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373980544 00000100:00100000:2.0:1783135065.383092:0:14861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373980544 00000100:00100000:2.0:1783135065.383103:0:14861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373980800 00000100:00100000:2.0:1783135065.383106:0:14861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373980800 00000100:00100000:2.0:1783135065.383120:0:14861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 3 00000100:00100000:2.0:1783135065.383127:0:14861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fe828700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2b138366-7a70-4ff2-909d-348210e4a0a2+5:2370:x1869752373980416:12345-192.168.201.41@tcp:400:kworker.0 00000100:00100000:2.0:1783135065.383155:0:14861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fe828700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2b138366-7a70-4ff2-909d-348210e4a0a2+5:2370:x1869752373980416:12345-192.168.201.41@tcp:400:kworker.0 Request processed in 28us (557us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135065.383162:0:14861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 3 00000100:00100000:2.0:1783135065.383174:0:14861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 4 00000100:00100000:2.0:1783135065.383180:0:14861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fe829880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:aa2f4fd1-78f9-41b4-ba50-d28d753ff635+5:2370:x1869752373980928:12345-192.168.201.41@tcp:400:kworker.0 00000100:00100000:2.0:1783135065.383205:0:14861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fe829880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:aa2f4fd1-78f9-41b4-ba50-d28d753ff635+5:2370:x1869752373980928:12345-192.168.201.41@tcp:400:kworker.0 Request processed in 26us (524us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135065.383211:0:14861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 4 00000100:00100000:2.0:1783135065.383222:0:14861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 5 00000100:00100000:2.0:1783135065.383228:0:14861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fe82b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2b138366-7a70-4ff2-909d-348210e4a0a2+5:2370:x1869752373980544:12345-192.168.201.41@tcp:400:kworker.0 00000100:00100000:2.0:1783135065.383250:0:14861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fe82b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2b138366-7a70-4ff2-909d-348210e4a0a2+5:2370:x1869752373980544:12345-192.168.201.41@tcp:400:kworker.0 Request processed in 23us (532us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135065.383256:0:14861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 5 00000100:00100000:2.0:1783135065.383268:0:14861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 6 00000100:00100000:2.0:1783135065.383273:0:14861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fe82b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:aa2f4fd1-78f9-41b4-ba50-d28d753ff635+5:2370:x1869752373980800:12345-192.168.201.41@tcp:400:kworker.0 00000100:00100000:2.0:1783135065.383320:0:14861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fe82b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:aa2f4fd1-78f9-41b4-ba50-d28d753ff635+5:2370:x1869752373980800:12345-192.168.201.41@tcp:400:kworker.0 Request processed in 47us (580us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135065.383332:0:14861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 6 00000100:00080000:0.0:1783135065.383508:0:14218:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1783135065.383513:0:14218:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1783135065.383536:0:14218:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1783135065.582512:0:14210:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1783135065.923713:0:14219:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1783135065.923727:0:14219:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff9fe9f6724800 from 10 10000000:01000000:3.0:1783135065.923733:0:14219:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1783135065.923784:0:14219:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.141@tcp lock: ffff9fe9c0031000/0xd6c4b8f05867fa03 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135065.923796:0:14219:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.141@tcp lock: ffff9fe9c0031000/0xd6c4b8f05867fa03 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135065.923806:0:14219:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.141@tcp lock: ffff9fe9c0031000/0xd6c4b8f05867fa03 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783135065.923830:0:14219:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9fe90ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1fe35bd-99cf-438e-8ada-ed586b673efa:14219:1869752384443264:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1783135065.923899:0:14219:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135065.924073:0:14219:0:(client.c:2701:ptlrpc_set_wait()) set ffff9fe9fe9440c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783135065.924261:0:14216:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384443264 00000100:00100000:1.0:1783135065.924268:0:14216:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384443264 00000100:00100000:1.0:1783135065.924332:0:14216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1783135065.924340:0:14216:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fe40e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1fe35bd-99cf-438e-8ada-ed586b673efa+16:14219:x1869752384443264:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783135065.924353:0:14216:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783135065.924364:0:14216:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fe8c5550c00/0xd6c4b8f05867fa0a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xd6c4b8f05867fa03 expref: -99 pid: 14216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135065.924385:0:14216:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fe8c5550c00/0xd6c4b8f05867fa0a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd6c4b8f05867fa03 expref: 17 pid: 14216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135065.924395:0:14216:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fe8c5550c00/0xd6c4b8f05867fa0a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd6c4b8f05867fa03 expref: 17 pid: 14216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135065.924404:0:14216:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fe8c5550c00, rc 0) 00000100:00100000:1.0:1783135065.924481:0:14216:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fe40e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1fe35bd-99cf-438e-8ada-ed586b673efa+17:14219:x1869752384443264:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 141us (581us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135065.924488:0:14216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1783135065.925275:0:14219:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9fe90ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1fe35bd-99cf-438e-8ada-ed586b673efa:14219:1869752384443264:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783135065.925304:0:14219:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.141@tcp lock: ffff9fe9c0031000/0xd6c4b8f05867fa03 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd6c4b8f05867fa0a expref: -99 pid: 14219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135065.925314:0:14219:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.141@tcp lock: ffff9fe9c0031000/0xd6c4b8f05867fa03 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd6c4b8f05867fa0a expref: -99 pid: 14219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783135065.925361:0:14219:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9fe90ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1fe35bd-99cf-438e-8ada-ed586b673efa:14219:1869752384443392:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783135065.925384:0:14219:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135065.925409:0:14219:0:(client.c:2701:ptlrpc_set_wait()) set ffff9fe9fe9440c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783135065.925457:0:14215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384443392 00000100:00100000:1.0:1783135065.925461:0:14215:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384443392 00000100:00100000:1.0:1783135065.925487:0:14215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1783135065.925493:0:14215:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fe40cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c1fe35bd-99cf-438e-8ada-ed586b673efa+17:14219:x1869752384443392:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783135065.925806:0:14215:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fe40cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c1fe35bd-99cf-438e-8ada-ed586b673efa+17:14219:x1869752384443392:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 312us (420us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135065.925813:0:14215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1783135065.927725:0:14219:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9fe90ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1fe35bd-99cf-438e-8ada-ed586b673efa:14219:1869752384443392:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783135065.927766:0:14219:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9fe82b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1fe35bd-99cf-438e-8ada-ed586b673efa:14219:1869752384443520:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783135065.927871:0:14219:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135065.927953:0:14219:0:(client.c:2701:ptlrpc_set_wait()) set ffff9fe9f426c3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783135065.928438:0:14217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384443520 00000100:00100000:0.0:1783135065.928444:0:14217:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384443520 00000100:00100000:0.0:1783135065.928522:0:14217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1783135065.928530:0:14217:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fe40d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1fe35bd-99cf-438e-8ada-ed586b673efa+17:14219:x1869752384443520:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783135065.928699:0:14217:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fe40d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1fe35bd-99cf-438e-8ada-ed586b673efa+17:14219:x1869752384443520:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 169us (827us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135065.928706:0:14217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1783135065.928783:0:14219:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9fe82b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1fe35bd-99cf-438e-8ada-ed586b673efa:14219:1869752384443520:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1783135065.930490:0:16348:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:3.0:1783135065.930638:0:14219:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:3.0:1783135065.932097:0:14219:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.201.141@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1783135065.932112:0:14219:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.141@tcp lock: ffff9fe9c0031000/0xd6c4b8f05867fa03 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd6c4b8f05867fa0a expref: -99 pid: 14219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135065.932124:0:14219:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.141@tcp lock: ffff9fe9c0031000/0xd6c4b8f05867fa03 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd6c4b8f05867fa0a expref: -99 pid: 14219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783135065.932134:0:14219:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1783135065.932137:0:14219:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff9fe8c47e2000 from 10 10000000:01000000:3.0:1783135065.932139:0:14219:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1783135065.932174:0:14219:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.141@tcp lock: ffff9fe9c0030800/0xd6c4b8f05867fa11 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135065.932182:0:14219:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.141@tcp lock: ffff9fe9c0030800/0xd6c4b8f05867fa11 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135065.932194:0:14219:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.141@tcp lock: ffff9fe9c0030800/0xd6c4b8f05867fa11 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783135065.932235:0:14219:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9fe90ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1fe35bd-99cf-438e-8ada-ed586b673efa:14219:1869752384443648:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1783135065.932306:0:14219:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135065.932483:0:14219:0:(client.c:2701:ptlrpc_set_wait()) set ffff9fe9fe944300 going to sleep for 11 seconds 00000100:00100000:1.0:1783135065.932531:0:14215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384443648 00000100:00100000:1.0:1783135065.932538:0:14215:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384443648 00000100:00100000:1.0:1783135065.932575:0:14215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1783135065.932618:0:14215:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9ca9ba050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c1fe35bd-99cf-438e-8ada-ed586b673efa+17:14219:x1869752384443648:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783135065.932632:0:14215:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783135065.932644:0:14215:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fe8c5550600/0xd6c4b8f05867fa18 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xd6c4b8f05867fa11 expref: -99 pid: 14215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135065.932666:0:14215:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fe8c5550600/0xd6c4b8f05867fa18 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd6c4b8f05867fa11 expref: 18 pid: 14215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135065.932676:0:14215:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fe8c5550600/0xd6c4b8f05867fa18 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd6c4b8f05867fa11 expref: 18 pid: 14215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135065.932685:0:14215:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fe8c5550600, rc 0) 00000100:00100000:1.0:1783135065.932758:0:14215:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9ca9ba050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c1fe35bd-99cf-438e-8ada-ed586b673efa+18:14219:x1869752384443648:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 175us (452us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135065.932816:0:14219:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9fe90ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1fe35bd-99cf-438e-8ada-ed586b673efa:14219:1869752384443648:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783135065.932828:0:14219:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.141@tcp lock: ffff9fe9c0030800/0xd6c4b8f05867fa11 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd6c4b8f05867fa18 expref: -99 pid: 14219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135065.932837:0:14219:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.141@tcp lock: ffff9fe9c0030800/0xd6c4b8f05867fa11 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xd6c4b8f05867fa18 expref: -99 pid: 14219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783135065.932878:0:14219:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9fe90ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1fe35bd-99cf-438e-8ada-ed586b673efa:14219:1869752384443776:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783135065.932899:0:14219:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135065.932948:0:14219:0:(client.c:2701:ptlrpc_set_wait()) set ffff9fe9fe944300 going to sleep for 11 seconds 00000100:00100000:0.0:1783135065.932995:0:14217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384443776 00000100:00100000:0.0:1783135065.933000:0:14217:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384443776 00000100:00100000:1.0:1783135065.941259:0:14215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1783135065.941502:0:14217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1783135065.941516:0:14217:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9ca9b8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1fe35bd-99cf-438e-8ada-ed586b673efa+18:14219:x1869752384443776:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783135065.941807:0:14217:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9ca9b8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1fe35bd-99cf-438e-8ada-ed586b673efa+18:14219:x1869752384443776:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 295us (8906us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135065.941815:0:14217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1783135065.941884:0:14219:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9fe90ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1fe35bd-99cf-438e-8ada-ed586b673efa:14219:1869752384443776:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783135065.941931:0:14219:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9fe90ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1fe35bd-99cf-438e-8ada-ed586b673efa:14219:1869752384443904:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783135065.941978:0:14219:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135065.942070:0:14219:0:(client.c:2701:ptlrpc_set_wait()) set ffff9fe9fe944300 going to sleep for 11 seconds 00000100:00100000:2.0:1783135065.942149:0:14216:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384443904 00000100:00100000:2.0:1783135065.942156:0:14216:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384443904 00000100:00100000:2.0:1783135065.942184:0:14216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1783135065.942190:0:14216:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9ca9b9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1fe35bd-99cf-438e-8ada-ed586b673efa+18:14219:x1869752384443904:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783135065.942345:0:14216:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9ca9b9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1fe35bd-99cf-438e-8ada-ed586b673efa+18:14219:x1869752384443904:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 154us (367us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135065.942352:0:14216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1783135065.942471:0:14219:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9fe90ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1fe35bd-99cf-438e-8ada-ed586b673efa:14219:1869752384443904:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1783135065.943227:0:16349:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:3.0:1783135065.943295:0:14219:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:3.0:1783135065.943313:0:14219:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.201.141@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1783135065.943322:0:14219:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.141@tcp lock: ffff9fe9c0030800/0xd6c4b8f05867fa11 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd6c4b8f05867fa18 expref: -99 pid: 14219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135065.943344:0:14219:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.141@tcp lock: ffff9fe9c0030800/0xd6c4b8f05867fa11 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd6c4b8f05867fa18 expref: -99 pid: 14219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783135065.943355:0:14219:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1783135065.943358:0:14219:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff9fe9f6f8d000 from 10 10000000:01000000:3.0:1783135065.943361:0:14219:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1783135065.943384:0:14219:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.141@tcp lock: ffff9fe9c0030200/0xd6c4b8f05867fa1f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135065.943392:0:14219:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.141@tcp lock: ffff9fe9c0030200/0xd6c4b8f05867fa1f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135065.943401:0:14219:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.141@tcp lock: ffff9fe9c0030200/0xd6c4b8f05867fa1f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783135065.943417:0:14219:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9fe90ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1fe35bd-99cf-438e-8ada-ed586b673efa:14219:1869752384444032:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1783135065.943449:0:14219:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135065.943478:0:14219:0:(client.c:2701:ptlrpc_set_wait()) set ffff9fe9fe944540 going to sleep for 11 seconds 00000100:00100000:3.0:1783135065.943547:0:14216:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384444032 00000100:00100000:3.0:1783135065.943551:0:14216:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384444032 00000100:00100000:3.0:1783135065.943572:0:14216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1783135065.943578:0:14216:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9ca9ba450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1fe35bd-99cf-438e-8ada-ed586b673efa+18:14219:x1869752384444032:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783135065.943586:0:14216:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783135065.943596:0:14216:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fe9c0031600/0xd6c4b8f05867fa26 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xd6c4b8f05867fa1f expref: -99 pid: 14216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135065.943617:0:14216:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fe9c0031600/0xd6c4b8f05867fa26 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd6c4b8f05867fa1f expref: 19 pid: 14216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135065.943638:0:14216:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fe9c0031600/0xd6c4b8f05867fa26 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd6c4b8f05867fa1f expref: 19 pid: 14216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135065.943647:0:14216:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fe9c0031600, rc 0) 00000100:00100000:3.0:1783135065.943675:0:14216:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9ca9ba450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1fe35bd-99cf-438e-8ada-ed586b673efa+19:14219:x1869752384444032:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 97us (225us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135065.943682:0:14216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1783135065.943714:0:14219:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9fe90ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1fe35bd-99cf-438e-8ada-ed586b673efa:14219:1869752384444032:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783135065.943725:0:14219:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.141@tcp lock: ffff9fe9c0030200/0xd6c4b8f05867fa1f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd6c4b8f05867fa26 expref: -99 pid: 14219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135065.943734:0:14219:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.141@tcp lock: ffff9fe9c0030200/0xd6c4b8f05867fa1f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xd6c4b8f05867fa26 expref: -99 pid: 14219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783135065.943769:0:14219:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9fe90ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1fe35bd-99cf-438e-8ada-ed586b673efa:14219:1869752384444160:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783135065.943790:0:14219:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135065.943802:0:14219:0:(client.c:2701:ptlrpc_set_wait()) set ffff9fe9fe944540 going to sleep for 11 seconds 00000100:00100000:3.0:1783135065.943812:0:14216:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384444160 00000100:00100000:3.0:1783135065.943816:0:14216:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384444160 00000100:00100000:3.0:1783135065.943832:0:14216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1783135065.943838:0:14216:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9ca9b8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1fe35bd-99cf-438e-8ada-ed586b673efa+19:14219:x1869752384444160:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783135065.944024:0:14216:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9ca9b8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1fe35bd-99cf-438e-8ada-ed586b673efa+19:14219:x1869752384444160:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 186us (232us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135065.944030:0:14216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1783135065.944068:0:14219:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9fe90ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1fe35bd-99cf-438e-8ada-ed586b673efa:14219:1869752384444160:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783135065.944097:0:14219:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9fe90ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1fe35bd-99cf-438e-8ada-ed586b673efa:14219:1869752384444288:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783135065.944126:0:14219:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135065.944137:0:14219:0:(client.c:2701:ptlrpc_set_wait()) set ffff9fe9fe944540 going to sleep for 11 seconds 00000100:00100000:3.0:1783135065.944147:0:14216:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384444288 00000100:00100000:3.0:1783135065.944150:0:14216:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384444288 00000100:00100000:3.0:1783135065.944164:0:14216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1783135065.944169:0:14216:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9ca9ba850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1fe35bd-99cf-438e-8ada-ed586b673efa+19:14219:x1869752384444288:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783135065.944300:0:14216:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9ca9ba850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1fe35bd-99cf-438e-8ada-ed586b673efa+19:14219:x1869752384444288:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 111us (153us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135065.944306:0:14216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1783135065.944334:0:14219:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9fe90ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c1fe35bd-99cf-438e-8ada-ed586b673efa:14219:1869752384444288:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1783135065.944938:0:16350:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:3.0:1783135065.944979:0:14219:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:3.0:1783135065.944993:0:14219:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.201.141@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1783135065.945001:0:14219:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.141@tcp lock: ffff9fe9c0030200/0xd6c4b8f05867fa1f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd6c4b8f05867fa26 expref: -99 pid: 14219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135065.945010:0:14219:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.141@tcp lock: ffff9fe9c0030200/0xd6c4b8f05867fa1f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd6c4b8f05867fa26 expref: -99 pid: 14219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783135066.389564:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:2.0:1783135066.389710:0:14224:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373981056 00000100:00100000:2.0:1783135066.389721:0:14224:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373981056 00000100:00100000:2.0:1783135066.389782:0:14224:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 15 00000100:00100000:2.0:1783135066.389801:0:14224:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe8c6dfe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2b138366-7a70-4ff2-909d-348210e4a0a2+6:14369:x1869752373981056:12345-192.168.201.41@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1783135066.389835:0:14224:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783135066.389856:0:14224:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828600/0xd6c4b8f05867fa2d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4428da03f5eb7640 expref: -99 pid: 14224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135066.389961:0:14224:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829400/0xd6c4b8f05867fa34 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135066.390712:0:14224:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829400/0xd6c4b8f05867fa34 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135066.390731:0:14224:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829400/0xd6c4b8f05867fa34 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135066.390750:0:14224:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828400/0xd6c4b8f05867fa3b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135066.390759:0:14224:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828400/0xd6c4b8f05867fa3b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135066.390767:0:14224:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828400/0xd6c4b8f05867fa3b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135066.391455:0:14224:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829800/0xd6c4b8f05867fa42 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135066.391467:0:14224:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829800/0xd6c4b8f05867fa42 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135066.391475:0:14224:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829800/0xd6c4b8f05867fa42 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14224 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783135066.391582:0:14224:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 6656 00000004:00200000:2.0:1783135066.391587:0:14224:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:2.0:1783135066.392768:0:14224:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829800/0xd6c4b8f05867fa42 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135066.392788:0:14224:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829400/0xd6c4b8f05867fa34 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135066.392806:0:14224:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829400/0xd6c4b8f05867fa34 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135066.392830:0:14224:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829400/0xd6c4b8f05867fa34 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135066.392837:0:14224:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe9c7829400 already unused, calling callback (ffffffffc1f634f0) 00010000:00010000:2.0:1783135066.392843:0:14224:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829400/0xd6c4b8f05867fa34 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135066.392852:0:14224:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829400/0xd6c4b8f05867fa34 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135066.392879:0:14224:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fe9e1c2b500) 00010000:00010000:2.0:1783135066.392882:0:14224:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783135066.392887:0:14224:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829400/0xd6c4b8f05867fa34 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135066.392894:0:14224:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829400/0xd6c4b8f05867fa34 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135066.392911:0:14224:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828400/0xd6c4b8f05867fa3b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135066.392918:0:14224:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828400/0xd6c4b8f05867fa3b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135066.392924:0:14224:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828400/0xd6c4b8f05867fa3b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135066.392930:0:14224:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe9c7828400 already unused, calling callback (ffffffffc1f634f0) 00010000:00010000:2.0:1783135066.392939:0:14224:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828400/0xd6c4b8f05867fa3b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135066.392945:0:14224:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828400/0xd6c4b8f05867fa3b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135066.392953:0:14224:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff9fe9cc3c1600) 00010000:00010000:2.0:1783135066.392956:0:14224:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783135066.392959:0:14224:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828400/0xd6c4b8f05867fa3b lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135066.392964:0:14224:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828400/0xd6c4b8f05867fa3b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135066.393442:0:14224:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828600/0xd6c4b8f05867fa2d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb7640 expref: 8 pid: 14224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135066.393461:0:14224:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829800/0xd6c4b8f05867fa42 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb7640 expref: 7 pid: 14224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135066.393470:0:14224:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9fe9cc3c1f00) 00010000:00010000:2.0:1783135066.393472:0:14224:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1783135066.393475:0:14224:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fe9c7829800, rc 0) 00000100:00100000:2.0:1783135066.393583:0:14224:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe8c6dfe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2b138366-7a70-4ff2-909d-348210e4a0a2+7:14369:x1869752373981056:12345-192.168.201.41@tcp:101:lhsmtool_posix.0 Request processed in 3782us (4028us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135066.393608:0:14224:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 15 00000100:00100000:1.0:1783135066.398093:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:2.0:1783135066.398403:0:14223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373981312 00000100:00100000:2.0:1783135066.398417:0:14223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373981312 00000100:00100000:2.0:1783135066.398516:0:14223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 16 00000100:00100000:2.0:1783135066.398527:0:14223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fe95b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2b138366-7a70-4ff2-909d-348210e4a0a2+7:14369:x1869752373981312:12345-192.168.201.41@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1783135066.398568:0:14223:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783135066.398604:0:14223:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829c00/0xd6c4b8f05867fa49 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4428da03f5eb7647 expref: -99 pid: 14223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135066.398725:0:14223:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829000/0xd6c4b8f05867fa50 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135066.398742:0:14223:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829000/0xd6c4b8f05867fa50 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135066.398751:0:14223:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829000/0xd6c4b8f05867fa50 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135066.398783:0:14223:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c1523800/0xd6c4b8f05867fa57 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135066.398790:0:14223:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c1523800/0xd6c4b8f05867fa57 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135066.398794:0:14223:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c1523800/0xd6c4b8f05867fa57 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135066.399409:0:14223:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c1523c00/0xd6c4b8f05867fa5e lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135066.399418:0:14223:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c1523c00/0xd6c4b8f05867fa5e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135066.399426:0:14223:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c1523c00/0xd6c4b8f05867fa5e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783135066.399437:0:14223:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 6656 00010000:00010000:2.0:1783135066.399658:0:14223:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829000/0xd6c4b8f05867fa50 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135066.399665:0:14223:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829000/0xd6c4b8f05867fa50 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135066.399669:0:14223:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829000/0xd6c4b8f05867fa50 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135066.399673:0:14223:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe9c7829000 already unused, calling callback (ffffffffc1f634f0) 00010000:00010000:2.0:1783135066.399677:0:14223:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829000/0xd6c4b8f05867fa50 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135066.399683:0:14223:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829000/0xd6c4b8f05867fa50 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135066.399694:0:14223:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9fe9cc3c1f00) 00010000:00010000:2.0:1783135066.399696:0:14223:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783135066.399699:0:14223:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829000/0xd6c4b8f05867fa50 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135066.399703:0:14223:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829000/0xd6c4b8f05867fa50 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135066.399712:0:14223:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c1523800/0xd6c4b8f05867fa57 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135066.399716:0:14223:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c1523800/0xd6c4b8f05867fa57 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135066.399720:0:14223:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c1523800/0xd6c4b8f05867fa57 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135066.399730:0:14223:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe9c1523800 already unused, calling callback (ffffffffc1f634f0) 00010000:00010000:2.0:1783135066.399733:0:14223:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c1523800/0xd6c4b8f05867fa57 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135066.399737:0:14223:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c1523800/0xd6c4b8f05867fa57 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135066.399741:0:14223:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff9fe9cc3c1100) 00010000:00010000:2.0:1783135066.399742:0:14223:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783135066.399744:0:14223:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c1523800/0xd6c4b8f05867fa57 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135066.399747:0:14223:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c1523800/0xd6c4b8f05867fa57 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135066.400072:0:14223:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829c00/0xd6c4b8f05867fa49 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb7647 expref: 10 pid: 14223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135066.400084:0:14223:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c1523c00/0xd6c4b8f05867fa5e lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb7647 expref: 9 pid: 14223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135066.400090:0:14223:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9fe9cc3c1800) 00010000:00010000:2.0:1783135066.400091:0:14223:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783135066.400093:0:14223:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fe9c1523c00, rc 0) 00000100:00100000:2.0:1783135066.400175:0:14223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fe95b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2b138366-7a70-4ff2-909d-348210e4a0a2+9:14369:x1869752373981312:12345-192.168.201.41@tcp:101:lhsmtool_posix.0 Request processed in 1649us (2095us total) trans 8589934593 rc 0/0 00000100:00100000:2.0:1783135066.400184:0:14223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 16 00000100:00100000:1.0:1783135066.406176:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:2.0:1783135066.406223:0:14224:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373981440 00000100:00100000:2.0:1783135066.406254:0:14224:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373981440 00000100:00100000:2.0:1783135066.406327:0:14224:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 17 00000100:00100000:2.0:1783135066.406338:0:14224:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fe959880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2b138366-7a70-4ff2-909d-348210e4a0a2+9:14369:x1869752373981440:12345-192.168.201.41@tcp:59:lhsmtool_posix.0 00000100:00100000:2.0:1783135066.406448:0:14224:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fe959880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2b138366-7a70-4ff2-909d-348210e4a0a2+9:14369:x1869752373981440:12345-192.168.201.41@tcp:59:lhsmtool_posix.0 Request processed in 111us (282us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135066.406455:0:14224:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 17 00000100:00100000:1.0:1783135066.433452:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:2.0:1783135066.433727:0:14223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373981568 00000100:00100000:2.0:1783135066.433739:0:14223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373981568 00000100:00100000:2.0:1783135066.433810:0:14223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 18 00000100:00100000:2.0:1783135066.433821:0:14223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fe95a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2b138366-7a70-4ff2-909d-348210e4a0a2+9:14376:x1869752373981568:12345-192.168.201.41@tcp:101:lfs.0 00010000:00010000:2.0:1783135066.433849:0:14223:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783135066.433875:0:14223:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c1523800/0xd6c4b8f05867fa6c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4428da03f5eb764e expref: -99 pid: 14223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135066.433969:0:14223:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c1522400/0xd6c4b8f05867fa73 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135066.433987:0:14223:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c1522400/0xd6c4b8f05867fa73 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135066.433999:0:14223:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c1522400/0xd6c4b8f05867fa73 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135066.434056:0:14223:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c1523200/0xd6c4b8f05867fa7a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135066.434065:0:14223:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c1523200/0xd6c4b8f05867fa7a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135066.434073:0:14223:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c1523200/0xd6c4b8f05867fa7a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135066.435846:0:14223:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c1522400/0xd6c4b8f05867fa73 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135066.435865:0:14223:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c1522400/0xd6c4b8f05867fa73 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135066.435872:0:14223:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c1522400/0xd6c4b8f05867fa73 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135066.435878:0:14223:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe9c1522400 already unused, calling callback (ffffffffc1f634f0) 00010000:00010000:2.0:1783135066.435882:0:14223:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c1522400/0xd6c4b8f05867fa73 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135066.435890:0:14223:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c1522400/0xd6c4b8f05867fa73 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135066.435908:0:14223:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fe9e1c2b500) 00010000:00010000:2.0:1783135066.435911:0:14223:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783135066.435916:0:14223:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c1522400/0xd6c4b8f05867fa73 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135066.435923:0:14223:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c1522400/0xd6c4b8f05867fa73 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135066.435938:0:14223:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c1523200/0xd6c4b8f05867fa7a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135066.435944:0:14223:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c1523200/0xd6c4b8f05867fa7a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135066.435949:0:14223:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c1523200/0xd6c4b8f05867fa7a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135066.435963:0:14223:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe9c1523200 already unused, calling callback (ffffffffc1f634f0) 00010000:00010000:2.0:1783135066.435967:0:14223:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c1523200/0xd6c4b8f05867fa7a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135066.435973:0:14223:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c1523200/0xd6c4b8f05867fa7a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135066.435981:0:14223:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9fe9cc3c1100) 00010000:00010000:2.0:1783135066.435984:0:14223:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783135066.435987:0:14223:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c1523200/0xd6c4b8f05867fa7a lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135066.435993:0:14223:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c1523200/0xd6c4b8f05867fa7a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135066.436037:0:14223:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c1523800/0xd6c4b8f05867fa6c lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb764e expref: 10 pid: 14223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135066.436060:0:14223:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fe9e1c2b500) 00010000:00010000:2.0:1783135066.436062:0:14223:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783135066.436066:0:14223:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c1523800/0xd6c4b8f05867fa6c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb764e expref: 10 pid: 14223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135066.436076:0:14223:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fe9c1523800, rc 0) 00000100:00100000:2.0:1783135066.436252:0:14223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fe95a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2b138366-7a70-4ff2-909d-348210e4a0a2+9:14376:x1869752373981568:12345-192.168.201.41@tcp:101:lfs.0 Request processed in 2431us (2812us total) trans 0 rc 301/301 00000100:00100000:2.0:1783135066.436262:0:14223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 18 00000100:00100000:1.0:1783135066.441408:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:3.0:1783135066.441626:0:14231:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373981696 00000100:00100000:3.0:1783135066.441640:0:14231:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373981696 00000100:00100000:3.0:1783135066.441711:0:14231:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 0 00000100:00100000:3.0:1783135066.441724:0:14231:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fe95a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:2b138366-7a70-4ff2-909d-348210e4a0a2+9:14376:x1869752373981696:12345-192.168.201.41@tcp:700:lfs.0 00000100:00100000:3.0:1783135066.441869:0:14231:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fe95a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:2b138366-7a70-4ff2-909d-348210e4a0a2+9:14376:x1869752373981696:12345-192.168.201.41@tcp:700:lfs.0 Request processed in 147us (534us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135066.441907:0:14231:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 0 00000100:00100000:1.0:1783135066.443948:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:2.0:1783135066.447343:0:14224:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373981952 00000100:00100000:2.0:1783135066.447393:0:14224:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373981952 00000100:00100000:2.0:1783135066.447469:0:14224:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 19 00000100:00100000:2.0:1783135066.447478:0:14224:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fe958a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2b138366-7a70-4ff2-909d-348210e4a0a2+9:14376:x1869752373981952:12345-192.168.201.41@tcp:36:lfs.0 00010000:00010000:2.0:1783135066.447545:0:14224:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783135066.447581:0:14224:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe8c5551e00/0xd6c4b8f05867f8eb lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb75c9 expref: 9 pid: 14223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135066.447607:0:14224:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fe9e1c2b500) 00010000:00010000:2.0:1783135066.447658:0:14224:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1783135066.447941:0:14224:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c1523800/0xd6c4b8f05867fa81 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135066.447956:0:14224:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829e00/0xd6c4b8f05867f9e7 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb762b expref: 5 pid: 14223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135066.447963:0:14224:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c1523800/0xd6c4b8f05867fa81 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135066.448004:0:14224:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829e00/0xd6c4b8f05867f9e7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb762b expref: 5 pid: 14223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135066.448018:0:14224:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829e00/0xd6c4b8f05867f9e7 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb762b expref: 5 pid: 14223 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783135066.448030:0:14224:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9fe82b800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14224:1869752384444416:192.168.201.41@tcp:104: 00000100:00100000:2.0:1783135066.448189:0:14224:0:(client.c:2701:ptlrpc_set_wait()) set ffff9fe9f426cd80 going to sleep for 11 seconds 00000100:00100000:1.0:1783135066.451807:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:0.0:1783135066.451934:0:14209:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373982080 00000100:00100000:0.0:1783135066.451951:0:14209:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373982080 00010000:00010000:0.0:1783135066.452038:0:14209:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829e00/0xd6c4b8f05867f9e7 lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb762b expref: 6 pid: 14223 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783135066.452106:0:14209:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 9 00000100:00100000:0.0:1783135066.452119:0:14209:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fe95aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:aa2f4fd1-78f9-41b4-ba50-d28d753ff635+6:2370:x1869752373982080:12345-192.168.201.41@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783135066.452141:0:14209:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783135066.452150:0:14209:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829e00/0xd6c4b8f05867f9e7 lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb762b expref: 6 pid: 14223 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135066.452167:0:14209:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829e00/0xd6c4b8f05867f9e7 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb762b expref: 6 pid: 14223 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135066.452207:0:14209:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fe9e1c2b500) 00010000:00010000:0.0:1783135066.452215:0:14209:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c1523800/0xd6c4b8f05867fa81 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135066.452231:0:14209:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c1523800/0xd6c4b8f05867fa81 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 14224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135066.452241:0:14209:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c1523800/0xd6c4b8f05867fa81 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 14224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135066.452270:0:14209:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783135066.452358:0:14209:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fe95aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:aa2f4fd1-78f9-41b4-ba50-d28d753ff635+6:2370:x1869752373982080:12345-192.168.201.41@tcp:103:ldlm_bl.0 Request processed in 242us (568us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135066.452367:0:14209:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 9 00010000:00010000:2.0:1783135066.453090:0:14224:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829e00/0xd6c4b8f05867f9e7 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb762b expref: 5 pid: 14223 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783135066.453138:0:14224:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9fe82b800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14224:1869752384444416:192.168.201.41@tcp:104: 00010000:00010000:2.0:1783135066.453174:0:14224:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c1523800/0xd6c4b8f05867fa81 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135066.453187:0:14224:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c1523800/0xd6c4b8f05867fa81 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135066.453193:0:14224:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c1523800/0xd6c4b8f05867fa81 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135066.453230:0:14224:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c1523200/0xd6c4b8f05867fa88 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135066.453241:0:14224:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c1523200/0xd6c4b8f05867fa88 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135066.453250:0:14224:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c1523200/0xd6c4b8f05867fa88 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14224 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783135066.455809:0:14224:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:2.0:1783135066.455840:0:14224:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c1523800/0xd6c4b8f05867fa81 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135066.455852:0:14224:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c1523800/0xd6c4b8f05867fa81 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135066.455861:0:14224:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c1523800/0xd6c4b8f05867fa81 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135066.455868:0:14224:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe9c1523800 already unused, calling callback (ffffffffc1f634f0) 00010000:00010000:2.0:1783135066.455882:0:14224:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c1523800/0xd6c4b8f05867fa81 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135066.455890:0:14224:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c1523800/0xd6c4b8f05867fa81 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135066.455910:0:14224:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fe9e1c2b500) 00010000:00010000:2.0:1783135066.455914:0:14224:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783135066.456189:0:14224:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c1523800/0xd6c4b8f05867fa81 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135066.456197:0:14224:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c1523800/0xd6c4b8f05867fa81 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14224 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1783135066.456229:0:14224:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000002b1fccc0 reply state 00000000fa994007 transno 8589934594 ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c1523200/0xd6c4b8f05867fa88 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14224 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783135066.456240:0:14224:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1783135066.456541:0:14224:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fe958a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2b138366-7a70-4ff2-909d-348210e4a0a2+10:14376:x1869752373981952:12345-192.168.201.41@tcp:36:lfs.0 Request processed in 9054us (12595us total) trans 8589934594 rc 0/0 00000100:00100000:2.0:1783135066.456554:0:14224:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 19 00010000:00010000:0.0:1783135066.460093:0:3273:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c1523200/0xd6c4b8f05867fa88 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135066.460136:0:3273:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c1523200/0xd6c4b8f05867fa88 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135066.460142:0:3273:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c1523200/0xd6c4b8f05867fa88 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135066.460146:0:3273:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe9c1523200 already unused, calling callback (ffffffffc1f634f0) 00010000:00010000:0.0:1783135066.460150:0:3273:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c1523200/0xd6c4b8f05867fa88 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135066.460157:0:3273:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c1523200/0xd6c4b8f05867fa88 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135066.460179:0:3273:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9fe9cc3c1100) 00010000:00010000:0.0:1783135066.460181:0:3273:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783135066.460186:0:3273:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c1523200/0xd6c4b8f05867fa88 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135066.460189:0:3273:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c1523200/0xd6c4b8f05867fa88 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14224 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783135066.492378:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:2.0:1783135066.492483:0:14223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373982208 00000100:00100000:2.0:1783135066.492499:0:14223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373982208 00000100:00100000:2.0:1783135066.492571:0:14223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 20 00000100:00100000:2.0:1783135066.492580:0:14223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fe90ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2b138366-7a70-4ff2-909d-348210e4a0a2+9:14384:x1869752373982208:12345-192.168.201.41@tcp:101:lctl.0 00010000:00010000:2.0:1783135066.492599:0:14223:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783135066.492626:0:14223:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c1523800/0xd6c4b8f05867fa8f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4428da03f5eb7655 expref: -99 pid: 14223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135066.492685:0:14223:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c1522400/0xd6c4b8f05867fa96 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135066.492709:0:14223:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c1522400/0xd6c4b8f05867fa96 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135066.492717:0:14223:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c1522400/0xd6c4b8f05867fa96 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783135066.492767:0:14223:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:2.0:1783135066.492770:0:14223:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 4 stripe count 1 MDT count 1 00000004:00010000:2.0:1783135066.492802:0:14223:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c1522400/0xd6c4b8f05867fa96 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135066.492822:0:14223:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c1523800/0xd6c4b8f05867fa8f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb7655 expref: 11 pid: 14223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135066.492836:0:14223:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c1522400/0xd6c4b8f05867fa96 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb7655 expref: 10 pid: 14223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135066.492843:0:14223:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fe9cc3c1600) 00010000:00010000:2.0:1783135066.492846:0:14223:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1783135066.492848:0:14223:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fe9c1522400, rc 0) 00000100:00100000:2.0:1783135066.492908:0:14223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fe90ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2b138366-7a70-4ff2-909d-348210e4a0a2+10:14384:x1869752373982208:12345-192.168.201.41@tcp:101:lctl.0 Request processed in 330us (547us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135066.492913:0:14223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 20 00000100:00100000:1.0:1783135066.510511:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:2.0:1783135066.510630:0:14224:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373982336 00000100:00100000:2.0:1783135066.510644:0:14224:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373982336 00000100:00100000:2.0:1783135066.510727:0:14224:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 21 00000100:00100000:2.0:1783135066.510736:0:14224:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fe958e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aa2f4fd1-78f9-41b4-ba50-d28d753ff635+5:14385:x1869752373982336:12345-192.168.201.41@tcp:101:lfs.0 00010000:00010000:2.0:1783135066.510761:0:14224:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783135066.510804:0:14224:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c1523800/0xd6c4b8f05867fa9d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4428da03f5eb765c expref: -99 pid: 14224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135066.510884:0:14224:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c1522c00/0xd6c4b8f05867faa4 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135066.510898:0:14224:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c1522c00/0xd6c4b8f05867faa4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135066.510908:0:14224:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c1522c00/0xd6c4b8f05867faa4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14224 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783135066.510983:0:14224:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:2.0:1783135066.510986:0:14224:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 4 stripe count 1 MDT count 1 00000004:00010000:2.0:1783135066.511013:0:14224:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c1522c00/0xd6c4b8f05867faa4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135066.511061:0:14224:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c1523800/0xd6c4b8f05867fa9d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb765c expref: 7 pid: 14224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135066.511086:0:14224:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c1522c00/0xd6c4b8f05867faa4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb765c expref: 6 pid: 14224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135066.511096:0:14224:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fe9cc3c1600) 00010000:00010000:2.0:1783135066.511099:0:14224:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1783135066.511104:0:14224:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fe9c1522c00, rc 0) 00000100:00100000:2.0:1783135066.511189:0:14224:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fe958e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aa2f4fd1-78f9-41b4-ba50-d28d753ff635+6:14385:x1869752373982336:12345-192.168.201.41@tcp:101:lfs.0 Request processed in 452us (691us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135066.511197:0:14224:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 21 00000100:00100000:0.0:1783135066.513795:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:1.0:1783135066.513915:0:14222:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373982464 00000100:00100000:1.0:1783135066.513928:0:14222:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373982464 00000100:00100000:1.0:1783135066.514030:0:14222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 22 00000100:00100000:1.0:1783135066.514069:0:14222:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe8c6dfd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa2f4fd1-78f9-41b4-ba50-d28d753ff635+6:14385:x1869752373982464:12345-192.168.201.41@tcp:101:lfs.0 00010000:00010000:1.0:1783135066.514097:0:14222:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783135066.514126:0:14222:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe8c5551200/0xd6c4b8f05867faab lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4428da03f5eb7663 expref: -99 pid: 14222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135066.514208:0:14222:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe8c5551e00/0xd6c4b8f05867fab2 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135066.514224:0:14222:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fe8c5551e00/0xd6c4b8f05867fab2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135066.514237:0:14222:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe8c5551e00/0xd6c4b8f05867fab2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135066.514255:0:14222:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe8c5551800/0xd6c4b8f05867fab9 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135066.514263:0:14222:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fe8c5551800/0xd6c4b8f05867fab9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135066.514269:0:14222:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe8c5551800/0xd6c4b8f05867fab9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135066.514719:0:14222:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe8c5550e00/0xd6c4b8f05867fac0 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135066.514766:0:14222:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fe8c5550e00/0xd6c4b8f05867fac0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135066.514780:0:14222:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe8c5550e00/0xd6c4b8f05867fac0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14222 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783135066.514872:0:14222:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00000004:00200000:1.0:1783135066.514876:0:14222:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1783135066.514901:0:14222:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fe8c5550e00/0xd6c4b8f05867fac0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135066.514913:0:14222:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe8c5551e00/0xd6c4b8f05867fab2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135066.514917:0:14222:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fe8c5551e00/0xd6c4b8f05867fab2 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135066.514922:0:14222:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fe8c5551e00/0xd6c4b8f05867fab2 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135066.514926:0:14222:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe8c5551e00 already unused, calling callback (ffffffffc1f634f0) 00010000:00010000:1.0:1783135066.514928:0:14222:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe8c5551e00/0xd6c4b8f05867fab2 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135066.514934:0:14222:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe8c5551e00/0xd6c4b8f05867fab2 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135066.514944:0:14222:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fe9cc3c1600) 00010000:00010000:1.0:1783135066.514946:0:14222:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783135066.514950:0:14222:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fe8c5551e00/0xd6c4b8f05867fab2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135066.514961:0:14222:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe8c5551e00/0xd6c4b8f05867fab2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135066.514978:0:14222:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe8c5551800/0xd6c4b8f05867fab9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135066.514981:0:14222:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fe8c5551800/0xd6c4b8f05867fab9 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135066.514985:0:14222:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fe8c5551800/0xd6c4b8f05867fab9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135066.514988:0:14222:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe8c5551800 already unused, calling callback (ffffffffc1f634f0) 00010000:00010000:1.0:1783135066.514990:0:14222:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe8c5551800/0xd6c4b8f05867fab9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135066.514993:0:14222:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe8c5551800/0xd6c4b8f05867fab9 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135066.514997:0:14222:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9fe9e1c2bc00) 00010000:00010000:1.0:1783135066.514998:0:14222:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783135066.515000:0:14222:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fe8c5551800/0xd6c4b8f05867fab9 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135066.515003:0:14222:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe8c5551800/0xd6c4b8f05867fab9 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135066.515036:0:14222:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe8c5551200/0xd6c4b8f05867faab lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb7663 expref: 8 pid: 14222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135066.515075:0:14222:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe8c5550e00/0xd6c4b8f05867fac0 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb7663 expref: 7 pid: 14222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135066.515080:0:14222:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9fe9e1c2b600) 00010000:00010000:1.0:1783135066.515082:0:14222:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1783135066.515083:0:14222:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fe8c5550e00, rc 0) 00000100:00100000:1.0:1783135066.515203:0:14222:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe8c6dfd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa2f4fd1-78f9-41b4-ba50-d28d753ff635+7:14385:x1869752373982464:12345-192.168.201.41@tcp:101:lfs.0 Request processed in 1142us (1417us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135066.515211:0:14222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 22 00000100:00100000:3.0:1783135066.519446:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:0.0:1783135066.519717:0:14223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373982720 00000100:00100000:0.0:1783135066.519730:0:14223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373982720 00000100:00100000:0.0:1783135066.519819:0:14223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 23 00000100:00100000:0.0:1783135066.519832:0:14223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fe90d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa2f4fd1-78f9-41b4-ba50-d28d753ff635+7:14385:x1869752373982720:12345-192.168.201.41@tcp:101:lfs.0 00010000:00010000:0.0:1783135066.519860:0:14223:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783135066.519888:0:14223:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ad400/0xd6c4b8f05867fac7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4428da03f5eb766a expref: -99 pid: 14223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783135066.520109:0:14223:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:0.0:1783135066.520330:0:14223:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ad400/0xd6c4b8f05867fac7 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb766a expref: 9 pid: 14223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135066.520417:0:14223:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fe9cc3c1600) 00010000:00010000:0.0:1783135066.520420:0:14223:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1783135066.520427:0:14223:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ad400/0xd6c4b8f05867fac7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb766a expref: 9 pid: 14223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135066.520444:0:14223:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fe9f68ad400, rc 0) 00000100:00100000:0.0:1783135066.520530:0:14223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fe90d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aa2f4fd1-78f9-41b4-ba50-d28d753ff635+8:14385:x1869752373982720:12345-192.168.201.41@tcp:101:lfs.0 Request processed in 701us (1105us total) trans 8589934595 rc 301/301 00000100:00100000:0.0:1783135066.520539:0:14223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 23 00000100:00100000:0.0:1783135066.523999:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:1.0:1783135066.524119:0:14222:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373982976 00000100:00100000:1.0:1783135066.524142:0:14222:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373982976 00000100:00100000:1.0:1783135066.524251:0:14222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 24 00000100:00100000:1.0:1783135066.524268:0:14222:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe8c6dfca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa2f4fd1-78f9-41b4-ba50-d28d753ff635+8:14385:x1869752373982976:12345-192.168.201.41@tcp:36:lfs.0 00010000:00010000:1.0:1783135066.524383:0:14222:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783135066.524426:0:14222:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe8c5550e00/0xd6c4b8f05867fac0 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb7663 expref: 8 pid: 14222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135066.524448:0:14222:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9fe9e1c2b600) 00010000:00010000:1.0:1783135066.524461:0:14222:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1783135066.524487:0:14222:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe8c5551200/0xd6c4b8f05867fad5 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135066.524501:0:14222:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fe8c5551200/0xd6c4b8f05867fad5 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135066.524512:0:14222:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe8c5551200/0xd6c4b8f05867fad5 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14222 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1783135066.524805:0:14222:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000ba55a83d reply state 00000000380cf06c transno 8589934596 ns: mdt-lustre-MDT0000_UUID lock: ffff9fe8c5551200/0xd6c4b8f05867fad5 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14222 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783135066.524817:0:14222:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1783135066.524833:0:14222:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00000100:00100000:1.0:1783135066.525999:0:14222:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe8c6dfca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa2f4fd1-78f9-41b4-ba50-d28d753ff635+9:14385:x1869752373982976:12345-192.168.201.41@tcp:36:lfs.0 Request processed in 1728us (2017us total) trans 8589934596 rc 0/0 00000100:00100000:1.0:1783135066.526015:0:14222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 24 00010000:00010000:1.0:1783135066.531185:0:3272:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe8c5551200/0xd6c4b8f05867fad5 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135066.531209:0:3272:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fe8c5551200/0xd6c4b8f05867fad5 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135066.531218:0:3272:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fe8c5551200/0xd6c4b8f05867fad5 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135066.531226:0:3272:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe8c5551200 already unused, calling callback (ffffffffc1f634f0) 00010000:00010000:1.0:1783135066.531232:0:3272:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe8c5551200/0xd6c4b8f05867fad5 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135066.531240:0:3272:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe8c5551200/0xd6c4b8f05867fad5 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135066.531267:0:3272:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9fe9e1c2bc00) 00010000:00010000:1.0:1783135066.531270:0:3272:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:1.0:1783135066.531276:0:3272:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fe8c5551200/0xd6c4b8f05867fad5 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135066.531309:0:3272:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe8c5551200/0xd6c4b8f05867fad5 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14222 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783135066.532273:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:3.0:1783135066.532611:0:16002:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373983232 00000100:00100000:3.0:1783135066.532628:0:16002:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373983232 00000100:00100000:3.0:1783135066.532722:0:16002:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 2 00000100:00100000:3.0:1783135066.532736:0:16002:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe8c6dfc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:aa2f4fd1-78f9-41b4-ba50-d28d753ff635+8:14385:x1869752373983232:12345-192.168.201.41@tcp:35:lfs.0 00000100:00100000:3.0:1783135066.533183:0:16002:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe8c6dfc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:aa2f4fd1-78f9-41b4-ba50-d28d753ff635+9:14385:x1869752373983232:12345-192.168.201.41@tcp:35:lfs.0 Request processed in 448us (925us total) trans 8589934597 rc 0/0 00000100:00100000:3.0:1783135066.533193:0:16002:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 2 00000100:00100000:3.0:1783135066.536744:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:2.0:1783135066.536875:0:14224:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373983488 00000100:00100000:2.0:1783135066.536910:0:14224:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373983488 00000100:00100000:2.0:1783135066.536987:0:14224:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 25 00000100:00100000:2.0:1783135066.536998:0:14224:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fe90d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aa2f4fd1-78f9-41b4-ba50-d28d753ff635+9:14385:x1869752373983488:12345-192.168.201.41@tcp:101:lfs.0 00010000:00010000:2.0:1783135066.537036:0:14224:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783135066.537085:0:14224:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c1523800/0xd6c4b8f05867fadc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4428da03f5eb7671 expref: -99 pid: 14224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135066.537196:0:14224:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c1522000/0xd6c4b8f05867fae3 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135066.537215:0:14224:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c1522000/0xd6c4b8f05867fae3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135066.537229:0:14224:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c1522000/0xd6c4b8f05867fae3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135066.537246:0:14224:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c1523000/0xd6c4b8f05867faea lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135066.537253:0:14224:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c1523000/0xd6c4b8f05867faea lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135066.537259:0:14224:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c1523000/0xd6c4b8f05867faea lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14224 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783135066.537488:0:14224:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:2.0:1783135066.537619:0:14224:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c1522000/0xd6c4b8f05867fae3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135066.537628:0:14224:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c1522000/0xd6c4b8f05867fae3 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135066.537649:0:14224:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c1522000/0xd6c4b8f05867fae3 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135066.537656:0:14224:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe9c1522000 already unused, calling callback (ffffffffc1f634f0) 00010000:00010000:2.0:1783135066.537661:0:14224:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c1522000/0xd6c4b8f05867fae3 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135066.537670:0:14224:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c1522000/0xd6c4b8f05867fae3 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135066.537687:0:14224:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fe9cc3c1600) 00010000:00010000:2.0:1783135066.537690:0:14224:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783135066.537696:0:14224:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c1522000/0xd6c4b8f05867fae3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135066.537703:0:14224:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c1522000/0xd6c4b8f05867fae3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135066.537723:0:14224:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c1523000/0xd6c4b8f05867faea lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135066.537729:0:14224:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c1523000/0xd6c4b8f05867faea lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135066.537735:0:14224:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c1523000/0xd6c4b8f05867faea lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135066.537740:0:14224:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe9c1523000 already unused, calling callback (ffffffffc1f634f0) 00010000:00010000:2.0:1783135066.537744:0:14224:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c1523000/0xd6c4b8f05867faea lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135066.537761:0:14224:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c1523000/0xd6c4b8f05867faea lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135066.537770:0:14224:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9fe9cc3c1200) 00010000:00010000:2.0:1783135066.537772:0:14224:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783135066.537775:0:14224:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c1523000/0xd6c4b8f05867faea lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135066.537780:0:14224:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c1523000/0xd6c4b8f05867faea lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135066.537832:0:14224:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c1523800/0xd6c4b8f05867fadc lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb7671 expref: 11 pid: 14224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135066.537844:0:14224:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fe9cc3c1600) 00010000:00010000:2.0:1783135066.537847:0:14224:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1783135066.537850:0:14224:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c1523800/0xd6c4b8f05867fadc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb7671 expref: 11 pid: 14224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135066.537861:0:14224:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fe9c1523800, rc 0) 00000100:00100000:2.0:1783135066.537960:0:14224:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fe90d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aa2f4fd1-78f9-41b4-ba50-d28d753ff635+10:14385:x1869752373983488:12345-192.168.201.41@tcp:101:lfs.0 Request processed in 962us (1230us total) trans 8589934598 rc 301/301 00000100:00100000:2.0:1783135066.537969:0:14224:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 25 00000100:00100000:1.0:1783135066.540816:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:0.0:1783135066.540895:0:14222:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373983616 00000100:00100000:0.0:1783135066.540905:0:14222:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373983616 00000100:00100000:0.0:1783135066.540961:0:14222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 26 00000100:00100000:0.0:1783135066.540969:0:14222:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fe959500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa2f4fd1-78f9-41b4-ba50-d28d753ff635+10:14385:x1869752373983616:12345-192.168.201.41@tcp:101:lfs.0 00010000:00010000:0.0:1783135066.540993:0:14222:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783135066.541016:0:14222:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ad400/0xd6c4b8f05867faf8 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4428da03f5eb7678 expref: -99 pid: 14222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135066.541139:0:14222:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ada00/0xd6c4b8f05867faff lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135066.541177:0:14222:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ada00/0xd6c4b8f05867faff lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135066.541191:0:14222:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ada00/0xd6c4b8f05867faff lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14222 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783135066.541245:0:14222:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00000004:00200000:0.0:1783135066.541248:0:14222:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1783135066.541265:0:14222:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ada00/0xd6c4b8f05867faff lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135066.541323:0:14222:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ad400/0xd6c4b8f05867faf8 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb7678 expref: 12 pid: 14222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135066.541345:0:14222:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ada00/0xd6c4b8f05867faff lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb7678 expref: 11 pid: 14222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135066.541352:0:14222:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9fe9c8301a00) 00010000:00010000:0.0:1783135066.541355:0:14222:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1783135066.541358:0:14222:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fe9f68ada00, rc 0) 00000100:00100000:0.0:1783135066.541417:0:14222:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fe959500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa2f4fd1-78f9-41b4-ba50-d28d753ff635+11:14385:x1869752373983616:12345-192.168.201.41@tcp:101:lfs.0 Request processed in 450us (613us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135066.541421:0:14222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 26 00000100:00100000:1.0:1783135066.545905:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:3.0:1783135066.546008:0:14225:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373983744 00000100:00100000:3.0:1783135066.546019:0:14225:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373983744 00000100:00100000:3.0:1783135066.546103:0:14225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 3 00000100:00100000:3.0:1783135066.546113:0:14225:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fe959f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aa2f4fd1-78f9-41b4-ba50-d28d753ff635+11:14385:x1869752373983744:12345-192.168.201.41@tcp:37:lfs.0 00000100:00100000:0.0:1783135066.550757:0:14225:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fe959f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aa2f4fd1-78f9-41b4-ba50-d28d753ff635+11:14385:x1869752373983744:12345-192.168.201.41@tcp:37:lfs.0 Request processed in 4628us (4846us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135066.550775:0:14225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 3 00000100:00100000:1.0:1783135066.555555:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:2.0:1783135066.555642:0:14226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373984000 00000100:00100000:2.0:1783135066.555655:0:14226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373984000 00000100:00100000:2.0:1783135066.555727:0:14226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 4 00000100:00100000:2.0:1783135066.555738:0:14226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9ff67a050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:aa2f4fd1-78f9-41b4-ba50-d28d753ff635+11:14385:x1869752373984000:12345-192.168.201.41@tcp:35:lfs.0 00000100:00100000:2.0:1783135066.556316:0:14226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9ff67a050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:aa2f4fd1-78f9-41b4-ba50-d28d753ff635+12:14385:x1869752373984000:12345-192.168.201.41@tcp:35:lfs.0 Request processed in 577us (773us total) trans 8589934599 rc 0/0 00000100:00100000:2.0:1783135066.556326:0:14226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 4 00000100:00100000:1.0:1783135066.598815:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:0.0:1783135066.598948:0:14223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373984128 00000100:00100000:0.0:1783135066.598961:0:14223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373984128 00000100:00100000:0.0:1783135066.599357:0:14223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 27 00000100:00100000:0.0:1783135066.599373:0:14223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fe959f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2b138366-7a70-4ff2-909d-348210e4a0a2+10:14391:x1869752373984128:12345-192.168.201.41@tcp:101:bash.0 00010000:00010000:0.0:1783135066.599405:0:14223:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783135066.599433:0:14223:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ad400/0xd6c4b8f05867fb06 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4428da03f5eb767f expref: -99 pid: 14223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135066.599654:0:14223:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ac200/0xd6c4b8f05867fb0d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135066.599675:0:14223:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ac200/0xd6c4b8f05867fb0d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135066.599690:0:14223:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ac200/0xd6c4b8f05867fb0d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135066.599710:0:14223:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ade00/0xd6c4b8f05867fb14 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135066.599716:0:14223:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ade00/0xd6c4b8f05867fb14 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135066.599723:0:14223:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ade00/0xd6c4b8f05867fb14 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135066.599863:0:14223:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ad800/0xd6c4b8f05867fb1b lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135066.599872:0:14223:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ad800/0xd6c4b8f05867fb1b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135066.599879:0:14223:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ad800/0xd6c4b8f05867fb1b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783135066.599936:0:14223:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00000004:00200000:0.0:1783135066.599940:0:14223:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1783135066.599991:0:14223:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ad800/0xd6c4b8f05867fb1b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135066.600006:0:14223:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ac200/0xd6c4b8f05867fb0d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135066.600013:0:14223:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ac200/0xd6c4b8f05867fb0d lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135066.600020:0:14223:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ac200/0xd6c4b8f05867fb0d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135066.600026:0:14223:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe9f68ac200 already unused, calling callback (ffffffffc1f634f0) 00010000:00010000:0.0:1783135066.600031:0:14223:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ac200/0xd6c4b8f05867fb0d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135066.600365:0:14223:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ac200/0xd6c4b8f05867fb0d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135066.600382:0:14223:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fe9cc3c1600) 00010000:00010000:0.0:1783135066.600385:0:14223:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783135066.600391:0:14223:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ac200/0xd6c4b8f05867fb0d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135066.600397:0:14223:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ac200/0xd6c4b8f05867fb0d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135066.600412:0:14223:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ade00/0xd6c4b8f05867fb14 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135066.600429:0:14223:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ade00/0xd6c4b8f05867fb14 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135066.600436:0:14223:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ade00/0xd6c4b8f05867fb14 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135066.600441:0:14223:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe9f68ade00 already unused, calling callback (ffffffffc1f634f0) 00010000:00010000:0.0:1783135066.600444:0:14223:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ade00/0xd6c4b8f05867fb14 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135066.600451:0:14223:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ade00/0xd6c4b8f05867fb14 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135066.600459:0:14223:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9fe9c8301e00) 00010000:00010000:0.0:1783135066.600462:0:14223:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783135066.600465:0:14223:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ade00/0xd6c4b8f05867fb14 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135066.600471:0:14223:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ade00/0xd6c4b8f05867fb14 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135066.600517:0:14223:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ad400/0xd6c4b8f05867fb06 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb767f expref: 12 pid: 14223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135066.600533:0:14223:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ad800/0xd6c4b8f05867fb1b lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb767f expref: 11 pid: 14223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135066.600540:0:14223:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9fe9c8301a00) 00010000:00010000:0.0:1783135066.600543:0:14223:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1783135066.600551:0:14223:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fe9f68ad800, rc 0) 00000100:00100000:0.0:1783135066.600650:0:14223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fe959f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2b138366-7a70-4ff2-909d-348210e4a0a2+11:14391:x1869752373984128:12345-192.168.201.41@tcp:101:bash.0 Request processed in 1280us (1849us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135066.600659:0:14223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 27 00000100:00100000:3.0:1783135066.604269:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:2.0:1783135066.604624:0:14224:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373984384 00000100:00100000:2.0:1783135066.604637:0:14224:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373984384 00000100:00100000:2.0:1783135066.604720:0:14224:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 28 00000100:00100000:2.0:1783135066.604731:0:14224:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fe90e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2b138366-7a70-4ff2-909d-348210e4a0a2+11:14391:x1869752373984384:12345-192.168.201.41@tcp:101:bash.0 00010000:00010000:2.0:1783135066.604758:0:14224:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783135066.604785:0:14224:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c1523800/0xd6c4b8f05867fb22 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4428da03f5eb7686 expref: -99 pid: 14224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135066.604967:0:14224:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c1523000/0xd6c4b8f05867fb29 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135066.604984:0:14224:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ada00/0xd6c4b8f05867faff lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb7678 expref: 11 pid: 14222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135066.604995:0:14224:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c1523000/0xd6c4b8f05867fb29 lrc: 4/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135066.605052:0:14224:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ada00/0xd6c4b8f05867faff lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb7678 expref: 11 pid: 14222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135066.605076:0:14224:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ada00/0xd6c4b8f05867faff lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb7678 expref: 11 pid: 14222 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783135066.605093:0:14224:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9fe82b800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14224:1869752384444544:192.168.201.41@tcp:104: 00000100:00100000:2.0:1783135066.605254:0:14224:0:(client.c:2701:ptlrpc_set_wait()) set ffff9fe9e0136000 going to sleep for 11 seconds 00000100:00100000:2.0:1783135066.609121:0:14224:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9fe82b800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14224:1869752384444544:192.168.201.41@tcp:104: 00010000:00010000:2.0:1783135066.609162:0:14224:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c1523000/0xd6c4b8f05867fb29 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14224 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783135066.610711:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:1.0:1783135066.611033:0:14207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373984512 00000100:00100000:1.0:1783135066.611059:0:14207:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373984512 00010000:00010000:1.0:1783135066.611112:0:14207:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ada00/0xd6c4b8f05867faff lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb7678 expref: 12 pid: 14222 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783135066.611163:0:14207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 10 00000100:00100000:1.0:1783135066.611175:0:14207:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fe90f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:aa2f4fd1-78f9-41b4-ba50-d28d753ff635+12:2369:x1869752373984512:12345-192.168.201.41@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1783135066.611194:0:14207:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783135066.611201:0:14207:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ada00/0xd6c4b8f05867faff lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb7678 expref: 12 pid: 14222 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135066.611217:0:14207:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ada00/0xd6c4b8f05867faff lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb7678 expref: 12 pid: 14222 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135066.611245:0:14207:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ada00/0xd6c4b8f05867faff lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb7678 expref: 12 pid: 14222 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135066.611269:0:14207:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9fe9c8301a00) 00010000:00010000:1.0:1783135066.611275:0:14207:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c1523000/0xd6c4b8f05867fb29 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135066.611319:0:14207:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c1523000/0xd6c4b8f05867fb29 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135066.611358:0:14207:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c1523000/0xd6c4b8f05867fb29 lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135066.611384:0:14207:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783135066.611463:0:14207:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fe90f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:aa2f4fd1-78f9-41b4-ba50-d28d753ff635+11:2369:x1869752373984512:12345-192.168.201.41@tcp:103:ldlm_bl.0 Request processed in 289us (761us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135066.611473:0:14207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 10 00010000:00010000:2.0:1783135066.613250:0:14224:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c1523000/0xd6c4b8f05867fb29 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135066.613270:0:14224:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c1523000/0xd6c4b8f05867fb29 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135066.613348:0:14224:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c1522000/0xd6c4b8f05867fb30 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135066.613364:0:14224:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c1522000/0xd6c4b8f05867fb30 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135066.613377:0:14224:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c1522000/0xd6c4b8f05867fb30 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135066.614211:0:14224:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c1523e00/0xd6c4b8f05867fb37 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135066.614223:0:14224:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c1523e00/0xd6c4b8f05867fb37 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135066.614232:0:14224:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c1523e00/0xd6c4b8f05867fb37 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14224 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783135066.614245:0:14224:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1783135066.614307:0:14224:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c1523000/0xd6c4b8f05867fb29 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135066.614327:0:14224:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c1523000/0xd6c4b8f05867fb29 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135066.614334:0:14224:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c1523000/0xd6c4b8f05867fb29 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135066.614342:0:14224:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe9c1523000 already unused, calling callback (ffffffffc1f634f0) 00010000:00010000:2.0:1783135066.614347:0:14224:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c1523000/0xd6c4b8f05867fb29 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135066.614355:0:14224:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c1523000/0xd6c4b8f05867fb29 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135066.614371:0:14224:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9fe9c8301a00) 00010000:00010000:2.0:1783135066.614374:0:14224:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783135066.614380:0:14224:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c1523000/0xd6c4b8f05867fb29 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135066.614385:0:14224:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c1523000/0xd6c4b8f05867fb29 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14224 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1783135066.614400:0:14224:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000008b9635e3 reply state 00000000289fee30 transno 8589934600 ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c1522000/0xd6c4b8f05867fb30 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14224 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783135066.614411:0:14224:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1783135066.614456:0:14224:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c1523800/0xd6c4b8f05867fb22 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb7686 expref: 14 pid: 14224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135066.614471:0:14224:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c1523e00/0xd6c4b8f05867fb37 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb7686 expref: 13 pid: 14224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135066.614492:0:14224:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9fe9cc3c1300) 00010000:00010000:2.0:1783135066.614494:0:14224:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:2.0:1783135066.614496:0:14224:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fe9c1523e00, rc 0) 00000100:00100000:2.0:1783135066.614595:0:14224:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fe90e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2b138366-7a70-4ff2-909d-348210e4a0a2+14:14391:x1869752373984384:12345-192.168.201.41@tcp:101:bash.0 Request processed in 9865us (10340us total) trans 8589934600 rc 0/0 00000100:00100000:2.0:1783135066.614606:0:14224:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 28 00010000:00010000:0.0:1783135066.619133:0:3273:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c1522000/0xd6c4b8f05867fb30 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135066.619159:0:3273:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c1522000/0xd6c4b8f05867fb30 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135066.619167:0:3273:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c1522000/0xd6c4b8f05867fb30 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135066.619174:0:3273:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe9c1522000 already unused, calling callback (ffffffffc1f634f0) 00010000:00010000:0.0:1783135066.619180:0:3273:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c1522000/0xd6c4b8f05867fb30 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135066.619188:0:3273:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c1522000/0xd6c4b8f05867fb30 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135066.619210:0:3273:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff9fe9cc3c1200) 00010000:00010000:0.0:1783135066.619214:0:3273:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783135066.619219:0:3273:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c1522000/0xd6c4b8f05867fb30 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135066.619226:0:3273:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c1522000/0xd6c4b8f05867fb30 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14224 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783135066.627619:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:0.0:1783135066.628010:0:14223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373984640 00000100:00100000:0.0:1783135066.628024:0:14223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373984640 00000100:00100000:0.0:1783135066.628116:0:14223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 29 00000100:00100000:0.0:1783135066.628127:0:14223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fe90f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2b138366-7a70-4ff2-909d-348210e4a0a2+13:14391:x1869752373984640:12345-192.168.201.41@tcp:101:bash.0 00010000:00010000:0.0:1783135066.628179:0:14223:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783135066.628206:0:14223:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ad400/0xd6c4b8f05867fb45 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4428da03f5eb768d expref: -99 pid: 14223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135066.628318:0:14223:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ade00/0xd6c4b8f05867fb4c lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135066.628348:0:14223:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ade00/0xd6c4b8f05867fb4c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135066.628362:0:14223:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ade00/0xd6c4b8f05867fb4c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783135066.628413:0:14223:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:0.0:1783135066.628418:0:14223:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1783135066.628442:0:14223:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ade00/0xd6c4b8f05867fb4c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135066.628453:0:14223:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ade00/0xd6c4b8f05867fb4c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135066.628480:0:14223:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ad400/0xd6c4b8f05867fb45 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb768d expref: 15 pid: 14223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135066.628501:0:14223:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ade00/0xd6c4b8f05867fb4c lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb768d expref: 14 pid: 14223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135066.628510:0:14223:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9fe9cc3c1300) 00010000:00010000:0.0:1783135066.628514:0:14223:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1783135066.628517:0:14223:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fe9f68ade00, rc 0) 00000100:00100000:0.0:1783135066.628604:0:14223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fe90f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2b138366-7a70-4ff2-909d-348210e4a0a2+14:14391:x1869752373984640:12345-192.168.201.41@tcp:101:bash.0 Request processed in 478us (1000us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135066.628613:0:14223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 29 00010000:00010000:3.0:1783135066.629205:0:14211:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783135066.631836:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:0.0:1783135066.631914:0:14225:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373984896 00000100:00100000:0.0:1783135066.631925:0:14225:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373984896 00000100:00100000:0.0:1783135066.631996:0:14225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 5 00000100:00100000:0.0:1783135066.632009:0:14225:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fe90f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2b138366-7a70-4ff2-909d-348210e4a0a2+14:14391:x1869752373984896:12345-192.168.201.41@tcp:35:bash.0 00000100:00100000:0.0:1783135066.632549:0:14225:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fe90f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2b138366-7a70-4ff2-909d-348210e4a0a2+15:14391:x1869752373984896:12345-192.168.201.41@tcp:35:bash.0 Request processed in 540us (735us total) trans 8589934601 rc 0/0 00000100:00100000:0.0:1783135066.632558:0:14225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 5 00000100:00100000:1.0:1783135066.682632:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:2.0:1783135066.682706:0:14224:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373985152 00000100:00100000:2.0:1783135066.682719:0:14224:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373985152 00000100:00100000:2.0:1783135066.682794:0:14224:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 30 00000100:00100000:2.0:1783135066.682806:0:14224:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fe43a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2b138366-7a70-4ff2-909d-348210e4a0a2+15:14401:x1869752373985152:12345-192.168.201.41@tcp:101:lfs.0 00010000:00010000:2.0:1783135066.682837:0:14224:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783135066.682858:0:14224:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c1523800/0xd6c4b8f05867fb53 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4428da03f5eb7694 expref: -99 pid: 14224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783135066.682997:0:14224:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:2.0:1783135066.683176:0:14224:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c1523800/0xd6c4b8f05867fb53 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb7694 expref: 17 pid: 14224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135066.683190:0:14224:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fe9cc3c1600) 00010000:00010000:2.0:1783135066.683192:0:14224:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1783135066.683197:0:14224:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c1523800/0xd6c4b8f05867fb53 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb7694 expref: 17 pid: 14224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135066.683212:0:14224:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fe9c1523800, rc 0) 00000100:00100000:2.0:1783135066.683275:0:14224:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fe43a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2b138366-7a70-4ff2-909d-348210e4a0a2+16:14401:x1869752373985152:12345-192.168.201.41@tcp:101:lfs.0 Request processed in 471us (655us total) trans 8589934602 rc 301/301 00000100:00100000:2.0:1783135066.683360:0:14224:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 30 00000100:00100000:1.0:1783135066.685125:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:2.0:1783135066.685422:0:14226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373985408 00000100:00100000:2.0:1783135066.685433:0:14226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373985408 00000100:00100000:2.0:1783135066.685510:0:14226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 6 00000100:00100000:2.0:1783135066.685518:0:14226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fe43ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2b138366-7a70-4ff2-909d-348210e4a0a2+16:14401:x1869752373985408:12345-192.168.201.41@tcp:35:lfs.0 00000100:00100000:2.0:1783135066.685781:0:14226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fe43ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2b138366-7a70-4ff2-909d-348210e4a0a2+17:14401:x1869752373985408:12345-192.168.201.41@tcp:35:lfs.0 Request processed in 262us (664us total) trans 8589934603 rc 0/0 00000100:00100000:2.0:1783135066.685794:0:14226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 6 00000100:00100000:3.0:1783135066.702112:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:0.0:1783135066.704579:0:14223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373985664 00000100:00100000:0.0:1783135066.704596:0:14223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373985664 00000100:00100000:0.0:1783135066.704680:0:14223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 31 00000100:00100000:0.0:1783135066.704693:0:14223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fe90d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2b138366-7a70-4ff2-909d-348210e4a0a2+17:14404:x1869752373985664:12345-192.168.201.41@tcp:101:lfs.0 00010000:00010000:0.0:1783135066.704726:0:14223:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783135066.704751:0:14223:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ad400/0xd6c4b8f05867fb61 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4428da03f5eb769b expref: -99 pid: 14223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135066.704864:0:14223:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ac200/0xd6c4b8f05867fb68 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135066.704877:0:14223:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ac200/0xd6c4b8f05867fb68 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135066.704887:0:14223:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ac200/0xd6c4b8f05867fb68 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783135066.704898:0:14223:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1783135066.705060:0:14223:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ad400/0xd6c4b8f05867fb61 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb769b expref: 20 pid: 14223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135066.705082:0:14223:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ac200/0xd6c4b8f05867fb68 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb769b expref: 19 pid: 14223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135066.705093:0:14223:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9fe9cc3c1300) 00010000:00010000:0.0:1783135066.705096:0:14223:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1783135066.705101:0:14223:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fe9f68ac200, rc 0) 00000100:00100000:0.0:1783135066.705187:0:14223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fe90d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2b138366-7a70-4ff2-909d-348210e4a0a2+19:14404:x1869752373985664:12345-192.168.201.41@tcp:101:lfs.0 Request processed in 496us (3089us total) trans 8589934604 rc 0/0 00000100:00100000:0.0:1783135066.705196:0:14223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 31 00000100:00100000:1.0:1783135066.707863:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:0.0:1783135066.709185:0:14222:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373985792 00000100:00100000:0.0:1783135066.709199:0:14222:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373985792 00000100:00100000:0.0:1783135066.709272:0:14222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 32 00000100:00100000:0.0:1783135066.709300:0:14222:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fe43b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2b138366-7a70-4ff2-909d-348210e4a0a2+19:14404:x1869752373985792:12345-192.168.201.41@tcp:54:lfs.0 00010000:00010000:0.0:1783135066.709387:0:14222:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ac000/0xd6c4b8f05867fb76 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135066.709406:0:14222:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ac000/0xd6c4b8f05867fb76 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135066.709418:0:14222:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ac000/0xd6c4b8f05867fb76 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135066.709449:0:14222:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ac000/0xd6c4b8f05867fb76 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135066.709456:0:14222:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ac000/0xd6c4b8f05867fb76 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135066.709483:0:14222:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ac000/0xd6c4b8f05867fb76 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135066.709490:0:14222:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe9f68ac000 already unused, calling callback (ffffffffc1f634f0) 00010000:00010000:0.0:1783135066.709495:0:14222:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ac000/0xd6c4b8f05867fb76 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135066.709502:0:14222:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ac000/0xd6c4b8f05867fb76 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135066.709515:0:14222:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9fe9cc3c1300) 00010000:00010000:0.0:1783135066.709518:0:14222:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1783135066.709522:0:14222:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ac000/0xd6c4b8f05867fb76 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135066.709528:0:14222:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ac000/0xd6c4b8f05867fb76 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14222 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783135066.709786:0:14222:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fe43b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2b138366-7a70-4ff2-909d-348210e4a0a2+19:14404:x1869752373985792:12345-192.168.201.41@tcp:54:lfs.0 Request processed in 503us (1932us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135066.709795:0:14222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 32 00000040:00080000:1.0:1783135066.820784:0:14257:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1783135066.964791:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:0.0:1783135066.964896:0:14223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373986048 00000100:00100000:0.0:1783135066.964909:0:14223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373986048 00000100:00100000:0.0:1783135066.964976:0:14223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 33 00000100:00100000:0.0:1783135066.964986:0:14223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fe439880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2b138366-7a70-4ff2-909d-348210e4a0a2+19:14441:x1869752373986048:12345-192.168.201.41@tcp:101:dd.0 00010000:00010000:0.0:1783135066.965011:0:14223:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783135066.965069:0:14223:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ac000/0xd6c4b8f05867fb7d lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4428da03f5eb76a2 expref: -99 pid: 14223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135066.965214:0:14223:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ad400/0xd6c4b8f05867fb84 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135066.965227:0:14223:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c1523e00/0xd6c4b8f05867fb37 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb7686 expref: 20 pid: 14224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135066.965233:0:14223:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ade00/0xd6c4b8f05867fb4c lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb768d expref: 20 pid: 14223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135066.965239:0:14223:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ad400/0xd6c4b8f05867fb84 lrc: 5/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135066.965276:0:14223:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ade00/0xd6c4b8f05867fb4c lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb768d expref: 20 pid: 14223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135066.965320:0:14223:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ade00/0xd6c4b8f05867fb4c lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb768d expref: 20 pid: 14223 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783135066.965340:0:14223:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe8c6dff100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14223:1869752384444672:192.168.201.41@tcp:104: 00010000:00010000:0.0:1783135066.965448:0:14223:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c1523e00/0xd6c4b8f05867fb37 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb7686 expref: 20 pid: 14224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135066.965455:0:14223:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c1523e00/0xd6c4b8f05867fb37 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb7686 expref: 20 pid: 14224 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783135066.965460:0:14223:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe8c6dff480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14223:1869752384444800:192.168.201.41@tcp:104: 00000100:00100000:0.0:1783135066.965486:0:14223:0:(client.c:2701:ptlrpc_set_wait()) set ffff9fe9f426c480 going to sleep for 11 seconds 00000100:00100000:0.0:1783135066.969717:0:14223:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe8c6dff100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14223:1869752384444672:192.168.201.41@tcp:104: 00000100:00100000:0.0:1783135066.969738:0:14223:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe8c6dff480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14223:1869752384444800:192.168.201.41@tcp:104: 00010000:00010000:0.0:1783135066.969772:0:14223:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ad400/0xd6c4b8f05867fb84 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783135066.970198:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:1.0:1783135066.970226:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:0.0:1783135066.970318:0:14209:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373986176 00000100:00100000:0.0:1783135066.970335:0:14209:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373986176 00010000:00010000:0.0:1783135066.970376:0:14209:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ade00/0xd6c4b8f05867fb4c lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb768d expref: 21 pid: 14223 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783135066.970409:0:14209:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373986304 00000100:00100000:0.0:1783135066.970411:0:14209:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373986304 00010000:00010000:0.0:1783135066.970421:0:14209:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c1523e00/0xd6c4b8f05867fb37 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb7686 expref: 22 pid: 14224 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783135066.970444:0:14209:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 11 00000100:00100000:0.0:1783135066.970452:0:14209:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fe43aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2b138366-7a70-4ff2-909d-348210e4a0a2+22:2369:x1869752373986176:12345-192.168.201.41@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783135066.970469:0:14209:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783135066.970476:0:14209:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ade00/0xd6c4b8f05867fb4c lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb768d expref: 22 pid: 14223 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135066.970488:0:14209:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ade00/0xd6c4b8f05867fb4c lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb768d expref: 22 pid: 14223 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135066.970511:0:14209:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ade00/0xd6c4b8f05867fb4c lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb768d expref: 22 pid: 14223 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135066.970550:0:14209:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9fe9cc3c1300) 00010000:00010000:0.0:1783135066.970555:0:14209:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ad400/0xd6c4b8f05867fb84 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135066.970564:0:14209:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ad400/0xd6c4b8f05867fb84 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135066.970571:0:14209:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783135066.970632:0:14209:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fe43aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2b138366-7a70-4ff2-909d-348210e4a0a2+21:2369:x1869752373986176:12345-192.168.201.41@tcp:103:ldlm_bl.0 Request processed in 180us (434us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135066.970640:0:14209:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 11 00000100:00100000:0.0:1783135066.970658:0:14209:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 12 00000100:00100000:0.0:1783135066.970664:0:14209:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fe438000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2b138366-7a70-4ff2-909d-348210e4a0a2+20:2369:x1869752373986304:12345-192.168.201.41@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783135066.970674:0:14209:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783135066.970680:0:14209:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c1523e00/0xd6c4b8f05867fb37 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb7686 expref: 20 pid: 14224 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135066.970689:0:14209:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c1523e00/0xd6c4b8f05867fb37 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb7686 expref: 20 pid: 14224 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135066.970698:0:14209:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c1523e00/0xd6c4b8f05867fb37 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb7686 expref: 20 pid: 14224 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135066.970705:0:14209:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9fe9cc3c1300) 00010000:00010000:0.0:1783135066.970708:0:14209:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ad400/0xd6c4b8f05867fb84 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135066.970721:0:14209:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ad400/0xd6c4b8f05867fb84 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135066.970727:0:14209:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ad400/0xd6c4b8f05867fb84 lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135066.970745:0:14209:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783135066.970761:0:14209:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fe438000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2b138366-7a70-4ff2-909d-348210e4a0a2+19:2369:x1869752373986304:12345-192.168.201.41@tcp:103:ldlm_bl.0 Request processed in 98us (535us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135066.970765:0:14209:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 12 00010000:00010000:0.0:1783135066.970780:0:14223:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ad400/0xd6c4b8f05867fb84 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135066.970785:0:14223:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ad400/0xd6c4b8f05867fb84 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783135066.970803:0:14223:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1783135066.970967:0:14223:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ac000/0xd6c4b8f05867fb7d lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb76a2 expref: 20 pid: 14223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135066.970977:0:14223:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ad400/0xd6c4b8f05867fb84 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb76a2 expref: 19 pid: 14223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135066.970983:0:14223:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9fe9cc3c1300) 00010000:00010000:0.0:1783135066.970984:0:14223:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1783135066.970986:0:14223:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fe9f68ad400, rc 0) 00000100:00100000:0.0:1783135066.971005:0:14223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fe439880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2b138366-7a70-4ff2-909d-348210e4a0a2+19:14441:x1869752373986048:12345-192.168.201.41@tcp:101:dd.0 Request processed in 6022us (6231us total) trans 8589934605 rc 0/0 00000100:00100000:0.0:1783135066.971016:0:14223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 33 00000100:00100000:3.0:1783135066.972998:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:0.0:1783135066.973111:0:14222:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373986560 00000100:00100000:0.0:1783135066.973121:0:14222:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373986560 00000100:00100000:0.0:1783135066.973175:0:14222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 34 00000100:00100000:0.0:1783135066.973186:0:14222:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fe90dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2b138366-7a70-4ff2-909d-348210e4a0a2+19:14441:x1869752373986560:12345-192.168.201.41@tcp:36:dd.0 00010000:00010000:0.0:1783135066.973508:0:14222:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68aca00/0xd6c4b8f05867fb92 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135066.973525:0:14222:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68aca00/0xd6c4b8f05867fb92 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135066.973534:0:14222:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68aca00/0xd6c4b8f05867fb92 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14222 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1783135066.973588:0:14222:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934606 00000004:00010000:0.0:1783135066.973631:0:14222:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000099fbf32a reply state 00000000c1fecf96 transno 8589934607 ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68aca00/0xd6c4b8f05867fb92 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14222 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783135066.973639:0:14222:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1783135066.973723:0:14222:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fe90dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2b138366-7a70-4ff2-909d-348210e4a0a2+22:14441:x1869752373986560:12345-192.168.201.41@tcp:36:dd.0 Request processed in 537us (733us total) trans 8589934607 rc 0/0 00000100:00100000:0.0:1783135066.973731:0:14222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 34 00000020:00080000:0.0:1783135066.973736:0:14222:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1783135066.976680:0:3272:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68aca00/0xd6c4b8f05867fb92 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135066.976702:0:3272:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68aca00/0xd6c4b8f05867fb92 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135066.976712:0:3272:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68aca00/0xd6c4b8f05867fb92 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135066.976720:0:3272:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe9f68aca00 already unused, calling callback (ffffffffc1f634f0) 00010000:00010000:1.0:1783135066.976726:0:3272:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68aca00/0xd6c4b8f05867fb92 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135066.976736:0:3272:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68aca00/0xd6c4b8f05867fb92 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135066.976785:0:3272:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9fe9cc3c1300) 00010000:00010000:1.0:1783135066.976789:0:3272:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783135066.976794:0:3272:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68aca00/0xd6c4b8f05867fb92 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135066.976801:0:3272:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68aca00/0xd6c4b8f05867fb92 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14222 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783135067.134621:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:0.0:1783135067.134786:0:14223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373986688 00000100:00100000:0.0:1783135067.134799:0:14223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373986688 00000100:00100000:0.0:1783135067.134942:0:14223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 35 00000100:00100000:0.0:1783135067.134952:0:14223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fe90e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2b138366-7a70-4ff2-909d-348210e4a0a2+21:14455:x1869752373986688:12345-192.168.201.41@tcp:101:stat.0 00010000:00010000:0.0:1783135067.134979:0:14223:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783135067.135017:0:14223:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ac000/0xd6c4b8f05867fb99 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4428da03f5eb76a9 expref: -99 pid: 14223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135067.135134:0:14223:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ade00/0xd6c4b8f05867fba0 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135067.135152:0:14223:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ade00/0xd6c4b8f05867fba0 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135067.135165:0:14223:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ade00/0xd6c4b8f05867fba0 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135067.135180:0:14223:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ac800/0xd6c4b8f05867fba7 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135067.135187:0:14223:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ac800/0xd6c4b8f05867fba7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135067.135204:0:14223:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ac800/0xd6c4b8f05867fba7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135067.135374:0:14223:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ad000/0xd6c4b8f05867fbae lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135067.135386:0:14223:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ad400/0xd6c4b8f05867fb84 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb76a2 expref: 22 pid: 14223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135067.135395:0:14223:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ad000/0xd6c4b8f05867fbae lrc: 4/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135067.135438:0:14223:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ad400/0xd6c4b8f05867fb84 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb76a2 expref: 22 pid: 14223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1783135067.135442:0:14218:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1783135067.135464:0:14223:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ad400/0xd6c4b8f05867fb84 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb76a2 expref: 22 pid: 14223 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783135067.135481:0:14223:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe8c6dff480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14223:1869752384444928:192.168.201.41@tcp:104: 00000100:00100000:0.0:1783135067.135798:0:14223:0:(client.c:2701:ptlrpc_set_wait()) set ffff9fe9f418a540 going to sleep for 11 seconds 00000100:00100000:2.0:1783135067.138185:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:0.0:1783135067.138217:0:14223:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe8c6dff480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14223:1869752384444928:192.168.201.41@tcp:104: 00010000:00010000:0.0:1783135067.138265:0:14223:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ad000/0xd6c4b8f05867fbae lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783135067.138494:0:16002:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373986944 00000100:00100000:3.0:1783135067.138504:0:16002:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373986944 00000100:00100000:3.0:1783135067.138569:0:16002:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 7 00000100:00100000:3.0:1783135067.138591:0:16002:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fe82b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:2b138366-7a70-4ff2-909d-348210e4a0a2+23:13712:x1869752373986944:12345-192.168.201.41@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1783135067.138966:0:16002:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fe82b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:2b138366-7a70-4ff2-909d-348210e4a0a2+24:13712:x1869752373986944:12345-192.168.201.41@tcp:35:ldlm_bl.0 Request processed in 373us (793us total) trans 8589934608 rc 0/0 00000100:00100000:3.0:1783135067.138979:0:16002:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 7 00000100:00100000:1.0:1783135067.144733:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:0.0:1783135067.151338:0:14209:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373987072 00000100:00100000:0.0:1783135067.151359:0:14209:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373987072 00010000:00010000:0.0:1783135067.151435:0:14209:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ad400/0xd6c4b8f05867fb84 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb76a2 expref: 24 pid: 14223 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783135067.151503:0:14209:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 13 00000100:00100000:0.0:1783135067.151516:0:14209:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fe69dc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2b138366-7a70-4ff2-909d-348210e4a0a2+24:2370:x1869752373987072:12345-192.168.201.41@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783135067.151537:0:14209:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783135067.151556:0:14209:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ad400/0xd6c4b8f05867fb84 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb76a2 expref: 24 pid: 14223 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135067.151573:0:14209:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ad400/0xd6c4b8f05867fb84 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb76a2 expref: 24 pid: 14223 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135067.151602:0:14209:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ad400/0xd6c4b8f05867fb84 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb76a2 expref: 24 pid: 14223 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135067.151648:0:14209:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9fe9cc3c1300) 00010000:00010000:0.0:1783135067.151654:0:14209:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ad000/0xd6c4b8f05867fbae lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135067.151667:0:14209:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ad000/0xd6c4b8f05867fbae lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135067.151676:0:14209:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ad000/0xd6c4b8f05867fbae lrc: 4/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135067.151725:0:14209:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783135067.151819:0:14209:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fe69dc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2b138366-7a70-4ff2-909d-348210e4a0a2+23:2370:x1869752373987072:12345-192.168.201.41@tcp:103:ldlm_bl.0 Request processed in 305us (7100us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135067.151828:0:14209:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 13 00010000:00010000:1.0:1783135067.152249:0:14223:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ad000/0xd6c4b8f05867fbae lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135067.152258:0:14223:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ad000/0xd6c4b8f05867fbae lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783135067.152353:0:14223:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:1.0:1783135067.152359:0:14223:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1783135067.152410:0:14223:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ad000/0xd6c4b8f05867fbae lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135067.152423:0:14223:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ad000/0xd6c4b8f05867fbae lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135067.152434:0:14223:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ade00/0xd6c4b8f05867fba0 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135067.152440:0:14223:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ade00/0xd6c4b8f05867fba0 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135067.152448:0:14223:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ade00/0xd6c4b8f05867fba0 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135067.152466:0:14223:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe9f68ade00 already unused, calling callback (ffffffffc1f634f0) 00010000:00010000:1.0:1783135067.152472:0:14223:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ade00/0xd6c4b8f05867fba0 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135067.152480:0:14223:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ade00/0xd6c4b8f05867fba0 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135067.152492:0:14223:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9fe9c8301a00) 00010000:00010000:1.0:1783135067.152494:0:14223:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783135067.152498:0:14223:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ade00/0xd6c4b8f05867fba0 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135067.152504:0:14223:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ade00/0xd6c4b8f05867fba0 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135067.152517:0:14223:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ac800/0xd6c4b8f05867fba7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135067.152523:0:14223:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ac800/0xd6c4b8f05867fba7 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135067.152530:0:14223:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ac800/0xd6c4b8f05867fba7 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135067.152535:0:14223:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe9f68ac800 already unused, calling callback (ffffffffc1f634f0) 00010000:00010000:1.0:1783135067.152538:0:14223:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ac800/0xd6c4b8f05867fba7 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135067.152776:0:14223:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ac800/0xd6c4b8f05867fba7 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135067.152797:0:14223:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff9fe9c8301e00) 00010000:00010000:1.0:1783135067.152799:0:14223:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783135067.152803:0:14223:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ac800/0xd6c4b8f05867fba7 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135067.152810:0:14223:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ac800/0xd6c4b8f05867fba7 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135067.152858:0:14223:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ac000/0xd6c4b8f05867fb99 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb76a9 expref: 23 pid: 14223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135067.152874:0:14223:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ad000/0xd6c4b8f05867fbae lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb76a9 expref: 22 pid: 14223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135067.152882:0:14223:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9fe9cc3c1300) 00010000:00010000:1.0:1783135067.152885:0:14223:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1783135067.152887:0:14223:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fe9f68ad000, rc 0) 00000100:00100000:1.0:1783135067.152951:0:14223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fe90e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2b138366-7a70-4ff2-909d-348210e4a0a2+22:14455:x1869752373986688:12345-192.168.201.41@tcp:101:stat.0 Request processed in 18001us (18415us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135067.152959:0:14223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 35 00000100:00100000:1.0:1783135067.225137:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:0.0:1783135067.225259:0:14222:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373987328 00000100:00100000:0.0:1783135067.225273:0:14222:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373987328 00000100:00100000:2.0:1783135067.225689:0:14222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 36 00000100:00100000:2.0:1783135067.225702:0:14222:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fe439180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2b138366-7a70-4ff2-909d-348210e4a0a2+22:14462:x1869752373987328:12345-192.168.201.41@tcp:36:truncate.0 00010000:00010000:2.0:1783135067.225786:0:14222:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783135067.225822:0:14222:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ad000/0xd6c4b8f05867fbae lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb76a9 expref: 22 pid: 14223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135067.225859:0:14222:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9fe9cc3c1300) 00010000:00010000:2.0:1783135067.225866:0:14222:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1783135067.226551:0:14222:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c1523a00/0xd6c4b8f05867fbb5 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135067.226571:0:14222:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c1523a00/0xd6c4b8f05867fbb5 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135067.226583:0:14222:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c1523a00/0xd6c4b8f05867fbb5 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14222 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1783135067.226672:0:14222:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934609 00000004:00010000:2.0:1783135067.226699:0:14222:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000008b823219 reply state 000000003aa94e3b transno 8589934610 ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c1523a00/0xd6c4b8f05867fbb5 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14222 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783135067.226709:0:14222:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1783135067.227512:0:14222:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fe439180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2b138366-7a70-4ff2-909d-348210e4a0a2+24:14462:x1869752373987328:12345-192.168.201.41@tcp:36:truncate.0 Request processed in 1807us (2484us total) trans 8589934610 rc 0/0 00000100:00100000:2.0:1783135067.227524:0:14222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 36 00000020:00080000:2.0:1783135067.227532:0:14222:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1783135067.229245:0:3273:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c1523a00/0xd6c4b8f05867fbb5 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135067.229264:0:3273:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c1523a00/0xd6c4b8f05867fbb5 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135067.229272:0:3273:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c1523a00/0xd6c4b8f05867fbb5 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135067.229337:0:3273:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe9c1523a00 already unused, calling callback (ffffffffc1f634f0) 00010000:00010000:0.0:1783135067.229344:0:3273:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c1523a00/0xd6c4b8f05867fbb5 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135067.229354:0:3273:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c1523a00/0xd6c4b8f05867fbb5 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135067.229394:0:3273:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9fe9cc3c1300) 00010000:00010000:0.0:1783135067.229397:0:3273:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783135067.229403:0:3273:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c1523a00/0xd6c4b8f05867fbb5 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135067.229409:0:3273:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c1523a00/0xd6c4b8f05867fbb5 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14222 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783135067.359524:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:0.0:1783135067.359632:0:14223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373987456 00000100:00100000:0.0:1783135067.359645:0:14223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373987456 00000100:00100000:0.0:1783135067.359720:0:14223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 37 00000100:00100000:0.0:1783135067.359732:0:14223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fe43bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2b138366-7a70-4ff2-909d-348210e4a0a2+23:14476:x1869752373987456:12345-192.168.201.41@tcp:101:stat.0 00010000:00010000:0.0:1783135067.359766:0:14223:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783135067.359792:0:14223:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ad400/0xd6c4b8f05867fbbc lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4428da03f5eb76b0 expref: -99 pid: 14223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135067.359875:0:14223:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ace00/0xd6c4b8f05867fbc3 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135067.359891:0:14223:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ace00/0xd6c4b8f05867fbc3 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135067.359904:0:14223:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ace00/0xd6c4b8f05867fbc3 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135067.359922:0:14223:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ad000/0xd6c4b8f05867fbca lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135067.359930:0:14223:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ad000/0xd6c4b8f05867fbca lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135067.359954:0:14223:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ad000/0xd6c4b8f05867fbca lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135067.360263:0:14223:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ac000/0xd6c4b8f05867fbd1 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135067.360273:0:14223:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ac000/0xd6c4b8f05867fbd1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135067.360449:0:14223:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ac000/0xd6c4b8f05867fbd1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783135067.360586:0:14223:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 1234567 00000004:00200000:0.0:1783135067.360591:0:14223:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1783135067.360619:0:14223:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ac000/0xd6c4b8f05867fbd1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135067.360631:0:14223:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ac000/0xd6c4b8f05867fbd1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135067.360640:0:14223:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ace00/0xd6c4b8f05867fbc3 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135067.360647:0:14223:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ace00/0xd6c4b8f05867fbc3 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135067.360654:0:14223:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ace00/0xd6c4b8f05867fbc3 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135067.360660:0:14223:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe9f68ace00 already unused, calling callback (ffffffffc1f634f0) 00010000:00010000:0.0:1783135067.360664:0:14223:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ace00/0xd6c4b8f05867fbc3 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135067.360681:0:14223:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ace00/0xd6c4b8f05867fbc3 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135067.360694:0:14223:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9fe9c8301a00) 00010000:00010000:0.0:1783135067.360698:0:14223:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783135067.360704:0:14223:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ace00/0xd6c4b8f05867fbc3 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135067.360710:0:14223:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ace00/0xd6c4b8f05867fbc3 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135067.360725:0:14223:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ad000/0xd6c4b8f05867fbca lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135067.360731:0:14223:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ad000/0xd6c4b8f05867fbca lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135067.360737:0:14223:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ad000/0xd6c4b8f05867fbca lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135067.360743:0:14223:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe9f68ad000 already unused, calling callback (ffffffffc1f634f0) 00010000:00010000:0.0:1783135067.360746:0:14223:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ad000/0xd6c4b8f05867fbca lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135067.360752:0:14223:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ad000/0xd6c4b8f05867fbca lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135067.360760:0:14223:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff9fe9c8301f00) 00010000:00010000:0.0:1783135067.360763:0:14223:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783135067.360766:0:14223:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ad000/0xd6c4b8f05867fbca lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135067.360784:0:14223:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ad000/0xd6c4b8f05867fbca lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135067.360826:0:14223:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ad400/0xd6c4b8f05867fbbc lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb76b0 expref: 25 pid: 14223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135067.360841:0:14223:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ac000/0xd6c4b8f05867fbd1 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb76b0 expref: 24 pid: 14223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135067.360850:0:14223:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9fe9cc3c1300) 00010000:00010000:0.0:1783135067.360852:0:14223:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1783135067.360855:0:14223:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fe9f68ac000, rc 0) 00000100:00100000:0.0:1783135067.360940:0:14223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fe43bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2b138366-7a70-4ff2-909d-348210e4a0a2+24:14476:x1869752373987456:12345-192.168.201.41@tcp:101:stat.0 Request processed in 1209us (1431us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135067.360949:0:14223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 37 00000100:00100000:3.0:1783135067.452955:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:2.0:1783135067.453093:0:14222:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373987712 00000100:00100000:2.0:1783135067.453105:0:14222:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373987712 00000100:00100000:2.0:1783135067.453178:0:14222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 38 00000100:00100000:2.0:1783135067.453190:0:14222:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fe90ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2b138366-7a70-4ff2-909d-348210e4a0a2+24:14486:x1869752373987712:12345-192.168.201.41@tcp:101:lfs.0 00010000:00010000:2.0:1783135067.453219:0:14222:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783135067.453246:0:14222:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c1523400/0xd6c4b8f05867fbd8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4428da03f5eb76b7 expref: -99 pid: 14222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783135067.453540:0:14222:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:2.0:1783135067.453703:0:14222:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c1523400/0xd6c4b8f05867fbd8 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb76b7 expref: 26 pid: 14222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135067.453722:0:14222:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fe9cc3c1600) 00010000:00010000:2.0:1783135067.453725:0:14222:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1783135067.453731:0:14222:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c1523400/0xd6c4b8f05867fbd8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb76b7 expref: 26 pid: 14222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135067.453748:0:14222:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fe9c1523400, rc 0) 00000100:00100000:2.0:1783135067.453848:0:14222:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fe90ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2b138366-7a70-4ff2-909d-348210e4a0a2+25:14486:x1869752373987712:12345-192.168.201.41@tcp:101:lfs.0 Request processed in 660us (907us total) trans 8589934611 rc 301/301 00000100:00100000:2.0:1783135067.453856:0:14222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 38 00000100:00100000:3.0:1783135067.457272:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:2.0:1783135067.457985:0:14226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373987968 00000100:00100000:2.0:1783135067.458002:0:14226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373987968 00000100:00100000:2.0:1783135067.458138:0:14226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 8 00000100:00100000:2.0:1783135067.458150:0:14226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fe90f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2b138366-7a70-4ff2-909d-348210e4a0a2+25:14486:x1869752373987968:12345-192.168.201.41@tcp:35:lfs.0 00000100:00100000:2.0:1783135067.460598:0:14226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fe90f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2b138366-7a70-4ff2-909d-348210e4a0a2+26:14486:x1869752373987968:12345-192.168.201.41@tcp:35:lfs.0 Request processed in 2437us (3328us total) trans 8589934612 rc 0/0 00000100:00100000:2.0:1783135067.460613:0:14226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 8 00000100:00100000:3.0:1783135067.527757:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:0.0:1783135067.527900:0:14223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373988224 00000100:00100000:0.0:1783135067.527912:0:14223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373988224 00000100:00100000:0.0:1783135067.527997:0:14223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 39 00000100:00100000:0.0:1783135067.528010:0:14223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fe90ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2b138366-7a70-4ff2-909d-348210e4a0a2+26:14492:x1869752373988224:12345-192.168.201.41@tcp:101:bash.0 00010000:00010000:0.0:1783135067.528075:0:14223:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783135067.528104:0:14223:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ad400/0xd6c4b8f05867fbe6 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4428da03f5eb76be expref: -99 pid: 14223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135067.528235:0:14223:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ad000/0xd6c4b8f05867fbed lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135067.528251:0:14223:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ac000/0xd6c4b8f05867fbd1 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb76b0 expref: 27 pid: 14223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135067.528317:0:14223:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ad000/0xd6c4b8f05867fbed lrc: 4/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135067.528371:0:14223:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ac000/0xd6c4b8f05867fbd1 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb76b0 expref: 27 pid: 14223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135067.528389:0:14223:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ac000/0xd6c4b8f05867fbd1 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb76b0 expref: 27 pid: 14223 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783135067.528405:0:14223:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe8c6dfdc00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14223:1869752384445056:192.168.201.41@tcp:104: 00000100:00100000:0.0:1783135067.528512:0:14223:0:(client.c:2701:ptlrpc_set_wait()) set ffff9fe9f418a300 going to sleep for 11 seconds 00000100:00100000:3.0:1783135067.532093:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:1.0:1783135067.532239:0:16237:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373988352 00000100:00100000:1.0:1783135067.532249:0:16237:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373988352 00010000:00010000:1.0:1783135067.532351:0:16237:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ac000/0xd6c4b8f05867fbd1 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb76b0 expref: 28 pid: 14223 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783135067.532396:0:16237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 14 00000100:00100000:1.0:1783135067.532426:0:16237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fe90ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2b138366-7a70-4ff2-909d-348210e4a0a2+28:2370:x1869752373988352:12345-192.168.201.41@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1783135067.532444:0:16237:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783135067.532453:0:16237:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ac000/0xd6c4b8f05867fbd1 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb76b0 expref: 28 pid: 14223 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135067.532469:0:16237:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ac000/0xd6c4b8f05867fbd1 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb76b0 expref: 28 pid: 14223 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135067.532495:0:16237:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9fe9cc3c1300) 00010000:00010000:1.0:1783135067.532501:0:16237:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ad000/0xd6c4b8f05867fbed lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135067.532512:0:16237:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ad000/0xd6c4b8f05867fbed lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135067.532522:0:16237:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ad000/0xd6c4b8f05867fbed lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135067.532544:0:16237:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783135067.532620:0:16237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fe90ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2b138366-7a70-4ff2-909d-348210e4a0a2+28:2370:x1869752373988352:12345-192.168.201.41@tcp:103:ldlm_bl.0 Request processed in 196us (541us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135067.532628:0:16237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 14 00010000:00010000:0.0:1783135067.533653:0:14223:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ac000/0xd6c4b8f05867fbd1 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb76b0 expref: 27 pid: 14223 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783135067.533677:0:14223:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe8c6dfdc00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14223:1869752384445056:192.168.201.41@tcp:104: 00010000:00010000:0.0:1783135067.533703:0:14223:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ad000/0xd6c4b8f05867fbed lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135067.533714:0:14223:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ad000/0xd6c4b8f05867fbed lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135067.533722:0:14223:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ad000/0xd6c4b8f05867fbed lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783135067.533744:0:14223:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 1234567 00010000:00010000:0.0:1783135067.533922:0:14223:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ad400/0xd6c4b8f05867fbe6 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb76be expref: 28 pid: 14223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135067.533956:0:14223:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ad000/0xd6c4b8f05867fbed lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb76be expref: 27 pid: 14223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135067.533965:0:14223:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9fe9cc3c1300) 00010000:00010000:0.0:1783135067.533969:0:14223:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1783135067.533971:0:14223:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fe9f68ad000, rc 0) 00000100:00100000:0.0:1783135067.534050:0:14223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fe90ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2b138366-7a70-4ff2-909d-348210e4a0a2+27:14492:x1869752373988224:12345-192.168.201.41@tcp:101:bash.0 Request processed in 6043us (6308us total) trans 8589934613 rc 0/0 00000100:00100000:0.0:1783135067.534059:0:14223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 39 00000100:00100000:3.0:1783135067.537705:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:1.0:1783135067.537946:0:14224:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373988608 00000100:00100000:1.0:1783135067.537960:0:14224:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373988608 00000100:00100000:1.0:1783135067.538061:0:14224:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 40 00000100:00100000:1.0:1783135067.538073:0:14224:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fe90c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2b138366-7a70-4ff2-909d-348210e4a0a2+27:14492:x1869752373988608:12345-192.168.201.41@tcp:36:bash.0 00010000:00010000:1.0:1783135067.538643:0:14224:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe8c5550200/0xd6c4b8f05867fbfb lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135067.538686:0:14224:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fe8c5550200/0xd6c4b8f05867fbfb lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135067.538700:0:14224:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe8c5550200/0xd6c4b8f05867fbfb lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14224 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1783135067.538755:0:14224:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934614 00000004:00010000:1.0:1783135067.538776:0:14224:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000efab02f4 reply state 000000008beab85e transno 8589934615 ns: mdt-lustre-MDT0000_UUID lock: ffff9fe8c5550200/0xd6c4b8f05867fbfb lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14224 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783135067.538787:0:14224:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1783135067.538905:0:14224:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fe90c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2b138366-7a70-4ff2-909d-348210e4a0a2+30:14492:x1869752373988608:12345-192.168.201.41@tcp:36:bash.0 Request processed in 832us (1211us total) trans 8589934615 rc 0/0 00000100:00100000:1.0:1783135067.538914:0:14224:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 40 00000020:00080000:1.0:1783135067.538920:0:14224:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1783135067.547517:0:3272:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe8c5550200/0xd6c4b8f05867fbfb lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135067.547538:0:3272:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fe8c5550200/0xd6c4b8f05867fbfb lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135067.547547:0:3272:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fe8c5550200/0xd6c4b8f05867fbfb lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135067.547555:0:3272:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe8c5550200 already unused, calling callback (ffffffffc1f634f0) 00010000:00010000:1.0:1783135067.547561:0:3272:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe8c5550200/0xd6c4b8f05867fbfb lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135067.547570:0:3272:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe8c5550200/0xd6c4b8f05867fbfb lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135067.547615:0:3272:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9fe9cc3c1300) 00010000:00010000:1.0:1783135067.547618:0:3272:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783135067.547623:0:3272:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fe8c5550200/0xd6c4b8f05867fbfb lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135067.547630:0:3272:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe8c5550200/0xd6c4b8f05867fbfb lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14224 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783135067.552718:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:0.0:1783135067.552804:0:14223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373988736 00000100:00100000:0.0:1783135067.552816:0:14223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373988736 00000100:00100000:0.0:1783135067.552880:0:14223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 41 00000100:00100000:0.0:1783135067.552891:0:14223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fea00bcf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2b138366-7a70-4ff2-909d-348210e4a0a2+29:14492:x1869752373988736:12345-192.168.201.41@tcp:101:bash.0 00010000:00010000:0.0:1783135067.552924:0:14223:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783135067.552955:0:14223:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ad400/0xd6c4b8f05867fc02 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4428da03f5eb76c5 expref: -99 pid: 14223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135067.553126:0:14223:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ac000/0xd6c4b8f05867fc09 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135067.553147:0:14223:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ad000/0xd6c4b8f05867fbed lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb76be expref: 30 pid: 14223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135067.553158:0:14223:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ac000/0xd6c4b8f05867fc09 lrc: 4/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135067.553205:0:14223:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ad000/0xd6c4b8f05867fbed lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb76be expref: 30 pid: 14223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135067.553233:0:14223:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ad000/0xd6c4b8f05867fbed lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb76be expref: 30 pid: 14223 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783135067.553251:0:14223:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe8c6dfdc00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14223:1869752384445184:192.168.201.41@tcp:104: 00000100:00100000:0.0:1783135067.553413:0:14223:0:(client.c:2701:ptlrpc_set_wait()) set ffff9fe9f418a3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783135067.557495:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:0.0:1783135067.557667:0:14223:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe8c6dfdc00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14223:1869752384445184:192.168.201.41@tcp:104: 00010000:00010000:0.0:1783135067.557703:0:14223:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ac000/0xd6c4b8f05867fc09 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783135067.557852:0:14209:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373988864 00000100:00100000:1.0:1783135067.557861:0:14209:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373988864 00010000:00010000:1.0:1783135067.557909:0:14209:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ad000/0xd6c4b8f05867fbed lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb76be expref: 31 pid: 14223 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783135067.557956:0:14209:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 15 00000100:00100000:1.0:1783135067.557967:0:14209:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fea00bcc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2b138366-7a70-4ff2-909d-348210e4a0a2+31:2369:x1869752373988864:12345-192.168.201.41@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1783135067.557991:0:14209:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783135067.557998:0:14209:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ad000/0xd6c4b8f05867fbed lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb76be expref: 31 pid: 14223 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135067.558012:0:14209:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ad000/0xd6c4b8f05867fbed lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb76be expref: 31 pid: 14223 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135067.558058:0:14209:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ad000/0xd6c4b8f05867fbed lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb76be expref: 31 pid: 14223 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135067.558077:0:14209:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9fe9cc3c1300) 00010000:00010000:1.0:1783135067.558082:0:14209:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ac000/0xd6c4b8f05867fc09 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135067.558112:0:14209:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ac000/0xd6c4b8f05867fc09 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135067.558121:0:14209:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ac000/0xd6c4b8f05867fc09 lrc: 4/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135067.558150:0:14209:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783135067.558214:0:14209:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fea00bcc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2b138366-7a70-4ff2-909d-348210e4a0a2+30:2369:x1869752373988864:12345-192.168.201.41@tcp:103:ldlm_bl.0 Request processed in 248us (733us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135067.558223:0:14209:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 15 00010000:00010000:0.0:1783135067.558354:0:14223:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ac000/0xd6c4b8f05867fc09 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135067.558362:0:14223:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ac000/0xd6c4b8f05867fc09 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783135067.558421:0:14223:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:0.0:1783135067.558425:0:14223:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1783135067.558447:0:14223:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ac000/0xd6c4b8f05867fc09 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135067.558483:0:14223:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ad400/0xd6c4b8f05867fc02 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb76c5 expref: 30 pid: 14223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135067.558498:0:14223:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ac000/0xd6c4b8f05867fc09 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb76c5 expref: 29 pid: 14223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135067.558507:0:14223:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9fe9cc3c1300) 00010000:00010000:0.0:1783135067.558517:0:14223:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1783135067.558521:0:14223:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fe9f68ac000, rc 0) 00000100:00100000:0.0:1783135067.558547:0:14223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fea00bcf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2b138366-7a70-4ff2-909d-348210e4a0a2+29:14492:x1869752373988736:12345-192.168.201.41@tcp:101:bash.0 Request processed in 5659us (5844us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135067.558554:0:14223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 41 00000100:00100000:3.0:1783135067.563553:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:0.0:1783135067.563729:0:14225:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373989120 00000100:00100000:0.0:1783135067.563741:0:14225:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373989120 00000100:00100000:0.0:1783135067.563807:0:14225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 9 00000100:00100000:0.0:1783135067.563818:0:14225:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fea00bcca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2b138366-7a70-4ff2-909d-348210e4a0a2+29:14492:x1869752373989120:12345-192.168.201.41@tcp:35:bash.0 00000100:00100000:0.0:1783135067.564141:0:14225:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fea00bcca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2b138366-7a70-4ff2-909d-348210e4a0a2+30:14492:x1869752373989120:12345-192.168.201.41@tcp:35:bash.0 Request processed in 322us (600us total) trans 8589934616 rc 0/0 00000100:00100000:0.0:1783135067.564150:0:14225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 9 00000100:00100000:3.0:1783135067.649903:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:2.0:1783135067.650037:0:14222:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373989376 00000100:00100000:2.0:1783135067.650057:0:14222:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373989376 00000100:00100000:2.0:1783135067.650128:0:14222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 42 00000100:00100000:2.0:1783135067.650139:0:14222:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fea00bcc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2b138366-7a70-4ff2-909d-348210e4a0a2+30:14502:x1869752373989376:12345-192.168.201.41@tcp:101:lfs.0 00010000:00010000:2.0:1783135067.650173:0:14222:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783135067.650201:0:14222:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c1523a00/0xd6c4b8f05867fc10 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4428da03f5eb76cc expref: -99 pid: 14222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783135067.650527:0:14222:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:2.0:1783135067.650667:0:14222:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c1523a00/0xd6c4b8f05867fc10 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb76cc expref: 32 pid: 14222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135067.650685:0:14222:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fe9cc3c1600) 00010000:00010000:2.0:1783135067.650688:0:14222:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1783135067.650694:0:14222:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c1523a00/0xd6c4b8f05867fc10 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb76cc expref: 32 pid: 14222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135067.650722:0:14222:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fe9c1523a00, rc 0) 00000100:00100000:2.0:1783135067.650798:0:14222:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fea00bcc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2b138366-7a70-4ff2-909d-348210e4a0a2+31:14502:x1869752373989376:12345-192.168.201.41@tcp:101:lfs.0 Request processed in 660us (908us total) trans 8589934617 rc 301/301 00000100:00100000:2.0:1783135067.650806:0:14222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 42 00010000:00010000:1.0:1783135067.652168:0:15220:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783135067.654369:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:0.0:1783135067.654522:0:14223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373989504 00000100:00100000:0.0:1783135067.654535:0:14223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373989504 00000100:00100000:0.0:1783135067.654610:0:14223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 43 00000100:00100000:0.0:1783135067.654620:0:14223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fe82a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2b138366-7a70-4ff2-909d-348210e4a0a2+31:14502:x1869752373989504:12345-192.168.201.41@tcp:34:lfs.0 00010000:00010000:0.0:1783135067.654718:0:14223:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ad400/0xd6c4b8f05867fc1e lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135067.654739:0:14223:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ad400/0xd6c4b8f05867fc1e lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135067.654753:0:14223:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ad400/0xd6c4b8f05867fc1e lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135067.654769:0:14223:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ace00/0xd6c4b8f05867fc25 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135067.654776:0:14223:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ace00/0xd6c4b8f05867fc25 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135067.654798:0:14223:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ace00/0xd6c4b8f05867fc25 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135067.654909:0:14223:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ac800/0xd6c4b8f05867fc2c lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135067.654918:0:14223:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ac800/0xd6c4b8f05867fc2c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135067.654925:0:14223:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ac800/0xd6c4b8f05867fc2c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1783135067.654977:0:14223:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ac800/0xd6c4b8f05867fc2c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135067.654990:0:14223:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ad400/0xd6c4b8f05867fc1e lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135067.654997:0:14223:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ad400/0xd6c4b8f05867fc1e lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135067.655006:0:14223:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ad400/0xd6c4b8f05867fc1e lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135067.655012:0:14223:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe9f68ad400 already unused, calling callback (ffffffffc1f634f0) 00010000:00010000:0.0:1783135067.655017:0:14223:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ad400/0xd6c4b8f05867fc1e lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135067.655050:0:14223:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ad400/0xd6c4b8f05867fc1e lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135067.655065:0:14223:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9fe9c8301a00) 00010000:00010000:0.0:1783135067.655075:0:14223:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783135067.655081:0:14223:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ad400/0xd6c4b8f05867fc1e lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135067.655088:0:14223:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ad400/0xd6c4b8f05867fc1e lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135067.655103:0:14223:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ace00/0xd6c4b8f05867fc25 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135067.655109:0:14223:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ace00/0xd6c4b8f05867fc25 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135067.655115:0:14223:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ace00/0xd6c4b8f05867fc25 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135067.655121:0:14223:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe9f68ace00 already unused, calling callback (ffffffffc1f634f0) 00010000:00010000:0.0:1783135067.655124:0:14223:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ace00/0xd6c4b8f05867fc25 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135067.655129:0:14223:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ace00/0xd6c4b8f05867fc25 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135067.655135:0:14223:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff9fe9c8301f00) 00010000:00010000:0.0:1783135067.655137:0:14223:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783135067.655140:0:14223:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ace00/0xd6c4b8f05867fc25 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135067.655145:0:14223:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ace00/0xd6c4b8f05867fc25 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135067.655159:0:14223:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ac800/0xd6c4b8f05867fc2c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135067.655169:0:14223:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ac800/0xd6c4b8f05867fc2c lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135067.655175:0:14223:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ac800/0xd6c4b8f05867fc2c lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135067.655180:0:14223:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe9f68ac800 already unused, calling callback (ffffffffc1f634f0) 00010000:00010000:0.0:1783135067.655182:0:14223:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ac800/0xd6c4b8f05867fc2c lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135067.655188:0:14223:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ac800/0xd6c4b8f05867fc2c lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135067.655195:0:14223:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9fe9cc3c1300) 00010000:00010000:0.0:1783135067.655197:0:14223:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783135067.655200:0:14223:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ac800/0xd6c4b8f05867fc2c lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135067.655205:0:14223:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ac800/0xd6c4b8f05867fc2c lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783135067.655945:0:14223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fe82a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2b138366-7a70-4ff2-909d-348210e4a0a2+31:14502:x1869752373989504:12345-192.168.201.41@tcp:34:lfs.0 Request processed in 1320us (1584us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135067.655956:0:14223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 43 00000100:00100000:3.0:1783135067.658822:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:2.0:1783135067.658945:0:14226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373989760 00000100:00100000:2.0:1783135067.658959:0:14226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373989760 00000100:00100000:0.0:1783135067.659470:0:14225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 10 00000100:00100000:0.0:1783135067.659485:0:14225:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9ff678450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2b138366-7a70-4ff2-909d-348210e4a0a2+31:14502:x1869752373989760:12345-192.168.201.41@tcp:35:lfs.0 00000100:00100000:0.0:1783135067.659925:0:14225:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9ff678450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2b138366-7a70-4ff2-909d-348210e4a0a2+32:14502:x1869752373989760:12345-192.168.201.41@tcp:35:lfs.0 Request processed in 443us (1117us total) trans 8589934618 rc 0/0 00000100:00100000:0.0:1783135067.659956:0:14225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 10 00000100:00100000:2.0:1783135067.693779:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:1.0:1783135067.693874:0:14224:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373990016 00000100:00100000:1.0:1783135067.693886:0:14224:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373990016 00000100:00100000:1.0:1783135067.693953:0:14224:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 44 00000100:00100000:1.0:1783135067.693963:0:14224:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fe829c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2b138366-7a70-4ff2-909d-348210e4a0a2+32:14505:x1869752373990016:12345-192.168.201.41@tcp:101:lfs.0 00010000:00010000:1.0:1783135067.693994:0:14224:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783135067.694030:0:14224:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe8c5550200/0xd6c4b8f05867fc33 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4428da03f5eb76d3 expref: -99 pid: 14224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135067.694248:0:14224:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe8c5551600/0xd6c4b8f05867fc3a lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135067.694264:0:14224:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fe8c5551600/0xd6c4b8f05867fc3a lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135067.694277:0:14224:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe8c5551600/0xd6c4b8f05867fc3a lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135067.694316:0:14224:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe8c5550e00/0xd6c4b8f05867fc41 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135067.694404:0:14224:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fe8c5550e00/0xd6c4b8f05867fc41 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135067.694412:0:14224:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe8c5550e00/0xd6c4b8f05867fc41 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135067.694559:0:14224:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe8c5551200/0xd6c4b8f05867fc48 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135067.694568:0:14224:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fe8c5551200/0xd6c4b8f05867fc48 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135067.694576:0:14224:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe8c5551200/0xd6c4b8f05867fc48 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14224 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783135067.694587:0:14224:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1783135067.694697:0:14224:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe8c5551600/0xd6c4b8f05867fc3a lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135067.694705:0:14224:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fe8c5551600/0xd6c4b8f05867fc3a lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135067.694712:0:14224:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fe8c5551600/0xd6c4b8f05867fc3a lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135067.694718:0:14224:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe8c5551600 already unused, calling callback (ffffffffc1f634f0) 00010000:00010000:1.0:1783135067.694724:0:14224:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe8c5551600/0xd6c4b8f05867fc3a lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135067.694732:0:14224:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe8c5551600/0xd6c4b8f05867fc3a lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135067.694756:0:14224:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9fe9c8301a00) 00010000:00010000:1.0:1783135067.694759:0:14224:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783135067.694764:0:14224:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fe8c5551600/0xd6c4b8f05867fc3a lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135067.694771:0:14224:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe8c5551600/0xd6c4b8f05867fc3a lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135067.694786:0:14224:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe8c5550e00/0xd6c4b8f05867fc41 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135067.694792:0:14224:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fe8c5550e00/0xd6c4b8f05867fc41 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135067.694798:0:14224:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fe8c5550e00/0xd6c4b8f05867fc41 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135067.694804:0:14224:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe8c5550e00 already unused, calling callback (ffffffffc1f634f0) 00010000:00010000:1.0:1783135067.694807:0:14224:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe8c5550e00/0xd6c4b8f05867fc41 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135067.694813:0:14224:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe8c5550e00/0xd6c4b8f05867fc41 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135067.694819:0:14224:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff9fe9e1c2bc00) 00010000:00010000:1.0:1783135067.694821:0:14224:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783135067.694824:0:14224:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fe8c5550e00/0xd6c4b8f05867fc41 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135067.694829:0:14224:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe8c5550e00/0xd6c4b8f05867fc41 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135067.694886:0:14224:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe8c5550200/0xd6c4b8f05867fc33 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb76d3 expref: 35 pid: 14224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135067.694900:0:14224:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe8c5551200/0xd6c4b8f05867fc48 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb76d3 expref: 34 pid: 14224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135067.694908:0:14224:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9fe9cc3c1300) 00010000:00010000:1.0:1783135067.694910:0:14224:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1783135067.694913:0:14224:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fe8c5551200, rc 0) 00000100:00100000:1.0:1783135067.695147:0:14224:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fe829c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2b138366-7a70-4ff2-909d-348210e4a0a2+34:14505:x1869752373990016:12345-192.168.201.41@tcp:101:lfs.0 Request processed in 1184us (1380us total) trans 8589934619 rc 0/0 00000100:00100000:1.0:1783135067.695156:0:14224:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 44 00000100:00100000:3.0:1783135067.699134:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:3.0:1783135067.699183:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:0.0:1783135067.699367:0:16002:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373990272 00000100:00100000:0.0:1783135067.699379:0:16002:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373990272 00000100:00100000:0.0:1783135067.699445:0:16002:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 11 00000100:00100000:0.0:1783135067.699456:0:16002:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fea00bcc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:2b138366-7a70-4ff2-909d-348210e4a0a2+34:14505:x1869752373990272:12345-192.168.201.41@tcp:35:lfs.0 00000100:00100000:0.0:1783135067.699734:0:16002:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fea00bcc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:2b138366-7a70-4ff2-909d-348210e4a0a2+35:14505:x1869752373990272:12345-192.168.201.41@tcp:35:lfs.0 Request processed in 278us (612us total) trans 8589934620 rc 0/0 00000100:00100000:0.0:1783135067.699743:0:16002:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 11 00000100:00100000:1.0:1783135067.699925:0:16237:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373990400 00000100:00100000:1.0:1783135067.699931:0:16237:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373990400 00000100:00100000:1.0:1783135067.699976:0:16237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 0 00000100:00100000:1.0:1783135067.699984:0:16237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fea00bced80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2b138366-7a70-4ff2-909d-348210e4a0a2+35:2368:x1869752373990400:12345-192.168.201.41@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1783135067.699996:0:16237:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783135067.700035:0:16237:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe8c5551200/0xd6c4b8f05867fc48 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb76d3 expref: 35 pid: 14224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135067.700076:0:16237:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9fe9cc3c1300) 00010000:00010000:1.0:1783135067.700082:0:16237:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783135067.700101:0:16237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fea00bced80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2b138366-7a70-4ff2-909d-348210e4a0a2+34:2368:x1869752373990400:12345-192.168.201.41@tcp:103:ldlm_bl.0 Request processed in 118us (917us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135067.700108:0:16237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 0 00000100:00100000:3.0:1783135067.706627:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:2.0:1783135067.707090:0:14222:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373990528 00000100:00100000:2.0:1783135067.707103:0:14222:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373990528 00000100:00100000:2.0:1783135067.707181:0:14222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 45 00000100:00100000:2.0:1783135067.707194:0:14222:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fea00bcfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2b138366-7a70-4ff2-909d-348210e4a0a2+34:14505:x1869752373990528:12345-192.168.201.41@tcp:54:lfs.0 00010000:00010000:2.0:1783135067.707777:0:14222:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c1523e00/0xd6c4b8f05867fc56 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135067.707801:0:14222:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c1523e00/0xd6c4b8f05867fc56 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135067.707817:0:14222:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c1523e00/0xd6c4b8f05867fc56 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135067.707868:0:14222:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c1523e00/0xd6c4b8f05867fc56 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135067.707876:0:14222:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c1523e00/0xd6c4b8f05867fc56 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135067.707884:0:14222:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c1523e00/0xd6c4b8f05867fc56 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135067.707909:0:14222:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe9c1523e00 already unused, calling callback (ffffffffc1f634f0) 00010000:00010000:2.0:1783135067.707914:0:14222:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c1523e00/0xd6c4b8f05867fc56 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135067.707923:0:14222:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c1523e00/0xd6c4b8f05867fc56 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135067.707939:0:14222:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9fe9cc3c1300) 00010000:00010000:2.0:1783135067.707942:0:14222:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1783135067.707948:0:14222:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c1523e00/0xd6c4b8f05867fc56 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135067.707954:0:14222:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c1523e00/0xd6c4b8f05867fc56 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14222 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783135067.708085:0:14222:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fea00bcfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2b138366-7a70-4ff2-909d-348210e4a0a2+34:14505:x1869752373990528:12345-192.168.201.41@tcp:54:lfs.0 Request processed in 892us (1470us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135067.708094:0:14222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 45 00000100:00100000:2.0:1783135067.880541:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:1.0:1783135067.880686:0:14224:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373990656 00000100:00100000:1.0:1783135067.880698:0:14224:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373990656 00000100:00100000:1.0:1783135067.880767:0:14224:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 46 00000100:00100000:1.0:1783135067.880777:0:14224:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fe82ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2b138366-7a70-4ff2-909d-348210e4a0a2+34:14524:x1869752373990656:12345-192.168.201.41@tcp:101:lfs.0 00010000:00010000:1.0:1783135067.880802:0:14224:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783135067.880826:0:14224:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe8c5551200/0xd6c4b8f05867fc5d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4428da03f5eb76da expref: -99 pid: 14224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135067.880910:0:14224:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe8c5550200/0xd6c4b8f05867fc64 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135067.880926:0:14224:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fe8c5550200/0xd6c4b8f05867fc64 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135067.880939:0:14224:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe8c5550200/0xd6c4b8f05867fc64 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14224 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783135067.881013:0:14224:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00000004:00200000:1.0:1783135067.881029:0:14224:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:1.0:1783135067.881178:0:14224:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fe8c5550200/0xd6c4b8f05867fc64 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135067.881208:0:14224:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe8c5551200/0xd6c4b8f05867fc5d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb76da expref: 36 pid: 14224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135067.881230:0:14224:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe8c5550200/0xd6c4b8f05867fc64 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb76da expref: 35 pid: 14224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135067.881240:0:14224:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9fe9c8301a00) 00010000:00010000:1.0:1783135067.881244:0:14224:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1783135067.881265:0:14224:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fe8c5550200, rc 0) 00000100:00100000:1.0:1783135067.881606:0:14224:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fe82ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2b138366-7a70-4ff2-909d-348210e4a0a2+35:14524:x1869752373990656:12345-192.168.201.41@tcp:101:lfs.0 Request processed in 829us (1077us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135067.881614:0:14224:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 46 00000100:00100000:3.0:1783135067.887831:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:0.0:1783135067.887888:0:14225:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373991040 00000100:00100000:0.0:1783135067.887900:0:14225:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373991040 00000100:00100000:0.0:1783135067.887971:0:14225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 12 00000100:00100000:0.0:1783135067.887982:0:14225:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fea00bcea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2b138366-7a70-4ff2-909d-348210e4a0a2+35:14524:x1869752373991040:12345-192.168.201.41@tcp:35:lfs.0 00000100:00100000:0.0:1783135067.888447:0:14225:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fea00bcea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2b138366-7a70-4ff2-909d-348210e4a0a2+36:14524:x1869752373991040:12345-192.168.201.41@tcp:35:lfs.0 Request processed in 465us (628us total) trans 8589934621 rc 0/0 00000100:00100000:0.0:1783135067.888455:0:14225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 12 00000100:00100000:2.0:1783135067.890891:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:1.0:1783135067.890971:0:14209:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373991168 00000100:00100000:1.0:1783135067.890983:0:14209:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373991168 00000100:00100000:1.0:1783135067.891072:0:14209:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 1 00000100:00100000:1.0:1783135067.891082:0:14209:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fe82b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2b138366-7a70-4ff2-909d-348210e4a0a2+36:14524:x1869752373991168:12345-192.168.201.41@tcp:103:lfs.0 00010000:00010000:1.0:1783135067.891101:0:14209:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1783135067.891130:0:14209:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ac000/0xd6c4b8f05867fc09 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb76c5 expref: 36 pid: 14223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135067.891153:0:14209:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ac200/0xd6c4b8f05867fb68 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb769b expref: 35 pid: 14223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135067.891164:0:14209:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9fe9cc3c1300) 00010000:00010000:1.0:1783135067.891177:0:14209:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783135067.891324:0:14209:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fe82b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2b138366-7a70-4ff2-909d-348210e4a0a2+34:14524:x1869752373991168:12345-192.168.201.41@tcp:103:lfs.0 Request processed in 197us (399us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135067.891332:0:14209:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 1 00000100:00100000:2.0:1783135067.893163:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:1.0:1783135067.893574:0:14222:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373991296 00000100:00100000:1.0:1783135067.893588:0:14222:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373991296 00000100:00100000:1.0:1783135067.893653:0:14222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 47 00000100:00100000:1.0:1783135067.893664:0:14222:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fe828000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2b138366-7a70-4ff2-909d-348210e4a0a2+34:14524:x1869752373991296:12345-192.168.201.41@tcp:58:lfs.0 00010000:00010000:1.0:1783135067.893842:0:14222:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe8c5551200/0xd6c4b8f05867fc6b lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135067.893862:0:14222:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fe8c5551200/0xd6c4b8f05867fc6b lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135067.893881:0:14222:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe8c5551200/0xd6c4b8f05867fc6b lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14222 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1783135067.894874:0:14222:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1783135067.894948:0:14222:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 64 off8320 00000040:00080000:1.0:1783135067.895168:0:14222:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].1, 136 off8328 00000100:00100000:1.0:1783135067.895678:0:14222:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fe828000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2b138366-7a70-4ff2-909d-348210e4a0a2+34:14524:x1869752373991296:12345-192.168.201.41@tcp:58:lfs.0 Request processed in 2009us (2520us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135067.895690:0:14222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 47 00000100:00100000:3.0:1783135067.915897:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:0.0:1783135067.917135:0:14223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373991424 00000100:00100000:0.0:1783135067.917152:0:14223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373991424 00000100:00100000:0.0:1783135067.917358:0:14223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 48 00000100:00100000:0.0:1783135067.917371:0:14223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fea00bcf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2b138366-7a70-4ff2-909d-348210e4a0a2+34:14526:x1869752373991424:12345-192.168.201.41@tcp:101:lfs.0 00010000:00010000:0.0:1783135067.917398:0:14223:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783135067.917426:0:14223:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ac800/0xd6c4b8f05867fc72 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4428da03f5eb76e1 expref: -99 pid: 14223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135067.917508:0:14223:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ace00/0xd6c4b8f05867fc79 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135067.917548:0:14223:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ace00/0xd6c4b8f05867fc79 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135067.917562:0:14223:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ace00/0xd6c4b8f05867fc79 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135067.917579:0:14223:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ad400/0xd6c4b8f05867fc80 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135067.917586:0:14223:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ad400/0xd6c4b8f05867fc80 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135067.917592:0:14223:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ad400/0xd6c4b8f05867fc80 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135067.917726:0:14223:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ade00/0xd6c4b8f05867fc87 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135067.917734:0:14223:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ade00/0xd6c4b8f05867fc87 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135067.917740:0:14223:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ade00/0xd6c4b8f05867fc87 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783135067.917789:0:14223:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:0.0:1783135067.917794:0:14223:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1783135067.917823:0:14223:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ade00/0xd6c4b8f05867fc87 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135067.917838:0:14223:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ade00/0xd6c4b8f05867fc87 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135067.917859:0:14223:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ace00/0xd6c4b8f05867fc79 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135067.917866:0:14223:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ace00/0xd6c4b8f05867fc79 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135067.917874:0:14223:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ace00/0xd6c4b8f05867fc79 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135067.917881:0:14223:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe9f68ace00 already unused, calling callback (ffffffffc1f634f0) 00010000:00010000:0.0:1783135067.917886:0:14223:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ace00/0xd6c4b8f05867fc79 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135067.917895:0:14223:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ace00/0xd6c4b8f05867fc79 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135067.917910:0:14223:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9fe9c8301a00) 00010000:00010000:0.0:1783135067.917914:0:14223:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783135067.917919:0:14223:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ace00/0xd6c4b8f05867fc79 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135067.917926:0:14223:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ace00/0xd6c4b8f05867fc79 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135067.917941:0:14223:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ad400/0xd6c4b8f05867fc80 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135067.917948:0:14223:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ad400/0xd6c4b8f05867fc80 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135067.917954:0:14223:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ad400/0xd6c4b8f05867fc80 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135067.917964:0:14223:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe9f68ad400 already unused, calling callback (ffffffffc1f634f0) 00010000:00010000:0.0:1783135067.917967:0:14223:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ad400/0xd6c4b8f05867fc80 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135067.917973:0:14223:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ad400/0xd6c4b8f05867fc80 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135067.917979:0:14223:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff9fe9c8301f00) 00010000:00010000:0.0:1783135067.917981:0:14223:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783135067.917984:0:14223:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ad400/0xd6c4b8f05867fc80 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135067.917989:0:14223:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ad400/0xd6c4b8f05867fc80 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135067.918139:0:14223:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ac800/0xd6c4b8f05867fc72 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb76e1 expref: 36 pid: 14223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135067.918158:0:14223:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ade00/0xd6c4b8f05867fc87 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb76e1 expref: 35 pid: 14223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135067.918166:0:14223:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9fe9e1c2bc00) 00010000:00010000:0.0:1783135067.918168:0:14223:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1783135067.918171:0:14223:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fe9f68ade00, rc 0) 00000100:00100000:0.0:1783135067.918416:0:14223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fea00bcf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2b138366-7a70-4ff2-909d-348210e4a0a2+35:14526:x1869752373991424:12345-192.168.201.41@tcp:101:lfs.0 Request processed in 1045us (2536us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135067.918425:0:14223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 48 00010000:00010000:2.0:1783135068.675649:0:14210:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1783135068.760550:0:16389:0:(llog.c:800:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1783135068.760571:0:16389:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1783135068.760616:0:16389:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:0.0:1783135068.760623:0:16389:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:0.0:1783135068.808751:0:3286:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fea00bce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1869752384445312:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1783135068.808898:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135068.810132:0:14862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384445312 00000100:00100000:1.0:1783135068.810147:0:14862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384445312 00000100:00100000:1.0:1783135068.810219:0:14862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1783135068.810232:0:14862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe8c6dfdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1869752384445312:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1783135068.810299:0:14862:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1783135068.810386:0:14862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe8c6dfdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1869752384445312:12345-0@lo:13:osp-pre-1-0.0 Request processed in 156us (1491us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135068.810394:0:14862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1783135068.814223:0:3288:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe8c6dff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1869752384445568:0@lo:400:kworker.0 00000100:00100000:0.0:1783135068.814685:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135068.814741:0:3288:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1783135068.814749:0:3288:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe8c6dff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3288:1869752384445696:0@lo:400:kworker.0 00000100:00100000:0.0:1783135068.814792:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135068.814988:0:3287:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe8c6dfd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c1fe35bd-99cf-438e-8ada-ed586b673efa:3287:1869752384445440:0@lo:400:kworker.0 00000100:00100000:2.0:1783135068.815148:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135068.815188:0:3287:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe8c6dfc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3287:1869752384445952:0@lo:400:kworker.0 00000100:00100000:2.0:1783135068.815212:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1783135068.815224:0:14218:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1783135068.815233:0:3287:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1783135068.815238:0:3287:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe8c6dfdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3287:1869752384445824:0@lo:400:kworker.0 00000100:00100000:1.0:1783135068.815255:0:14222:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384445696 00000100:00100000:1.0:1783135068.815265:0:14222:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384445696 00000100:00100000:1.0:1783135068.815334:0:14222:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384445952 00000100:00100000:1.0:1783135068.815338:0:14222:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384445952 00000100:00100000:0.0:1783135068.815399:0:14861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384445568 00000100:00100000:3.0:1783135068.815402:0:14216:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384445440 00000100:00100000:0.0:1783135068.815404:0:14861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384445568 00000100:00100000:3.0:1783135068.815406:0:14216:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384445440 00000100:00100000:2.0:1783135068.815454:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135068.815454:0:14222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1783135068.815467:0:14222:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe8c6dff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3288:x1869752384445696:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783135068.815499:0:14861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1783135068.815509:0:14861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe8c6dfce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3288:x1869752384445568:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783135068.815551:0:14222:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe8c6dff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3288:x1869752384445696:12345-0@lo:400:kworker.0 Request processed in 85us (757us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135068.815559:0:14222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1783135068.815583:0:14222:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384445824 00000100:00100000:1.0:1783135068.815586:0:14222:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384445824 00000100:00100000:0.0:1783135068.815591:0:14861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe8c6dfce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3288:x1869752384445568:12345-0@lo:400:kworker.0 Request processed in 85us (909us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135068.815598:0:14861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1783135068.815602:0:14222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1783135068.815608:0:14222:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fe82a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3287:x1869752384445952:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783135068.815619:0:14223:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:0.0:1783135068.815629:0:14223:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:1.0:1783135068.815642:0:14222:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fe82a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3287:x1869752384445952:12345-0@lo:400:kworker.0 Request processed in 34us (429us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135068.815648:0:14222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1783135068.815660:0:14222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1783135068.815668:0:14222:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fe82aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3287:x1869752384445824:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783135068.815713:0:14222:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fe82aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3287:x1869752384445824:12345-0@lo:400:kworker.0 Request processed in 46us (415us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135068.815719:0:14222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00080000:1.0:1783135068.815991:0:14218:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1783135068.815996:0:14218:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1783135068.816051:0:3287:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe8c6dfdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3287:1869752384445824:0@lo:400:kworker.0 00000100:00100000:1.0:1783135068.816066:0:3287:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe8c6dfc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3287:1869752384445952:0@lo:400:kworker.0 00000100:00100000:1.0:1783135068.816514:0:3286:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934594 gen 2 00000100:00100000:1.0:1783135068.816545:0:3286:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fea00bce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1869752384445312:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1783135068.819043:0:3288:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe8c6dff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3288:1869752384445696:0@lo:400:kworker.0 00000100:00100000:2.0:1783135068.819086:0:3288:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe8c6dff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1869752384445568:0@lo:400:kworker.0 00000100:00100000:3.0:1783135068.823858:0:14216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1783135068.823899:0:14216:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9ca9b9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1fe35bd-99cf-438e-8ada-ed586b673efa+19:3287:x1869752384445440:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783135068.824076:0:14216:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9ca9b9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1fe35bd-99cf-438e-8ada-ed586b673efa+19:3287:x1869752384445440:12345-0@lo:400:kworker.0 Request processed in 193us (8926us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135068.825396:0:3287:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe8c6dfd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c1fe35bd-99cf-438e-8ada-ed586b673efa:3287:1869752384445440:0@lo:400:kworker.0 00000100:00100000:3.0:1783135068.825955:0:14216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000040:00080000:3.0:1783135068.867780:0:14257:0:(llog.c:800:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1783135068.867793:0:14257:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1783135068.867862:0:14257:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:3.0:1783135068.867872:0:14257:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:3.0:1783135068.868065:0:14257:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fea00bcce00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14257:1869752384446080:192.168.201.41@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1783135068.868197:0:14257:0:(client.c:2701:ptlrpc_set_wait()) set ffff9fe9e9d2a900 going to sleep for 11 seconds 00000001:00080000:3.0:1783135068.888366:0:5791:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934621 is committed 00000001:00080000:3.0:1783135068.888408:0:5791:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934595 is committed 00000001:00080000:3.0:1783135068.888429:0:5791:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934596 is committed 00000001:00080000:3.0:1783135068.888465:0:5791:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934599 is committed 00000100:00100000:3.0:1783135068.897261:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:2.0:1783135068.897409:0:14233:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373991552 00000100:00100000:2.0:1783135068.897420:0:14233:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373991552 00000100:00100000:2.0:1783135068.897494:0:14233:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 0 00000100:00100000:2.0:1783135068.897506:0:14233:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fea00bcdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:2b138366-7a70-4ff2-909d-348210e4a0a2+12:14538:x1869752373991552:12345-192.168.201.41@tcp:900:lhsmtool_posix.0 00000100:00100000:2.0:1783135068.897614:0:14233:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fea00bcdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:2b138366-7a70-4ff2-909d-348210e4a0a2+12:14538:x1869752373991552:12345-192.168.201.41@tcp:900:lhsmtool_posix.0 Request processed in 111us (368us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135068.897623:0:14233:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 0 00000100:00100000:1.0:1783135068.898232:0:14257:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fea00bcce00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14257:1869752384446080:192.168.201.41@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1783135068.899978:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:2.0:1783135068.900141:0:14222:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373991680 00000100:00100000:2.0:1783135068.900155:0:14222:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373991680 00000100:00100000:2.0:1783135068.900228:0:14222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 49 00000100:00100000:2.0:1783135068.900239:0:14222:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fea00bcdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2b138366-7a70-4ff2-909d-348210e4a0a2+11:14538:x1869752373991680:12345-192.168.201.41@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1783135068.900321:0:14222:0:(mdt_handler.c:7960:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1783135068.900452:0:14222:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fea00bcdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2b138366-7a70-4ff2-909d-348210e4a0a2+11:14538:x1869752373991680:12345-192.168.201.41@tcp:53:lhsmtool_posix.0 Request processed in 213us (483us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135068.900460:0:14222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 49 00000100:00100000:0.0:1783135068.910609:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:0.0:1783135068.910659:0:16395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373991808 00000100:00100000:0.0:1783135068.910672:0:16395:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373991808 00000100:00100000:0.0:1783135068.910761:0:16395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 50 00000100:00100000:0.0:1783135068.910774:0:16395:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe8c6dfe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2b138366-7a70-4ff2-909d-348210e4a0a2+11:14538:x1869752373991808:12345-192.168.201.41@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1783135068.911015:0:16395:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ad400/0xd6c4b8f05867fc8e lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 16395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135068.911038:0:16395:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ad400/0xd6c4b8f05867fc8e lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135068.911072:0:16395:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ad400/0xd6c4b8f05867fc8e lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135068.911091:0:16395:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ace00/0xd6c4b8f05867fc95 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135068.911098:0:16395:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ace00/0xd6c4b8f05867fc95 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135068.911105:0:16395:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ace00/0xd6c4b8f05867fc95 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135068.911141:0:16395:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68aca00/0xd6c4b8f05867fc9c lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 16395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135068.911150:0:16395:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68aca00/0xd6c4b8f05867fc9c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135068.911157:0:16395:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68aca00/0xd6c4b8f05867fc9c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16395 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783135068.911212:0:16395:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:0.0:1783135068.911218:0:16395:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1783135068.911237:0:16395:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68aca00/0xd6c4b8f05867fc9c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135068.911252:0:16395:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ad400/0xd6c4b8f05867fc8e lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135068.911260:0:16395:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ad400/0xd6c4b8f05867fc8e lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 16395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135068.911317:0:16395:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ad400/0xd6c4b8f05867fc8e lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135068.911325:0:16395:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe9f68ad400 already unused, calling callback (ffffffffc1f634f0) 00010000:00010000:0.0:1783135068.911330:0:16395:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ad400/0xd6c4b8f05867fc8e lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135068.911339:0:16395:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ad400/0xd6c4b8f05867fc8e lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 16395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135068.911354:0:16395:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9fe9cc3c1800) 00010000:00010000:0.0:1783135068.911358:0:16395:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783135068.911364:0:16395:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ad400/0xd6c4b8f05867fc8e lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135068.911371:0:16395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ad400/0xd6c4b8f05867fc8e lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135068.911385:0:16395:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ace00/0xd6c4b8f05867fc95 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135068.911391:0:16395:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ace00/0xd6c4b8f05867fc95 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135068.911397:0:16395:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ace00/0xd6c4b8f05867fc95 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135068.911402:0:16395:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe9f68ace00 already unused, calling callback (ffffffffc1f634f0) 00010000:00010000:0.0:1783135068.911405:0:16395:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ace00/0xd6c4b8f05867fc95 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135068.911425:0:16395:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ace00/0xd6c4b8f05867fc95 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135068.911434:0:16395:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x4549062c (ffff9fe9c8301300) 00010000:00010000:0.0:1783135068.911436:0:16395:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783135068.911439:0:16395:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ace00/0xd6c4b8f05867fc95 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135068.911445:0:16395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ace00/0xd6c4b8f05867fc95 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135068.911461:0:16395:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68aca00/0xd6c4b8f05867fc9c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135068.911467:0:16395:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68aca00/0xd6c4b8f05867fc9c lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 16395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135068.911472:0:16395:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68aca00/0xd6c4b8f05867fc9c lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135068.911478:0:16395:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe9f68aca00 already unused, calling callback (ffffffffc1f634f0) 00010000:00010000:0.0:1783135068.911481:0:16395:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68aca00/0xd6c4b8f05867fc9c lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135068.911487:0:16395:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68aca00/0xd6c4b8f05867fc9c lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 16395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135068.911495:0:16395:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9fe9e1c2bc00) 00010000:00010000:0.0:1783135068.911498:0:16395:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783135068.911501:0:16395:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68aca00/0xd6c4b8f05867fc9c lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135068.911519:0:16395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68aca00/0xd6c4b8f05867fc9c lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16395 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783135068.911625:0:16395:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe8c6dfe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2b138366-7a70-4ff2-909d-348210e4a0a2+11:14538:x1869752373991808:12345-192.168.201.41@tcp:34:lhsmtool_posix.0 Request processed in 851us (1029us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135068.911635:0:16395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 50 00000100:00100000:2.0:1783135068.928321:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:3.0:1783135068.928565:0:14222:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373992064 00000100:00100000:3.0:1783135068.928578:0:14222:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373992064 00000100:00100000:3.0:1783135068.928661:0:14222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 51 00000100:00100000:3.0:1783135068.928674:0:14222:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fea17100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2b138366-7a70-4ff2-909d-348210e4a0a2+11:14538:x1869752373992064:12345-192.168.201.41@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1783135068.928710:0:14222:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783135068.928742:0:14222:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c0030000/0xd6c4b8f05867fca3 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4428da03f5eb76e8 expref: -99 pid: 14222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135068.928876:0:14222:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c0030c00/0xd6c4b8f05867fcaa lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135068.928895:0:14222:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c0030c00/0xd6c4b8f05867fcaa lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135068.928911:0:14222:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c0030c00/0xd6c4b8f05867fcaa lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14222 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783135068.928923:0:14222:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:3.0:1783135068.929144:0:14222:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c0030c00/0xd6c4b8f05867fcaa lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135068.929152:0:14222:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c0030c00/0xd6c4b8f05867fcaa lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135068.929159:0:14222:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c0030c00/0xd6c4b8f05867fcaa lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135068.929166:0:14222:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe9c0030c00 already unused, calling callback (ffffffffc1f634f0) 00010000:00010000:3.0:1783135068.929171:0:14222:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c0030c00/0xd6c4b8f05867fcaa lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135068.929179:0:14222:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c0030c00/0xd6c4b8f05867fcaa lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135068.929194:0:14222:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9fe9e1c2bc00) 00010000:00010000:3.0:1783135068.929198:0:14222:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1783135068.929203:0:14222:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c0030c00/0xd6c4b8f05867fcaa lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135068.929209:0:14222:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c0030c00/0xd6c4b8f05867fcaa lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135068.929268:0:14222:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c0030000/0xd6c4b8f05867fca3 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb76e8 expref: 13 pid: 14222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135068.929316:0:14222:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9fe9cc3c1800) 00010000:00010000:3.0:1783135068.929319:0:14222:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1783135068.929323:0:14222:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c0030000/0xd6c4b8f05867fca3 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb76e8 expref: 13 pid: 14222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135068.929347:0:14222:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fe9c0030000, rc 0) 00000100:00100000:3.0:1783135068.929436:0:14222:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fea17100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2b138366-7a70-4ff2-909d-348210e4a0a2+12:14538:x1869752373992064:12345-192.168.201.41@tcp:101:lhsmtool_posix.0 Request processed in 764us (1155us total) trans 8589934622 rc 301/301 00000100:00100000:3.0:1783135068.929444:0:14222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 51 00000100:00100000:3.0:1783135068.932592:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:1.0:1783135068.932703:0:16395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373992192 00000100:00100000:1.0:1783135068.932725:0:16395:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373992192 00000100:00100000:1.0:1783135068.932795:0:16395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 52 00000100:00100000:1.0:1783135068.932806:0:16395:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fea00bcf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2b138366-7a70-4ff2-909d-348210e4a0a2+12:14538:x1869752373992192:12345-192.168.201.41@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1783135068.932872:0:16395:0:(mdt_handler.c:7960:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1783135068.933023:0:16395:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fea00bcf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2b138366-7a70-4ff2-909d-348210e4a0a2+12:14538:x1869752373992192:12345-192.168.201.41@tcp:53:lhsmtool_posix.0 Request processed in 217us (443us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135068.933039:0:16395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 52 00000100:00100000:2.0:1783135068.937214:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:0.0:1783135068.937826:0:14223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373992448 00000100:00100000:0.0:1783135068.937840:0:14223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373992448 00000100:00100000:0.0:1783135068.940121:0:14223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 53 00000100:00100000:0.0:1783135068.940146:0:14223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fea15880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2b138366-7a70-4ff2-909d-348210e4a0a2+12:14538:x1869752373992448:12345-192.168.201.41@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1783135068.940177:0:14223:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783135068.940181:0:14223:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1783135068.940217:0:14223:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe8c5550200/0xd6c4b8f05867fc64 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb76da expref: 12 pid: 14224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135068.940242:0:14223:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9fe9c8301a00) 00010000:00010000:0.0:1783135068.940246:0:14223:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1783135068.940263:0:14223:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68aca00/0xd6c4b8f05867fcb8 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4428da03f5eb76ef expref: -99 pid: 14223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1783135068.941303:0:14223:0:(osp_internal.h:570:osp_update_last_fid()) Gap in objids: start=[0x280000400:0x7:0x0], count =27 00000004:00080000:0.0:1783135068.941314:0:14223:0:(osp_object.c:1645:osp_create()) Writing gap [0x280000400:0x7:0x0]+27 in llog 00000004:00080000:0.0:1783135068.941367:0:14223:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x22:0x0], index 1: 0 00010000:00010000:0.0:1783135068.941714:0:14223:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ace00/0xd6c4b8f05867fcbf lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135068.941733:0:14223:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ace00/0xd6c4b8f05867fcbf lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135068.941754:0:14223:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ace00/0xd6c4b8f05867fcbf lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135068.941838:0:14223:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68aca00/0xd6c4b8f05867fcb8 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb76ef expref: 14 pid: 14223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135068.941858:0:14223:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ace00/0xd6c4b8f05867fcbf lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb76ef expref: 13 pid: 14223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135068.941869:0:14223:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9fe9c8301300) 00010000:00010000:0.0:1783135068.941873:0:14223:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1783135068.941877:0:14223:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fe9f68ace00, rc 0) 00000100:00100000:0.0:1783135068.941991:0:14223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fea15880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2b138366-7a70-4ff2-909d-348210e4a0a2+13:14538:x1869752373992448:12345-192.168.201.41@tcp:101:lhsmtool_posix.0 Request processed in 1853us (4790us total) trans 8589934623 rc 0/0 00000100:00100000:0.0:1783135068.942010:0:14223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 53 00000100:00100000:2.0:1783135068.951187:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:1.0:1783135068.951315:0:16395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373992704 00000100:00100000:1.0:1783135068.951327:0:16395:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373992704 00000100:00100000:1.0:1783135068.951396:0:16395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 54 00000100:00100000:1.0:1783135068.951409:0:16395:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fea15c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2b138366-7a70-4ff2-909d-348210e4a0a2+13:14538:x1869752373992704:12345-192.168.201.41@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1783135068.951484:0:16395:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783135068.951518:0:16395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ace00/0xd6c4b8f05867fcbf lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb76ef expref: 13 pid: 14223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135068.951542:0:16395:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9fe9c8301300) 00010000:00010000:1.0:1783135068.951555:0:16395:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1783135068.951585:0:16395:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe8c5551600/0xd6c4b8f05867fccd lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 16395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135068.951602:0:16395:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fe8c5551600/0xd6c4b8f05867fccd lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135068.951614:0:16395:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe8c5551600/0xd6c4b8f05867fccd lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135068.951635:0:16395:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe8c5551e00/0xd6c4b8f05867fcd4 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd952f2c1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135068.951643:0:16395:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fe8c5551e00/0xd6c4b8f05867fcd4 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd952f2c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135068.951650:0:16395:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe8c5551e00/0xd6c4b8f05867fcd4 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd952f2c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135068.952048:0:16395:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe8c5551600/0xd6c4b8f05867fccd lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135068.952058:0:16395:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fe8c5551600/0xd6c4b8f05867fccd lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 16395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135068.952064:0:16395:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fe8c5551600/0xd6c4b8f05867fccd lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135068.952071:0:16395:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe8c5551600 already unused, calling callback (ffffffffc1f634f0) 00010000:00010000:1.0:1783135068.952076:0:16395:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe8c5551600/0xd6c4b8f05867fccd lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135068.952085:0:16395:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe8c5551600/0xd6c4b8f05867fccd lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 16395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135068.952095:0:16395:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9fe9c8301a00) 00010000:00010000:1.0:1783135068.952098:0:16395:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783135068.952103:0:16395:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fe8c5551600/0xd6c4b8f05867fccd lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135068.952109:0:16395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe8c5551600/0xd6c4b8f05867fccd lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135068.952120:0:16395:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe8c5551e00/0xd6c4b8f05867fcd4 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd952f2c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135068.952126:0:16395:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fe8c5551e00/0xd6c4b8f05867fcd4 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd952f2c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135068.952132:0:16395:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fe8c5551e00/0xd6c4b8f05867fcd4 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd952f2c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135068.952144:0:16395:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe8c5551e00 already unused, calling callback (ffffffffc1f634f0) 00010000:00010000:1.0:1783135068.952148:0:16395:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe8c5551e00/0xd6c4b8f05867fcd4 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd952f2c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135068.952154:0:16395:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe8c5551e00/0xd6c4b8f05867fcd4 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd952f2c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135068.952163:0:16395:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd952f2c1 (ffff9fe9e1c2b600) 00010000:00010000:1.0:1783135068.952165:0:16395:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783135068.952168:0:16395:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fe8c5551e00/0xd6c4b8f05867fcd4 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd952f2c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135068.952174:0:16395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe8c5551e00/0xd6c4b8f05867fcd4 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd952f2c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16395 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783135068.952311:0:16395:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fea15c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2b138366-7a70-4ff2-909d-348210e4a0a2+12:14538:x1869752373992704:12345-192.168.201.41@tcp:36:lhsmtool_posix.0 Request processed in 871us (1106us total) trans 0 rc -2/-2 00000100:00100000:1.0:1783135068.952320:0:16395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 54 00000100:00100000:2.0:1783135068.954616:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:3.0:1783135068.954712:0:14222:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373992832 00000100:00100000:3.0:1783135068.954724:0:14222:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373992832 00000100:00100000:3.0:1783135068.954789:0:14222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 55 00000100:00100000:3.0:1783135068.954801:0:14222:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fea16680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2b138366-7a70-4ff2-909d-348210e4a0a2+12:14538:x1869752373992832:12345-192.168.201.41@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1783135068.954827:0:14222:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783135068.954859:0:14222:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c0030000/0xd6c4b8f05867fcdb lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4428da03f5eb76f6 expref: -99 pid: 14222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135068.954904:0:14222:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c0030c00/0xd6c4b8f05867fce2 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135068.954921:0:14222:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c0030c00/0xd6c4b8f05867fce2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135068.954933:0:14222:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c0030c00/0xd6c4b8f05867fce2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135068.955073:0:14222:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c0030000/0xd6c4b8f05867fcdb lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb76f6 expref: 14 pid: 14222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135068.955096:0:14222:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c0030c00/0xd6c4b8f05867fce2 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb76f6 expref: 13 pid: 14222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135068.955120:0:14222:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9fe9c33d0300) 00010000:00010000:3.0:1783135068.955123:0:14222:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1783135068.955128:0:14222:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fe9c0030c00, rc 0) 00000100:00100000:3.0:1783135068.955199:0:14222:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fea16680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2b138366-7a70-4ff2-909d-348210e4a0a2+13:14538:x1869752373992832:12345-192.168.201.41@tcp:101:lhsmtool_posix.0 Request processed in 400us (597us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135068.955207:0:14222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 55 00000100:00100000:2.0:1783135068.971164:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:1.0:1783135068.971359:0:16395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373993088 00000100:00100000:1.0:1783135068.971374:0:16395:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373993088 00000100:00100000:1.0:1783135068.971448:0:16395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 56 00000100:00100000:1.0:1783135068.971459:0:16395:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9f6cb3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2b138366-7a70-4ff2-909d-348210e4a0a2+13:14538:x1869752373993088:12345-192.168.201.41@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1783135068.971576:0:16395:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe8c5550a00/0xd6c4b8f05867fce9 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 16395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135068.971598:0:16395:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fe8c5550a00/0xd6c4b8f05867fce9 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135068.971612:0:16395:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe8c5550a00/0xd6c4b8f05867fce9 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16395 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1783135068.972199:0:16395:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].2, 88 off8344 00000004:00080000:1.0:1783135068.972217:0:16395:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 351367935738ns, next at 352367931129ns, rc = 0 00000004:00010000:1.0:1783135068.972380:0:16395:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000510ab835 reply state 0000000013f3c641 transno 8589934624 ns: mdt-lustre-MDT0000_UUID lock: ffff9fe8c5550a00/0xd6c4b8f05867fce9 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16395 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783135068.972392:0:16395:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1783135068.972525:0:16395:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9f6cb3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2b138366-7a70-4ff2-909d-348210e4a0a2+15:14538:x1869752373993088:12345-192.168.201.41@tcp:36:lhsmtool_posix.0 Request processed in 1065us (1371us total) trans 8589934624 rc 0/0 00000100:00100000:1.0:1783135068.972534:0:16395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 56 00010000:00010000:1.0:1783135068.983577:0:3273:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe8c5550a00/0xd6c4b8f05867fce9 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135068.983599:0:3273:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fe8c5550a00/0xd6c4b8f05867fce9 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 16395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135068.983711:0:3273:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fe8c5550a00/0xd6c4b8f05867fce9 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135068.983720:0:3273:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe8c5550a00 already unused, calling callback (ffffffffc1f634f0) 00010000:00010000:1.0:1783135068.983726:0:3273:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe8c5550a00/0xd6c4b8f05867fce9 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135068.983735:0:3273:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe8c5550a00/0xd6c4b8f05867fce9 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 16395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135068.983758:0:3273:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9fe9c33d0300) 00010000:00010000:1.0:1783135068.983762:0:3273:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1783135068.983767:0:3273:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fe8c5550a00/0xd6c4b8f05867fce9 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135068.983800:0:3273:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe8c5550a00/0xd6c4b8f05867fce9 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16395 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783135068.983953:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:3.0:1783135068.984073:0:14222:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373993216 00000100:00100000:3.0:1783135068.984086:0:14222:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373993216 00000100:00100000:3.0:1783135068.984588:0:14222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 57 00000100:00100000:3.0:1783135068.984605:0:14222:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fe43b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2b138366-7a70-4ff2-909d-348210e4a0a2+14:14538:x1869752373993216:12345-192.168.201.41@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1783135068.984637:0:14222:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783135068.984732:0:14222:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c0030400/0xd6c4b8f05867fcf0 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4428da03f5eb76fd expref: -99 pid: 14222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135068.984810:0:14222:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c0030400/0xd6c4b8f05867fcf0 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb76fd expref: 15 pid: 14222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135068.984826:0:14222:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c0030400/0xd6c4b8f05867fcf0 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb76fd expref: 15 pid: 14222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135068.984849:0:14222:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9fe9c33d0300) 00010000:00010000:3.0:1783135068.984852:0:14222:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1783135068.984855:0:14222:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fe9c0030400, rc 0) 00000100:00100000:3.0:1783135068.984939:0:14222:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fe43b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2b138366-7a70-4ff2-909d-348210e4a0a2+15:14538:x1869752373993216:12345-192.168.201.41@tcp:101:lhsmtool_posix.0 Request processed in 338us (992us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135068.984963:0:14222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 57 00000100:00100000:3.0:1783135069.003635:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:1.0:1783135069.005080:0:15538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373993344 00000100:00100000:1.0:1783135069.005096:0:15538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373993344 00000100:00100000:1.0:1783135069.005203:0:15538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 13 00000100:00100000:1.0:1783135069.005220:0:15538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fea00bcd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2b138366-7a70-4ff2-909d-348210e4a0a2+5:2370:x1869752373993344:12345-192.168.201.41@tcp:2:lhsmtool_posix.0 00000100:00100000:1.0:1783135069.005712:0:15538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fea00bcd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2b138366-7a70-4ff2-909d-348210e4a0a2+6:2370:x1869752373993344:12345-192.168.201.41@tcp:2:lhsmtool_posix.0 Request processed in 496us (2091us total) trans 8589934595 rc 0/0 00000100:00100000:1.0:1783135069.005721:0:15538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 13 00000100:00080000:3.0:1783135069.007367:0:14218:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1783135069.011681:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:3.0:1783135069.017733:0:14226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373993600 00000100:00100000:3.0:1783135069.017752:0:14226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373993600 00000100:00100000:2.0:1783135069.018653:0:14226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 13 00000100:00100000:2.0:1783135069.018668:0:14226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fe438e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2b138366-7a70-4ff2-909d-348210e4a0a2+15:14538:x1869752373993600:12345-192.168.201.41@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1783135069.019164:0:14226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fe438e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2b138366-7a70-4ff2-909d-348210e4a0a2+16:14538:x1869752373993600:12345-192.168.201.41@tcp:35:lhsmtool_posix.0 Request processed in 498us (7498us total) trans 8589934625 rc 0/0 00000100:00100000:2.0:1783135069.019173:0:14226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 13 00000100:00080000:3.0:1783135069.020320:0:14218:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1783135069.022196:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:0.0:1783135069.026649:0:16395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373993856 00000100:00100000:0.0:1783135069.026664:0:16395:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373993856 00000100:00100000:2.0:1783135069.026809:0:14224:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 58 00000100:00100000:2.0:1783135069.026835:0:14224:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9f6cb0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2b138366-7a70-4ff2-909d-348210e4a0a2+16:14538:x1869752373993856:12345-192.168.201.41@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1783135069.026975:0:14224:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9f6cb0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2b138366-7a70-4ff2-909d-348210e4a0a2+16:14538:x1869752373993856:12345-192.168.201.41@tcp:57:lhsmtool_posix.0 Request processed in 156us (4790us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135069.026984:0:14224:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 58 00000100:00100000:2.0:1783135069.053232:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:3.0:1783135069.053340:0:14222:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373993984 00000100:00100000:3.0:1783135069.053353:0:14222:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373993984 00000100:00100000:3.0:1783135069.053421:0:14222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 59 00000100:00100000:3.0:1783135069.053435:0:14222:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9f6cb1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2b138366-7a70-4ff2-909d-348210e4a0a2+16:14538:x1869752373993984:12345-192.168.201.41@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1783135069.053460:0:14222:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783135069.053486:0:14222:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c0030000/0xd6c4b8f05867fcf7 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4428da03f5eb7704 expref: -99 pid: 14222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135069.053574:0:14222:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c0031400/0xd6c4b8f05867fcfe lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135069.053590:0:14222:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c0031400/0xd6c4b8f05867fcfe lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135069.053603:0:14222:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c0031400/0xd6c4b8f05867fcfe lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14222 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783135069.053649:0:14222:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1783135069.053672:0:14222:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c0031400/0xd6c4b8f05867fcfe lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135069.053701:0:14222:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c0030000/0xd6c4b8f05867fcf7 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb7704 expref: 18 pid: 14222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135069.053919:0:14222:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c0031400/0xd6c4b8f05867fcfe lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb7704 expref: 17 pid: 14222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135069.053930:0:14222:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9fe9c33d0300) 00010000:00010000:3.0:1783135069.053933:0:14222:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1783135069.053938:0:14222:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fe9c0031400, rc 0) 00000100:00100000:3.0:1783135069.054019:0:14222:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9f6cb1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2b138366-7a70-4ff2-909d-348210e4a0a2+17:14538:x1869752373993984:12345-192.168.201.41@tcp:101:lhsmtool_posix.0 Request processed in 587us (797us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135069.054027:0:14222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 59 00000100:00100000:2.0:1783135069.056565:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:3.0:1783135069.056678:0:14861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373994112 00000100:00100000:3.0:1783135069.056689:0:14861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373994112 00000100:00100000:3.0:1783135069.058692:0:14861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 14 00000100:00100000:3.0:1783135069.058709:0:14861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9f6cb2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2b138366-7a70-4ff2-909d-348210e4a0a2+6:2370:x1869752373994112:12345-192.168.201.41@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1783135069.058747:0:14861:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783135069.058776:0:14861:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003d1ec7ff/0xd6c4b8f05867fd05 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4428da03f5eb770b expref: -99 pid: 14861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1783135069.058810:0:14861:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a487b5c, blocks: 0x1 00010000:00010000:3.0:1783135069.058842:0:14861:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=351s v=(0 0) 00010000:00010000:3.0:1783135069.058848:0:14861:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783135069.058860:0:14861:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003d1ec7ff/0xd6c4b8f05867fd05 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb770b expref: 7 pid: 14861 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135069.058883:0:14861:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000003d1ec7ff/0xd6c4b8f05867fd05 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb770b expref: 7 pid: 14861 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135069.058912:0:14861:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fe9c0030a00, rc 0) 00000100:00100000:3.0:1783135069.058989:0:14861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9f6cb2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2b138366-7a70-4ff2-909d-348210e4a0a2+7:2370:x1869752373994112:12345-192.168.201.41@tcp:101:lhsmtool_posix.0 Request processed in 285us (2440us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135069.059008:0:14861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 14 00000100:00100000:1.0:1783135069.063970:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:3.0:1783135069.066029:0:14224:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373994368 00000100:00100000:3.0:1783135069.066045:0:14224:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373994368 00000100:00100000:3.0:1783135069.066117:0:14224:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 60 00000100:00100000:3.0:1783135069.066244:0:14224:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fe43b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2b138366-7a70-4ff2-909d-348210e4a0a2+17:14538:x1869752373994368:12345-192.168.201.41@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1783135069.066416:0:14224:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fe43b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2b138366-7a70-4ff2-909d-348210e4a0a2+17:14538:x1869752373994368:12345-192.168.201.41@tcp:57:lhsmtool_posix.0 Request processed in 289us (2454us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135069.066426:0:14224:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 60 00000100:00100000:2.0:1783135069.070103:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:1.0:1783135069.071161:0:15538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373994496 00000100:00100000:1.0:1783135069.071176:0:15538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373994496 00000100:00100000:1.0:1783135069.071768:0:15538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 15 00000100:00100000:1.0:1783135069.071787:0:15538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9f6cb2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2b138366-7a70-4ff2-909d-348210e4a0a2+7:14538:x1869752373994496:12345-192.168.201.41@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1783135069.071819:0:15538:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783135069.071853:0:15538:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009f6ed2b7/0xd6c4b8f05867fd0c lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4428da03f5eb7712 expref: -99 pid: 15538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135069.071907:0:15538:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000003d1ec7ff/0xd6c4b8f05867fd05 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb770b expref: 8 pid: 14861 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135069.071916:0:15538:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783135069.071925:0:15538:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783135069.071930:0:15538:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009f6ed2b7/0xd6c4b8f05867fd0c lrc: 4/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb7712 expref: 8 pid: 15538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135069.071983:0:15538:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000003d1ec7ff/0xd6c4b8f05867fd05 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb770b expref: 8 pid: 14861 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135069.072105:0:15538:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000003d1ec7ff/0xd6c4b8f05867fd05 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb770b expref: 8 pid: 14861 timeout: 451 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783135069.072122:0:15538:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9fe439500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:15538:1869752384446208:192.168.201.41@tcp:104: 00000100:00100000:1.0:1783135069.072269:0:15538:0:(client.c:2701:ptlrpc_set_wait()) set ffff9fe9d1552000 going to sleep for 11 seconds 00000100:00100000:2.0:1783135069.074723:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:1.0:1783135069.074806:0:15538:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9fe439500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:15538:1869752384446208:192.168.201.41@tcp:104: 00000100:00100000:3.0:1783135069.074814:0:16237:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373994624 00000100:00100000:3.0:1783135069.074822:0:16237:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373994624 00010000:00010000:1.0:1783135069.074847:0:15538:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000009f6ed2b7/0xd6c4b8f05867fd0c lrc: 3/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb7712 expref: 9 pid: 15538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135069.074861:0:16237:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000003d1ec7ff/0xd6c4b8f05867fd05 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb770b expref: 9 pid: 14861 timeout: 451 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135069.074871:0:15538:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fe8c5550200, rc 0) 00000100:00100000:3.0:1783135069.074904:0:16237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 16 00000100:00100000:3.0:1783135069.074914:0:16237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9f68f1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2b138366-7a70-4ff2-909d-348210e4a0a2+9:2369:x1869752373994624:12345-192.168.201.41@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783135069.074930:0:16237:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1783135069.074942:0:15538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9f6cb2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2b138366-7a70-4ff2-909d-348210e4a0a2+9:14538:x1869752373994496:12345-192.168.201.41@tcp:101:lhsmtool_posix.0 Request processed in 3162us (4853us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135069.074951:0:15538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 15 00010000:00010000:3.0:1783135069.074956:0:16237:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000003d1ec7ff/0xd6c4b8f05867fd05 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb770b expref: 9 pid: 14861 timeout: 451 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135069.074969:0:16237:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000003d1ec7ff/0xd6c4b8f05867fd05 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb770b expref: 8 pid: 14861 timeout: 451 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135069.075027:0:16237:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003d1ec7ff/0xd6c4b8f05867fd05 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb770b expref: 8 pid: 14861 timeout: 451 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135069.075044:0:16237:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783135069.075048:0:16237:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783135069.075055:0:16237:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000009f6ed2b7/0xd6c4b8f05867fd0c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb7712 expref: 7 pid: 15538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135069.075063:0:16237:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009f6ed2b7/0xd6c4b8f05867fd0c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb7712 expref: 7 pid: 15538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135069.075095:0:16237:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000009f6ed2b7/0xd6c4b8f05867fd0c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb7712 expref: 7 pid: 15538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783135069.075106:0:16237:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fea00bce680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:16237:1869752384446336:192.168.201.41@tcp:105: 00000100:00100000:3.0:1783135069.075153:0:16237:0:(client.c:2701:ptlrpc_set_wait()) set ffff9fe9e1efae40 going to sleep for 11 seconds 00000100:00100000:3.0:1783135069.077524:0:16237:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fea00bce680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:16237:1869752384446336:192.168.201.41@tcp:105: 00010000:00010000:3.0:1783135069.077559:0:16237:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783135069.077629:0:16237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9f68f1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2b138366-7a70-4ff2-909d-348210e4a0a2+7:2369:x1869752373994624:12345-192.168.201.41@tcp:103:ldlm_bl.0 Request processed in 2714us (2917us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135069.077641:0:16237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 16 00000100:00100000:0.0:1783135069.078942:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:2.0:1783135069.079326:0:14864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373994752 00000100:00100000:2.0:1783135069.079339:0:14864:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373994752 00002000:00100000:2.0:1783135069.079402:0:14864:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x22:0x0] (0->8) req@ffff9fe8c6dfc000 x1869752373994752/t0(0) o4->2b138366-7a70-4ff2-909d-348210e4a0a2@192.168.201.41@tcp:240/0 lens 504/0 e 0 to 0 dl 1783135080 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:100 00002000:00100000:2.0:1783135069.079415:0:14864:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9fe8c6dfc000 with x1869752373994752 ext(0->8) 00002000:00010000:2.0:1783135069.079423:0:14864:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9fe8c6dfc000 00000100:00100000:2.0:1783135069.079489:0:14864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 0 00000100:00100000:2.0:1783135069.079502:0:14864:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe8c6dfc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:2b138366-7a70-4ff2-909d-348210e4a0a2+7:2369:x1869752373994752:12345-192.168.201.41@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1783135069.080220:0:14864:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe8c6dfc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:2b138366-7a70-4ff2-909d-348210e4a0a2+9:2369:x1869752373994752:12345-192.168.201.41@tcp:4:lhsmtool_posix.0 Request processed in 718us (1282us total) trans 8589934596 rc 0/0 00000100:00100000:2.0:1783135069.080235:0:14864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 0 00002000:00100000:2.0:1783135069.080245:0:14864:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x22:0x0] (0->8) req@ffff9fe8c6dfc000 x1869752373994752/t8589934596(0) o4->2b138366-7a70-4ff2-909d-348210e4a0a2@192.168.201.41@tcp:240/0 lens 504/448 e 0 to 0 dl 1783135080 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:100 00002000:00100000:2.0:1783135069.080254:0:14864:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9fe8c6dfc000 with x1869752373994752 ext(0->8) 00002000:00010000:2.0:1783135069.080259:0:14864:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9fe8c6dfc000 00000100:00100000:0.0:1783135069.081957:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:3.0:1783135069.082117:0:14222:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373994880 00000100:00100000:3.0:1783135069.082127:0:14222:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373994880 00000100:00100000:3.0:1783135069.082172:0:14222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 61 00000100:00100000:3.0:1783135069.082198:0:14222:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe8c6dfd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2b138366-7a70-4ff2-909d-348210e4a0a2+17:14538:x1869752373994880:12345-192.168.201.41@tcp:44:lhsmtool_posix.0 00000001:00080000:1.0:1783135069.111341:0:5791:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934623 is committed 00000001:00080000:1.0:1783135069.111395:0:5791:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934624 is committed 00000004:00080000:1.0:1783135069.111403:0:5791:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000001:00080000:1.0:1783135069.111428:0:5791:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934625 is committed 00000100:00100000:1.0:1783135069.111657:0:3288:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fea00bce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1869752384446464:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1783135069.111764:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135069.111933:0:14860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384446464 00000100:00100000:0.0:1783135069.111943:0:14860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384446464 00000100:00100000:0.0:1783135069.112022:0:14860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1783135069.112035:0:14860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fe439500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3288:x1869752384446464:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1783135069.112244:0:14860:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:0.0:1783135069.112247:0:14860:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb mtime from disk: 0 -> 1783135068 00002000:00010000:0.0:1783135069.112249:0:14860:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1783135069.112251:0:14860:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb ctime from disk: 1783135068 -> 1783135068 00002000:00010000:0.0:1783135069.112258:0:14860:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1783135069.112484:0:14860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fe439500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3288:x1869752384446464:12345-0@lo:2:osp-syn-1-0.0 Request processed in 448us (719us total) trans 8589934597 rc 0/0 00000100:00100000:0.0:1783135069.112493:0:14860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000004:00080000:1.0:1783135069.112518:0:3288:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9fea00bce680/2, rc 0, transno 8589934597 00000100:00100000:1.0:1783135069.112525:0:3288:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fea00bce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1869752384446464:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1783135069.113046:0:14222:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe8c6dfd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2b138366-7a70-4ff2-909d-348210e4a0a2+13:14538:x1869752373994880:12345-192.168.201.41@tcp:44:lhsmtool_posix.0 Request processed in 30843us (31092us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135069.113058:0:14222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 61 00000100:00100000:0.0:1783135069.114984:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:1.0:1783135069.115075:0:14858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373995008 00000100:00100000:1.0:1783135069.115089:0:14858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373995008 00000100:00100000:1.0:1783135069.115154:0:14858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 17 00000100:00100000:1.0:1783135069.115168:0:14858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe8c6dff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2b138366-7a70-4ff2-909d-348210e4a0a2+9:2370:x1869752373995008:12345-192.168.201.41@tcp:16:lhsmtool_posix.0 00000001:00080000:2.0:1783135069.139917:0:7470:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934597 is committed 00000001:00080000:2.0:1783135069.139958:0:7470:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934595 is committed 00000001:00080000:2.0:1783135069.139979:0:7470:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934596 is committed 00000100:00100000:1.0:1783135069.140407:0:14858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe8c6dff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2b138366-7a70-4ff2-909d-348210e4a0a2+6:2370:x1869752373995008:12345-192.168.201.41@tcp:16:lhsmtool_posix.0 Request processed in 25229us (25423us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135069.140421:0:14858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 17 00000100:00100000:2.0:1783135069.146931:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:3.0:1783135069.147066:0:16395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373995264 00000100:00100000:3.0:1783135069.147079:0:16395:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373995264 00000100:00100000:3.0:1783135069.147146:0:16395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 62 00000100:00100000:3.0:1783135069.147157:0:16395:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9f68f2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2b138366-7a70-4ff2-909d-348210e4a0a2+13:14538:x1869752373995264:12345-192.168.201.41@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1783135069.147226:0:16395:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783135069.147264:0:16395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c0031400/0xd6c4b8f05867fcfe lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb7704 expref: 13 pid: 14222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135069.147332:0:16395:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9fe9c33d0300) 00010000:00010000:3.0:1783135069.147338:0:16395:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1783135069.147377:0:16395:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c0030a00/0xd6c4b8f05867fd13 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 16395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135069.147393:0:16395:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c0030a00/0xd6c4b8f05867fd13 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135069.147404:0:16395:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c0030a00/0xd6c4b8f05867fd13 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16395 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1783135069.147649:0:16395:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000042b191aa reply state 000000005b5ef843 transno 8589934626 ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c0030a00/0xd6c4b8f05867fd13 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16395 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783135069.147660:0:16395:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1783135069.152550:0:16395:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9f68f2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2b138366-7a70-4ff2-909d-348210e4a0a2+14:14538:x1869752373995264:12345-192.168.201.41@tcp:36:lhsmtool_posix.0 Request processed in 5374us (5615us total) trans 8589934626 rc 0/0 00000100:00100000:2.0:1783135069.152569:0:16395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 62 00000100:00100000:0.0:1783135069.158471:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:3.0:1783135069.158518:0:14861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373995392 00000100:00100000:3.0:1783135069.158532:0:14861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373995392 00010000:00010000:1.0:1783135069.158634:0:3272:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c0030a00/0xd6c4b8f05867fd13 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135069.158649:0:3272:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c0030a00/0xd6c4b8f05867fd13 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 16395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135069.158657:0:3272:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c0030a00/0xd6c4b8f05867fd13 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135069.158665:0:3272:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe9c0030a00 already unused, calling callback (ffffffffc1f634f0) 00010000:00010000:1.0:1783135069.158672:0:3272:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c0030a00/0xd6c4b8f05867fd13 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135069.158681:0:3272:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c0030a00/0xd6c4b8f05867fd13 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 16395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135069.158772:0:3272:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9fe9c33d0300) 00010000:00010000:1.0:1783135069.158776:0:3272:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783135069.158783:0:3272:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c0030a00/0xd6c4b8f05867fd13 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135069.158815:0:3272:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c0030a00/0xd6c4b8f05867fd13 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16395 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783135069.158888:0:14861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 18 00000100:00100000:3.0:1783135069.158902:0:14861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe8c6dff100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2b138366-7a70-4ff2-909d-348210e4a0a2+6:2370:x1869752373995392:12345-192.168.201.41@tcp:2:lhsmtool_posix.0 00002000:00010000:1.0:1783135069.160991:0:14861:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:1.0:1783135069.161078:0:14861:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb mtime from disk: 1783135068 -> 1783135067 00002000:00010000:1.0:1783135069.161082:0:14861:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb atime from disk: 0 -> 1783135066 00002000:00010000:1.0:1783135069.161085:0:14861:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb ctime from disk: 1783135068 -> 1783135067 00002000:00010000:1.0:1783135069.161089:0:14861:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:1.0:1783135069.161262:0:14861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe8c6dff100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2b138366-7a70-4ff2-909d-348210e4a0a2+7:2370:x1869752373995392:12345-192.168.201.41@tcp:2:lhsmtool_posix.0 Request processed in 2353us (2798us total) trans 8589934598 rc 0/0 00000100:00100000:1.0:1783135069.161277:0:14861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 18 00000100:00100000:2.0:1783135069.165414:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:3.0:1783135069.165544:0:14223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373995648 00000100:00100000:3.0:1783135069.165578:0:14223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373995648 00000100:00100000:3.0:1783135069.165644:0:14223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 63 00000100:00100000:3.0:1783135069.165657:0:14223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9f68f0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2b138366-7a70-4ff2-909d-348210e4a0a2+13:14538:x1869752373995648:12345-192.168.201.41@tcp:55:lhsmtool_posix.0 00010000:00010000:3.0:1783135069.165760:0:14223:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c0030600/0xd6c4b8f05867fd1a lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135069.165785:0:14223:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c0030c00/0xd6c4b8f05867fce2 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb76f6 expref: 13 pid: 14222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135069.165797:0:14223:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c0030600/0xd6c4b8f05867fd1a lrc: 4/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135069.165841:0:14223:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c0030c00/0xd6c4b8f05867fce2 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb76f6 expref: 13 pid: 14222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135069.165857:0:14223:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c0030c00/0xd6c4b8f05867fce2 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb76f6 expref: 13 pid: 14222 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783135069.165873:0:14223:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fea00bcd880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14223:1869752384446592:192.168.201.41@tcp:104: 00000100:00100000:3.0:1783135069.165983:0:14223:0:(client.c:2701:ptlrpc_set_wait()) set ffff9fe9d25b3b40 going to sleep for 11 seconds 00000100:00100000:3.0:1783135069.170119:0:14223:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fea00bcd880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14223:1869752384446592:192.168.201.41@tcp:104: 00010000:00010000:3.0:1783135069.170160:0:14223:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c0030600/0xd6c4b8f05867fd1a lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783135069.171438:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:1.0:1783135069.171613:0:14209:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373995776 00000100:00100000:1.0:1783135069.171626:0:14209:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373995776 00010000:00010000:1.0:1783135069.171707:0:14209:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c0030c00/0xd6c4b8f05867fce2 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb76f6 expref: 14 pid: 14222 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783135069.171763:0:14209:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 17 00000100:00100000:1.0:1783135069.171776:0:14209:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9f68f1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2b138366-7a70-4ff2-909d-348210e4a0a2+14:2370:x1869752373995776:12345-192.168.201.41@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1783135069.171798:0:14209:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783135069.171808:0:14209:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c0030c00/0xd6c4b8f05867fce2 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb76f6 expref: 14 pid: 14222 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135069.171824:0:14209:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c0030c00/0xd6c4b8f05867fce2 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb76f6 expref: 14 pid: 14222 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135069.171855:0:14209:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c0030c00/0xd6c4b8f05867fce2 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb76f6 expref: 14 pid: 14222 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135069.171898:0:14209:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9fe9c33d0300) 00010000:00010000:1.0:1783135069.171905:0:14209:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c0030600/0xd6c4b8f05867fd1a lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135069.171917:0:14209:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c0030600/0xd6c4b8f05867fd1a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135069.171927:0:14209:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c0030600/0xd6c4b8f05867fd1a lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135069.171972:0:14209:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783135069.172059:0:14209:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9f68f1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2b138366-7a70-4ff2-909d-348210e4a0a2+13:2370:x1869752373995776:12345-192.168.201.41@tcp:103:ldlm_bl.0 Request processed in 284us (629us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135069.172067:0:14209:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 17 00010000:00010000:3.0:1783135069.172074:0:14223:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c0030600/0xd6c4b8f05867fd1a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135069.172082:0:14223:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c0030600/0xd6c4b8f05867fd1a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135069.172133:0:14223:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c0030600/0xd6c4b8f05867fd1a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135069.172141:0:14223:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c0030600/0xd6c4b8f05867fd1a lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135069.172148:0:14223:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c0030600/0xd6c4b8f05867fd1a lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135069.172155:0:14223:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe9c0030600 already unused, calling callback (ffffffffc1f634f0) 00010000:00010000:3.0:1783135069.172160:0:14223:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c0030600/0xd6c4b8f05867fd1a lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135069.172180:0:14223:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c0030600/0xd6c4b8f05867fd1a lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135069.172190:0:14223:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9fe9c33d0300) 00010000:00010000:3.0:1783135069.172192:0:14223:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:3.0:1783135069.172197:0:14223:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c0030600/0xd6c4b8f05867fd1a lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135069.172202:0:14223:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c0030600/0xd6c4b8f05867fd1a lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783135069.172249:0:14223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9f68f0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2b138366-7a70-4ff2-909d-348210e4a0a2+12:14538:x1869752373995648:12345-192.168.201.41@tcp:55:lhsmtool_posix.0 Request processed in 6594us (6854us total) trans 0 rc -22/-22 00000100:00100000:3.0:1783135069.172258:0:14223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 63 00000100:00100000:2.0:1783135069.176490:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:0.0:1783135069.176620:0:15538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373995904 00000100:00100000:0.0:1783135069.176632:0:15538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373995904 00000100:00100000:0.0:1783135069.176707:0:15538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 19 00000100:00100000:0.0:1783135069.177546:0:15538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9f68f1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2b138366-7a70-4ff2-909d-348210e4a0a2+7:2368:x1869752373995904:12345-192.168.201.41@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1783135069.177614:0:15538:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000047dd9209/0xd6c4b8f05867fd21 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135069.177642:0:15538:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000009f6ed2b7/0xd6c4b8f05867fd0c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb7712 expref: 7 pid: 15538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135069.177664:0:15538:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783135069.177670:0:15538:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1783135069.177675:0:15538:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000047dd9209/0xd6c4b8f05867fd21 lrc: 4/1,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135069.177729:0:15538:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000009f6ed2b7/0xd6c4b8f05867fd0c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb7712 expref: 7 pid: 15538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135069.177745:0:15538:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000009f6ed2b7/0xd6c4b8f05867fd0c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb7712 expref: 7 pid: 15538 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783135069.177788:0:15538:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe8c6dfc380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:15538:1869752384446720:192.168.201.41@tcp:104: 00000100:00100000:1.0:1783135069.181085:0:15538:0:(client.c:2701:ptlrpc_set_wait()) set ffff9fe9fe46cc00 going to sleep for 11 seconds 00000100:00100000:1.0:1783135069.182034:0:15538:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe8c6dfc380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:15538:1869752384446720:192.168.201.41@tcp:104: 00010000:00010000:1.0:1783135069.182072:0:15538:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000047dd9209/0xd6c4b8f05867fd21 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783135069.182780:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:0.0:1783135069.182850:0:14207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373996032 00000100:00100000:0.0:1783135069.182862:0:14207:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373996032 00010000:00010000:0.0:1783135069.182911:0:14207:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000009f6ed2b7/0xd6c4b8f05867fd0c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb7712 expref: 8 pid: 15538 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783135069.182963:0:14207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 18 00000100:00100000:0.0:1783135069.182975:0:14207:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fe69d850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2b138366-7a70-4ff2-909d-348210e4a0a2+8:2370:x1869752373996032:12345-192.168.201.41@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783135069.183010:0:14207:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783135069.183038:0:14207:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000009f6ed2b7/0xd6c4b8f05867fd0c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb7712 expref: 8 pid: 15538 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135069.183054:0:14207:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000009f6ed2b7/0xd6c4b8f05867fd0c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb7712 expref: 8 pid: 15538 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135069.183083:0:14207:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009f6ed2b7/0xd6c4b8f05867fd0c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb7712 expref: 8 pid: 15538 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135069.183105:0:14207:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1783135069.183110:0:14207:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1783135069.183117:0:14207:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000047dd9209/0xd6c4b8f05867fd21 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 15538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135069.183127:0:14207:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000047dd9209/0xd6c4b8f05867fd21 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 15538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135069.183181:0:14207:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783135069.183267:0:14207:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fe69d850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2b138366-7a70-4ff2-909d-348210e4a0a2+7:2370:x1869752373996032:12345-192.168.201.41@tcp:103:ldlm_bl.0 Request processed in 293us (489us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135069.183276:0:14207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 18 00010000:00010000:1.0:1783135069.183483:0:15538:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000047dd9209/0xd6c4b8f05867fd21 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135069.183494:0:15538:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000047dd9209/0xd6c4b8f05867fd21 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135069.183526:0:15538:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000047dd9209/0xd6c4b8f05867fd21 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135069.183542:0:15538:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000047dd9209/0xd6c4b8f05867fd21 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135069.183550:0:15538:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000047dd9209/0xd6c4b8f05867fd21 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135069.183557:0:15538:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe9f68ac400 already unused, calling callback (ffffffffc1527ce0) 00010000:00010000:1.0:1783135069.183561:0:15538:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000047dd9209/0xd6c4b8f05867fd21 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135069.183569:0:15538:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000047dd9209/0xd6c4b8f05867fd21 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135069.183581:0:15538:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000047dd9209/0xd6c4b8f05867fd21 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135069.183588:0:15538:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000047dd9209/0xd6c4b8f05867fd21 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783135069.183693:0:15538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9f68f1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2b138366-7a70-4ff2-909d-348210e4a0a2+6:2368:x1869752373995904:12345-192.168.201.41@tcp:1:lhsmtool_posix.0 Request processed in 6976us (7219us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135069.183770:0:15538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 19 00000100:00100000:2.0:1783135069.187242:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:3.0:1783135069.187708:0:14224:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373996288 00000100:00100000:3.0:1783135069.187729:0:14224:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373996288 00000100:00100000:3.0:1783135069.187802:0:14224:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 64 00000100:00100000:3.0:1783135069.187917:0:14224:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9f68f0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2b138366-7a70-4ff2-909d-348210e4a0a2+12:14538:x1869752373996288:12345-192.168.201.41@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1783135069.188027:0:14224:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c0030600/0xd6c4b8f05867fd28 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135069.188044:0:14224:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c0030600/0xd6c4b8f05867fd28 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135069.188054:0:14224:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c0030600/0xd6c4b8f05867fd28 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135069.188500:0:14224:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c0031400/0xd6c4b8f05867fd2f lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135069.188509:0:14224:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c0030400/0xd6c4b8f05867fcf0 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb76fd expref: 13 pid: 14222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135069.188515:0:14224:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c0031400/0xd6c4b8f05867fd2f lrc: 4/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135069.188548:0:14224:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c0030400/0xd6c4b8f05867fcf0 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb76fd expref: 13 pid: 14222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135069.188560:0:14224:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c0030400/0xd6c4b8f05867fcf0 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb76fd expref: 13 pid: 14222 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783135069.188572:0:14224:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fea00bcd880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14224:1869752384446848:192.168.201.41@tcp:104: 00000100:00100000:3.0:1783135069.188670:0:14224:0:(client.c:2701:ptlrpc_set_wait()) set ffff9fe9d25b3b40 going to sleep for 11 seconds 00000100:00100000:3.0:1783135069.191251:0:14224:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fea00bcd880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14224:1869752384446848:192.168.201.41@tcp:104: 00000100:00100000:0.0:1783135069.191252:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:1.0:1783135069.191433:0:14209:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373996416 00000100:00100000:1.0:1783135069.191442:0:14209:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373996416 00010000:00010000:1.0:1783135069.191489:0:14209:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c0030400/0xd6c4b8f05867fcf0 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb76fd expref: 14 pid: 14222 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783135069.191549:0:14209:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 19 00000100:00100000:1.0:1783135069.191560:0:14209:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe8c6dfdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2b138366-7a70-4ff2-909d-348210e4a0a2+14:2369:x1869752373996416:12345-192.168.201.41@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1783135069.191578:0:14209:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783135069.191585:0:14209:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c0030400/0xd6c4b8f05867fcf0 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb76fd expref: 14 pid: 14222 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135069.191598:0:14209:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c0030400/0xd6c4b8f05867fcf0 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb76fd expref: 14 pid: 14222 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135069.191623:0:14209:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c0030400/0xd6c4b8f05867fcf0 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb76fd expref: 14 pid: 14222 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135069.191642:0:14209:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9fe9c33d0300) 00010000:00010000:1.0:1783135069.191648:0:14209:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c0031400/0xd6c4b8f05867fd2f lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135069.191658:0:14209:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c0031400/0xd6c4b8f05867fd2f lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50290000000000 pid: 14224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135069.191678:0:14209:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c0031400/0xd6c4b8f05867fd2f lrc: 4/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50290000000000 pid: 14224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135069.191714:0:14224:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c0031400/0xd6c4b8f05867fd2f lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135069.191740:0:14224:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c0031400/0xd6c4b8f05867fd2f lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135069.191747:0:14224:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c0031400/0xd6c4b8f05867fd2f lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135069.191860:0:14209:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783135069.191958:0:14209:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe8c6dfdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2b138366-7a70-4ff2-909d-348210e4a0a2+13:2369:x1869752373996416:12345-192.168.201.41@tcp:103:ldlm_bl.0 Request processed in 398us (725us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135069.191966:0:14209:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 19 00000001:00080000:2.0:1783135069.192878:0:14224:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934627 00000001:00080000:2.0:1783135069.193034:0:14224:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934628 00000001:00080000:2.0:1783135069.193141:0:14224:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934629 00000100:00100000:2.0:1783135069.193446:0:14224:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9f68f3b80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:14224:1869752384446976:0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1783135069.195823:0:14224:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135069.195897:0:14224:0:(client.c:2701:ptlrpc_set_wait()) set ffff9fe9f418ae40 going to sleep for 11 seconds 00000100:00100000:1.0:1783135069.195959:0:14227:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384446976 00000100:00100000:1.0:1783135069.195984:0:14227:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384446976 00000100:00100000:1.0:1783135069.196074:0:14227:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1783135069.196087:0:14227:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9f68f1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:14224:x1869752384446976:12345-0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1783135069.196250:0:14227:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9f68f1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:14224:x1869752384446976:12345-0@lo:1000:mdt00_002.0 Request processed in 166us (2598us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135069.196258:0:14227:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1783135069.196344:0:14224:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934597 gen 2 00000004:00080000:3.0:1783135069.196353:0:14224:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9fea00bce680, transno 8589934597 00000100:00100000:3.0:1783135069.196379:0:14224:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9f68f3b80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:14224:1869752384446976:0@lo:1000:mdt00_002.0 00000001:00080000:3.0:1783135069.197450:0:14224:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934630 00000100:00100000:3.0:1783135069.197547:0:14224:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fea00bcd880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:14224:1869752384447104:0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1783135069.197607:0:14224:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135069.197639:0:14224:0:(client.c:2701:ptlrpc_set_wait()) set ffff9fe9d25b3cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1783135069.197779:0:14227:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384447104 00000100:00100000:1.0:1783135069.197787:0:14227:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384447104 00000100:00100000:1.0:1783135069.197834:0:14227:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1783135069.197843:0:14227:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fea00bcd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:14224:x1869752384447104:12345-0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1783135069.198144:0:14227:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fea00bcd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:14224:x1869752384447104:12345-0@lo:1000:mdt00_002.0 Request processed in 301us (535us total) trans 8589934599 rc 0/0 00000100:00100000:1.0:1783135069.198152:0:14227:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1783135069.198220:0:14224:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fea00bcd880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:14224:1869752384447104:0@lo:1000:mdt00_002.0 00010000:00010000:3.0:1783135069.198264:0:14224:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c0031400/0xd6c4b8f05867fd2f lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135069.198275:0:14224:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c0031400/0xd6c4b8f05867fd2f lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135069.198361:0:14224:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c0031400/0xd6c4b8f05867fd2f lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135069.198369:0:14224:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe9c0031400 already unused, calling callback (ffffffffc1f634f0) 00010000:00010000:3.0:1783135069.198374:0:14224:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c0031400/0xd6c4b8f05867fd2f lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135069.198383:0:14224:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c0031400/0xd6c4b8f05867fd2f lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135069.198418:0:14224:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9fe9c33d0300) 00010000:00010000:3.0:1783135069.198421:0:14224:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1783135069.198427:0:14224:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c0031400/0xd6c4b8f05867fd2f lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135069.198434:0:14224:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c0031400/0xd6c4b8f05867fd2f lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135069.198483:0:14224:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe8c5551200/0xd6c4b8f05867fc6b lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135069.198490:0:14224:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fe8c5551200/0xd6c4b8f05867fc6b lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135069.198495:0:14224:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fe8c5551200/0xd6c4b8f05867fc6b lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135069.198501:0:14224:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe8c5551200 already unused, calling callback (ffffffffc1f634f0) 00010000:00010000:3.0:1783135069.198504:0:14224:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe8c5551200/0xd6c4b8f05867fc6b lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135069.198511:0:14224:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe8c5551200/0xd6c4b8f05867fc6b lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135069.198519:0:14224:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9fe9e1c2bc00) 00010000:00010000:3.0:1783135069.198521:0:14224:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1783135069.198524:0:14224:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fe8c5551200/0xd6c4b8f05867fc6b lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135069.198530:0:14224:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe8c5551200/0xd6c4b8f05867fc6b lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135069.198593:0:14224:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c0030000/0xd6c4b8f05867fd36 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135069.198611:0:14224:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ade00/0xd6c4b8f05867fc87 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb76e1 expref: 16 pid: 14223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135069.198848:0:14224:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c0030000/0xd6c4b8f05867fd36 lrc: 4/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135069.198888:0:14224:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ade00/0xd6c4b8f05867fc87 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb76e1 expref: 16 pid: 14223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135069.198905:0:14224:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ade00/0xd6c4b8f05867fc87 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb76e1 expref: 16 pid: 14223 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783135069.198919:0:14224:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fea00bce680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14224:1869752384447232:192.168.201.41@tcp:104: 00000100:00100000:3.0:1783135069.199055:0:14224:0:(client.c:2701:ptlrpc_set_wait()) set ffff9fe9d25b3a80 going to sleep for 11 seconds 00000100:00100000:0.0:1783135069.206426:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:3.0:1783135069.206473:0:14224:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fea00bce680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14224:1869752384447232:192.168.201.41@tcp:104: 00000100:00100000:1.0:1783135069.206497:0:16237:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373996544 00000100:00100000:1.0:1783135069.206505:0:16237:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373996544 00010000:00010000:3.0:1783135069.206510:0:14224:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c0030000/0xd6c4b8f05867fd36 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135069.206554:0:16237:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ade00/0xd6c4b8f05867fc87 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb76e1 expref: 17 pid: 14223 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783135069.206592:0:16237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 20 00000100:00100000:1.0:1783135069.206600:0:16237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe8c6dfc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2b138366-7a70-4ff2-909d-348210e4a0a2+17:2369:x1869752373996544:12345-192.168.201.41@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1783135069.206617:0:16237:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783135069.206623:0:16237:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ade00/0xd6c4b8f05867fc87 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb76e1 expref: 17 pid: 14223 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135069.206638:0:16237:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ade00/0xd6c4b8f05867fc87 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb76e1 expref: 17 pid: 14223 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135069.206681:0:16237:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ade00/0xd6c4b8f05867fc87 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb76e1 expref: 17 pid: 14223 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135069.206700:0:16237:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9fe9e1c2bc00) 00010000:00010000:1.0:1783135069.206706:0:16237:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c0030000/0xd6c4b8f05867fd36 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135069.206717:0:16237:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c0030000/0xd6c4b8f05867fd36 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135069.206726:0:16237:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c0030000/0xd6c4b8f05867fd36 lrc: 4/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135069.206758:0:16237:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1783135069.206810:0:14224:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c0030000/0xd6c4b8f05867fd36 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135069.206829:0:14224:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c0030000/0xd6c4b8f05867fd36 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135069.206844:0:14224:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c0030000/0xd6c4b8f05867fd36 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135069.206857:0:14224:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c0030000/0xd6c4b8f05867fd36 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135069.206864:0:14224:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c0030000/0xd6c4b8f05867fd36 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135069.206869:0:14224:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe9c0030000 already unused, calling callback (ffffffffc1f634f0) 00010000:00010000:3.0:1783135069.206874:0:14224:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c0030000/0xd6c4b8f05867fd36 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135069.206882:0:14224:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c0030000/0xd6c4b8f05867fd36 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135069.206890:0:14224:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9fe9e1c2bc00) 00010000:00010000:3.0:1783135069.206893:0:14224:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783135069.206896:0:14224:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c0030000/0xd6c4b8f05867fd36 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135069.206901:0:14224:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c0030000/0xd6c4b8f05867fd36 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135069.206913:0:14224:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c0030600/0xd6c4b8f05867fd28 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135069.206919:0:14224:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c0030600/0xd6c4b8f05867fd28 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135069.206924:0:14224:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c0030600/0xd6c4b8f05867fd28 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135069.206928:0:14224:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe9c0030600 already unused, calling callback (ffffffffc1f634f0) 00010000:00010000:3.0:1783135069.206937:0:14224:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c0030600/0xd6c4b8f05867fd28 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135069.206942:0:14224:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c0030600/0xd6c4b8f05867fd28 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135069.206948:0:14224:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9fe9e1c2bc00) 00010000:00010000:3.0:1783135069.206950:0:14224:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1783135069.206952:0:14224:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c0030600/0xd6c4b8f05867fd28 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135069.206957:0:14224:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c0030600/0xd6c4b8f05867fd28 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14224 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783135069.207172:0:16237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe8c6dfc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2b138366-7a70-4ff2-909d-348210e4a0a2+16:2369:x1869752373996544:12345-192.168.201.41@tcp:103:ldlm_bl.0 Request processed in 570us (754us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135069.207181:0:16237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 20 00000100:00100000:3.0:1783135069.207232:0:14224:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9f68f0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2b138366-7a70-4ff2-909d-348210e4a0a2+15:14538:x1869752373996288:12345-192.168.201.41@tcp:57:lhsmtool_posix.0 Request processed in 19316us (20003us total) trans 8589934631 rc 0/0 00000100:00100000:3.0:1783135069.207240:0:14224:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 64 00000020:00080000:3.0:1783135069.207245:0:14224:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:2.0:1783135069.207504:0:14257:0:(llog.c:800:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1783135069.207510:0:14257:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1783135069.207561:0:14257:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:2.0:1783135069.207569:0:14257:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:1.0:1783135069.219436:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:3.0:1783135069.219592:0:16002:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373996800 00000100:00100000:3.0:1783135069.219604:0:16002:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373996800 00000100:00100000:3.0:1783135069.219878:0:16002:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 14 00000100:00100000:3.0:1783135069.219891:0:16002:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fe438700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:2b138366-7a70-4ff2-909d-348210e4a0a2+15:14538:x1869752373996800:12345-192.168.201.41@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1783135069.220830:0:16002:0:(mdd_object.c:4010:mdd_close()) Object [0x200000bd1:0x3:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1783135069.220961:0:16002:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934632 00010000:00010000:3.0:1783135069.221027:0:16002:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c0030600/0xd6c4b8f05867fd3d lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16002 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135069.221047:0:16002:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c0030600/0xd6c4b8f05867fd3d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 16002 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135069.221061:0:16002:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c0030600/0xd6c4b8f05867fd3d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 16002 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135069.221081:0:16002:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c0030600/0xd6c4b8f05867fd3d lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 16002 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135069.221089:0:16002:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c0030600/0xd6c4b8f05867fd3d lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 16002 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135069.221096:0:16002:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c0030600/0xd6c4b8f05867fd3d lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 16002 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135069.221129:0:16002:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1783135069.221296:0:16002:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fe438700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:2b138366-7a70-4ff2-909d-348210e4a0a2+17:14538:x1869752373996800:12345-192.168.201.41@tcp:35:lhsmtool_posix.0 Request processed in 1388us (1857us total) trans 8589934633 rc 0/0 00000100:00100000:3.0:1783135069.221307:0:16002:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 14 00000020:00080000:3.0:1783135069.221313:0:16002:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1783135069.221391:0:14211:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783135069.221400:0:14211:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c0030600/0xd6c4b8f05867fd3d lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 16002 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135069.221409:0:14211:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe9c0030600 already unused, calling callback (ffffffffc1527ce0) 00010000:00010000:0.0:1783135069.221414:0:14211:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c0030600/0xd6c4b8f05867fd3d lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 16002 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135069.221423:0:14211:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c0030600/0xd6c4b8f05867fd3d lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 16002 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135069.221438:0:14211:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9fe9c33d0300) 00010000:00010000:0.0:1783135069.221442:0:14211:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1783135069.221447:0:14211:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c0030600/0xd6c4b8f05867fd3d lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 16002 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135069.221454:0:14211:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c0030600/0xd6c4b8f05867fd3d lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 16002 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135069.221474:0:14211:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783135069.221476:0:14211:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783135069.221478:0:14211:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783135069.700091:0:15220:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783135070.339888:0:3289:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fea00bce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1869752384447360:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1783135070.340021:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135070.340142:0:14862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384447360 00000100:00100000:3.0:1783135070.340153:0:14862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384447360 00000100:00100000:3.0:1783135070.340240:0:14862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1783135070.340253:0:14862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fea00bcc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3289:x1869752384447360:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1783135070.340342:0:14862:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1783135070.340410:0:14862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fea00bcc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3289:x1869752384447360:12345-0@lo:13:osp-pre-0-0.0 Request processed in 160us (391us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135070.340418:0:14862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00080000:3.0:1783135070.340446:0:14218:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1783135070.340500:0:3289:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fea00bce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1869752384447360:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1783135070.509931:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:0.0:1783135070.510009:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:0.0:1783135070.510045:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:0.0:1783135070.510080:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:0.0:1783135070.510101:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:0.0:1783135070.510127:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:2.0:1783135070.512146:0:14222:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373997056 00000100:00100000:2.0:1783135070.512165:0:14222:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373997056 00000100:00100000:2.0:1783135070.512236:0:14222:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373997440 00000100:00100000:2.0:1783135070.512240:0:14222:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373997440 00000100:00100000:2.0:1783135070.512292:0:14222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 16 00000100:00100000:2.0:1783135070.512305:0:14222:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fe82b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2b138366-7a70-4ff2-909d-348210e4a0a2+17:2367:x1869752373997056:12345-192.168.201.41@tcp:400:kworker.0 00000100:00100000:2.0:1783135070.512412:0:14222:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fe82b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2b138366-7a70-4ff2-909d-348210e4a0a2+17:2367:x1869752373997056:12345-192.168.201.41@tcp:400:kworker.0 Request processed in 109us (2402us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135070.512420:0:14222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 16 00000100:00100000:2.0:1783135070.512442:0:14222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 17 00000100:00100000:2.0:1783135070.512449:0:14222:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fe90f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa2f4fd1-78f9-41b4-ba50-d28d753ff635+6:2367:x1869752373997440:12345-192.168.201.41@tcp:400:kworker.0 00000100:00100000:2.0:1783135070.512478:0:14222:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fe90f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aa2f4fd1-78f9-41b4-ba50-d28d753ff635+6:2367:x1869752373997440:12345-192.168.201.41@tcp:400:kworker.0 Request processed in 30us (2376us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135070.512484:0:14222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 17 00000100:00100000:1.0:1783135070.512595:0:14860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373997184 00000100:00100000:1.0:1783135070.512601:0:14860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373997184 00000100:00100000:1.0:1783135070.512653:0:14860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373997312 00000100:00100000:1.0:1783135070.512656:0:14860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373997312 00000100:00100000:1.0:1783135070.512671:0:14860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373997568 00000100:00100000:1.0:1783135070.512673:0:14860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373997568 00000100:00100000:1.0:1783135070.512689:0:14860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 8 00000100:00100000:1.0:1783135070.512696:0:14860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fe90ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2b138366-7a70-4ff2-909d-348210e4a0a2+5:2367:x1869752373997184:12345-192.168.201.41@tcp:400:kworker.0 00000100:00100000:1.0:1783135070.512727:0:14860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fe90ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2b138366-7a70-4ff2-909d-348210e4a0a2+5:2367:x1869752373997184:12345-192.168.201.41@tcp:400:kworker.0 Request processed in 33us (2682us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135070.512745:0:14860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 8 00000100:00100000:1.0:1783135070.512758:0:14860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 9 00000100:00100000:1.0:1783135070.512764:0:14860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fe90f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2b138366-7a70-4ff2-909d-348210e4a0a2+6:2367:x1869752373997312:12345-192.168.201.41@tcp:400:kworker.0 00000100:00100000:1.0:1783135070.512790:0:14860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fe90f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2b138366-7a70-4ff2-909d-348210e4a0a2+6:2367:x1869752373997312:12345-192.168.201.41@tcp:400:kworker.0 Request processed in 26us (2709us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135070.512796:0:14860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 9 00000100:00100000:1.0:1783135070.512805:0:14860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 10 00000100:00100000:1.0:1783135070.512811:0:14860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fe95aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:aa2f4fd1-78f9-41b4-ba50-d28d753ff635+5:2367:x1869752373997568:12345-192.168.201.41@tcp:400:kworker.0 00000100:00100000:1.0:1783135070.512831:0:14860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fe95aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:aa2f4fd1-78f9-41b4-ba50-d28d753ff635+5:2367:x1869752373997568:12345-192.168.201.41@tcp:400:kworker.0 Request processed in 21us (2705us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135070.512838:0:14860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 10 00000100:00100000:3.0:1783135070.514866:0:14215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373996928 00000100:00100000:3.0:1783135070.514894:0:14215:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373996928 00000100:00100000:3.0:1783135070.515031:0:14215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 115 00000100:00100000:3.0:1783135070.515042:0:14215:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9ca9bb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:58985142-d56f-4f22-9f82-f587934b3bed+13:2367:x1869752373996928:12345-192.168.201.41@tcp:400:kworker.0 00000100:00100000:3.0:1783135070.515120:0:14215:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9ca9bb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:58985142-d56f-4f22-9f82-f587934b3bed+13:2367:x1869752373996928:12345-192.168.201.41@tcp:400:kworker.0 Request processed in 80us (5206us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135070.515129:0:14215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 115 00000100:00080000:3.0:1783135070.515175:0:14218:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1783135070.515182:0:14218:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1783135070.518853:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:3.0:1783135070.520760:0:14860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373997696 00000100:00100000:3.0:1783135070.520781:0:14860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373997696 00000100:00100000:3.0:1783135070.520937:0:14860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 11 00000100:00100000:3.0:1783135070.520953:0:14860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fe439f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:aa2f4fd1-78f9-41b4-ba50-d28d753ff635+5:2367:x1869752373997696:12345-192.168.201.41@tcp:400:kworker.0 00000100:00100000:3.0:1783135070.521105:0:14860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fe439f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:aa2f4fd1-78f9-41b4-ba50-d28d753ff635+5:2367:x1869752373997696:12345-192.168.201.41@tcp:400:kworker.0 Request processed in 156us (2276us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135070.521115:0:14860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 11 00000100:00080000:0.0:1783135070.524762:0:14218:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1783135070.729614:0:14210:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1783135070.889945:0:16443:0:(llog.c:800:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1783135070.889961:0:16443:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1783135070.890020:0:16443:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:0.0:1783135070.890028:0:16443:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:1.0:1783135070.982316:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:3.0:1783135070.982415:0:14222:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373997952 00000100:00100000:3.0:1783135070.982427:0:14222:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373997952 00000100:00100000:3.0:1783135070.982508:0:14222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 65 00000100:00100000:3.0:1783135070.982522:0:14222:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fe438a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2b138366-7a70-4ff2-909d-348210e4a0a2+17:14555:x1869752373997952:12345-192.168.201.41@tcp:101:lfs.0 00010000:00010000:3.0:1783135070.982556:0:14222:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783135070.982585:0:14222:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c0030000/0xd6c4b8f05867fd44 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4428da03f5eb7719 expref: -99 pid: 14222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783135070.982942:0:14222:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 7680 00010000:00010000:3.0:1783135070.983201:0:14222:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c0030000/0xd6c4b8f05867fd44 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb7719 expref: 19 pid: 14222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135070.983237:0:14222:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fe9cc3c1600) 00010000:00010000:3.0:1783135070.983241:0:14222:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1783135070.983248:0:14222:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c0030000/0xd6c4b8f05867fd44 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb7719 expref: 19 pid: 14222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135070.983265:0:14222:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fe9c0030000, rc 0) 00000100:00100000:3.0:1783135070.983419:0:14222:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fe438a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2b138366-7a70-4ff2-909d-348210e4a0a2+18:14555:x1869752373997952:12345-192.168.201.41@tcp:101:lfs.0 Request processed in 900us (1148us total) trans 8589934634 rc 301/301 00000100:00100000:3.0:1783135070.983430:0:14222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 65 00000100:00100000:3.0:1783135071.005556:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:1.0:1783135071.006271:0:14223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373998080 00000100:00100000:1.0:1783135071.012753:0:14223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373998080 00000100:00100000:1.0:1783135071.017663:0:14223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 66 00000100:00100000:1.0:1783135071.017676:0:14223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fea00bce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2b138366-7a70-4ff2-909d-348210e4a0a2+18:14555:x1869752373998080:12345-192.168.201.41@tcp:34:lfs.0 00010000:00010000:1.0:1783135071.017770:0:14223:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe8c5550200/0xd6c4b8f05867fd52 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135071.017787:0:14223:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fe8c5550200/0xd6c4b8f05867fd52 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135071.017798:0:14223:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe8c5550200/0xd6c4b8f05867fd52 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135071.017821:0:14223:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe8c5551800/0xd6c4b8f05867fd59 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135071.017826:0:14223:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fe8c5551800/0xd6c4b8f05867fd59 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135071.017830:0:14223:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe8c5551800/0xd6c4b8f05867fd59 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135071.018144:0:14223:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe8c5551e00/0xd6c4b8f05867fd60 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135071.018150:0:14223:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fe8c5551e00/0xd6c4b8f05867fd60 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135071.018154:0:14223:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe8c5551e00/0xd6c4b8f05867fd60 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1783135071.018198:0:14223:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fe8c5551e00/0xd6c4b8f05867fd60 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135071.018210:0:14223:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe8c5550200/0xd6c4b8f05867fd52 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135071.018215:0:14223:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fe8c5550200/0xd6c4b8f05867fd52 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135071.018221:0:14223:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fe8c5550200/0xd6c4b8f05867fd52 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135071.018225:0:14223:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe8c5550200 already unused, calling callback (ffffffffc1f634f0) 00010000:00010000:1.0:1783135071.018228:0:14223:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe8c5550200/0xd6c4b8f05867fd52 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135071.018239:0:14223:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe8c5550200/0xd6c4b8f05867fd52 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135071.018251:0:14223:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9fe9c8301a00) 00010000:00010000:1.0:1783135071.018253:0:14223:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783135071.018257:0:14223:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fe8c5550200/0xd6c4b8f05867fd52 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135071.018264:0:14223:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe8c5550200/0xd6c4b8f05867fd52 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135071.018303:0:14223:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe8c5551800/0xd6c4b8f05867fd59 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135071.018311:0:14223:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fe8c5551800/0xd6c4b8f05867fd59 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135071.018317:0:14223:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fe8c5551800/0xd6c4b8f05867fd59 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135071.018322:0:14223:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe8c5551800 already unused, calling callback (ffffffffc1f634f0) 00010000:00010000:1.0:1783135071.018324:0:14223:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe8c5551800/0xd6c4b8f05867fd59 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135071.018329:0:14223:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe8c5551800/0xd6c4b8f05867fd59 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135071.018335:0:14223:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff9fe9e1c2b700) 00010000:00010000:1.0:1783135071.018337:0:14223:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783135071.018339:0:14223:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fe8c5551800/0xd6c4b8f05867fd59 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135071.018361:0:14223:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe8c5551800/0xd6c4b8f05867fd59 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135071.018374:0:14223:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe8c5551e00/0xd6c4b8f05867fd60 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135071.018378:0:14223:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fe8c5551e00/0xd6c4b8f05867fd60 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135071.018382:0:14223:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fe8c5551e00/0xd6c4b8f05867fd60 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135071.018384:0:14223:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe8c5551e00 already unused, calling callback (ffffffffc1f634f0) 00010000:00010000:1.0:1783135071.018386:0:14223:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe8c5551e00/0xd6c4b8f05867fd60 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135071.018389:0:14223:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe8c5551e00/0xd6c4b8f05867fd60 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135071.018393:0:14223:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9fe9e1c2b600) 00010000:00010000:1.0:1783135071.018395:0:14223:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783135071.018396:0:14223:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fe8c5551e00/0xd6c4b8f05867fd60 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135071.018399:0:14223:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe8c5551e00/0xd6c4b8f05867fd60 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783135071.018483:0:14223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fea00bce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2b138366-7a70-4ff2-909d-348210e4a0a2+18:14555:x1869752373998080:12345-192.168.201.41@tcp:34:lfs.0 Request processed in 808us (12944us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135071.018488:0:14223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 66 00000100:00080000:3.0:1783135071.019245:0:14218:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1783135071.022630:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:0.0:1783135071.022713:0:14225:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373998336 00000100:00100000:0.0:1783135071.022723:0:14225:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373998336 00000100:00100000:0.0:1783135071.022790:0:14225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 15 00000100:00100000:0.0:1783135071.022798:0:14225:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fe439c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2b138366-7a70-4ff2-909d-348210e4a0a2+18:14555:x1869752373998336:12345-192.168.201.41@tcp:35:lfs.0 00000100:00100000:0.0:1783135071.023475:0:14225:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fe439c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2b138366-7a70-4ff2-909d-348210e4a0a2+19:14555:x1869752373998336:12345-192.168.201.41@tcp:35:lfs.0 Request processed in 551us (731us total) trans 8589934635 rc 0/0 00000100:00100000:0.0:1783135071.023482:0:14225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 15 00000100:00100000:0.0:1783135071.142426:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:3.0:1783135071.144583:0:14222:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373998592 00000100:00100000:3.0:1783135071.144599:0:14222:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373998592 00000100:00100000:3.0:1783135071.144666:0:14222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 67 00000100:00100000:3.0:1783135071.144675:0:14222:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fe9faa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2b138366-7a70-4ff2-909d-348210e4a0a2+19:14558:x1869752373998592:12345-192.168.201.41@tcp:101:lfs.0 00010000:00010000:3.0:1783135071.144702:0:14222:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783135071.144724:0:14222:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c0030000/0xd6c4b8f05867fd67 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4428da03f5eb7720 expref: -99 pid: 14222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135071.144814:0:14222:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c0031400/0xd6c4b8f05867fd6e lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135071.144827:0:14222:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c0031400/0xd6c4b8f05867fd6e lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135071.144838:0:14222:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c0031400/0xd6c4b8f05867fd6e lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135071.144860:0:14222:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c0030600/0xd6c4b8f05867fd75 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135071.144865:0:14222:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c0030600/0xd6c4b8f05867fd75 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135071.144869:0:14222:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c0030600/0xd6c4b8f05867fd75 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135071.145215:0:14222:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c0030400/0xd6c4b8f05867fd7c lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135071.145221:0:14222:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c0030400/0xd6c4b8f05867fd7c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135071.145225:0:14222:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c0030400/0xd6c4b8f05867fd7c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14222 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783135071.145235:0:14222:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 9 00010000:00010000:3.0:1783135071.145517:0:14222:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c0031400/0xd6c4b8f05867fd6e lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135071.145523:0:14222:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c0031400/0xd6c4b8f05867fd6e lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135071.145528:0:14222:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c0031400/0xd6c4b8f05867fd6e lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135071.145532:0:14222:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe9c0031400 already unused, calling callback (ffffffffc1f634f0) 00010000:00010000:3.0:1783135071.145535:0:14222:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c0031400/0xd6c4b8f05867fd6e lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135071.145549:0:14222:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c0031400/0xd6c4b8f05867fd6e lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135071.145560:0:14222:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9fe9c8301a00) 00010000:00010000:3.0:1783135071.145563:0:14222:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783135071.145565:0:14222:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c0031400/0xd6c4b8f05867fd6e lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135071.145570:0:14222:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c0031400/0xd6c4b8f05867fd6e lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135071.145580:0:14222:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c0030600/0xd6c4b8f05867fd75 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135071.145584:0:14222:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c0030600/0xd6c4b8f05867fd75 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135071.145588:0:14222:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c0030600/0xd6c4b8f05867fd75 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135071.145590:0:14222:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe9c0030600 already unused, calling callback (ffffffffc1f634f0) 00010000:00010000:3.0:1783135071.145592:0:14222:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c0030600/0xd6c4b8f05867fd75 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135071.145595:0:14222:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c0030600/0xd6c4b8f05867fd75 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135071.145599:0:14222:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff9fe9c33d0000) 00010000:00010000:3.0:1783135071.145600:0:14222:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783135071.145601:0:14222:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c0030600/0xd6c4b8f05867fd75 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135071.145610:0:14222:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c0030600/0xd6c4b8f05867fd75 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135071.145647:0:14222:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c0030000/0xd6c4b8f05867fd67 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb7720 expref: 22 pid: 14222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135071.145657:0:14222:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c0030400/0xd6c4b8f05867fd7c lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb7720 expref: 21 pid: 14222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135071.145663:0:14222:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9fe9c33d0f00) 00010000:00010000:3.0:1783135071.145664:0:14222:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1783135071.145666:0:14222:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fe9c0030400, rc 0) 00000100:00100000:3.0:1783135071.145741:0:14222:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fe9faa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2b138366-7a70-4ff2-909d-348210e4a0a2+21:14558:x1869752373998592:12345-192.168.201.41@tcp:101:lfs.0 Request processed in 1067us (3329us total) trans 8589934636 rc 0/0 00000100:00100000:3.0:1783135071.145747:0:14222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 67 00000100:00100000:3.0:1783135071.155752:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:2.0:1783135071.157730:0:14223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373998720 00000100:00100000:2.0:1783135071.157746:0:14223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373998720 00000100:00100000:2.0:1783135071.162033:0:14223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 68 00000100:00100000:2.0:1783135071.162061:0:14223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fea00bced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2b138366-7a70-4ff2-909d-348210e4a0a2+21:14558:x1869752373998720:12345-192.168.201.41@tcp:54:lfs.0 00010000:00010000:2.0:1783135071.162146:0:14223:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c1523e00/0xd6c4b8f05867fd8a lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135071.162164:0:14223:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c1523e00/0xd6c4b8f05867fd8a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135071.162192:0:14223:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c1523e00/0xd6c4b8f05867fd8a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135071.162224:0:14223:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c1523e00/0xd6c4b8f05867fd8a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135071.162229:0:14223:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c1523e00/0xd6c4b8f05867fd8a lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135071.162235:0:14223:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c1523e00/0xd6c4b8f05867fd8a lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135071.162239:0:14223:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe9c1523e00 already unused, calling callback (ffffffffc1f634f0) 00010000:00010000:2.0:1783135071.162242:0:14223:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c1523e00/0xd6c4b8f05867fd8a lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135071.162247:0:14223:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c1523e00/0xd6c4b8f05867fd8a lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135071.162258:0:14223:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9fe9c33d0f00) 00010000:00010000:2.0:1783135071.162261:0:14223:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1783135071.162267:0:14223:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c1523e00/0xd6c4b8f05867fd8a lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135071.162271:0:14223:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c1523e00/0xd6c4b8f05867fd8a lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783135071.163613:0:14223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fea00bced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2b138366-7a70-4ff2-909d-348210e4a0a2+21:14558:x1869752373998720:12345-192.168.201.41@tcp:54:lfs.0 Request processed in 1554us (7865us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135071.163623:0:14223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 68 00000100:00100000:3.0:1783135071.173835:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:2.0:1783135071.174343:0:16002:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373998976 00000100:00100000:2.0:1783135071.174429:0:16002:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373998976 00000100:00100000:2.0:1783135071.174498:0:16002:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 16 00000100:00100000:2.0:1783135071.174830:0:16002:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9ff67a450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:2b138366-7a70-4ff2-909d-348210e4a0a2+21:14558:x1869752373998976:12345-192.168.201.41@tcp:35:lfs.0 00000100:00100000:2.0:1783135071.177716:0:16002:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9ff67a450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:2b138366-7a70-4ff2-909d-348210e4a0a2+22:14558:x1869752373998976:12345-192.168.201.41@tcp:35:lfs.0 Request processed in 3196us (3882us total) trans 8589934637 rc 0/0 00000100:00100000:2.0:1783135071.177728:0:16002:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 16 00000100:00100000:2.0:1783135071.213922:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:1.0:1783135071.215859:0:14222:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373999232 00000100:00100000:1.0:1783135071.215874:0:14222:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373999232 00000100:00100000:1.0:1783135071.215943:0:14222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 69 00000100:00100000:1.0:1783135071.215956:0:14222:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9f68f0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2b138366-7a70-4ff2-909d-348210e4a0a2+22:12108:x1869752373999232:12345-192.168.201.41@tcp:101:bash.0 00010000:00010000:1.0:1783135071.215997:0:14222:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783135071.216025:0:14222:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe8c5551e00/0xd6c4b8f05867fd91 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4428da03f5eb7727 expref: -99 pid: 14222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135071.216159:0:14222:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe8c5551800/0xd6c4b8f05867fd98 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135071.216173:0:14222:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c0030400/0xd6c4b8f05867fd7c lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb7720 expref: 23 pid: 14222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135071.216180:0:14222:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fe8c5551800/0xd6c4b8f05867fd98 lrc: 4/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135071.216216:0:14222:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c0030400/0xd6c4b8f05867fd7c lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb7720 expref: 23 pid: 14222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135071.216226:0:14222:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c0030400/0xd6c4b8f05867fd7c lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb7720 expref: 23 pid: 14222 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783135071.216237:0:14222:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9fe43a680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14222:1869752384447488:192.168.201.41@tcp:104: 00000100:00100000:1.0:1783135071.216378:0:14222:0:(client.c:2701:ptlrpc_set_wait()) set ffff9fe9c136ab40 going to sleep for 11 seconds 00000100:00100000:1.0:1783135071.226759:0:14222:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9fe43a680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14222:1869752384447488:192.168.201.41@tcp:104: 00010000:00010000:1.0:1783135071.226811:0:14222:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9fe8c5551800/0xd6c4b8f05867fd98 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14222 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783135071.226815:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:3.0:1783135071.229232:0:14208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373999360 00000100:00100000:3.0:1783135071.229251:0:14208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373999360 00010000:00010000:3.0:1783135071.229384:0:14208:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c0030400/0xd6c4b8f05867fd7c lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb7720 expref: 24 pid: 14222 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783135071.229435:0:14208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 21 00000100:00100000:3.0:1783135071.229446:0:14208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fe9f9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2b138366-7a70-4ff2-909d-348210e4a0a2+24:2370:x1869752373999360:12345-192.168.201.41@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783135071.229464:0:14208:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783135071.229472:0:14208:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c0030400/0xd6c4b8f05867fd7c lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb7720 expref: 24 pid: 14222 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135071.229507:0:14208:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c0030400/0xd6c4b8f05867fd7c lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb7720 expref: 24 pid: 14222 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135071.229538:0:14208:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c0030400/0xd6c4b8f05867fd7c lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb7720 expref: 24 pid: 14222 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135071.229555:0:14208:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9fe9c33d0f00) 00010000:00010000:3.0:1783135071.229561:0:14208:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9fe8c5551800/0xd6c4b8f05867fd98 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135071.229575:0:14208:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe8c5551800/0xd6c4b8f05867fd98 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135071.229585:0:14208:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fe8c5551800/0xd6c4b8f05867fd98 lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135071.229616:0:14208:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783135071.229691:0:14208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fe9f9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2b138366-7a70-4ff2-909d-348210e4a0a2+23:2370:x1869752373999360:12345-192.168.201.41@tcp:103:ldlm_bl.0 Request processed in 246us (2877us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135071.229700:0:14208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 21 00010000:00010000:2.0:1783135071.232402:0:14222:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9fe8c5551800/0xd6c4b8f05867fd98 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135071.232425:0:14222:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe8c5551800/0xd6c4b8f05867fd98 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14222 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783135071.232458:0:14222:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 9 00010000:00010000:2.0:1783135071.232689:0:14222:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe8c5551e00/0xd6c4b8f05867fd91 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb7727 expref: 24 pid: 14222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135071.232715:0:14222:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe8c5551800/0xd6c4b8f05867fd98 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb7727 expref: 23 pid: 14222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135071.232726:0:14222:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9fe9c33d0f00) 00010000:00010000:2.0:1783135071.232729:0:14222:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1783135071.232733:0:14222:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fe8c5551800, rc 0) 00000100:00100000:2.0:1783135071.234928:0:14222:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9f68f0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2b138366-7a70-4ff2-909d-348210e4a0a2+23:12108:x1869752373999232:12345-192.168.201.41@tcp:101:bash.0 Request processed in 18959us (21002us total) trans 8589934638 rc 0/0 00000100:00100000:2.0:1783135071.234957:0:14222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 69 00000040:00080000:2.0:1783135071.237106:0:14257:0:(llog.c:800:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1783135071.237133:0:14257:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1783135071.237178:0:14257:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:2.0:1783135071.237188:0:14257:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:0.0:1783135071.241536:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:2.0:1783135071.241642:0:14223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373999616 00000100:00100000:2.0:1783135071.241656:0:14223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373999616 00000100:00100000:2.0:1783135071.241737:0:14223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 70 00000100:00100000:2.0:1783135071.241749:0:14223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fe9fa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2b138366-7a70-4ff2-909d-348210e4a0a2+23:12108:x1869752373999616:12345-192.168.201.41@tcp:36:bash.0 00010000:00010000:2.0:1783135071.242412:0:14223:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c1523e00/0xd6c4b8f05867fda6 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135071.242437:0:14223:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c1523e00/0xd6c4b8f05867fda6 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135071.242453:0:14223:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c1523e00/0xd6c4b8f05867fda6 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1783135071.242523:0:14223:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934639 00000004:00010000:2.0:1783135071.242552:0:14223:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000e92d9e29 reply state 000000003d464bab transno 8589934640 ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c1523e00/0xd6c4b8f05867fda6 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783135071.242561:0:14223:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:2.0:1783135071.242670:0:14223:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934640 00000100:00100000:2.0:1783135071.244492:0:14223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fe9fa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2b138366-7a70-4ff2-909d-348210e4a0a2+27:12108:x1869752373999616:12345-192.168.201.41@tcp:36:bash.0 Request processed in 2729us (2955us total) trans 8589934641 rc 0/0 00000100:00100000:2.0:1783135071.244712:0:14223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 70 00000020:00080000:2.0:1783135071.244724:0:14223:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00010000:00010000:1.0:1783135071.266056:0:3273:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c1523e00/0xd6c4b8f05867fda6 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135071.266083:0:3273:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c1523e00/0xd6c4b8f05867fda6 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135071.266092:0:3273:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c1523e00/0xd6c4b8f05867fda6 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135071.266099:0:3273:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe9c1523e00 already unused, calling callback (ffffffffc1f634f0) 00010000:00010000:1.0:1783135071.266105:0:3273:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c1523e00/0xd6c4b8f05867fda6 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135071.266114:0:3273:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c1523e00/0xd6c4b8f05867fda6 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135071.266137:0:3273:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9fe9c33d0f00) 00010000:00010000:1.0:1783135071.266141:0:3273:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783135071.266146:0:3273:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c1523e00/0xd6c4b8f05867fda6 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135071.266153:0:3273:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c1523e00/0xd6c4b8f05867fda6 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783135071.267746:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:2.0:1783135071.267927:0:16395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373999744 00000100:00100000:2.0:1783135071.267939:0:16395:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373999744 00000100:00100000:2.0:1783135071.268217:0:16395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 71 00000100:00100000:2.0:1783135071.268231:0:16395:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fe9f8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2b138366-7a70-4ff2-909d-348210e4a0a2+26:12108:x1869752373999744:12345-192.168.201.41@tcp:101:bash.0 00010000:00010000:2.0:1783135071.268624:0:16395:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783135071.268649:0:16395:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c1523a00/0xd6c4b8f05867fdad lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4428da03f5eb772e expref: -99 pid: 16395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135071.268728:0:16395:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c1523a00/0xd6c4b8f05867fdad lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb772e expref: 27 pid: 16395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135071.268747:0:16395:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c1523a00/0xd6c4b8f05867fdad lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb772e expref: 27 pid: 16395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135071.268846:0:16395:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9fe9c33d0f00) 00010000:00010000:2.0:1783135071.268850:0:16395:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1783135071.268855:0:16395:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fe9c1523a00, rc 0) 00000100:00100000:2.0:1783135071.269053:0:16395:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fe9f8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2b138366-7a70-4ff2-909d-348210e4a0a2+27:12108:x1869752373999744:12345-192.168.201.41@tcp:101:bash.0 Request processed in 823us (1316us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135071.269062:0:16395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 71 00000100:00100000:0.0:1783135071.283253:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:1.0:1783135071.283528:0:14858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752373999872 00000100:00100000:1.0:1783135071.283541:0:14858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752373999872 00000100:00100000:1.0:1783135071.283628:0:14858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 20 00000100:00100000:1.0:1783135071.283640:0:14858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fe9fb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2b138366-7a70-4ff2-909d-348210e4a0a2+6:12108:x1869752373999872:12345-192.168.201.41@tcp:101:bash.0 00010000:00010000:1.0:1783135071.283664:0:14858:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783135071.283691:0:14858:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000086a0872a/0xd6c4b8f05867fdb4 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4428da03f5eb7735 expref: -99 pid: 14858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1783135071.283742:0:14858:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x22:0x0] initial LVB size: 9, mtime: 0x6a487b5b, atime: 0x6a487b5a, ctime: 0x6a487b5b, blocks: 0xb 00010000:00010000:1.0:1783135071.283786:0:14858:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=353s v=(0 0) 00010000:00010000:1.0:1783135071.283792:0:14858:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783135071.283802:0:14858:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000086a0872a/0xd6c4b8f05867fdb4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb7735 expref: 7 pid: 14858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135071.283824:0:14858:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000086a0872a/0xd6c4b8f05867fdb4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb7735 expref: 7 pid: 14858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135071.283840:0:14858:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fe8c5550a00, rc 0) 00000100:00100000:1.0:1783135071.283924:0:14858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fe9fb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2b138366-7a70-4ff2-909d-348210e4a0a2+7:12108:x1869752373999872:12345-192.168.201.41@tcp:101:bash.0 Request processed in 285us (688us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135071.283932:0:14858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 20 00000100:00080000:3.0:1783135071.284972:0:14218:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1783135071.286563:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:1.0:1783135071.286859:0:14866:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752374000000 00000100:00100000:1.0:1783135071.286870:0:14866:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752374000000 00002000:00010000:1.0:1783135071.286916:0:14866:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/34 (0->18446744073709551615) 00002000:00100000:1.0:1783135071.286921:0:14866:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9fea00bcce00 with x1869752374000000 ext(0->18446744073709551615) 00002000:00010000:1.0:1783135071.286937:0:14866:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9fea00bcce00. 00000100:00100000:1.0:1783135071.287145:0:14866:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 1 00000100:00100000:1.0:1783135071.287157:0:14866:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fea00bcce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:2b138366-7a70-4ff2-909d-348210e4a0a2+7:2370:x1869752374000000:12345-192.168.201.41@tcp:10:bash.0 00002000:00010000:1.0:1783135071.288338:0:14866:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:1.0:1783135071.288346:0:14866:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb mtime from disk: 1783135067 -> 1783135071 00002000:00010000:1.0:1783135071.288359:0:14866:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb atime from disk: 1783135066 -> 1783135066 00002000:00010000:1.0:1783135071.288362:0:14866:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb ctime from disk: 1783135067 -> 1783135071 00002000:00010000:1.0:1783135071.288378:0:14866:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:1.0:1783135071.288474:0:14866:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fea00bcce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:2b138366-7a70-4ff2-909d-348210e4a0a2+8:2370:x1869752374000000:12345-192.168.201.41@tcp:10:bash.0 Request processed in 1315us (1916us total) trans 8589934600 rc 0/0 00000100:00100000:1.0:1783135071.288485:0:14866:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 1 00002000:00010000:1.0:1783135071.288491:0:14866:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/34 (0->18446744073709551615) 00002000:00100000:1.0:1783135071.288495:0:14866:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9fea00bcce00 with x1869752374000000 ext(0->18446744073709551615) 00002000:00010000:1.0:1783135071.288502:0:14866:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9fea00bcce00. 00000100:00100000:3.0:1783135071.369689:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:1.0:1783135071.369967:0:14224:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752374000256 00000100:00100000:1.0:1783135071.369993:0:14224:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752374000256 00000100:00100000:1.0:1783135071.370073:0:14224:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 72 00000100:00100000:1.0:1783135071.370085:0:14224:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fea00bce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2b138366-7a70-4ff2-909d-348210e4a0a2+27:14572:x1869752374000256:12345-192.168.201.41@tcp:101:lfs.0 00010000:00010000:1.0:1783135071.370113:0:14224:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783135071.370144:0:14224:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe8c5551e00/0xd6c4b8f05867fdbb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4428da03f5eb773c expref: -99 pid: 14224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135071.370520:0:14224:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe8c5550200/0xd6c4b8f05867fdc2 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135071.370538:0:14224:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fe8c5550200/0xd6c4b8f05867fdc2 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135071.370552:0:14224:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe8c5550200/0xd6c4b8f05867fdc2 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14224 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783135071.370565:0:14224:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 7680 00010000:00010000:1.0:1783135071.370768:0:14224:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe8c5551e00/0xd6c4b8f05867fdbb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb773c expref: 30 pid: 14224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135071.370788:0:14224:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe8c5550200/0xd6c4b8f05867fdc2 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb773c expref: 29 pid: 14224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135071.370806:0:14224:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9fe9c8301a00) 00010000:00010000:1.0:1783135071.370810:0:14224:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1783135071.370814:0:14224:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fe8c5550200, rc 0) 00000100:00100000:1.0:1783135071.370886:0:14224:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fea00bce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2b138366-7a70-4ff2-909d-348210e4a0a2+29:14572:x1869752374000256:12345-192.168.201.41@tcp:101:lfs.0 Request processed in 802us (1207us total) trans 8589934642 rc 0/0 00000100:00100000:1.0:1783135071.370894:0:14224:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 72 00000100:00100000:2.0:1783135071.391587:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:1.0:1783135071.391755:0:14222:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752374000384 00000100:00100000:1.0:1783135071.391777:0:14222:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752374000384 00000100:00100000:1.0:1783135071.391971:0:14222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 73 00000100:00100000:1.0:1783135071.391994:0:14222:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9f68f2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2b138366-7a70-4ff2-909d-348210e4a0a2+29:14572:x1869752374000384:12345-192.168.201.41@tcp:34:lfs.0 00010000:00010000:1.0:1783135071.392095:0:14222:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe8c5551e00/0xd6c4b8f05867fdd0 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135071.392116:0:14222:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fe8c5551e00/0xd6c4b8f05867fdd0 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135071.392129:0:14222:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe8c5551e00/0xd6c4b8f05867fdd0 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135071.392145:0:14222:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe8c5551600/0xd6c4b8f05867fdd7 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135071.392152:0:14222:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fe8c5551600/0xd6c4b8f05867fdd7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135071.392158:0:14222:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe8c5551600/0xd6c4b8f05867fdd7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135071.392574:0:14222:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe8c5550e00/0xd6c4b8f05867fdde lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135071.392585:0:14222:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fe8c5550e00/0xd6c4b8f05867fdde lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135071.392592:0:14222:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe8c5550e00/0xd6c4b8f05867fdde lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14222 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1783135071.392639:0:14222:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fe8c5550e00/0xd6c4b8f05867fdde lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135071.392652:0:14222:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe8c5551e00/0xd6c4b8f05867fdd0 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135071.392659:0:14222:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fe8c5551e00/0xd6c4b8f05867fdd0 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135071.392667:0:14222:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fe8c5551e00/0xd6c4b8f05867fdd0 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135071.392674:0:14222:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe8c5551e00 already unused, calling callback (ffffffffc1f634f0) 00010000:00010000:1.0:1783135071.392679:0:14222:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe8c5551e00/0xd6c4b8f05867fdd0 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135071.392687:0:14222:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe8c5551e00/0xd6c4b8f05867fdd0 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135071.392702:0:14222:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9fe9c8301a00) 00010000:00010000:1.0:1783135071.392705:0:14222:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783135071.392711:0:14222:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fe8c5551e00/0xd6c4b8f05867fdd0 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135071.392725:0:14222:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe8c5551e00/0xd6c4b8f05867fdd0 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135071.392740:0:14222:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe8c5551600/0xd6c4b8f05867fdd7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135071.392746:0:14222:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fe8c5551600/0xd6c4b8f05867fdd7 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135071.392751:0:14222:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fe8c5551600/0xd6c4b8f05867fdd7 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135071.392756:0:14222:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe8c5551600 already unused, calling callback (ffffffffc1f634f0) 00010000:00010000:1.0:1783135071.392759:0:14222:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe8c5551600/0xd6c4b8f05867fdd7 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135071.392765:0:14222:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe8c5551600/0xd6c4b8f05867fdd7 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135071.392773:0:14222:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff9fe9e1c2ba00) 00010000:00010000:1.0:1783135071.392775:0:14222:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783135071.392778:0:14222:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fe8c5551600/0xd6c4b8f05867fdd7 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135071.392784:0:14222:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe8c5551600/0xd6c4b8f05867fdd7 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135071.392797:0:14222:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe8c5550e00/0xd6c4b8f05867fdde lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135071.392802:0:14222:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fe8c5550e00/0xd6c4b8f05867fdde lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135071.392814:0:14222:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fe8c5550e00/0xd6c4b8f05867fdde lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135071.392819:0:14222:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe8c5550e00 already unused, calling callback (ffffffffc1f634f0) 00010000:00010000:1.0:1783135071.392822:0:14222:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe8c5550e00/0xd6c4b8f05867fdde lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135071.392828:0:14222:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe8c5550e00/0xd6c4b8f05867fdde lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135071.392844:0:14222:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9fe9c33d0f00) 00010000:00010000:1.0:1783135071.392847:0:14222:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783135071.392850:0:14222:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fe8c5550e00/0xd6c4b8f05867fdde lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135071.392856:0:14222:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe8c5550e00/0xd6c4b8f05867fdde lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14222 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783135071.392968:0:14222:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9f68f2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2b138366-7a70-4ff2-909d-348210e4a0a2+29:14572:x1869752374000384:12345-192.168.201.41@tcp:34:lfs.0 Request processed in 975us (1382us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135071.392977:0:14222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 73 00000100:00100000:3.0:1783135071.453187:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:1.0:1783135071.453520:0:14224:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752374000640 00000100:00100000:1.0:1783135071.453533:0:14224:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752374000640 00000100:00100000:1.0:1783135071.453610:0:14224:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 74 00000100:00100000:1.0:1783135071.453623:0:14224:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fea00bcca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2b138366-7a70-4ff2-909d-348210e4a0a2+29:14575:x1869752374000640:12345-192.168.201.41@tcp:101:lfs.0 00010000:00010000:1.0:1783135071.453651:0:14224:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783135071.453677:0:14224:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe8c5550e00/0xd6c4b8f05867fde5 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4428da03f5eb7743 expref: -99 pid: 14224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135071.453801:0:14224:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe8c5551600/0xd6c4b8f05867fdec lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135071.453819:0:14224:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fe8c5551600/0xd6c4b8f05867fdec lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135071.453833:0:14224:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe8c5551600/0xd6c4b8f05867fdec lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135071.453851:0:14224:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe8c5551e00/0xd6c4b8f05867fdf3 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135071.453860:0:14224:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fe8c5551e00/0xd6c4b8f05867fdf3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135071.453867:0:14224:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe8c5551e00/0xd6c4b8f05867fdf3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135071.454268:0:14224:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe8c5550800/0xd6c4b8f05867fdfa lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135071.454337:0:14224:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fe8c5550800/0xd6c4b8f05867fdfa lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135071.455108:0:14224:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe8c5550800/0xd6c4b8f05867fdfa lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14224 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783135071.455128:0:14224:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1783135071.455340:0:14224:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe8c5551600/0xd6c4b8f05867fdec lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135071.455501:0:14224:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fe8c5551600/0xd6c4b8f05867fdec lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135071.455509:0:14224:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fe8c5551600/0xd6c4b8f05867fdec lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135071.455516:0:14224:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe8c5551600 already unused, calling callback (ffffffffc1f634f0) 00010000:00010000:1.0:1783135071.455521:0:14224:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe8c5551600/0xd6c4b8f05867fdec lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135071.455529:0:14224:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe8c5551600/0xd6c4b8f05867fdec lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135071.455545:0:14224:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9fe9c8301a00) 00010000:00010000:1.0:1783135071.455549:0:14224:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783135071.455555:0:14224:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fe8c5551600/0xd6c4b8f05867fdec lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135071.455561:0:14224:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe8c5551600/0xd6c4b8f05867fdec lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135071.455578:0:14224:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe8c5551e00/0xd6c4b8f05867fdf3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135071.455584:0:14224:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fe8c5551e00/0xd6c4b8f05867fdf3 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135071.455590:0:14224:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fe8c5551e00/0xd6c4b8f05867fdf3 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135071.455595:0:14224:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe8c5551e00 already unused, calling callback (ffffffffc1f634f0) 00010000:00010000:1.0:1783135071.455604:0:14224:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe8c5551e00/0xd6c4b8f05867fdf3 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135071.455610:0:14224:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe8c5551e00/0xd6c4b8f05867fdf3 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135071.455618:0:14224:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff9fe9e1c2ba00) 00010000:00010000:1.0:1783135071.455621:0:14224:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783135071.455624:0:14224:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fe8c5551e00/0xd6c4b8f05867fdf3 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135071.455630:0:14224:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe8c5551e00/0xd6c4b8f05867fdf3 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135071.455690:0:14224:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe8c5550e00/0xd6c4b8f05867fde5 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb7743 expref: 32 pid: 14224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135071.455706:0:14224:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe8c5550800/0xd6c4b8f05867fdfa lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb7743 expref: 31 pid: 14224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135071.455714:0:14224:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9fe9c33d0f00) 00010000:00010000:1.0:1783135071.455717:0:14224:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1783135071.455720:0:14224:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fe8c5550800, rc 0) 00000100:00100000:1.0:1783135071.455890:0:14224:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fea00bcca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2b138366-7a70-4ff2-909d-348210e4a0a2+31:14575:x1869752374000640:12345-192.168.201.41@tcp:101:lfs.0 Request processed in 2268us (2714us total) trans 8589934643 rc 0/0 00000100:00100000:1.0:1783135071.455900:0:14224:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 74 00000100:00100000:0.0:1783135071.463186:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:1.0:1783135071.463720:0:16395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752374000768 00000100:00100000:1.0:1783135071.463734:0:16395:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752374000768 00000100:00100000:1.0:1783135071.463840:0:16395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 75 00000100:00100000:1.0:1783135071.463855:0:16395:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fe9f8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2b138366-7a70-4ff2-909d-348210e4a0a2+31:14575:x1869752374000768:12345-192.168.201.41@tcp:54:lfs.0 00010000:00010000:1.0:1783135071.463995:0:16395:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe8c5550e00/0xd6c4b8f05867fe08 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 16395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135071.464016:0:16395:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe8c5551800/0xd6c4b8f05867fd98 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb7727 expref: 31 pid: 14222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135071.464028:0:16395:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fe8c5550e00/0xd6c4b8f05867fe08 lrc: 4/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135071.464073:0:16395:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9fe8c5551800/0xd6c4b8f05867fd98 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb7727 expref: 31 pid: 14222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135071.464089:0:16395:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe8c5551800/0xd6c4b8f05867fd98 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb7727 expref: 31 pid: 14222 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783135071.464106:0:16395:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9fe43a680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16395:1869752384447616:192.168.201.41@tcp:104: 00000100:00100000:1.0:1783135071.464230:0:16395:0:(client.c:2701:ptlrpc_set_wait()) set ffff9fe9d9b6fc00 going to sleep for 11 seconds 00000100:00100000:3.0:1783135071.467222:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:1.0:1783135071.467764:0:16395:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9fe43a680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16395:1869752384447616:192.168.201.41@tcp:104: 00010000:00010000:1.0:1783135071.467801:0:16395:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9fe8c5550e00/0xd6c4b8f05867fe08 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16395 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783135071.468196:0:14225:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752374001024 00000100:00100000:0.0:1783135071.468206:0:14225:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752374001024 00000100:00100000:1.0:1783135071.468735:0:14225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 17 00000100:00100000:1.0:1783135071.468749:0:14225:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fea00bcc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2b138366-7a70-4ff2-909d-348210e4a0a2+32:13712:x1869752374001024:12345-192.168.201.41@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1783135071.469219:0:14225:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fea00bcc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2b138366-7a70-4ff2-909d-348210e4a0a2+33:13712:x1869752374001024:12345-192.168.201.41@tcp:35:ldlm_bl.0 Request processed in 471us (2009us total) trans 8589934644 rc 0/0 00000100:00100000:1.0:1783135071.469228:0:14225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 17 00000100:00100000:3.0:1783135071.472252:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:0.0:1783135071.472780:0:14207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752374001152 00000100:00100000:0.0:1783135071.472794:0:14207:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752374001152 00010000:00010000:0.0:1783135071.472850:0:14207:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fe8c5551800/0xd6c4b8f05867fd98 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb7727 expref: 33 pid: 14222 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783135071.472923:0:14207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 22 00000100:00100000:0.0:1783135071.472946:0:14207:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fea00bcea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2b138366-7a70-4ff2-909d-348210e4a0a2+33:2369:x1869752374001152:12345-192.168.201.41@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783135071.473114:0:14207:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783135071.473124:0:14207:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9fe8c5551800/0xd6c4b8f05867fd98 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb7727 expref: 33 pid: 14222 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135071.473141:0:14207:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9fe8c5551800/0xd6c4b8f05867fd98 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb7727 expref: 33 pid: 14222 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135071.473169:0:14207:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe8c5551800/0xd6c4b8f05867fd98 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb7727 expref: 33 pid: 14222 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135071.473188:0:14207:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9fe9c33d0f00) 00010000:00010000:0.0:1783135071.473193:0:14207:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9fe8c5550e00/0xd6c4b8f05867fe08 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135071.473204:0:14207:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe8c5550e00/0xd6c4b8f05867fe08 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 16395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135071.473212:0:14207:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fe8c5550e00/0xd6c4b8f05867fe08 lrc: 4/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 16395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135071.473475:0:14207:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783135071.473548:0:14207:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fea00bcea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2b138366-7a70-4ff2-909d-348210e4a0a2+32:2369:x1869752374001152:12345-192.168.201.41@tcp:103:ldlm_bl.0 Request processed in 614us (1310us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135071.473557:0:14207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 22 00010000:00010000:2.0:1783135071.473644:0:16395:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9fe8c5550e00/0xd6c4b8f05867fe08 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135071.473655:0:16395:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe8c5550e00/0xd6c4b8f05867fe08 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135071.473694:0:16395:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe8c5550e00/0xd6c4b8f05867fe08 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135071.473702:0:16395:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fe8c5550e00/0xd6c4b8f05867fe08 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 16395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135071.473724:0:16395:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fe8c5550e00/0xd6c4b8f05867fe08 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135071.473731:0:16395:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe8c5550e00 already unused, calling callback (ffffffffc1f634f0) 00010000:00010000:2.0:1783135071.473736:0:16395:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe8c5550e00/0xd6c4b8f05867fe08 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135071.473744:0:16395:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe8c5550e00/0xd6c4b8f05867fe08 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 16395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135071.473755:0:16395:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9fe9c33d0f00) 00010000:00010000:2.0:1783135071.473758:0:16395:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1783135071.473763:0:16395:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fe8c5550e00/0xd6c4b8f05867fe08 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135071.473769:0:16395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe8c5550e00/0xd6c4b8f05867fe08 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16395 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783135071.473817:0:16395:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fe9f8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2b138366-7a70-4ff2-909d-348210e4a0a2+31:14575:x1869752374000768:12345-192.168.201.41@tcp:54:lfs.0 Request processed in 9966us (10645us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135071.473827:0:16395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 75 00000100:00100000:0.0:1783135071.478042:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:3.0:1783135071.478185:0:14226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752374001408 00000100:00100000:3.0:1783135071.478198:0:14226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752374001408 00000100:00100000:3.0:1783135071.478318:0:14226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 18 00000100:00100000:3.0:1783135071.478331:0:14226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fe9fad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2b138366-7a70-4ff2-909d-348210e4a0a2+31:14575:x1869752374001408:12345-192.168.201.41@tcp:35:lfs.0 00000100:00100000:3.0:1783135071.478967:0:14226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fe9fad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2b138366-7a70-4ff2-909d-348210e4a0a2+32:14575:x1869752374001408:12345-192.168.201.41@tcp:35:lfs.0 Request processed in 623us (931us total) trans 8589934645 rc 0/0 00000100:00100000:3.0:1783135071.478978:0:14226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 18 00000100:00100000:3.0:1783135071.608169:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:2.0:1783135071.608339:0:14223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752374001664 00000100:00100000:2.0:1783135071.608363:0:14223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752374001664 00000100:00100000:2.0:1783135071.608443:0:14223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 76 00000100:00100000:2.0:1783135071.608463:0:14223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fe7d3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2b138366-7a70-4ff2-909d-348210e4a0a2+32:14586:x1869752374001664:12345-192.168.201.41@tcp:101:cat.0 00010000:00010000:2.0:1783135071.608497:0:14223:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783135071.608522:0:14223:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c1523000/0xd6c4b8f05867fe0f lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4428da03f5eb774a expref: -99 pid: 14223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135071.608661:0:14223:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c1523800/0xd6c4b8f05867fe16 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135071.608679:0:14223:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c1523800/0xd6c4b8f05867fe16 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135071.608695:0:14223:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c1523800/0xd6c4b8f05867fe16 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135071.608711:0:14223:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c1522000/0xd6c4b8f05867fe1d lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135071.608718:0:14223:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c1522000/0xd6c4b8f05867fe1d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135071.608724:0:14223:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c1522000/0xd6c4b8f05867fe1d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135071.609908:0:14223:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c1523200/0xd6c4b8f05867fe24 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135071.609925:0:14223:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c1523200/0xd6c4b8f05867fe24 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135071.609936:0:14223:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c1523200/0xd6c4b8f05867fe24 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783135071.609950:0:14223:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 8 00010000:00010000:2.0:1783135071.610151:0:14223:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c1523800/0xd6c4b8f05867fe16 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135071.610171:0:14223:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c1523800/0xd6c4b8f05867fe16 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135071.610180:0:14223:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c1523800/0xd6c4b8f05867fe16 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135071.610186:0:14223:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe9c1523800 already unused, calling callback (ffffffffc1f634f0) 00010000:00010000:2.0:1783135071.610192:0:14223:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c1523800/0xd6c4b8f05867fe16 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135071.610201:0:14223:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c1523800/0xd6c4b8f05867fe16 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135071.610216:0:14223:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9fe9c8301a00) 00010000:00010000:2.0:1783135071.610220:0:14223:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783135071.610226:0:14223:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c1523800/0xd6c4b8f05867fe16 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135071.610233:0:14223:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c1523800/0xd6c4b8f05867fe16 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135071.610251:0:14223:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c1522000/0xd6c4b8f05867fe1d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135071.610258:0:14223:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c1522000/0xd6c4b8f05867fe1d lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135071.610264:0:14223:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c1522000/0xd6c4b8f05867fe1d lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135071.610270:0:14223:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe9c1522000 already unused, calling callback (ffffffffc1f634f0) 00010000:00010000:2.0:1783135071.610731:0:14223:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c1522000/0xd6c4b8f05867fe1d lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135071.610742:0:14223:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c1522000/0xd6c4b8f05867fe1d lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135071.610754:0:14223:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff9fe9cc3c1400) 00010000:00010000:2.0:1783135071.610756:0:14223:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783135071.610861:0:14223:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c1522000/0xd6c4b8f05867fe1d lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135071.610869:0:14223:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c1522000/0xd6c4b8f05867fe1d lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135071.611072:0:14223:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c1523000/0xd6c4b8f05867fe0f lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb774a expref: 35 pid: 14223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135071.611091:0:14223:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c1523200/0xd6c4b8f05867fe24 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb774a expref: 34 pid: 14223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135071.611216:0:14223:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9fe9c33d0f00) 00010000:00010000:2.0:1783135071.611219:0:14223:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1783135071.611222:0:14223:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fe9c1523200, rc 0) 00000100:00100000:2.0:1783135071.611928:0:14223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fe7d3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2b138366-7a70-4ff2-909d-348210e4a0a2+34:14586:x1869752374001664:12345-192.168.201.41@tcp:101:cat.0 Request processed in 3472us (3771us total) trans 8589934646 rc 0/0 00000100:00100000:2.0:1783135071.611941:0:14223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 76 00000100:00100000:0.0:1783135071.690191:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:1.0:1783135071.690417:0:14225:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752374001920 00000100:00100000:1.0:1783135071.690429:0:14225:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752374001920 00000100:00100000:1.0:1783135071.690523:0:14225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 19 00000100:00100000:1.0:1783135071.690534:0:14225:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fe9fa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2b138366-7a70-4ff2-909d-348210e4a0a2+34:14586:x1869752374001920:12345-192.168.201.41@tcp:35:cat.0 00000100:00100000:1.0:1783135071.694401:0:14225:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fe9fa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2b138366-7a70-4ff2-909d-348210e4a0a2+35:14586:x1869752374001920:12345-192.168.201.41@tcp:35:cat.0 Request processed in 3850us (4214us total) trans 8589934647 rc 0/0 00000100:00100000:1.0:1783135071.694419:0:14225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 19 00000100:00100000:0.0:1783135071.728931:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:2.0:1783135071.729098:0:14222:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752374002176 00000100:00100000:2.0:1783135071.729112:0:14222:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752374002176 00000100:00100000:2.0:1783135071.729204:0:14222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 77 00000100:00100000:2.0:1783135071.729216:0:14222:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fe9f8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2b138366-7a70-4ff2-909d-348210e4a0a2+35:14587:x1869752374002176:12345-192.168.201.41@tcp:36:rm.0 00010000:00010000:2.0:1783135071.729381:0:14222:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1783135071.729429:0:14222:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c1523200/0xd6c4b8f05867fe24 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb774a expref: 35 pid: 14223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135071.729459:0:14222:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe8c5550800/0xd6c4b8f05867fdfa lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb7743 expref: 34 pid: 14224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135071.729474:0:14222:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c1523a00/0xd6c4b8f05867fdad lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb772e expref: 33 pid: 16395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135071.729486:0:14222:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9fe9c33d0f00) 00010000:00010000:2.0:1783135071.729499:0:14222:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1783135071.729540:0:14222:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c1523000/0xd6c4b8f05867fe32 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135071.729558:0:14222:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c1523000/0xd6c4b8f05867fe32 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135071.729569:0:14222:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c1523000/0xd6c4b8f05867fe32 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135071.729586:0:14222:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c1522000/0xd6c4b8f05867fe39 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135071.729593:0:14222:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c1522000/0xd6c4b8f05867fe39 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135071.729600:0:14222:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c1522000/0xd6c4b8f05867fe39 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135071.730015:0:14222:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c1523800/0xd6c4b8f05867fe40 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135071.730025:0:14222:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c1523800/0xd6c4b8f05867fe40 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135071.730032:0:14222:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c1523800/0xd6c4b8f05867fe40 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14222 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1783135071.730834:0:14222:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].3, 64 off8408 00000004:00080000:2.0:1783135071.730849:0:14222:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 354126567931ns, next at 355126564060ns, rc = 0 00010000:00010000:2.0:1783135071.730925:0:14222:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c1523e00/0xd6c4b8f05867fe47 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135071.730936:0:14222:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c1523e00/0xd6c4b8f05867fe47 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 14222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135071.730944:0:14222:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c1523e00/0xd6c4b8f05867fe47 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135071.730969:0:14222:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c1523e00/0xd6c4b8f05867fe47 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135071.730976:0:14222:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c1523e00/0xd6c4b8f05867fe47 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135071.730983:0:14222:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c1523e00/0xd6c4b8f05867fe47 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135071.731004:0:14222:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1783135071.731048:0:14222:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c1523800/0xd6c4b8f05867fe40 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135071.731061:0:14222:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c1523800/0xd6c4b8f05867fe40 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135071.731069:0:14222:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c1523800/0xd6c4b8f05867fe40 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135071.731075:0:14222:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe9c1523800 already unused, calling callback (ffffffffc1f634f0) 00010000:00010000:0.0:1783135071.732545:0:14211:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783135071.732560:0:14211:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c1523e00/0xd6c4b8f05867fe47 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135071.732573:0:14211:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe9c1523e00 already unused, calling callback (ffffffffc1527ce0) 00010000:00010000:0.0:1783135071.732579:0:14211:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c1523e00/0xd6c4b8f05867fe47 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135071.732592:0:14211:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c1523e00/0xd6c4b8f05867fe47 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 14222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135071.732614:0:14211:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9fe9cc3c1900) 00010000:00010000:0.0:1783135071.732618:0:14211:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1783135071.732623:0:14211:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c1523e00/0xd6c4b8f05867fe47 lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135071.732630:0:14211:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c1523e00/0xd6c4b8f05867fe47 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135071.732652:0:14211:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783135071.732654:0:14211:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783135071.732656:0:14211:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783135071.738845:0:14222:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c1523800/0xd6c4b8f05867fe40 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135071.738884:0:14222:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c1523800/0xd6c4b8f05867fe40 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135071.738912:0:14222:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9fe9cc3c1900) 00010000:00010000:2.0:1783135071.738915:0:14222:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1783135071.738921:0:14222:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c1523800/0xd6c4b8f05867fe40 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135071.738929:0:14222:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c1523800/0xd6c4b8f05867fe40 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135071.738997:0:14222:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c1523000/0xd6c4b8f05867fe32 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135071.739004:0:14222:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c1523000/0xd6c4b8f05867fe32 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135071.739011:0:14222:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c1523000/0xd6c4b8f05867fe32 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135071.739017:0:14222:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe9c1523000 already unused, calling callback (ffffffffc1f634f0) 00010000:00010000:2.0:1783135071.739059:0:14222:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c1523000/0xd6c4b8f05867fe32 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135071.739066:0:14222:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c1523000/0xd6c4b8f05867fe32 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135071.739076:0:14222:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9fe9c8301a00) 00010000:00010000:2.0:1783135071.739079:0:14222:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783135071.739082:0:14222:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c1523000/0xd6c4b8f05867fe32 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135071.739088:0:14222:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c1523000/0xd6c4b8f05867fe32 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14222 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1783135071.739101:0:14222:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000059a0078d reply state 0000000042a821c3 transno 8589934648 ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c1522000/0xd6c4b8f05867fe39 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14222 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783135071.739111:0:14222:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1783135071.742866:0:14222:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fe9f8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2b138366-7a70-4ff2-909d-348210e4a0a2+34:14587:x1869752374002176:12345-192.168.201.41@tcp:36:rm.0 Request processed in 13630us (13928us total) trans 8589934648 rc 0/0 00000100:00100000:3.0:1783135071.742882:0:14222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 77 00010000:00010000:1.0:1783135071.749777:0:3272:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c1522000/0xd6c4b8f05867fe39 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135071.749802:0:3272:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c1522000/0xd6c4b8f05867fe39 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135071.749811:0:3272:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c1522000/0xd6c4b8f05867fe39 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135071.749818:0:3272:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe9c1522000 already unused, calling callback (ffffffffc1f634f0) 00010000:00010000:1.0:1783135071.749824:0:3272:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c1522000/0xd6c4b8f05867fe39 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135071.749834:0:3272:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c1522000/0xd6c4b8f05867fe39 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135071.749856:0:3272:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff9fe9cc3c1400) 00010000:00010000:1.0:1783135071.749860:0:3272:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783135071.749866:0:3272:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c1522000/0xd6c4b8f05867fe39 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135071.749873:0:3272:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c1522000/0xd6c4b8f05867fe39 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135071.752186:0:15220:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783135071.866700:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:1.0:1783135071.867699:0:14224:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752374002432 00000100:00100000:1.0:1783135071.867720:0:14224:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752374002432 00000100:00100000:1.0:1783135071.867818:0:14224:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 78 00000100:00100000:1.0:1783135071.867831:0:14224:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fe9f8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2b138366-7a70-4ff2-909d-348210e4a0a2+33:14593:x1869752374002432:12345-192.168.201.41@tcp:101:bash.0 00010000:00010000:1.0:1783135071.867881:0:14224:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783135071.867912:0:14224:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe8c5551e00/0xd6c4b8f05867fe4e lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4428da03f5eb7751 expref: -99 pid: 14224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135071.868878:0:14224:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe8c5551600/0xd6c4b8f05867fe55 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135071.868904:0:14224:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fe8c5551600/0xd6c4b8f05867fe55 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135071.868920:0:14224:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe8c5551600/0xd6c4b8f05867fe55 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135071.868940:0:14224:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe8c5551200/0xd6c4b8f05867fe5c lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135071.868958:0:14224:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fe8c5551200/0xd6c4b8f05867fe5c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135071.868974:0:14224:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe8c5551200/0xd6c4b8f05867fe5c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135071.878958:0:14224:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ade00/0xd6c4b8f05867fe63 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135071.878983:0:14224:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ade00/0xd6c4b8f05867fe63 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135071.878996:0:14224:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ade00/0xd6c4b8f05867fe63 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14224 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783135071.879029:0:14224:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x4:0x0]: returning size 0 00010000:00010000:0.0:1783135071.879078:0:14224:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe8c5551600/0xd6c4b8f05867fe55 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135071.879086:0:14224:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fe8c5551600/0xd6c4b8f05867fe55 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135071.879093:0:14224:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fe8c5551600/0xd6c4b8f05867fe55 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135071.879099:0:14224:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe8c5551600 already unused, calling callback (ffffffffc1f634f0) 00010000:00010000:0.0:1783135071.879105:0:14224:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe8c5551600/0xd6c4b8f05867fe55 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135071.879112:0:14224:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe8c5551600/0xd6c4b8f05867fe55 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135071.879125:0:14224:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9fe9c8301a00) 00010000:00010000:0.0:1783135071.879128:0:14224:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783135071.879132:0:14224:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fe8c5551600/0xd6c4b8f05867fe55 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135071.879139:0:14224:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe8c5551600/0xd6c4b8f05867fe55 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14224 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1783135071.879157:0:14224:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000009c593a7e reply state 00000000ba1f62e3 transno 8589934649 ns: mdt-lustre-MDT0000_UUID lock: ffff9fe8c5551200/0xd6c4b8f05867fe5c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14224 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783135071.879166:0:14224:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1783135071.879209:0:14224:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe8c5551e00/0xd6c4b8f05867fe4e lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb7751 expref: 36 pid: 14224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135071.879236:0:14224:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ade00/0xd6c4b8f05867fe63 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb7751 expref: 35 pid: 14224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135071.879243:0:14224:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x4:0x0].0x0 (ffff9fe9c8301900) 00010000:00010000:0.0:1783135071.879246:0:14224:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:0.0:1783135071.879248:0:14224:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fe9f68ade00, rc 0) 00000100:00100000:0.0:1783135071.879388:0:14224:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fe9f8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2b138366-7a70-4ff2-909d-348210e4a0a2+36:14593:x1869752374002432:12345-192.168.201.41@tcp:101:bash.0 Request processed in 11559us (12702us total) trans 8589934649 rc 0/0 00000100:00100000:0.0:1783135071.879397:0:14224:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 78 00010000:00010000:1.0:1783135071.885356:0:3273:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe8c5551200/0xd6c4b8f05867fe5c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135071.885401:0:3273:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fe8c5551200/0xd6c4b8f05867fe5c lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135071.885420:0:3273:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fe8c5551200/0xd6c4b8f05867fe5c lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135071.885428:0:3273:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe8c5551200 already unused, calling callback (ffffffffc1f634f0) 00010000:00010000:1.0:1783135071.885435:0:3273:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe8c5551200/0xd6c4b8f05867fe5c lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135071.885444:0:3273:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe8c5551200/0xd6c4b8f05867fe5c lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135071.885467:0:3273:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff9fe9e1c2ba00) 00010000:00010000:1.0:1783135071.885471:0:3273:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783135071.885475:0:3273:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fe8c5551200/0xd6c4b8f05867fe5c lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135071.885482:0:3273:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe8c5551200/0xd6c4b8f05867fe5c lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14224 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783135071.904180:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:1.0:1783135071.917115:0:16395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752374002560 00000100:00100000:1.0:1783135071.917136:0:16395:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752374002560 00000100:00100000:2.0:1783135071.917370:0:16395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 79 00000100:00100000:2.0:1783135071.917385:0:16395:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fe9fb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2b138366-7a70-4ff2-909d-348210e4a0a2+35:14593:x1869752374002560:12345-192.168.201.41@tcp:101:bash.0 00010000:00010000:2.0:1783135071.917419:0:16395:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783135071.917443:0:16395:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c1523000/0xd6c4b8f05867fe71 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4428da03f5eb7758 expref: -99 pid: 16395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135071.917539:0:16395:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c1523800/0xd6c4b8f05867fe78 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 16395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135071.917557:0:16395:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c1523800/0xd6c4b8f05867fe78 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135071.917571:0:16395:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c1523800/0xd6c4b8f05867fe78 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16395 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783135071.917638:0:16395:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x4:0x0]: returning size 0 00000004:00200000:2.0:1783135071.917643:0:16395:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1783135071.917665:0:16395:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c1523800/0xd6c4b8f05867fe78 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135071.917678:0:16395:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c1523800/0xd6c4b8f05867fe78 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135071.917706:0:16395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c1523000/0xd6c4b8f05867fe71 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb7758 expref: 37 pid: 16395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135071.917727:0:16395:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c1523800/0xd6c4b8f05867fe78 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb7758 expref: 36 pid: 16395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135071.917737:0:16395:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x4:0x0].0x0 (ffff9fe9c8301900) 00010000:00010000:2.0:1783135071.917740:0:16395:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1783135071.917744:0:16395:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fe9c1523800, rc 0) 00000100:00100000:2.0:1783135071.917835:0:16395:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fe9fb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2b138366-7a70-4ff2-909d-348210e4a0a2+36:14593:x1869752374002560:12345-192.168.201.41@tcp:101:bash.0 Request processed in 453us (14860us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135071.917843:0:16395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 79 00000100:00100000:3.0:1783135071.932651:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:1.0:1783135071.934662:0:14226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752374002816 00000100:00100000:1.0:1783135071.934679:0:14226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752374002816 00000100:00100000:1.0:1783135071.934777:0:14226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 20 00000100:00100000:1.0:1783135071.934790:0:14226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fe7d2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2b138366-7a70-4ff2-909d-348210e4a0a2+36:14593:x1869752374002816:12345-192.168.201.41@tcp:35:bash.0 00000100:00100000:1.0:1783135071.935809:0:14226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fe7d2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2b138366-7a70-4ff2-909d-348210e4a0a2+37:14593:x1869752374002816:12345-192.168.201.41@tcp:35:bash.0 Request processed in 1017us (3169us total) trans 8589934650 rc 0/0 00000100:00100000:1.0:1783135071.935831:0:14226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 20 00000100:00100000:3.0:1783135072.171804:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:2.0:1783135072.177885:0:14223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752374003072 00000100:00100000:2.0:1783135072.177909:0:14223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752374003072 00000100:00100000:2.0:1783135072.178191:0:14223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 80 00000100:00100000:2.0:1783135072.178205:0:14223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fe7d3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2b138366-7a70-4ff2-909d-348210e4a0a2+37:14606:x1869752374003072:12345-192.168.201.41@tcp:101:lfs.0 00010000:00010000:2.0:1783135072.180764:0:14223:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783135072.180806:0:14223:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c1523000/0xd6c4b8f05867fe7f lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4428da03f5eb775f expref: -99 pid: 14223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135072.181445:0:14223:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c1523a00/0xd6c4b8f05867fe86 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135072.181464:0:14223:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c1523a00/0xd6c4b8f05867fe86 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135072.181477:0:14223:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c1523a00/0xd6c4b8f05867fe86 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783135072.181493:0:14223:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x4:0x0]: returning size 0 00010000:00010000:2.0:1783135072.181821:0:14223:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c1523000/0xd6c4b8f05867fe7f lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb775f expref: 40 pid: 14223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135072.181846:0:14223:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c1523a00/0xd6c4b8f05867fe86 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb775f expref: 39 pid: 14223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135072.181857:0:14223:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x4:0x0].0x0 (ffff9fe9c8301900) 00010000:00010000:2.0:1783135072.181860:0:14223:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1783135072.181864:0:14223:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fe9c1523a00, rc 0) 00000100:00100000:2.0:1783135072.182128:0:14223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fe7d3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2b138366-7a70-4ff2-909d-348210e4a0a2+39:14606:x1869752374003072:12345-192.168.201.41@tcp:101:lfs.0 Request processed in 3923us (10343us total) trans 8589934651 rc 0/0 00000100:00100000:2.0:1783135072.182139:0:14223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 80 00000100:00100000:3.0:1783135072.192902:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:3.0:1783135072.192956:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:0.0:1783135072.193251:0:14208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752374003328 00000100:00100000:0.0:1783135072.193264:0:14208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752374003328 00000100:00100000:0.0:1783135072.193675:0:14208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 2 00000100:00100000:0.0:1783135072.193690:0:14208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fe7d1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2b138366-7a70-4ff2-909d-348210e4a0a2+39:2369:x1869752374003328:12345-192.168.201.41@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783135072.193714:0:14208:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783135072.193748:0:14208:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c1523a00/0xd6c4b8f05867fe86 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb775f expref: 39 pid: 14223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135072.193774:0:14208:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x4:0x0].0x0 (ffff9fe9c8301900) 00010000:00010000:0.0:1783135072.193781:0:14208:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783135072.193855:0:14208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fe7d1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2b138366-7a70-4ff2-909d-348210e4a0a2+38:2369:x1869752374003328:12345-192.168.201.41@tcp:103:ldlm_bl.0 Request processed in 169us (898us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135072.193864:0:14208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 2 00000100:00100000:2.0:1783135072.193959:0:16395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752374003200 00000100:00100000:2.0:1783135072.193973:0:16395:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752374003200 00000100:00100000:2.0:1783135072.194021:0:16395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 81 00000100:00100000:2.0:1783135072.194029:0:16395:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fe7d0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2b138366-7a70-4ff2-909d-348210e4a0a2+38:14606:x1869752374003200:12345-192.168.201.41@tcp:54:lfs.0 00010000:00010000:2.0:1783135072.194142:0:16395:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c1523200/0xd6c4b8f05867fe94 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 16395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135072.194166:0:16395:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c1523200/0xd6c4b8f05867fe94 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135072.194179:0:16395:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c1523200/0xd6c4b8f05867fe94 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135072.194214:0:16395:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c1523200/0xd6c4b8f05867fe94 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135072.194221:0:16395:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c1523200/0xd6c4b8f05867fe94 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 16395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135072.194229:0:16395:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c1523200/0xd6c4b8f05867fe94 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135072.194247:0:16395:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe9c1523200 already unused, calling callback (ffffffffc1f634f0) 00010000:00010000:2.0:1783135072.194253:0:16395:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c1523200/0xd6c4b8f05867fe94 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135072.194263:0:16395:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c1523200/0xd6c4b8f05867fe94 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 16395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135072.194273:0:16395:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x4:0x0].0x0 (ffff9fe9c8301900) 00010000:00010000:2.0:1783135072.194276:0:16395:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1783135072.194301:0:16395:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c1523200/0xd6c4b8f05867fe94 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135072.194308:0:16395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c1523200/0xd6c4b8f05867fe94 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16395 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783135072.194365:0:16395:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fe7d0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2b138366-7a70-4ff2-909d-348210e4a0a2+38:14606:x1869752374003200:12345-192.168.201.41@tcp:54:lfs.0 Request processed in 336us (1476us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135072.194378:0:16395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 81 00000100:00100000:3.0:1783135072.206815:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:2.0:1783135072.207151:0:14225:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752374003584 00000100:00100000:2.0:1783135072.207164:0:14225:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752374003584 00000100:00100000:2.0:1783135072.207251:0:14225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 21 00000100:00100000:2.0:1783135072.207265:0:14225:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fe7d0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2b138366-7a70-4ff2-909d-348210e4a0a2+38:14606:x1869752374003584:12345-192.168.201.41@tcp:35:lfs.0 00000100:00100000:2.0:1783135072.207662:0:14225:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fe7d0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2b138366-7a70-4ff2-909d-348210e4a0a2+39:14606:x1869752374003584:12345-192.168.201.41@tcp:35:lfs.0 Request processed in 398us (859us total) trans 8589934652 rc 0/0 00000100:00100000:2.0:1783135072.207671:0:14225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 21 00000100:00100000:3.0:1783135072.430630:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:0.0:1783135072.430910:0:14224:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752374003840 00000100:00100000:0.0:1783135072.430924:0:14224:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752374003840 00000100:00100000:0.0:1783135072.431028:0:14224:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 82 00000100:00100000:0.0:1783135072.431054:0:14224:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fe7d2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2b138366-7a70-4ff2-909d-348210e4a0a2+39:14616:x1869752374003840:12345-192.168.201.41@tcp:101:bash.0 00010000:00010000:0.0:1783135072.431091:0:14224:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783135072.431116:0:14224:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ad400/0xd6c4b8f05867fe9b lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4428da03f5eb7766 expref: -99 pid: 14224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135072.431258:0:14224:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ac400/0xd6c4b8f05867fea2 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135072.431276:0:14224:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ac400/0xd6c4b8f05867fea2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135072.431338:0:14224:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ac400/0xd6c4b8f05867fea2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14224 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783135072.431353:0:14224:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x4:0x0]: returning size 0 00010000:00010000:0.0:1783135072.431882:0:14224:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ad400/0xd6c4b8f05867fe9b lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb7766 expref: 42 pid: 14224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135072.431909:0:14224:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ac400/0xd6c4b8f05867fea2 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb7766 expref: 41 pid: 14224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135072.431919:0:14224:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x4:0x0].0x0 (ffff9fe9c8301900) 00010000:00010000:0.0:1783135072.431923:0:14224:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1783135072.431927:0:14224:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fe9f68ac400, rc 0) 00000100:00100000:1.0:1783135072.432106:0:14224:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fe7d2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2b138366-7a70-4ff2-909d-348210e4a0a2+41:14616:x1869752374003840:12345-192.168.201.41@tcp:101:bash.0 Request processed in 1064us (1499us total) trans 8589934653 rc 0/0 00000100:00100000:1.0:1783135072.432115:0:14224:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 82 00000100:00100000:2.0:1783135072.445370:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:0.0:1783135072.445538:0:16395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752374004096 00000100:00100000:0.0:1783135072.445552:0:16395:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752374004096 00000100:00100000:0.0:1783135072.445639:0:16395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 83 00000100:00100000:0.0:1783135072.445652:0:16395:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9f68f1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2b138366-7a70-4ff2-909d-348210e4a0a2+41:14616:x1869752374004096:12345-192.168.201.41@tcp:36:bash.0 00010000:00010000:0.0:1783135072.445772:0:16395:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:0.0:1783135072.445808:0:16395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ac400/0xd6c4b8f05867fea2 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb7766 expref: 41 pid: 14224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135072.445834:0:16395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c1523800/0xd6c4b8f05867fe78 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb7758 expref: 40 pid: 16395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135072.445859:0:16395:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x4:0x0].0x0 (ffff9fe9c8301900) 00010000:00010000:0.0:1783135072.445865:0:16395:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1783135072.446179:0:16395:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68aca00/0xd6c4b8f05867feb0 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 16395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135072.446196:0:16395:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68aca00/0xd6c4b8f05867feb0 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135072.446207:0:16395:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68aca00/0xd6c4b8f05867feb0 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16395 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1783135072.446265:0:16395:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934654 00000004:00010000:0.0:1783135072.446327:0:16395:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000fa006278 reply state 00000000cac6ac9f transno 8589934655 ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68aca00/0xd6c4b8f05867feb0 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16395 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783135072.446339:0:16395:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1783135072.446476:0:16395:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9f68f1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2b138366-7a70-4ff2-909d-348210e4a0a2+42:14616:x1869752374004096:12345-192.168.201.41@tcp:36:bash.0 Request processed in 826us (1124us total) trans 8589934655 rc 0/0 00000100:00100000:0.0:1783135072.446485:0:16395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 83 00000020:00080000:0.0:1783135072.446492:0:16395:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1783135072.454475:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:2.0:1783135072.456388:0:14223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752374004224 00000100:00100000:2.0:1783135072.456421:0:14223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752374004224 00000100:00100000:2.0:1783135072.456521:0:14223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 84 00000100:00100000:2.0:1783135072.456534:0:14223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fe9f9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2b138366-7a70-4ff2-909d-348210e4a0a2+42:14616:x1869752374004224:12345-192.168.201.41@tcp:101:bash.0 00010000:00010000:2.0:1783135072.456568:0:14223:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783135072.456599:0:14223:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c1523200/0xd6c4b8f05867feb7 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4428da03f5eb776d expref: -99 pid: 14223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135072.456761:0:14223:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c1523400/0xd6c4b8f05867febe lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135072.456778:0:14223:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68aca00/0xd6c4b8f05867feb0 lrc: 2/0,1 mode: PW/PW res: [0x200000bd1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135072.456788:0:14223:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c1523400/0xd6c4b8f05867febe lrc: 4/1,0 mode: --/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135072.456813:0:14223:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68aca00/0xd6c4b8f05867feb0 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 16395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135072.456834:0:14223:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c1523400/0xd6c4b8f05867febe lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135072.457200:0:3272:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68aca00/0xd6c4b8f05867feb0 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 16395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135072.457210:0:3272:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68aca00/0xd6c4b8f05867feb0 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 16395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135072.457218:0:3272:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68aca00/0xd6c4b8f05867feb0 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 16395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135072.457224:0:3272:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe9f68aca00 already unused, calling callback (ffffffffc1f634f0) 00010000:00010000:1.0:1783135072.457227:0:3272:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68aca00/0xd6c4b8f05867feb0 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 16395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135072.457246:0:3272:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68aca00/0xd6c4b8f05867feb0 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 16395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135072.457271:0:3272:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x4:0x0].0x0 (ffff9fe9c8301900) 00010000:00010000:1.0:1783135072.457275:0:3272:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783135072.457304:0:3272:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c1523400/0xd6c4b8f05867febe lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135072.457313:0:3272:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c1523400/0xd6c4b8f05867febe lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135072.457320:0:3272:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c1523400/0xd6c4b8f05867febe lrc: 4/1,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135072.457356:0:3272:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68aca00/0xd6c4b8f05867feb0 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 16395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135072.457363:0:3272:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68aca00/0xd6c4b8f05867feb0 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 16395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135072.460192:0:14223:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c1523400/0xd6c4b8f05867febe lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135072.460211:0:14223:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c1523400/0xd6c4b8f05867febe lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783135072.460345:0:14223:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x4:0x0]: returning size 0 00000004:00200000:2.0:1783135072.460351:0:14223:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1783135072.460378:0:14223:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c1523400/0xd6c4b8f05867febe lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135072.460445:0:14223:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c1523200/0xd6c4b8f05867feb7 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb776d expref: 43 pid: 14223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135072.460470:0:14223:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c1523400/0xd6c4b8f05867febe lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb776d expref: 42 pid: 14223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135072.460481:0:14223:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x4:0x0].0x0 (ffff9fe9c8301900) 00010000:00010000:2.0:1783135072.460484:0:14223:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1783135072.460487:0:14223:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fe9c1523400, rc 0) 00000100:00100000:2.0:1783135072.460596:0:14223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fe9f9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2b138366-7a70-4ff2-909d-348210e4a0a2+42:14616:x1869752374004224:12345-192.168.201.41@tcp:101:bash.0 Request processed in 4063us (6136us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135072.460607:0:14223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 84 00000100:00100000:3.0:1783135072.469554:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:2.0:1783135072.469664:0:16002:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752374004480 00000100:00100000:2.0:1783135072.469677:0:16002:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752374004480 00000100:00100000:2.0:1783135072.469779:0:16002:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 22 00000100:00100000:2.0:1783135072.469791:0:16002:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fdc35450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:2b138366-7a70-4ff2-909d-348210e4a0a2+42:14616:x1869752374004480:12345-192.168.201.41@tcp:35:bash.0 00000100:00100000:2.0:1783135072.470181:0:16002:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fdc35450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:2b138366-7a70-4ff2-909d-348210e4a0a2+43:14616:x1869752374004480:12345-192.168.201.41@tcp:35:bash.0 Request processed in 390us (782us total) trans 8589934656 rc 0/0 00000100:00100000:2.0:1783135072.470190:0:16002:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 22 00000100:00100000:3.0:1783135072.628471:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:0.0:1783135072.634210:0:16395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752374004608 00000100:00100000:0.0:1783135072.634247:0:16395:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752374004608 00000100:00100000:0.0:1783135072.634800:0:16395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 85 00000100:00100000:0.0:1783135072.634827:0:16395:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fe7d0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2b138366-7a70-4ff2-909d-348210e4a0a2+43:14622:x1869752374004608:12345-192.168.201.41@tcp:101:lfs.0 00010000:00010000:0.0:1783135072.634866:0:16395:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783135072.635065:0:16395:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ad400/0xd6c4b8f05867fec5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4428da03f5eb7774 expref: -99 pid: 16395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135072.635163:0:16395:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ace00/0xd6c4b8f05867fecc lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 16395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135072.635181:0:16395:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ace00/0xd6c4b8f05867fecc lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135072.635199:0:16395:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ace00/0xd6c4b8f05867fecc lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16395 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783135072.635831:0:16395:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 7680 00000004:00200000:0.0:1783135072.635847:0:16395:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:0.0:1783135072.636564:0:16395:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ace00/0xd6c4b8f05867fecc lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135072.636616:0:16395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ad400/0xd6c4b8f05867fec5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb7774 expref: 45 pid: 16395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135072.636643:0:16395:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ace00/0xd6c4b8f05867fecc lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb7774 expref: 44 pid: 16395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135072.636656:0:16395:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9fe9c8301a00) 00010000:00010000:0.0:1783135072.636659:0:16395:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1783135072.636664:0:16395:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fe9f68ace00, rc 0) 00000100:00100000:0.0:1783135072.636765:0:16395:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fe7d0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2b138366-7a70-4ff2-909d-348210e4a0a2+44:14622:x1869752374004608:12345-192.168.201.41@tcp:101:lfs.0 Request processed in 1940us (8307us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135072.636795:0:16395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 85 00000100:00100000:0.0:1783135072.662180:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:1.0:1783135072.663259:0:14224:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752374004736 00000100:00100000:1.0:1783135072.663275:0:14224:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752374004736 00000100:00100000:1.0:1783135072.663396:0:14224:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 86 00000100:00100000:1.0:1783135072.663420:0:14224:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fe9f9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2b138366-7a70-4ff2-909d-348210e4a0a2+44:14622:x1869752374004736:12345-192.168.201.41@tcp:101:lfs.0 00010000:00010000:1.0:1783135072.663446:0:14224:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783135072.663472:0:14224:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe8c5551200/0xd6c4b8f05867fed3 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4428da03f5eb777b expref: -99 pid: 14224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135072.663554:0:14224:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe8c5551a00/0xd6c4b8f05867feda lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 14224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135072.663571:0:14224:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fe8c5551a00/0xd6c4b8f05867feda lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135072.663585:0:14224:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe8c5551a00/0xd6c4b8f05867feda lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 14224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135072.663601:0:14224:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe8c5551c00/0xd6c4b8f05867fee1 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135072.663608:0:14224:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fe8c5551c00/0xd6c4b8f05867fee1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135072.663615:0:14224:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe8c5551c00/0xd6c4b8f05867fee1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135072.663777:0:14224:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe8c5551e00/0xd6c4b8f05867fee8 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135072.663787:0:14224:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fe8c5551e00/0xd6c4b8f05867fee8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135072.663794:0:14224:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe8c5551e00/0xd6c4b8f05867fee8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14224 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783135072.663841:0:14224:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x4:0x0]: returning size 0 00000004:00200000:1.0:1783135072.663845:0:14224:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1783135072.663867:0:14224:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fe8c5551e00/0xd6c4b8f05867fee8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135072.664441:0:14224:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fe8c5551e00/0xd6c4b8f05867fee8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135072.664453:0:14224:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe8c5551a00/0xd6c4b8f05867feda lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135072.664459:0:14224:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fe8c5551a00/0xd6c4b8f05867feda lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 14224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135072.664466:0:14224:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fe8c5551a00/0xd6c4b8f05867feda lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135072.664473:0:14224:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe8c5551a00 already unused, calling callback (ffffffffc1f634f0) 00010000:00010000:1.0:1783135072.664479:0:14224:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe8c5551a00/0xd6c4b8f05867feda lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 14224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135072.664486:0:14224:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe8c5551a00/0xd6c4b8f05867feda lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 14224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135072.664516:0:14224:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9fe9c8301a00) 00010000:00010000:1.0:1783135072.664519:0:14224:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783135072.664524:0:14224:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fe8c5551a00/0xd6c4b8f05867feda lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135072.664531:0:14224:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe8c5551a00/0xd6c4b8f05867feda lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 14224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135072.664546:0:14224:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe8c5551c00/0xd6c4b8f05867fee1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135072.664553:0:14224:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fe8c5551c00/0xd6c4b8f05867fee1 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135072.664559:0:14224:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fe8c5551c00/0xd6c4b8f05867fee1 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135072.664565:0:14224:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe8c5551c00 already unused, calling callback (ffffffffc1f634f0) 00010000:00010000:1.0:1783135072.664568:0:14224:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe8c5551c00/0xd6c4b8f05867fee1 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135072.664574:0:14224:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe8c5551c00/0xd6c4b8f05867fee1 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135072.664581:0:14224:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff9fe9e1c2ba00) 00010000:00010000:1.0:1783135072.664584:0:14224:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783135072.664587:0:14224:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fe8c5551c00/0xd6c4b8f05867fee1 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135072.664593:0:14224:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe8c5551c00/0xd6c4b8f05867fee1 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135072.664646:0:14224:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe8c5551200/0xd6c4b8f05867fed3 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb777b expref: 46 pid: 14224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135072.665566:0:14224:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe8c5551e00/0xd6c4b8f05867fee8 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb777b expref: 45 pid: 14224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135072.665579:0:14224:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x4:0x0].0x0 (ffff9fe9c8301900) 00010000:00010000:1.0:1783135072.665581:0:14224:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1783135072.665585:0:14224:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fe8c5551e00, rc 0) 00000100:00100000:1.0:1783135072.665818:0:14224:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fe9f9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2b138366-7a70-4ff2-909d-348210e4a0a2+45:14622:x1869752374004736:12345-192.168.201.41@tcp:101:lfs.0 Request processed in 2399us (3651us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135072.665830:0:14224:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 86 00000100:00100000:3.0:1783135072.680923:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:0.0:1783135072.681020:0:14207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752374004864 00000100:00100000:0.0:1783135072.681034:0:14207:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752374004864 00000100:00100000:0.0:1783135072.681116:0:14207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 3 00000100:00100000:0.0:1783135072.681129:0:14207:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fe7d3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2b138366-7a70-4ff2-909d-348210e4a0a2+45:2367:x1869752374004864:12345-192.168.201.41@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783135072.681149:0:14207:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783135072.681183:0:14207:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe8c5551e00/0xd6c4b8f05867fee8 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb777b expref: 45 pid: 14224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135072.681210:0:14207:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x4:0x0].0x0 (ffff9fe9c8301900) 00010000:00010000:0.0:1783135072.681216:0:14207:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783135072.681353:0:14207:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fe7d3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2b138366-7a70-4ff2-909d-348210e4a0a2+44:2367:x1869752374004864:12345-192.168.201.41@tcp:103:ldlm_bl.0 Request processed in 225us (443us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135072.681362:0:14207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 3 00000100:00100000:3.0:1783135072.697607:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:2.0:1783135072.697810:0:14222:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752374005120 00000100:00100000:2.0:1783135072.697823:0:14222:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752374005120 00000100:00100000:2.0:1783135072.697901:0:14222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 87 00000100:00100000:2.0:1783135072.697911:0:14222:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fe7d1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2b138366-7a70-4ff2-909d-348210e4a0a2+44:14622:x1869752374005120:12345-192.168.201.41@tcp:101:lfs.0 00010000:00010000:2.0:1783135072.697945:0:14222:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783135072.697977:0:14222:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c1523200/0xd6c4b8f05867feef lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4428da03f5eb7782 expref: -99 pid: 14222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135072.698108:0:14222:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c1523800/0xd6c4b8f05867fef6 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135072.698126:0:14222:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c1523800/0xd6c4b8f05867fef6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135072.698139:0:14222:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c1523800/0xd6c4b8f05867fef6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14222 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783135072.698153:0:14222:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x4:0x0]: returning size 0 00010000:00010000:2.0:1783135072.698606:0:14222:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c1523200/0xd6c4b8f05867feef lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb7782 expref: 47 pid: 14222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135072.698629:0:14222:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c1523800/0xd6c4b8f05867fef6 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb7782 expref: 46 pid: 14222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135072.698670:0:14222:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x4:0x0].0x0 (ffff9fe9c8301900) 00010000:00010000:2.0:1783135072.698673:0:14222:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1783135072.698678:0:14222:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fe9c1523800, rc 0) 00000100:00100000:2.0:1783135072.698755:0:14222:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fe7d1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2b138366-7a70-4ff2-909d-348210e4a0a2+46:14622:x1869752374005120:12345-192.168.201.41@tcp:101:lfs.0 Request processed in 845us (1171us total) trans 8589934657 rc 0/0 00000100:00100000:2.0:1783135072.698762:0:14222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 87 00000100:00100000:3.0:1783135072.704803:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:1.0:1783135072.705916:0:14209:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752374005248 00000100:00100000:1.0:1783135072.705943:0:14209:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752374005248 00000100:00100000:1.0:1783135072.706618:0:14209:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 4 00000100:00100000:1.0:1783135072.706632:0:14209:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fe69fc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2b138366-7a70-4ff2-909d-348210e4a0a2+46:2368:x1869752374005248:12345-192.168.201.41@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1783135072.706654:0:14209:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783135072.706698:0:14209:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c1523800/0xd6c4b8f05867fef6 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb7782 expref: 46 pid: 14222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135072.706725:0:14209:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x4:0x0].0x0 (ffff9fe9c8301900) 00010000:00010000:1.0:1783135072.706731:0:14209:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783135072.706818:0:14209:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fe69fc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2b138366-7a70-4ff2-909d-348210e4a0a2+45:2368:x1869752374005248:12345-192.168.201.41@tcp:103:ldlm_bl.0 Request processed in 190us (2032us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135072.706827:0:14209:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 4 00000100:00100000:3.0:1783135072.708369:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:1.0:1783135072.720084:0:14209:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752374005504 00000100:00100000:1.0:1783135072.720107:0:14209:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752374005504 00000100:00100000:1.0:1783135072.720195:0:14209:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 5 00000100:00100000:1.0:1783135072.720207:0:14209:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fe7d1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2b138366-7a70-4ff2-909d-348210e4a0a2+45:14622:x1869752374005504:12345-192.168.201.41@tcp:103:lfs.0 00010000:00010000:1.0:1783135072.720237:0:14209:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1783135072.720275:0:14209:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c1523400/0xd6c4b8f05867febe lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb776d expref: 45 pid: 14223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135072.720321:0:14209:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ade00/0xd6c4b8f05867fe63 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb7751 expref: 44 pid: 14224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135072.720335:0:14209:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x4:0x0].0x0 (ffff9fe9c8301900) 00010000:00010000:1.0:1783135072.720349:0:14209:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783135072.720452:0:14209:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fe7d1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2b138366-7a70-4ff2-909d-348210e4a0a2+43:14622:x1869752374005504:12345-192.168.201.41@tcp:103:lfs.0 Request processed in 246us (12586us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135072.720461:0:14209:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 5 00000100:00100000:1.0:1783135072.727629:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:3.0:1783135072.728208:0:14223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752374005632 00000100:00100000:3.0:1783135072.728221:0:14223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752374005632 00000100:00100000:3.0:1783135072.728334:0:14223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 88 00000100:00100000:3.0:1783135072.728346:0:14223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fe43a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2b138366-7a70-4ff2-909d-348210e4a0a2+43:14622:x1869752374005632:12345-192.168.201.41@tcp:58:lfs.0 00010000:00010000:3.0:1783135072.728485:0:14223:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c0030c00/0xd6c4b8f05867ff04 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135072.728527:0:14223:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c0030c00/0xd6c4b8f05867ff04 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135072.728542:0:14223:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c0030c00/0xd6c4b8f05867ff04 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1783135072.729489:0:14223:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].2, 136 off8464 00000100:00100000:3.0:1783135072.729681:0:14223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fe43a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2b138366-7a70-4ff2-909d-348210e4a0a2+43:14622:x1869752374005632:12345-192.168.201.41@tcp:58:lfs.0 Request processed in 1330us (2061us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135072.729692:0:14223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 88 00000100:00100000:1.0:1783135072.738641:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:0.0:1783135072.747354:0:16395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752374005760 00000100:00100000:0.0:1783135072.747377:0:16395:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752374005760 00000100:00100000:2.0:1783135072.754215:0:16395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 89 00000100:00100000:2.0:1783135072.754247:0:16395:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fe438380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2b138366-7a70-4ff2-909d-348210e4a0a2+43:14622:x1869752374005760:12345-192.168.201.41@tcp:101:lfs.0 00010000:00010000:2.0:1783135072.754295:0:16395:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783135072.754323:0:16395:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c1523200/0xd6c4b8f05867ff0b lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4428da03f5eb7789 expref: -99 pid: 16395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135072.754403:0:16395:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c0030c00/0xd6c4b8f05867ff04 lrc: 2/0,1 mode: EX/EX res: [0x200000bd1:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135072.754417:0:16395:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c1523200/0xd6c4b8f05867ff0b lrc: 4/0,0 mode: --/CR res: [0x200000bd1:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb7789 expref: 44 pid: 16395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135072.754445:0:16395:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c0030c00/0xd6c4b8f05867ff04 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000020 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135072.754462:0:16395:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c1523200/0xd6c4b8f05867ff0b lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb7789 expref: 44 pid: 16395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135072.754477:0:16395:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x4:0x0].0x0 (ffff9fe9c33d0000) 00010000:00010000:2.0:1783135072.754481:0:16395:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1783135072.754504:0:16395:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c1523200/0xd6c4b8f05867ff0b lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb7789 expref: 44 pid: 16395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135072.754513:0:16395:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fe9c1523200, rc 0) 00000100:00100000:2.0:1783135072.754610:0:16395:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fe438380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2b138366-7a70-4ff2-909d-348210e4a0a2+44:14622:x1869752374005760:12345-192.168.201.41@tcp:101:lfs.0 Request processed in 368us (15984us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135072.754618:0:16395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 89 00010000:00010000:2.0:1783135072.771584:0:14210:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1783135073.284649:0:14257:0:(llog.c:800:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1783135073.284675:0:14257:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1783135073.284751:0:14257:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 3 count 3 00000040:00080000:2.0:1783135073.284764:0:14257:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:2.0:1783135073.285108:0:14257:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9f68f3100 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14257:1869752384447744:192.168.201.41@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1783135073.285478:0:14257:0:(client.c:2701:ptlrpc_set_wait()) set ffff9fe9c2fa86c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783135073.320618:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:2.0:1783135073.320865:0:14257:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9f68f3100 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14257:1869752384447744:192.168.201.41@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1783135073.321125:0:14224:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752374005888 00000100:00100000:0.0:1783135073.321133:0:14224:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752374005888 00000100:00100000:0.0:1783135073.321217:0:14224:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 90 00000100:00100000:0.0:1783135073.321240:0:14224:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fe438e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2b138366-7a70-4ff2-909d-348210e4a0a2+44:14624:x1869752374005888:12345-192.168.201.41@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1783135073.321319:0:14224:0:(mdt_handler.c:7960:mdt_fid2path()) path get [0x200000bd1:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1783135073.321443:0:14224:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fe438e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2b138366-7a70-4ff2-909d-348210e4a0a2+44:14624:x1869752374005888:12345-192.168.201.41@tcp:53:lhsmtool_posix.0 Request processed in 216us (838us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135073.321452:0:14224:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 90 00000100:00080000:3.0:1783135073.321597:0:14218:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1783135073.335118:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:2.0:1783135073.338390:0:16395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752374006016 00000100:00100000:2.0:1783135073.338407:0:16395:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752374006016 00000100:00100000:2.0:1783135073.338513:0:16395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 91 00000100:00100000:2.0:1783135073.338527:0:16395:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fe438700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2b138366-7a70-4ff2-909d-348210e4a0a2+44:14624:x1869752374006016:12345-192.168.201.41@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1783135073.338626:0:16395:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c1523a00/0xd6c4b8f05867ff12 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 16395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135073.338647:0:16395:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c1523a00/0xd6c4b8f05867ff12 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135073.338674:0:16395:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c1523a00/0xd6c4b8f05867ff12 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135073.459588:0:16395:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c1522000/0xd6c4b8f05867ff19 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0xdfbec3e4 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135073.459623:0:16395:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c1522000/0xd6c4b8f05867ff19 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdfbec3e4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135073.459635:0:16395:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c1522000/0xd6c4b8f05867ff19 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdfbec3e4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135073.459665:0:16395:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c1523e00/0xd6c4b8f05867ff20 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 16395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135073.459673:0:16395:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c1523e00/0xd6c4b8f05867ff20 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135073.459680:0:16395:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c1523e00/0xd6c4b8f05867ff20 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16395 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783135073.459726:0:16395:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x4:0x0]: returning size 0 00000004:00200000:2.0:1783135073.459730:0:16395:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1783135073.459743:0:16395:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c1523e00/0xd6c4b8f05867ff20 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135073.459755:0:16395:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c1523a00/0xd6c4b8f05867ff12 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135073.459762:0:16395:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c1523a00/0xd6c4b8f05867ff12 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 16395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135073.459769:0:16395:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c1523a00/0xd6c4b8f05867ff12 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135073.459775:0:16395:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe9c1523a00 already unused, calling callback (ffffffffc1f634f0) 00010000:00010000:2.0:1783135073.459779:0:16395:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c1523a00/0xd6c4b8f05867ff12 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135073.459793:0:16395:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c1523a00/0xd6c4b8f05867ff12 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 16395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135073.459806:0:16395:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9fe9cc3c1800) 00010000:00010000:2.0:1783135073.459809:0:16395:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783135073.459813:0:16395:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c1523a00/0xd6c4b8f05867ff12 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135073.459820:0:16395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c1523a00/0xd6c4b8f05867ff12 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135073.459838:0:16395:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c1522000/0xd6c4b8f05867ff19 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdfbec3e4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135073.459844:0:16395:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c1522000/0xd6c4b8f05867ff19 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdfbec3e4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135073.459850:0:16395:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c1522000/0xd6c4b8f05867ff19 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdfbec3e4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135073.459856:0:16395:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe9c1522000 already unused, calling callback (ffffffffc1f634f0) 00010000:00010000:2.0:1783135073.459859:0:16395:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c1522000/0xd6c4b8f05867ff19 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdfbec3e4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135073.459865:0:16395:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c1522000/0xd6c4b8f05867ff19 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdfbec3e4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135073.459872:0:16395:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0xdfbec3e4 (ffff9fe9cc3c1900) 00010000:00010000:2.0:1783135073.459874:0:16395:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783135073.459877:0:16395:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c1522000/0xd6c4b8f05867ff19 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xdfbec3e4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135073.459893:0:16395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c1522000/0xd6c4b8f05867ff19 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xdfbec3e4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135073.459910:0:16395:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c1523e00/0xd6c4b8f05867ff20 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135073.459917:0:16395:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c1523e00/0xd6c4b8f05867ff20 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 16395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135073.459952:0:16395:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c1523e00/0xd6c4b8f05867ff20 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135073.459958:0:16395:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe9c1523e00 already unused, calling callback (ffffffffc1f634f0) 00010000:00010000:2.0:1783135073.459962:0:16395:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c1523e00/0xd6c4b8f05867ff20 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135073.459968:0:16395:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c1523e00/0xd6c4b8f05867ff20 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 16395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135073.460081:0:16395:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x4:0x0].0x0 (ffff9fe9c33d0000) 00010000:00010000:2.0:1783135073.460084:0:16395:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783135073.460088:0:16395:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c1523e00/0xd6c4b8f05867ff20 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135073.460094:0:16395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c1523e00/0xd6c4b8f05867ff20 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16395 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783135073.460193:0:16395:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fe438700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2b138366-7a70-4ff2-909d-348210e4a0a2+44:14624:x1869752374006016:12345-192.168.201.41@tcp:34:lhsmtool_posix.0 Request processed in 121665us (125097us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135073.460203:0:16395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 91 00000100:00100000:2.0:1783135073.579895:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:0.0:1783135073.580958:0:14224:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752374006272 00000100:00100000:0.0:1783135073.581001:0:14224:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752374006272 00000100:00100000:0.0:1783135073.581116:0:14224:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 92 00000100:00100000:0.0:1783135073.581132:0:14224:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9f68f3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2b138366-7a70-4ff2-909d-348210e4a0a2+44:14624:x1869752374006272:12345-192.168.201.41@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1783135073.581161:0:14224:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783135073.581191:0:14224:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ad400/0xd6c4b8f05867ff27 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4428da03f5eb7790 expref: -99 pid: 14224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135073.581412:0:14224:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ada00/0xd6c4b8f05867ff2e lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135073.581430:0:14224:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ada00/0xd6c4b8f05867ff2e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135073.581443:0:14224:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ada00/0xd6c4b8f05867ff2e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14224 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783135073.581457:0:14224:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x4:0x0]: returning size 0 00010000:00010000:0.0:1783135073.581902:0:14224:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ada00/0xd6c4b8f05867ff2e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135073.581912:0:14224:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ada00/0xd6c4b8f05867ff2e lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135073.582378:0:14224:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ada00/0xd6c4b8f05867ff2e lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135073.582385:0:14224:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe9f68ada00 already unused, calling callback (ffffffffc1f634f0) 00010000:00010000:0.0:1783135073.582390:0:14224:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ada00/0xd6c4b8f05867ff2e lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135073.582399:0:14224:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ada00/0xd6c4b8f05867ff2e lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135073.582435:0:14224:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x4:0x0].0x0 (ffff9fe9c33d0000) 00010000:00010000:0.0:1783135073.582438:0:14224:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1783135073.582444:0:14224:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ada00/0xd6c4b8f05867ff2e lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135073.582451:0:14224:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ada00/0xd6c4b8f05867ff2e lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135073.583073:0:14224:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ad400/0xd6c4b8f05867ff27 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb7790 expref: 46 pid: 14224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135073.583151:0:14224:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9fe9cc3c1800) 00010000:00010000:0.0:1783135073.583154:0:14224:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1783135073.583160:0:14224:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ad400/0xd6c4b8f05867ff27 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb7790 expref: 46 pid: 14224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135073.583180:0:14224:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fe9f68ad400, rc 0) 00000100:00100000:0.0:1783135073.585363:0:14224:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9f68f3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2b138366-7a70-4ff2-909d-348210e4a0a2+45:14624:x1869752374006272:12345-192.168.201.41@tcp:101:lhsmtool_posix.0 Request processed in 4210us (5473us total) trans 8589934658 rc 301/301 00000100:00100000:0.0:1783135073.585382:0:14224:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 92 00000100:00100000:1.0:1783135073.610554:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:3.0:1783135073.611894:0:14222:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752374006400 00000100:00100000:3.0:1783135073.611909:0:14222:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752374006400 00000100:00100000:3.0:1783135073.612014:0:14222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 93 00000100:00100000:3.0:1783135073.612025:0:14222:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fe439c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2b138366-7a70-4ff2-909d-348210e4a0a2+45:14624:x1869752374006400:12345-192.168.201.41@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1783135073.626821:0:14222:0:(mdt_handler.c:7960:mdt_fid2path()) path get [0x200000bd1:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1783135073.627020:0:14222:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fe439c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2b138366-7a70-4ff2-909d-348210e4a0a2+45:14624:x1869752374006400:12345-192.168.201.41@tcp:53:lhsmtool_posix.0 Request processed in 14989us (16472us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135073.627040:0:14222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 93 00010000:00010000:0.0:1783135073.797624:0:14211:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783135073.923584:0:3288:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9fe9fbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1869752384448128:0@lo:400:kworker.0 00000100:00100000:0.0:1783135073.923695:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135073.923787:0:3288:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1783135073.923794:0:3288:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9fe9f8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3288:1869752384448256:0@lo:400:kworker.0 00000100:00100000:0.0:1783135073.923820:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135073.923855:0:14860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384448128 00000100:00100000:0.0:1783135073.923864:0:14860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384448128 00000100:00100000:0.0:1783135073.924117:0:14860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1783135073.924129:0:14860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fe9fad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3288:x1869752384448128:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783135073.924370:0:14860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fe9fad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3288:x1869752384448128:12345-0@lo:400:kworker.0 Request processed in 244us (674us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135073.924380:0:14860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00080000:0.0:1783135073.924408:0:14218:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1783135073.924446:0:3288:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9fe9fbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1869752384448128:0@lo:400:kworker.0 00000100:00100000:2.0:1783135073.924629:0:3286:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9fe9fb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c1fe35bd-99cf-438e-8ada-ed586b673efa:3286:1869752384447872:0@lo:400:kworker.0 00000100:00100000:2.0:1783135073.924691:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135073.924728:0:3286:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9fe9f9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3286:1869752384448384:0@lo:400:kworker.0 00000100:00100000:2.0:1783135073.924751:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135073.924774:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1783135073.924779:0:3286:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9fe9f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1869752384448000:0@lo:400:kworker.0 00000100:00100000:2.0:1783135073.924800:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135073.924814:0:3286:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9fe9f9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3286:1869752384448512:0@lo:400:kworker.0 00000100:00100000:2.0:1783135073.924833:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135073.924859:0:14223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384448256 00000100:00100000:2.0:1783135073.924864:0:14223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384448256 00000100:00100000:2.0:1783135073.924899:0:14223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384448384 00000100:00100000:2.0:1783135073.924902:0:14223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384448384 00000100:00100000:2.0:1783135073.924957:0:14223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384448512 00000100:00100000:2.0:1783135073.924960:0:14223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384448512 00000100:00100000:2.0:1783135073.924977:0:14223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1783135073.924984:0:14223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fe9fa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3288:x1869752384448256:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783135073.925026:0:14223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fe9fa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3288:x1869752384448256:12345-0@lo:400:kworker.0 Request processed in 43us (1205us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135073.925032:0:14223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1783135073.925045:0:14223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1783135073.925049:0:14223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9f68f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3286:x1869752384448384:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783135073.925074:0:14223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9f68f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3286:x1869752384448384:12345-0@lo:400:kworker.0 Request processed in 25us (322us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135073.925363:0:14223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1783135073.925381:0:14223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1783135073.925402:0:14223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9f68f2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3286:x1869752384448512:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783135073.925432:0:14223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9f68f2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3286:x1869752384448512:12345-0@lo:400:kworker.0 Request processed in 31us (598us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135073.925437:0:14223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1783135073.925459:0:15538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384448000 00000100:00100000:2.0:1783135073.925462:0:15538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384448000 00000100:00100000:2.0:1783135073.925487:0:15538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1783135073.925493:0:15538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9f68f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3286:x1869752384448000:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783135073.925518:0:15538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9f68f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3286:x1869752384448000:12345-0@lo:400:kworker.0 Request processed in 26us (718us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135073.925523:0:15538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00080000:2.0:1783135073.925541:0:14218:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1783135073.925545:0:14218:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1783135073.925567:0:3286:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9fe9f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1869752384448000:0@lo:400:kworker.0 00000100:00100000:2.0:1783135073.925580:0:3286:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9fe9f9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3286:1869752384448512:0@lo:400:kworker.0 00000100:00100000:2.0:1783135073.925588:0:3286:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9fe9f9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3286:1869752384448384:0@lo:400:kworker.0 00000100:00100000:2.0:1783135073.925619:0:3288:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9fe9f8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3288:1869752384448256:0@lo:400:kworker.0 00000100:00100000:0.0:1783135073.926813:0:14216:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384447872 00000100:00100000:0.0:1783135073.926827:0:14216:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384447872 00000100:00100000:0.0:1783135073.926896:0:14216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:0.0:1783135073.926905:0:14216:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9ca9b9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1fe35bd-99cf-438e-8ada-ed586b673efa+19:3286:x1869752384447872:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783135073.929111:0:14216:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9ca9b9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1fe35bd-99cf-438e-8ada-ed586b673efa+19:3286:x1869752384447872:12345-0@lo:400:kworker.0 Request processed in 2193us (4405us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135073.929127:0:14216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:2.0:1783135073.931868:0:3286:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9fe9fb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c1fe35bd-99cf-438e-8ada-ed586b673efa:3286:1869752384447872:0@lo:400:kworker.0 00000100:00100000:1.0:1783135073.956158:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:2.0:1783135073.957009:0:14223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752374006656 00000100:00100000:2.0:1783135073.957022:0:14223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752374006656 00000100:00100000:2.0:1783135073.957101:0:14223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 94 00000100:00100000:2.0:1783135073.957113:0:14223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fe43ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2b138366-7a70-4ff2-909d-348210e4a0a2+45:14624:x1869752374006656:12345-192.168.201.41@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1783135073.957137:0:14223:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783135073.957141:0:14223:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1783135073.957207:0:14223:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ace00/0xd6c4b8f05867fecc lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb7774 expref: 45 pid: 16395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135073.957230:0:14223:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9fe9c8301a00) 00010000:00010000:2.0:1783135073.957235:0:14223:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1783135073.957253:0:14223:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c1522000/0xd6c4b8f05867ff3c lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4428da03f5eb7797 expref: -99 pid: 14223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1783135073.957859:0:14223:0:(osp_internal.h:570:osp_update_last_fid()) Gap in objids: start=[0x240000400:0x6:0x0], count =28 00000004:00080000:2.0:1783135073.957869:0:14223:0:(osp_object.c:1645:osp_create()) Writing gap [0x240000400:0x6:0x0]+28 in llog 00000004:00080000:0.0:1783135073.958349:0:14248:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 356354067518ns, next at 357354065058ns, rc = 0 00000100:00100000:0.0:1783135073.958391:0:3289:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1783135073.958413:0:3289:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9fe9fbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1869752384448640:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1783135073.958502:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135073.959923:0:14862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384448640 00000100:00100000:3.0:1783135073.959950:0:14862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384448640 00000100:00100000:3.0:1783135073.960020:0:14862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1783135073.960032:0:14862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fe9fb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3289:x1869752384448640:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1783135073.960093:0:14862:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 49348608 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1783135073.960191:0:14862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fe9fb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3289:x1869752384448640:12345-0@lo:13:osp-pre-1-0.0 Request processed in 160us (1689us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135073.960200:0:14862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1783135073.961117:0:3289:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9fe9fbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1869752384448640:0@lo:13:osp-pre-1-0.0 00000004:00080000:2.0:1783135073.963758:0:14223:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x22:0x0], index 0: 0 00010000:00010000:2.0:1783135073.971388:0:14223:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c1523a00/0xd6c4b8f05867ff43 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135073.971421:0:14223:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c1523a00/0xd6c4b8f05867ff43 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135073.971438:0:14223:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c1523a00/0xd6c4b8f05867ff43 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135073.971555:0:14223:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c1522000/0xd6c4b8f05867ff3c lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb7797 expref: 47 pid: 14223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135073.971581:0:14223:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c1523a00/0xd6c4b8f05867ff43 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb7797 expref: 46 pid: 14223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135073.971591:0:14223:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x5:0x0].0x0 (ffff9fe9cc3c1900) 00010000:00010000:2.0:1783135073.971594:0:14223:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1783135073.971597:0:14223:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fe9c1523a00, rc 0) 00000100:00100000:2.0:1783135073.975909:0:14223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fe43ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2b138366-7a70-4ff2-909d-348210e4a0a2+46:14624:x1869752374006656:12345-192.168.201.41@tcp:101:lhsmtool_posix.0 Request processed in 18779us (19745us total) trans 8589934659 rc 0/0 00000100:00100000:2.0:1783135073.978808:0:14223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 94 00000100:00100000:2.0:1783135074.027488:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:0.0:1783135074.028867:0:14224:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752374006912 00000100:00100000:0.0:1783135074.028882:0:14224:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752374006912 00000100:00100000:0.0:1783135074.028993:0:14224:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 95 00000100:00100000:0.0:1783135074.029006:0:14224:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9f68f2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2b138366-7a70-4ff2-909d-348210e4a0a2+46:14624:x1869752374006912:12345-192.168.201.41@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1783135074.029714:0:14224:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783135074.029750:0:14224:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c1523a00/0xd6c4b8f05867ff43 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb7797 expref: 46 pid: 14223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135074.029776:0:14224:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x5:0x0].0x0 (ffff9fe9cc3c1900) 00010000:00010000:0.0:1783135074.029789:0:14224:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1783135074.029815:0:14224:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ad400/0xd6c4b8f05867ff51 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135074.029832:0:14224:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ad400/0xd6c4b8f05867ff51 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135074.029844:0:14224:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ad400/0xd6c4b8f05867ff51 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135074.029860:0:14224:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ada00/0xd6c4b8f05867ff58 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x100fb53f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135074.029867:0:14224:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ada00/0xd6c4b8f05867ff58 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x100fb53f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135074.029873:0:14224:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ada00/0xd6c4b8f05867ff58 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x100fb53f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135074.030092:0:14224:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ad400/0xd6c4b8f05867ff51 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135074.030100:0:14224:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ad400/0xd6c4b8f05867ff51 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135074.030107:0:14224:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ad400/0xd6c4b8f05867ff51 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135074.030124:0:14224:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe9f68ad400 already unused, calling callback (ffffffffc1f634f0) 00010000:00010000:0.0:1783135074.030129:0:14224:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ad400/0xd6c4b8f05867ff51 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135074.030137:0:14224:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ad400/0xd6c4b8f05867ff51 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135074.030146:0:14224:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9fe9c8301a00) 00010000:00010000:0.0:1783135074.030149:0:14224:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783135074.030362:0:14224:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ad400/0xd6c4b8f05867ff51 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135074.030371:0:14224:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ad400/0xd6c4b8f05867ff51 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135074.030382:0:14224:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ada00/0xd6c4b8f05867ff58 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x100fb53f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135074.030389:0:14224:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ada00/0xd6c4b8f05867ff58 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x100fb53f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135074.030395:0:14224:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ada00/0xd6c4b8f05867ff58 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x100fb53f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135074.030400:0:14224:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe9f68ada00 already unused, calling callback (ffffffffc1f634f0) 00010000:00010000:0.0:1783135074.030403:0:14224:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ada00/0xd6c4b8f05867ff58 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x100fb53f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135074.030409:0:14224:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ada00/0xd6c4b8f05867ff58 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x100fb53f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135074.030428:0:14224:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x100fb53f (ffff9fe9c8301200) 00010000:00010000:0.0:1783135074.030431:0:14224:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783135074.030433:0:14224:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ada00/0xd6c4b8f05867ff58 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x100fb53f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135074.030440:0:14224:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ada00/0xd6c4b8f05867ff58 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x100fb53f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14224 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783135074.030955:0:14224:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9f68f2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2b138366-7a70-4ff2-909d-348210e4a0a2+45:14624:x1869752374006912:12345-192.168.201.41@tcp:36:lhsmtool_posix.0 Request processed in 1948us (3479us total) trans 0 rc -2/-2 00000100:00100000:0.0:1783135074.030965:0:14224:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 95 00000100:00100000:1.0:1783135074.055639:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:2.0:1783135074.055793:0:16395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752374007040 00000100:00100000:2.0:1783135074.055808:0:16395:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752374007040 00000100:00100000:2.0:1783135074.055898:0:16395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 96 00000100:00100000:2.0:1783135074.055920:0:16395:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fe43aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2b138366-7a70-4ff2-909d-348210e4a0a2+45:14624:x1869752374007040:12345-192.168.201.41@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1783135074.055957:0:16395:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783135074.055988:0:16395:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c1522000/0xd6c4b8f05867ff5f lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4428da03f5eb779e expref: -99 pid: 16395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135074.056041:0:16395:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c1523a00/0xd6c4b8f05867ff66 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 16395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135074.056067:0:16395:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c1523a00/0xd6c4b8f05867ff66 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x5:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135074.056096:0:16395:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c1523a00/0xd6c4b8f05867ff66 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x5:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135074.056866:0:16395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c1522000/0xd6c4b8f05867ff5f lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x5:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb779e expref: 47 pid: 16395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135074.056894:0:16395:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c1523a00/0xd6c4b8f05867ff66 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x5:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb779e expref: 46 pid: 16395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135074.056904:0:16395:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x5:0x0].0x0 (ffff9fe9cc3c1d00) 00010000:00010000:2.0:1783135074.056907:0:16395:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1783135074.057000:0:16395:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fe9c1523a00, rc 0) 00000100:00100000:2.0:1783135074.057573:0:16395:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fe43aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2b138366-7a70-4ff2-909d-348210e4a0a2+46:14624:x1869752374007040:12345-192.168.201.41@tcp:101:lhsmtool_posix.0 Request processed in 1661us (1958us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135074.057589:0:16395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 96 00000100:00100000:3.0:1783135074.072130:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:2.0:1783135074.076844:0:14222:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752374007296 00000100:00100000:2.0:1783135074.076866:0:14222:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752374007296 00000100:00100000:2.0:1783135074.077121:0:14222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 97 00000100:00100000:2.0:1783135074.077138:0:14222:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fe7d0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2b138366-7a70-4ff2-909d-348210e4a0a2+46:14624:x1869752374007296:12345-192.168.201.41@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1783135074.078416:0:14222:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c1522000/0xd6c4b8f05867ff6d lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135074.078442:0:14222:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c1522000/0xd6c4b8f05867ff6d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135074.078457:0:14222:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c1522000/0xd6c4b8f05867ff6d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14222 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1783135074.080781:0:14222:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].2, 88 off8344 00000004:00080000:2.0:1783135074.080808:0:14222:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 356476527567ns, next at 357476521951ns, rc = 0 00000004:00010000:2.0:1783135074.081566:0:14222:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000007add0654 reply state 000000009245793a transno 8589934660 ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c1522000/0xd6c4b8f05867ff6d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14222 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783135074.081583:0:14222:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1783135074.082557:0:14222:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fe7d0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2b138366-7a70-4ff2-909d-348210e4a0a2+48:14624:x1869752374007296:12345-192.168.201.41@tcp:36:lhsmtool_posix.0 Request processed in 5415us (10433us total) trans 8589934660 rc 0/0 00000100:00100000:2.0:1783135074.082569:0:14222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 97 00000100:00100000:3.0:1783135074.091244:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:0.0:1783135074.091766:0:14223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752374007424 00000100:00100000:0.0:1783135074.091781:0:14223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752374007424 00000100:00100000:0.0:1783135074.091850:0:14223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 98 00000100:00100000:0.0:1783135074.091863:0:14223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fe7d1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2b138366-7a70-4ff2-909d-348210e4a0a2+48:14624:x1869752374007424:12345-192.168.201.41@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1783135074.091898:0:14223:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783135074.091952:0:14223:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ada00/0xd6c4b8f05867ff74 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4428da03f5eb77a5 expref: -99 pid: 14223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135074.092058:0:14223:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ada00/0xd6c4b8f05867ff74 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x5:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb77a5 expref: 49 pid: 14223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135074.092076:0:14223:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ada00/0xd6c4b8f05867ff74 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x5:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb77a5 expref: 49 pid: 14223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135074.092100:0:14223:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x5:0x0].0x0 (ffff9fe9cc3c1d00) 00010000:00010000:0.0:1783135074.092103:0:14223:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1783135074.092130:0:14223:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fe9f68ada00, rc 0) 00000100:00100000:0.0:1783135074.092241:0:14223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fe7d1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2b138366-7a70-4ff2-909d-348210e4a0a2+49:14624:x1869752374007424:12345-192.168.201.41@tcp:101:lhsmtool_posix.0 Request processed in 381us (1010us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135074.092250:0:14223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 98 00010000:00010000:1.0:1783135074.094195:0:3273:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c1522000/0xd6c4b8f05867ff6d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x5:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135074.094269:0:3273:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c1522000/0xd6c4b8f05867ff6d lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x5:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135074.094549:0:3273:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c1522000/0xd6c4b8f05867ff6d lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x5:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135074.094559:0:3273:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe9c1522000 already unused, calling callback (ffffffffc1f634f0) 00010000:00010000:1.0:1783135074.094566:0:3273:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c1522000/0xd6c4b8f05867ff6d lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x5:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135074.094575:0:3273:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c1522000/0xd6c4b8f05867ff6d lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x5:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135074.094599:0:3273:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x5:0x0].0x0 (ffff9fe9cc3c1d00) 00010000:00010000:1.0:1783135074.094603:0:3273:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1783135074.094608:0:3273:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c1522000/0xd6c4b8f05867ff6d lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x5:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135074.094614:0:3273:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c1522000/0xd6c4b8f05867ff6d lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x5:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14222 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783135074.099541:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:0.0:1783135074.099979:0:14860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752374007552 00000100:00100000:0.0:1783135074.099992:0:14860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752374007552 00000100:00100000:0.0:1783135074.100090:0:14860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 21 00000100:00100000:0.0:1783135074.100103:0:14860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fe7d2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2b138366-7a70-4ff2-909d-348210e4a0a2+5:2369:x1869752374007552:12345-192.168.201.41@tcp:2:lhsmtool_posix.0 00000100:00080000:2.0:1783135074.100370:0:14218:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1783135074.100884:0:14860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fe7d2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2b138366-7a70-4ff2-909d-348210e4a0a2+6:2369:x1869752374007552:12345-192.168.201.41@tcp:2:lhsmtool_posix.0 Request processed in 781us (1359us total) trans 8589934594 rc 0/0 00000100:00100000:0.0:1783135074.100894:0:14860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 21 00000100:00100000:3.0:1783135074.126890:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:1.0:1783135074.127104:0:14226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752374007808 00000100:00100000:1.0:1783135074.127117:0:14226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752374007808 00000100:00100000:1.0:1783135074.127217:0:14226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 23 00000100:00100000:1.0:1783135074.127230:0:14226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fe7d0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2b138366-7a70-4ff2-909d-348210e4a0a2+48:14624:x1869752374007808:12345-192.168.201.41@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1783135074.127578:0:14226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fe7d0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2b138366-7a70-4ff2-909d-348210e4a0a2+49:14624:x1869752374007808:12345-192.168.201.41@tcp:35:lhsmtool_posix.0 Request processed in 350us (701us total) trans 8589934661 rc 0/0 00000100:00100000:1.0:1783135074.127587:0:14226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 23 00000100:00100000:3.0:1783135074.131501:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:0.0:1783135074.172026:0:14224:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752374008064 00000100:00100000:0.0:1783135074.172047:0:14224:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752374008064 00000100:00100000:0.0:1783135074.172652:0:14224:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 99 00000100:00100000:0.0:1783135074.172673:0:14224:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fe7d2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2b138366-7a70-4ff2-909d-348210e4a0a2+49:14624:x1869752374008064:12345-192.168.201.41@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1783135074.172856:0:14224:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fe7d2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2b138366-7a70-4ff2-909d-348210e4a0a2+49:14624:x1869752374008064:12345-192.168.201.41@tcp:57:lhsmtool_posix.0 Request processed in 190us (41368us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135074.172866:0:14224:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 99 00000100:00100000:3.0:1783135074.175992:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:2.0:1783135074.176550:0:14222:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752374008192 00000100:00100000:2.0:1783135074.176564:0:14222:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752374008192 00000100:00100000:2.0:1783135074.176642:0:14222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 100 00000100:00100000:2.0:1783135074.176673:0:14222:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fe7d3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2b138366-7a70-4ff2-909d-348210e4a0a2+49:14624:x1869752374008192:12345-192.168.201.41@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1783135074.176701:0:14222:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783135074.176727:0:14222:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c1523400/0xd6c4b8f05867ff7b lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4428da03f5eb77ac expref: -99 pid: 14222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135074.176817:0:14222:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c1523800/0xd6c4b8f05867ff82 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x5:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135074.176835:0:14222:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c1523800/0xd6c4b8f05867ff82 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x5:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135074.176849:0:14222:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c1523800/0xd6c4b8f05867ff82 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x5:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14222 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783135074.176898:0:14222:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1783135074.176997:0:14222:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c1523800/0xd6c4b8f05867ff82 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x5:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135074.177031:0:14222:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c1523400/0xd6c4b8f05867ff7b lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb77ac expref: 51 pid: 14222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135074.177053:0:14222:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c1523800/0xd6c4b8f05867ff82 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x5:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb77ac expref: 50 pid: 14222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135074.177065:0:14222:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x5:0x0].0x0 (ffff9fe9cc3c1d00) 00010000:00010000:2.0:1783135074.177068:0:14222:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1783135074.177072:0:14222:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fe9c1523800, rc 0) 00000100:00100000:2.0:1783135074.177148:0:14222:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fe7d3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2b138366-7a70-4ff2-909d-348210e4a0a2+50:14624:x1869752374008192:12345-192.168.201.41@tcp:101:lhsmtool_posix.0 Request processed in 477us (1169us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135074.177167:0:14222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 100 00000100:00100000:2.0:1783135074.179940:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:0.0:1783135074.180482:0:14861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752374008320 00000100:00100000:0.0:1783135074.180495:0:14861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752374008320 00000100:00100000:0.0:1783135074.180598:0:14861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 22 00000100:00100000:0.0:1783135074.180610:0:14861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9f68f3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2b138366-7a70-4ff2-909d-348210e4a0a2+6:2369:x1869752374008320:12345-192.168.201.41@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1783135074.180635:0:14861:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783135074.180661:0:14861:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a7b1423f/0xd6c4b8f05867ff89 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4428da03f5eb77b3 expref: -99 pid: 14861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1783135074.180717:0:14861:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a487b61, blocks: 0x1 00010000:00010000:0.0:1783135074.180743:0:14861:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=356s v=(0 0) 00010000:00010000:0.0:1783135074.180749:0:14861:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783135074.180761:0:14861:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a7b1423f/0xd6c4b8f05867ff89 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb77b3 expref: 7 pid: 14861 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135074.180785:0:14861:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a7b1423f/0xd6c4b8f05867ff89 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb77b3 expref: 7 pid: 14861 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135074.180802:0:14861:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fe9f68ad400, rc 0) 00000100:00100000:0.0:1783135074.180880:0:14861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9f68f3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2b138366-7a70-4ff2-909d-348210e4a0a2+7:2369:x1869752374008320:12345-192.168.201.41@tcp:101:lhsmtool_posix.0 Request processed in 271us (971us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135074.180888:0:14861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 22 00000100:00100000:2.0:1783135074.183336:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:3.0:1783135074.183471:0:14222:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752374008576 00000100:00100000:3.0:1783135074.183483:0:14222:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752374008576 00000100:00100000:3.0:1783135074.183552:0:14222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 101 00000100:00100000:3.0:1783135074.183565:0:14222:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9f68f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2b138366-7a70-4ff2-909d-348210e4a0a2+50:14624:x1869752374008576:12345-192.168.201.41@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1783135074.183690:0:14222:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9f68f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2b138366-7a70-4ff2-909d-348210e4a0a2+50:14624:x1869752374008576:12345-192.168.201.41@tcp:57:lhsmtool_posix.0 Request processed in 127us (366us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135074.183699:0:14222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 101 00000100:00100000:3.0:1783135074.186354:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:1.0:1783135074.186525:0:15538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752374008704 00000100:00100000:1.0:1783135074.186556:0:15538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752374008704 00000100:00100000:1.0:1783135074.186630:0:15538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 23 00000100:00100000:1.0:1783135074.186642:0:15538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fe7d1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2b138366-7a70-4ff2-909d-348210e4a0a2+7:14624:x1869752374008704:12345-192.168.201.41@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1783135074.186669:0:15538:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783135074.186694:0:15538:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000022191fb6/0xd6c4b8f05867ff90 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4428da03f5eb77ba expref: -99 pid: 15538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135074.186737:0:15538:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000a7b1423f/0xd6c4b8f05867ff89 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb77b3 expref: 8 pid: 14861 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135074.186748:0:15538:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783135074.186753:0:15538:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783135074.186760:0:15538:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000022191fb6/0xd6c4b8f05867ff90 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb77ba expref: 8 pid: 15538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135074.186808:0:15538:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000a7b1423f/0xd6c4b8f05867ff89 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb77b3 expref: 8 pid: 14861 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135074.186823:0:15538:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000a7b1423f/0xd6c4b8f05867ff89 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb77b3 expref: 8 pid: 14861 timeout: 456 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783135074.186841:0:15538:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9fe438000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:15538:1869752384448768:192.168.201.41@tcp:104: 00000100:00100000:1.0:1783135074.186994:0:15538:0:(client.c:2701:ptlrpc_set_wait()) set ffff9fe9c136a480 going to sleep for 11 seconds 00000100:00100000:2.0:1783135074.190116:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:3.0:1783135074.190229:0:14209:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752374008832 00000100:00100000:3.0:1783135074.190240:0:14209:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752374008832 00010000:00010000:3.0:1783135074.190341:0:14209:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000a7b1423f/0xd6c4b8f05867ff89 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb77b3 expref: 9 pid: 14861 timeout: 456 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783135074.190387:0:14209:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 23 00000100:00100000:3.0:1783135074.190399:0:14209:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9f68f3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2b138366-7a70-4ff2-909d-348210e4a0a2+9:2370:x1869752374008832:12345-192.168.201.41@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783135074.190420:0:14209:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783135074.190451:0:14209:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000a7b1423f/0xd6c4b8f05867ff89 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb77b3 expref: 9 pid: 14861 timeout: 456 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135074.190469:0:14209:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000a7b1423f/0xd6c4b8f05867ff89 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb77b3 expref: 9 pid: 14861 timeout: 456 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135074.190508:0:14209:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783135074.190513:0:14209:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783135074.190545:0:14209:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000022191fb6/0xd6c4b8f05867ff90 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb77ba expref: 9 pid: 15538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135074.190558:0:14209:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000022191fb6/0xd6c4b8f05867ff90 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb77ba expref: 9 pid: 15538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135074.190608:0:14209:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 0000000022191fb6/0xd6c4b8f05867ff90 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb77ba expref: 9 pid: 15538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783135074.190627:0:14209:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9fe7d1880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:14209:1869752384448896:192.168.201.41@tcp:105: 00000100:00100000:3.0:1783135074.190737:0:14209:0:(client.c:2701:ptlrpc_set_wait()) set ffff9fe9f89806c0 going to sleep for 11 seconds 00010000:00010000:1.0:1783135074.191121:0:15538:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a7b1423f/0xd6c4b8f05867ff89 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb77b3 expref: 9 pid: 14861 timeout: 456 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783135074.191157:0:15538:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9fe438000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:15538:1869752384448768:192.168.201.41@tcp:104: 00010000:00010000:1.0:1783135074.191188:0:15538:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000022191fb6/0xd6c4b8f05867ff90 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb77ba expref: 8 pid: 15538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135074.191213:0:15538:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fe8c5550800, rc 0) 00000100:00100000:1.0:1783135074.191264:0:15538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fe7d1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2b138366-7a70-4ff2-909d-348210e4a0a2+8:14624:x1869752374008704:12345-192.168.201.41@tcp:101:lhsmtool_posix.0 Request processed in 4624us (4924us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135074.191273:0:15538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 23 00000100:00100000:2.0:1783135074.195973:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:3.0:1783135074.196147:0:14209:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9fe7d1880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:14209:1869752384448896:192.168.201.41@tcp:105: 00010000:00010000:3.0:1783135074.196180:0:14209:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783135074.196265:0:14209:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9f68f3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2b138366-7a70-4ff2-909d-348210e4a0a2+7:2370:x1869752374008832:12345-192.168.201.41@tcp:103:ldlm_bl.0 Request processed in 5867us (6161us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135074.196306:0:14209:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 23 00000100:00100000:0.0:1783135074.196464:0:14864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752374008960 00000100:00100000:0.0:1783135074.196473:0:14864:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752374008960 00002000:00100000:0.0:1783135074.196529:0:14864:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x22:0x0] (0->12) req@ffff9fe9f68f1180 x1869752374008960/t0(0) o4->2b138366-7a70-4ff2-909d-348210e4a0a2@192.168.201.41@tcp:245/0 lens 504/0 e 0 to 0 dl 1783135085 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:100 00002000:00100000:0.0:1783135074.196541:0:14864:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9fe9f68f1180 with x1869752374008960 ext(0->12) 00002000:00010000:0.0:1783135074.196547:0:14864:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9fe9f68f1180 00000100:00100000:0.0:1783135074.196580:0:14864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 2 00000100:00100000:0.0:1783135074.196589:0:14864:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9f68f1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:2b138366-7a70-4ff2-909d-348210e4a0a2+7:2370:x1869752374008960:12345-192.168.201.41@tcp:4:lhsmtool_posix.0 00000100:00100000:0.0:1783135074.197152:0:14864:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9f68f1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:2b138366-7a70-4ff2-909d-348210e4a0a2+9:2370:x1869752374008960:12345-192.168.201.41@tcp:4:lhsmtool_posix.0 Request processed in 562us (1191us total) trans 8589934595 rc 0/0 00000100:00100000:0.0:1783135074.197168:0:14864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 2 00002000:00100000:0.0:1783135074.197176:0:14864:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x22:0x0] (0->12) req@ffff9fe9f68f1180 x1869752374008960/t8589934595(0) o4->2b138366-7a70-4ff2-909d-348210e4a0a2@192.168.201.41@tcp:245/0 lens 504/448 e 0 to 0 dl 1783135085 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:100 00002000:00100000:0.0:1783135074.197185:0:14864:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9fe9f68f1180 with x1869752374008960 ext(0->12) 00002000:00010000:0.0:1783135074.197189:0:14864:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9fe9f68f1180 00000100:00100000:2.0:1783135074.202465:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:0.0:1783135074.202656:0:14224:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752374009088 00000100:00100000:0.0:1783135074.202668:0:14224:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752374009088 00000100:00100000:0.0:1783135074.202746:0:14224:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 102 00000100:00100000:0.0:1783135074.202758:0:14224:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9f68f1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2b138366-7a70-4ff2-909d-348210e4a0a2+50:14624:x1869752374009088:12345-192.168.201.41@tcp:44:lhsmtool_posix.0 00000004:00080000:2.0:1783135074.244417:0:5791:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 4 committed 00000001:00080000:2.0:1783135074.244453:0:5791:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934658 is committed 00000001:00080000:2.0:1783135074.244474:0:5791:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934661 is committed 00000004:00080000:2.0:1783135074.244502:0:5791:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000004:00080000:2.0:1783135074.244539:0:5791:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3 committed 00000020:00080000:2.0:1783135074.244588:0:5791:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9fe9d25b3180 refcount 2 committed 0 result 0 batchid 4294967527 00000020:00080000:2.0:1783135074.244595:0:5791:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9fe9fe480300 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9fe9d25b3b40 00000020:00080000:2.0:1783135074.244599:0:5791:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9fe9fe480900 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9fe8c58b5800 00000100:00100000:1.0:1783135074.244837:0:3288:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1783135074.244866:0:3288:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9fe438000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1869752384449024:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1783135074.244988:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135074.245072:0:14858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384449024 00000100:00100000:1.0:1783135074.245082:0:14858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384449024 00000100:00100000:1.0:1783135074.245140:0:14858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1783135074.245149:0:14858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe8c6dfdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3288:x1869752384449024:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1783135074.245185:0:14858:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:34 count 1 00010000:00010000:1.0:1783135074.245318:0:14858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007910f49a/0xd6c4b8f05867ff97 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135074.245347:0:14858:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000086a0872a/0xd6c4b8f05867fdb4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb7735 expref: 7 pid: 14858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135074.245356:0:14858:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x22:0x0].0x0 since=3s v=(0 0) 00010000:00010000:1.0:1783135074.245361:0:14858:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1783135074.245384:0:14858:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007910f49a/0xd6c4b8f05867ff97 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135074.245418:0:14858:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000086a0872a/0xd6c4b8f05867fdb4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb7735 expref: 7 pid: 14858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135074.245432:0:14858:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000086a0872a/0xd6c4b8f05867fdb4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb7735 expref: 7 pid: 14858 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783135074.245446:0:14858:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe8c6dfc380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:14858:1869752384449152:192.168.201.41@tcp:104: 00000100:00100000:1.0:1783135074.245517:0:14858:0:(client.c:2701:ptlrpc_set_wait()) set ffff9fe9e1fcec00 going to sleep for 11 seconds 00000020:00080000:3.0:1783135074.245807:0:14261:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4294967527 committed batchid 8 00000020:00080000:3.0:1783135074.246041:0:14261:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000100:00100000:3.0:1783135074.246052:0:3287:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1783135074.246064:0:3287:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9fe7d1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1869752384449280:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1783135074.246101:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135074.246131:0:14860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384449280 00000100:00100000:3.0:1783135074.246136:0:14860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384449280 00000100:00100000:3.0:1783135074.246164:0:14860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1783135074.246171:0:14860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fe7d3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3287:x1869752384449280:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1783135074.246420:0:14860:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:3.0:1783135074.246434:0:14860:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb mtime from disk: 0 -> 1783135074 00002000:00010000:3.0:1783135074.246437:0:14860:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1783135074.246439:0:14860:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb ctime from disk: 1783135073 -> 1783135074 00002000:00010000:3.0:1783135074.246442:0:14860:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1783135074.246489:0:14860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fe7d3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3287:x1869752384449280:12345-0@lo:2:osp-syn-0-0.0 Request processed in 317us (387us total) trans 8589934596 rc 0/0 00000100:00100000:3.0:1783135074.246497:0:14860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000004:00080000:3.0:1783135074.246553:0:3287:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9fe9fe7d1880/2, rc 0, transno 8589934596 00000100:00100000:3.0:1783135074.246560:0:3287:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9fe7d1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1869752384449280:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1783135074.248781:0:14858:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe8c6dfc380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:14858:1869752384449152:192.168.201.41@tcp:104: 00010000:00010000:1.0:1783135074.248821:0:14858:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000007910f49a/0xd6c4b8f05867ff97 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783135074.249269:0:14224:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9f68f1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2b138366-7a70-4ff2-909d-348210e4a0a2+14:14624:x1869752374009088:12345-192.168.201.41@tcp:44:lhsmtool_posix.0 Request processed in 46510us (46816us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135074.249303:0:14224:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 102 00000100:00100000:3.0:1783135074.251539:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:0.0:1783135074.252806:0:14208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752374009216 00000100:00100000:0.0:1783135074.252823:0:14208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752374009216 00010000:00010000:0.0:1783135074.252980:0:14208:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000086a0872a/0xd6c4b8f05867fdb4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb7735 expref: 8 pid: 14858 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783135074.253038:0:14208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 24 00000100:00100000:0.0:1783135074.253050:0:14208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fe7d2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2b138366-7a70-4ff2-909d-348210e4a0a2+8:2370:x1869752374009216:12345-192.168.201.41@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783135074.253069:0:14208:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783135074.253076:0:14208:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000086a0872a/0xd6c4b8f05867fdb4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb7735 expref: 8 pid: 14858 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135074.253090:0:14208:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000086a0872a/0xd6c4b8f05867fdb4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb7735 expref: 8 pid: 14858 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135074.253143:0:14208:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000086a0872a/0xd6c4b8f05867fdb4 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb7735 expref: 8 pid: 14858 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135074.253161:0:14208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1783135074.253165:0:14208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1783135074.253172:0:14208:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000007910f49a/0xd6c4b8f05867ff97 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 14858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135074.253183:0:14208:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007910f49a/0xd6c4b8f05867ff97 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 14858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135074.253372:0:14208:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783135074.253448:0:14208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fe7d2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2b138366-7a70-4ff2-909d-348210e4a0a2+7:2370:x1869752374009216:12345-192.168.201.41@tcp:103:ldlm_bl.0 Request processed in 399us (1919us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135074.253458:0:14208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 24 00010000:00010000:1.0:1783135074.254949:0:14858:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000007910f49a/0xd6c4b8f05867ff97 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135074.254968:0:14858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007910f49a/0xd6c4b8f05867ff97 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135074.254982:0:14858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007910f49a/0xd6c4b8f05867ff97 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135074.254992:0:14858:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007910f49a/0xd6c4b8f05867ff97 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135074.255054:0:14858:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1783135074.255797:0:14858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe8c6dfdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3288:x1869752384449024:12345-0@lo:6:osp-syn-1-0.0 Request processed in 10644us (10805us total) trans 8589934601 rc 0/0 00000100:00100000:1.0:1783135074.255808:0:14858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000004:00080000:1.0:1783135074.255887:0:3288:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9fe9fe438000/2, rc 0, transno 8589934601 00000100:00100000:1.0:1783135074.255896:0:3288:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9fe438000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1869752384449024:0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1783135074.255971:0:15220:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783135074.255980:0:15220:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007910f49a/0xd6c4b8f05867ff97 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135074.255990:0:15220:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe8c5551600 already unused, calling callback (ffffffffc1527ce0) 00010000:00010000:0.0:1783135074.255996:0:15220:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007910f49a/0xd6c4b8f05867ff97 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135074.256008:0:15220:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007910f49a/0xd6c4b8f05867ff97 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135074.256043:0:15220:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007910f49a/0xd6c4b8f05867ff97 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135074.256052:0:15220:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007910f49a/0xd6c4b8f05867ff97 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135074.256077:0:15220:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783135074.256079:0:15220:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783135074.256081:0:15220:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783135074.257703:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:0.0:1783135074.257786:0:14861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752374009344 00000100:00100000:0.0:1783135074.257797:0:14861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752374009344 00000100:00100000:0.0:1783135074.257863:0:14861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 26 00000100:00100000:0.0:1783135074.257875:0:14861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe8c6dfc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2b138366-7a70-4ff2-909d-348210e4a0a2+9:2370:x1869752374009344:12345-192.168.201.41@tcp:16:lhsmtool_posix.0 00000100:00080000:2.0:1783135074.261583:0:14218:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00080000:3.0:1783135074.292686:0:6602:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934595 is committed 00000001:00080000:3.0:1783135074.292716:0:6602:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934596 is committed 00000100:00100000:1.0:1783135074.292903:0:14861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe8c6dfc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2b138366-7a70-4ff2-909d-348210e4a0a2+6:2370:x1869752374009344:12345-192.168.201.41@tcp:16:lhsmtool_posix.0 Request processed in 35020us (35199us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135074.292936:0:14861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 26 00000100:00100000:2.0:1783135074.295698:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:3.0:1783135074.295817:0:14222:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752374009600 00000100:00100000:3.0:1783135074.295829:0:14222:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752374009600 00000100:00100000:3.0:1783135074.295904:0:14222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 103 00000100:00100000:3.0:1783135074.295935:0:14222:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fea00bcea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2b138366-7a70-4ff2-909d-348210e4a0a2+14:14624:x1869752374009600:12345-192.168.201.41@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1783135074.296022:0:14222:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783135074.296064:0:14222:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c1523800/0xd6c4b8f05867ff82 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x5:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb77ac expref: 14 pid: 14222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135074.296089:0:14222:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x5:0x0].0x0 (ffff9fe9cc3c1d00) 00010000:00010000:3.0:1783135074.296095:0:14222:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1783135074.296135:0:14222:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c0030400/0xd6c4b8f05867ff9e lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135074.296152:0:14222:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c0030400/0xd6c4b8f05867ff9e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135074.296186:0:14222:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c0030400/0xd6c4b8f05867ff9e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14222 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1783135074.296588:0:14222:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000002246cb29 reply state 00000000b54b055d transno 8589934662 ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c0030400/0xd6c4b8f05867ff9e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14222 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783135074.296601:0:14222:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1783135074.296720:0:14222:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fea00bcea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2b138366-7a70-4ff2-909d-348210e4a0a2+15:14624:x1869752374009600:12345-192.168.201.41@tcp:36:lhsmtool_posix.0 Request processed in 795us (1035us total) trans 8589934662 rc 0/0 00000100:00100000:3.0:1783135074.296729:0:14222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 103 00010000:00010000:1.0:1783135074.299307:0:3272:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c0030400/0xd6c4b8f05867ff9e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135074.299326:0:3272:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c0030400/0xd6c4b8f05867ff9e lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135074.299334:0:3272:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c0030400/0xd6c4b8f05867ff9e lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135074.299341:0:3272:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe9c0030400 already unused, calling callback (ffffffffc1f634f0) 00010000:00010000:1.0:1783135074.299347:0:3272:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c0030400/0xd6c4b8f05867ff9e lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135074.299356:0:3272:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c0030400/0xd6c4b8f05867ff9e lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135074.299375:0:3272:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x5:0x0].0x0 (ffff9fe9cc3c1d00) 00010000:00010000:1.0:1783135074.299395:0:3272:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783135074.299400:0:3272:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c0030400/0xd6c4b8f05867ff9e lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135074.299406:0:3272:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c0030400/0xd6c4b8f05867ff9e lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14222 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783135074.300897:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:3.0:1783135074.300999:0:15538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752374009728 00000100:00100000:3.0:1783135074.301013:0:15538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752374009728 00000100:00100000:3.0:1783135074.301088:0:15538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 27 00000100:00100000:3.0:1783135074.301101:0:15538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9c8add450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2b138366-7a70-4ff2-909d-348210e4a0a2+6:2368:x1869752374009728:12345-192.168.201.41@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1783135074.301506:0:15538:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:3.0:1783135074.301511:0:15538:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb mtime from disk: 1783135074 -> 1783135072 00002000:00010000:3.0:1783135074.301514:0:15538:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb atime from disk: 0 -> 1783135071 00002000:00010000:3.0:1783135074.301516:0:15538:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb ctime from disk: 1783135074 -> 1783135072 00002000:00010000:3.0:1783135074.301519:0:15538:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:3.0:1783135074.302001:0:15538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9c8add450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2b138366-7a70-4ff2-909d-348210e4a0a2+7:2368:x1869752374009728:12345-192.168.201.41@tcp:2:lhsmtool_posix.0 Request processed in 900us (1112us total) trans 8589934597 rc 0/0 00000100:00100000:3.0:1783135074.302012:0:15538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 27 00000100:00100000:3.0:1783135074.308020:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:1.0:1783135074.308114:0:14223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752374009984 00000100:00100000:1.0:1783135074.308127:0:14223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752374009984 00000100:00100000:1.0:1783135074.308205:0:14223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 104 00000100:00100000:1.0:1783135074.308226:0:14223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fe7d2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2b138366-7a70-4ff2-909d-348210e4a0a2+14:14624:x1869752374009984:12345-192.168.201.41@tcp:55:lhsmtool_posix.0 00010000:00010000:1.0:1783135074.308371:0:14223:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe8c5551e00/0xd6c4b8f05867ffa5 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135074.308393:0:14223:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c1523a00/0xd6c4b8f05867ff66 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x5:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb779e expref: 14 pid: 16395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135074.308405:0:14223:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fe8c5551e00/0xd6c4b8f05867ffa5 lrc: 4/0,1 mode: --/PW res: [0x200000bd1:0x5:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135074.308453:0:14223:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c1523a00/0xd6c4b8f05867ff66 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x5:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb779e expref: 14 pid: 16395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135074.308469:0:14223:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c1523a00/0xd6c4b8f05867ff66 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x5:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb779e expref: 14 pid: 16395 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783135074.308487:0:14223:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe8c6dfd180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14223:1869752384449408:192.168.201.41@tcp:104: 00000100:00100000:1.0:1783135074.308606:0:14223:0:(client.c:2701:ptlrpc_set_wait()) set ffff9fe9e1fce780 going to sleep for 11 seconds 00000100:00100000:2.0:1783135074.312366:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:0.0:1783135074.312460:0:14207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752374010112 00000100:00100000:0.0:1783135074.312474:0:14207:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752374010112 00010000:00010000:0.0:1783135074.312532:0:14207:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c1523a00/0xd6c4b8f05867ff66 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x5:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb779e expref: 15 pid: 16395 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783135074.312583:0:14207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 25 00000100:00100000:0.0:1783135074.312595:0:14207:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fea00bcc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2b138366-7a70-4ff2-909d-348210e4a0a2+15:2369:x1869752374010112:12345-192.168.201.41@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783135074.312618:0:14207:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783135074.312625:0:14207:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c1523a00/0xd6c4b8f05867ff66 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x5:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb779e expref: 15 pid: 16395 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135074.312640:0:14207:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c1523a00/0xd6c4b8f05867ff66 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x5:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb779e expref: 15 pid: 16395 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135074.312687:0:14207:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x5:0x0].0x0 (ffff9fe9cc3c1d00) 00010000:00010000:0.0:1783135074.312694:0:14207:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9fe8c5551e00/0xd6c4b8f05867ffa5 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x5:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135074.312707:0:14207:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe8c5551e00/0xd6c4b8f05867ffa5 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x5:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135074.312716:0:14207:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fe8c5551e00/0xd6c4b8f05867ffa5 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x5:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135074.312744:0:14207:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783135074.312822:0:14207:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fea00bcc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2b138366-7a70-4ff2-909d-348210e4a0a2+15:2369:x1869752374010112:12345-192.168.201.41@tcp:103:ldlm_bl.0 Request processed in 228us (470us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135074.312832:0:14207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 25 00010000:00010000:1.0:1783135074.312978:0:14223:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c1523a00/0xd6c4b8f05867ff66 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x5:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb779e expref: 14 pid: 16395 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783135074.313010:0:14223:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe8c6dfd180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14223:1869752384449408:192.168.201.41@tcp:104: 00010000:00010000:1.0:1783135074.313060:0:14223:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9fe8c5551e00/0xd6c4b8f05867ffa5 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x5:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135074.313072:0:14223:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9fe8c5551e00/0xd6c4b8f05867ffa5 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x5:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135074.313079:0:14223:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe8c5551e00/0xd6c4b8f05867ffa5 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x5:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135074.313120:0:14223:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe8c5551e00/0xd6c4b8f05867ffa5 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x5:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135074.313129:0:14223:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fe8c5551e00/0xd6c4b8f05867ffa5 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x5:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135074.313136:0:14223:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fe8c5551e00/0xd6c4b8f05867ffa5 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x5:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135074.313142:0:14223:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe8c5551e00 already unused, calling callback (ffffffffc1f634f0) 00010000:00010000:1.0:1783135074.313148:0:14223:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe8c5551e00/0xd6c4b8f05867ffa5 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x5:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135074.313156:0:14223:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe8c5551e00/0xd6c4b8f05867ffa5 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x5:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135074.313167:0:14223:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x5:0x0].0x0 (ffff9fe9cc3c1d00) 00010000:00010000:1.0:1783135074.313171:0:14223:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:1.0:1783135074.313174:0:14223:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fe8c5551e00/0xd6c4b8f05867ffa5 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x5:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135074.313186:0:14223:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe8c5551e00/0xd6c4b8f05867ffa5 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x5:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783135074.313233:0:14223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fe7d2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2b138366-7a70-4ff2-909d-348210e4a0a2+13:14624:x1869752374009984:12345-192.168.201.41@tcp:55:lhsmtool_posix.0 Request processed in 5009us (5227us total) trans 0 rc -22/-22 00000100:00100000:1.0:1783135074.313243:0:14223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 104 00000100:00100000:2.0:1783135074.316589:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:3.0:1783135074.316690:0:14860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752374010240 00000100:00100000:3.0:1783135074.316704:0:14860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752374010240 00000100:00100000:3.0:1783135074.316777:0:14860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 28 00000100:00100000:3.0:1783135074.316789:0:14860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fea00bcd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2b138366-7a70-4ff2-909d-348210e4a0a2+7:2369:x1869752374010240:12345-192.168.201.41@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1783135074.316867:0:14860:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000001f613943/0xd6c4b8f05867ffac lrc: 3/1,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135074.316897:0:14860:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000022191fb6/0xd6c4b8f05867ff90 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb77ba expref: 7 pid: 15538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135074.316919:0:14860:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783135074.316933:0:14860:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1783135074.316939:0:14860:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001f613943/0xd6c4b8f05867ffac lrc: 4/1,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135074.316985:0:14860:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000022191fb6/0xd6c4b8f05867ff90 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb77ba expref: 7 pid: 15538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135074.317002:0:14860:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000022191fb6/0xd6c4b8f05867ff90 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb77ba expref: 7 pid: 15538 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783135074.317023:0:14860:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9fe7d1c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:14860:1869752384449536:192.168.201.41@tcp:104: 00000100:00100000:3.0:1783135074.317231:0:14860:0:(client.c:2701:ptlrpc_set_wait()) set ffff9fe9f8980e40 going to sleep for 11 seconds 00000100:00100000:3.0:1783135074.325881:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:0.0:1783135074.326124:0:14860:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9fe7d1c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:14860:1869752384449536:192.168.201.41@tcp:104: 00010000:00010000:0.0:1783135074.326166:0:14860:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000001f613943/0xd6c4b8f05867ffac lrc: 3/1,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783135074.326474:0:14208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752374010368 00000100:00100000:1.0:1783135074.326484:0:14208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752374010368 00010000:00010000:1.0:1783135074.326535:0:14208:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000022191fb6/0xd6c4b8f05867ff90 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb77ba expref: 8 pid: 15538 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783135074.326629:0:14208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 26 00000100:00100000:1.0:1783135074.326641:0:14208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fe7d3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2b138366-7a70-4ff2-909d-348210e4a0a2+8:2370:x1869752374010368:12345-192.168.201.41@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1783135074.326662:0:14208:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783135074.326690:0:14208:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000022191fb6/0xd6c4b8f05867ff90 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb77ba expref: 8 pid: 15538 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135074.326704:0:14208:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000022191fb6/0xd6c4b8f05867ff90 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb77ba expref: 8 pid: 15538 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135074.326733:0:14208:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000022191fb6/0xd6c4b8f05867ff90 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb77ba expref: 8 pid: 15538 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135074.326751:0:14208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1783135074.326755:0:14208:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1783135074.326762:0:14208:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000001f613943/0xd6c4b8f05867ffac lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135074.326790:0:14208:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001f613943/0xd6c4b8f05867ffac lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135074.326827:0:14208:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783135074.326942:0:14208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fe7d3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2b138366-7a70-4ff2-909d-348210e4a0a2+7:2370:x1869752374010368:12345-192.168.201.41@tcp:103:ldlm_bl.0 Request processed in 302us (1073us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135074.326951:0:14208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 26 00010000:00010000:0.0:1783135074.327066:0:14860:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000001f613943/0xd6c4b8f05867ffac lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135074.327076:0:14860:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001f613943/0xd6c4b8f05867ffac lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135074.327106:0:14860:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000001f613943/0xd6c4b8f05867ffac lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135074.327129:0:14860:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001f613943/0xd6c4b8f05867ffac lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135074.327138:0:14860:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001f613943/0xd6c4b8f05867ffac lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135074.327145:0:14860:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe9c0030000 already unused, calling callback (ffffffffc1527ce0) 00010000:00010000:0.0:1783135074.327151:0:14860:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001f613943/0xd6c4b8f05867ffac lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135074.327161:0:14860:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001f613943/0xd6c4b8f05867ffac lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135074.327174:0:14860:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001f613943/0xd6c4b8f05867ffac lrc: 2/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135074.327182:0:14860:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001f613943/0xd6c4b8f05867ffac lrc: 0/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783135074.328492:0:14860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fea00bcd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2b138366-7a70-4ff2-909d-348210e4a0a2+6:2369:x1869752374010240:12345-192.168.201.41@tcp:1:lhsmtool_posix.0 Request processed in 11697us (11908us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135074.328505:0:14860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 28 00000100:00100000:2.0:1783135074.331022:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:3.0:1783135074.331134:0:14222:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752374010624 00000100:00100000:3.0:1783135074.331147:0:14222:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752374010624 00000100:00100000:3.0:1783135074.331327:0:14222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 105 00000100:00100000:3.0:1783135074.331341:0:14222:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9f6fe7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2b138366-7a70-4ff2-909d-348210e4a0a2+13:14624:x1869752374010624:12345-192.168.201.41@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1783135074.331445:0:14222:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c0030600/0xd6c4b8f05867ffb3 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135074.331494:0:14222:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c0030600/0xd6c4b8f05867ffb3 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135074.331510:0:14222:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c0030600/0xd6c4b8f05867ffb3 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135074.331841:0:14222:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c0031400/0xd6c4b8f05867ffba lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135074.331856:0:14222:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ada00/0xd6c4b8f05867ff74 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb77a5 expref: 14 pid: 14223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135074.331865:0:14222:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c0031400/0xd6c4b8f05867ffba lrc: 4/0,1 mode: --/EX res: [0x200000bd1:0x5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135074.332037:0:14222:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ada00/0xd6c4b8f05867ff74 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb77a5 expref: 14 pid: 14223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135074.332055:0:14222:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ada00/0xd6c4b8f05867ff74 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb77a5 expref: 14 pid: 14223 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783135074.332072:0:14222:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9fe7d0380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14222:1869752384449664:192.168.201.41@tcp:104: 00000100:00100000:3.0:1783135074.332188:0:14222:0:(client.c:2701:ptlrpc_set_wait()) set ffff9fe9f8980180 going to sleep for 11 seconds 00000100:00100000:3.0:1783135074.335326:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:1.0:1783135074.335540:0:14207:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752374010752 00000100:00100000:1.0:1783135074.335552:0:14207:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752374010752 00010000:00010000:1.0:1783135074.335604:0:14207:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ada00/0xd6c4b8f05867ff74 lrc: 5/0,0 mode: CR/CR res: [0x200000bd1:0x5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb77a5 expref: 15 pid: 14223 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783135074.335640:0:14207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 27 00000100:00100000:1.0:1783135074.335650:0:14207:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fe7d1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2b138366-7a70-4ff2-909d-348210e4a0a2+15:2369:x1869752374010752:12345-192.168.201.41@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1783135074.335669:0:14207:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783135074.335676:0:14207:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ada00/0xd6c4b8f05867ff74 lrc: 5/0,0 mode: CR/CR res: [0x200000bd1:0x5:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb77a5 expref: 15 pid: 14223 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135074.335691:0:14207:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ada00/0xd6c4b8f05867ff74 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x5:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb77a5 expref: 15 pid: 14223 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135074.335717:0:14207:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x5:0x0].0x0 (ffff9fe9cc3c1d00) 00010000:00010000:1.0:1783135074.335724:0:14207:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c0031400/0xd6c4b8f05867ffba lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x5:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135074.335733:0:14207:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c0031400/0xd6c4b8f05867ffba lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x5:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 14222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135074.335760:0:14207:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c0031400/0xd6c4b8f05867ffba lrc: 4/0,1 mode: EX/EX res: [0x200000bd1:0x5:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 14222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135074.335784:0:14207:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783135074.335850:0:14207:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fe7d1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2b138366-7a70-4ff2-909d-348210e4a0a2+15:2369:x1869752374010752:12345-192.168.201.41@tcp:103:ldlm_bl.0 Request processed in 200us (536us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135074.335858:0:14207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 27 00010000:00010000:0.0:1783135074.337547:0:14222:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ada00/0xd6c4b8f05867ff74 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb77a5 expref: 14 pid: 14223 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783135074.337599:0:14222:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9fe7d0380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14222:1869752384449664:192.168.201.41@tcp:104: 00010000:00010000:0.0:1783135074.337631:0:14222:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c0031400/0xd6c4b8f05867ffba lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x5:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135074.337642:0:14222:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c0031400/0xd6c4b8f05867ffba lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x5:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135074.337648:0:14222:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c0031400/0xd6c4b8f05867ffba lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x5:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14222 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1783135074.337919:0:14222:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934663 00000001:00080000:0.0:1783135074.338381:0:14222:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934664 00000001:00080000:0.0:1783135074.338446:0:14222:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934665 00000100:00100000:0.0:1783135074.338569:0:14222:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9fe9f8000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:14222:1869752384449792:0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1783135074.338659:0:14222:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135074.338787:0:14222:0:(client.c:2701:ptlrpc_set_wait()) set ffff9fe9e9d82180 going to sleep for 11 seconds 00000100:00100000:2.0:1783135074.339662:0:14228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384449792 00000100:00100000:2.0:1783135074.339678:0:14228:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384449792 00000100:00100000:2.0:1783135074.339808:0:14228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1783135074.339822:0:14228:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fe9f9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:14222:x1869752384449792:12345-0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1783135074.340116:0:14228:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fe9f9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:14222:x1869752384449792:12345-0@lo:1000:mdt00_000.0 Request processed in 296us (1455us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135074.340145:0:14228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1783135074.340236:0:14222:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934596 gen 2 00000004:00080000:0.0:1783135074.340243:0:14222:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9fe9fe7d1880, transno 8589934596 00000100:00100000:0.0:1783135074.340267:0:14222:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9fe9f8000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:14222:1869752384449792:0@lo:1000:mdt00_000.0 00000001:00080000:0.0:1783135074.340882:0:14222:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934666 00000100:00100000:0.0:1783135074.341194:0:14222:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9fe9f8000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:14222:1869752384449920:0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1783135074.341277:0:14222:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135074.342317:0:14222:0:(client.c:2701:ptlrpc_set_wait()) set ffff9fe9e0328900 going to sleep for 11 seconds 00000100:00100000:1.0:1783135074.342480:0:14227:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384449920 00000100:00100000:1.0:1783135074.342493:0:14227:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384449920 00000100:00100000:1.0:1783135074.342557:0:14227:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1783135074.342569:0:14227:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fe9f9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:14222:x1869752384449920:12345-0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1783135074.342983:0:14222:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9fe9f8000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:14222:1869752384449920:0@lo:1000:mdt00_000.0 00010000:00010000:0.0:1783135074.343180:0:14222:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c0031400/0xd6c4b8f05867ffba lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x5:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135074.343315:0:14222:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c0031400/0xd6c4b8f05867ffba lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x5:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135074.343324:0:14222:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c0031400/0xd6c4b8f05867ffba lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x5:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135074.343332:0:14222:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe9c0031400 already unused, calling callback (ffffffffc1f634f0) 00010000:00010000:0.0:1783135074.343338:0:14222:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c0031400/0xd6c4b8f05867ffba lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x5:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135074.343347:0:14222:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c0031400/0xd6c4b8f05867ffba lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x5:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135074.343369:0:14222:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x5:0x0].0x0 (ffff9fe9cc3c1d00) 00010000:00010000:0.0:1783135074.343373:0:14222:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1783135074.343378:0:14222:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c0031400/0xd6c4b8f05867ffba lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x5:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135074.343385:0:14222:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c0031400/0xd6c4b8f05867ffba lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x5:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135074.343430:0:14222:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c0030c00/0xd6c4b8f05867ff04 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135074.343437:0:14222:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c0030c00/0xd6c4b8f05867ff04 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135074.343442:0:14222:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c0030c00/0xd6c4b8f05867ff04 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135074.343447:0:14222:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe9c0030c00 already unused, calling callback (ffffffffc1f634f0) 00010000:00010000:0.0:1783135074.343458:0:14222:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c0030c00/0xd6c4b8f05867ff04 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135074.343465:0:14222:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c0030c00/0xd6c4b8f05867ff04 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000020 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135074.343475:0:14222:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x4:0x0].0x0 (ffff9fe9c33d0000) 00010000:00010000:0.0:1783135074.343477:0:14222:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1783135074.343487:0:14222:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c1523200/0xd6c4b8f05867ff0b lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb7789 expref: 17 pid: 16395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135074.343501:0:14222:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c1523200/0xd6c4b8f05867ff0b lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb7789 expref: 17 pid: 16395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135074.343512:0:14222:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c1523200/0xd6c4b8f05867ff0b lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb7789 expref: 17 pid: 16395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135074.343558:0:14222:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c1523200/0xd6c4b8f05867ff0b lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb7789 expref: 17 pid: 16395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783135074.343576:0:14222:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9fe9f9500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14222:1869752384450048:192.168.201.41@tcp:105: 00000100:00100000:0.0:1783135074.343757:0:14222:0:(client.c:2701:ptlrpc_set_wait()) set ffff9fe9e0328900 going to sleep for 11 seconds 00000100:00100000:1.0:1783135074.343833:0:14227:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fe9f9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:14222:x1869752384449920:12345-0@lo:1000:mdt00_000.0 Request processed in 340us (1629us total) trans 8589934598 rc 0/0 00000100:00100000:1.0:1783135074.343846:0:14227:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1783135074.350561:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:0.0:1783135074.350659:0:14222:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9fe9f9500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14222:1869752384450048:192.168.201.41@tcp:105: 00010000:00010000:0.0:1783135074.350699:0:14222:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c0030c00/0xd6c4b8f05867ff04 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135074.350712:0:14222:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c0030c00/0xd6c4b8f05867ff04 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135074.350773:0:14222:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ac000/0xd6c4b8f05867ffc1 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135074.350789:0:14222:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ac000/0xd6c4b8f05867ffc1 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135074.350803:0:14222:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ac000/0xd6c4b8f05867ffc1 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135074.350816:0:14222:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ac000/0xd6c4b8f05867ffc1 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135074.350823:0:14222:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ac000/0xd6c4b8f05867ffc1 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135074.350830:0:14222:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ac000/0xd6c4b8f05867ffc1 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135074.350836:0:14222:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe9f68ac000 already unused, calling callback (ffffffffc1f634f0) 00010000:00010000:0.0:1783135074.350841:0:14222:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ac000/0xd6c4b8f05867ffc1 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135074.350850:0:14222:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ac000/0xd6c4b8f05867ffc1 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135074.350865:0:14222:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x4:0x0].0x0 (ffff9fe9c33d0000) 00010000:00010000:0.0:1783135074.350869:0:14222:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783135074.350873:0:14222:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ac000/0xd6c4b8f05867ffc1 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135074.350879:0:14222:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ac000/0xd6c4b8f05867ffc1 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135074.350901:0:14222:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c0030600/0xd6c4b8f05867ffb3 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x4:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135074.350931:0:14222:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c0030600/0xd6c4b8f05867ffb3 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x4:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135074.350939:0:14222:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c0030600/0xd6c4b8f05867ffb3 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x4:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135074.350945:0:14222:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe9c0030600 already unused, calling callback (ffffffffc1f634f0) 00010000:00010000:0.0:1783135074.350948:0:14222:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c0030600/0xd6c4b8f05867ffb3 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x4:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135074.350955:0:14222:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c0030600/0xd6c4b8f05867ffb3 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x4:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135074.350965:0:14222:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x4:0x0].0x0 (ffff9fe9c33d0000) 00010000:00010000:0.0:1783135074.350968:0:14222:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1783135074.350971:0:14222:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c0030600/0xd6c4b8f05867ffb3 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x4:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135074.350977:0:14222:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c0030600/0xd6c4b8f05867ffb3 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x4:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14222 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783135074.351420:0:14225:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752374010880 00000100:00100000:1.0:1783135074.351434:0:14225:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752374010880 00000100:00100000:1.0:1783135074.351513:0:14225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 24 00000100:00100000:1.0:1783135074.351526:0:14225:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fe7d1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2b138366-7a70-4ff2-909d-348210e4a0a2+18:14622:x1869752374010880:12345-192.168.201.41@tcp:49:lfs.0 00000100:00100000:0.0:1783135074.352073:0:14222:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9f6fe7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2b138366-7a70-4ff2-909d-348210e4a0a2+18:14624:x1869752374010624:12345-192.168.201.41@tcp:57:lhsmtool_posix.0 Request processed in 20733us (21060us total) trans 8589934667 rc 0/0 00000100:00100000:0.0:1783135074.352084:0:14222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 105 00000020:00080000:0.0:1783135074.352091:0:14222:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:1.0:1783135074.352178:0:14225:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fe7d1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2b138366-7a70-4ff2-909d-348210e4a0a2+17:14622:x1869752374010880:12345-192.168.201.41@tcp:49:lfs.0 Request processed in 654us (1632us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135074.352187:0:14225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 24 00000040:00080000:0.0:1783135074.352517:0:14257:0:(llog.c:800:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1783135074.352523:0:14257:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1783135074.352585:0:14257:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 3 count 3 00000040:00080000:0.0:1783135074.352595:0:14257:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:2.0:1783135074.357775:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:2.0:1783135074.357880:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:3.0:1783135074.358031:0:16002:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752374011392 00000100:00100000:3.0:1783135074.358059:0:16002:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752374011392 00000100:00100000:3.0:1783135074.358141:0:16002:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 25 00000100:00100000:3.0:1783135074.358154:0:16002:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9f6fe5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:2b138366-7a70-4ff2-909d-348210e4a0a2+17:14624:x1869752374011392:12345-192.168.201.41@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1783135074.359807:0:16002:0:(mdd_object.c:4010:mdd_close()) Object [0x200000bd1:0x5:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1783135074.360432:0:16002:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934668 00010000:00010000:3.0:1783135074.360513:0:16002:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c0030a00/0xd6c4b8f05867ffc8 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16002 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135074.360535:0:16002:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c0030a00/0xd6c4b8f05867ffc8 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x5:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 16002 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135074.360550:0:16002:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c0030a00/0xd6c4b8f05867ffc8 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x5:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 16002 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135074.360562:0:16002:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c0030a00/0xd6c4b8f05867ffc8 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x5:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 16002 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135074.360570:0:16002:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c0030a00/0xd6c4b8f05867ffc8 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x5:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 16002 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135074.360578:0:16002:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c0030a00/0xd6c4b8f05867ffc8 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x5:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 16002 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135074.360722:0:16002:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1783135074.360878:0:16002:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9f6fe5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:2b138366-7a70-4ff2-909d-348210e4a0a2+19:14624:x1869752374011392:12345-192.168.201.41@tcp:35:lhsmtool_posix.0 Request processed in 2721us (2993us total) trans 8589934669 rc 0/0 00000100:00100000:3.0:1783135074.360890:0:16002:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 25 00000020:00080000:3.0:1783135074.360898:0:16002:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1783135074.362805:0:14224:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752374011136 00000100:00100000:0.0:1783135074.362825:0:14224:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752374011136 00000100:00100000:0.0:1783135074.362989:0:14224:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 106 00000100:00100000:0.0:1783135074.363003:0:14224:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9f6fe5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2b138366-7a70-4ff2-909d-348210e4a0a2+19:14622:x1869752374011136:12345-192.168.201.41@tcp:58:lfs.0 00000040:00080000:0.0:1783135074.363829:0:14224:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].3, 136 off8600 00010000:00010000:2.0:1783135074.364211:0:14210:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783135074.364225:0:14210:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c0030a00/0xd6c4b8f05867ffc8 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x5:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 16002 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135074.364238:0:14210:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe9c0030a00 already unused, calling callback (ffffffffc1527ce0) 00010000:00010000:2.0:1783135074.364244:0:14210:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c0030a00/0xd6c4b8f05867ffc8 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x5:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 16002 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135074.364257:0:14210:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c0030a00/0xd6c4b8f05867ffc8 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x5:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 16002 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135074.364295:0:14210:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x5:0x0].0x0 (ffff9fe9c33d0f00) 00010000:00010000:2.0:1783135074.364298:0:14210:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1783135074.364304:0:14210:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c0030a00/0xd6c4b8f05867ffc8 lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x5:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 16002 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135074.364311:0:14210:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c0030a00/0xd6c4b8f05867ffc8 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x5:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 16002 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783135074.364522:0:14224:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9f6fe5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2b138366-7a70-4ff2-909d-348210e4a0a2+19:14622:x1869752374011136:12345-192.168.201.41@tcp:58:lfs.0 Request processed in 1516us (6755us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135074.364533:0:14224:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 106 00010000:00010000:1.0:1783135074.364693:0:14210:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783135074.364696:0:14210:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783135074.364698:0:14210:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783135074.367691:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:1.0:1783135074.367768:0:14226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752374011648 00000100:00100000:1.0:1783135074.367780:0:14226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752374011648 00000100:00100000:1.0:1783135074.367857:0:14226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 26 00000100:00100000:1.0:1783135074.367883:0:14226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fe9f9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2b138366-7a70-4ff2-909d-348210e4a0a2+19:14622:x1869752374011648:12345-192.168.201.41@tcp:35:lfs.0 00000100:00100000:1.0:1783135074.368622:0:14226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fe9f9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2b138366-7a70-4ff2-909d-348210e4a0a2+20:14622:x1869752374011648:12345-192.168.201.41@tcp:35:lfs.0 Request processed in 738us (939us total) trans 8589934670 rc 0/0 00000100:00100000:1.0:1783135074.368632:0:14226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 26 00000100:00100000:0.0:1783135074.402739:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:2.0:1783135074.402851:0:16395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752374011776 00000100:00100000:2.0:1783135074.402863:0:16395:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752374011776 00000100:00100000:2.0:1783135074.402950:0:16395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 107 00000100:00100000:2.0:1783135074.402960:0:16395:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fe9fb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2b138366-7a70-4ff2-909d-348210e4a0a2+20:14626:x1869752374011776:12345-192.168.201.41@tcp:101:lfs.0 00010000:00010000:2.0:1783135074.402990:0:16395:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783135074.403016:0:16395:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c1523e00/0xd6c4b8f05867ffcf lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4428da03f5eb77c1 expref: -99 pid: 16395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135074.403134:0:16395:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c1523800/0xd6c4b8f05867ffd6 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 16395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135074.403152:0:16395:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c1523800/0xd6c4b8f05867ffd6 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135074.403165:0:16395:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c1523800/0xd6c4b8f05867ffd6 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135074.403179:0:16395:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c1522000/0xd6c4b8f05867ffdd lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135074.403186:0:16395:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c1522000/0xd6c4b8f05867ffdd lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135074.403192:0:16395:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c1522000/0xd6c4b8f05867ffdd lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135074.405003:0:16395:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c0030000/0xd6c4b8f05867ffe4 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 16395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135074.405022:0:16395:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c0030000/0xd6c4b8f05867ffe4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135074.405033:0:16395:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c0030000/0xd6c4b8f05867ffe4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16395 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783135074.405194:0:16395:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x4:0x0]: returning size 0 00000004:00200000:3.0:1783135074.405206:0:16395:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1783135074.405230:0:16395:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c0030000/0xd6c4b8f05867ffe4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135074.405243:0:16395:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c0030000/0xd6c4b8f05867ffe4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135074.405253:0:16395:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c1523800/0xd6c4b8f05867ffd6 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135074.405260:0:16395:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c1523800/0xd6c4b8f05867ffd6 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 16395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135074.405267:0:16395:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c1523800/0xd6c4b8f05867ffd6 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 16395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135074.405273:0:16395:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe9c1523800 already unused, calling callback (ffffffffc1f634f0) 00010000:00010000:3.0:1783135074.405390:0:16395:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c1523800/0xd6c4b8f05867ffd6 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 16395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135074.405403:0:16395:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c1523800/0xd6c4b8f05867ffd6 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 16395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135074.405422:0:16395:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9fe9c8301a00) 00010000:00010000:3.0:1783135074.405426:0:16395:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783135074.405431:0:16395:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c1523800/0xd6c4b8f05867ffd6 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 16395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135074.405438:0:16395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c1523800/0xd6c4b8f05867ffd6 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 16395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135074.405467:0:16395:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c1522000/0xd6c4b8f05867ffdd lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135074.405473:0:16395:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c1522000/0xd6c4b8f05867ffdd lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135074.405479:0:16395:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c1522000/0xd6c4b8f05867ffdd lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135074.405483:0:16395:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe9c1522000 already unused, calling callback (ffffffffc1f634f0) 00010000:00010000:3.0:1783135074.405486:0:16395:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c1522000/0xd6c4b8f05867ffdd lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135074.405491:0:16395:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c1522000/0xd6c4b8f05867ffdd lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135074.405497:0:16395:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff9fe9cc3c1400) 00010000:00010000:3.0:1783135074.405499:0:16395:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783135074.405502:0:16395:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c1522000/0xd6c4b8f05867ffdd lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135074.405506:0:16395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c1522000/0xd6c4b8f05867ffdd lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135074.405553:0:16395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c1523e00/0xd6c4b8f05867ffcf lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb77c1 expref: 22 pid: 16395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135074.405567:0:16395:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c0030000/0xd6c4b8f05867ffe4 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb77c1 expref: 21 pid: 16395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135074.405589:0:16395:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x4:0x0].0x0 (ffff9fe9c33d0000) 00010000:00010000:3.0:1783135074.405591:0:16395:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1783135074.405594:0:16395:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fe9c0030000, rc 0) 00000100:00100000:0.0:1783135074.406049:0:16395:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fe9fb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2b138366-7a70-4ff2-909d-348210e4a0a2+21:14626:x1869752374011776:12345-192.168.201.41@tcp:101:lfs.0 Request processed in 3086us (3319us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135074.406060:0:16395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 107 00000001:00080000:2.0:1783135074.588122:0:7470:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934601 is committed 00000001:00080000:2.0:1783135074.588156:0:7470:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934600 is committed 00010000:00010000:0.0:1783135074.826727:0:14211:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1783135075.400132:0:14257:0:(llog.c:800:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1783135075.400146:0:14257:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1783135075.400384:0:14257:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 4 count 4 00000040:00080000:2.0:1783135075.400393:0:14257:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:2.0:1783135075.400563:0:14257:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9f6fe5880 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14257:1869752384450176:192.168.201.41@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1783135075.400692:0:14257:0:(client.c:2701:ptlrpc_set_wait()) set ffff9fe9e0136900 going to sleep for 11 seconds 00000100:00100000:0.0:1783135075.407469:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:1.0:1783135075.407551:0:14223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752374011904 00000100:00100000:1.0:1783135075.407563:0:14223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752374011904 00000100:00100000:1.0:1783135075.407652:0:14223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 108 00000100:00100000:1.0:1783135075.407666:0:14223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fe9fad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2b138366-7a70-4ff2-909d-348210e4a0a2+22:14637:x1869752374011904:12345-192.168.201.41@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1783135075.407711:0:14223:0:(mdt_handler.c:7960:mdt_fid2path()) path get [0x200000bd1:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1783135075.407846:0:14223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fe9fad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2b138366-7a70-4ff2-909d-348210e4a0a2+22:14637:x1869752374011904:12345-192.168.201.41@tcp:53:lhsmtool_posix.0 Request processed in 183us (386us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135075.407855:0:14223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 108 00000100:00080000:0.0:1783135075.408186:0:14218:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1783135075.408317:0:14257:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9f6fe5880 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14257:1869752384450176:192.168.201.41@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1783135075.415588:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:3.0:1783135075.415703:0:14222:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752374012160 00000100:00100000:3.0:1783135075.415715:0:14222:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752374012160 00000100:00100000:3.0:1783135075.415784:0:14222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 109 00000100:00100000:3.0:1783135075.415795:0:14222:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fe9fbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2b138366-7a70-4ff2-909d-348210e4a0a2+21:14637:x1869752374012160:12345-192.168.201.41@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1783135075.415821:0:14222:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783135075.415846:0:14222:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c0030400/0xd6c4b8f05867ffeb lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4428da03f5eb77c8 expref: -99 pid: 14222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135075.416082:0:14222:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c0030a00/0xd6c4b8f05867fff2 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135075.416100:0:14222:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c0030a00/0xd6c4b8f05867fff2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135075.416112:0:14222:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c0030a00/0xd6c4b8f05867fff2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14222 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783135075.416126:0:14222:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x4:0x0]: returning size 0 00010000:00010000:3.0:1783135075.416627:0:14222:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c0030400/0xd6c4b8f05867ffeb lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb77c8 expref: 24 pid: 14222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135075.416646:0:14222:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c0030a00/0xd6c4b8f05867fff2 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb77c8 expref: 23 pid: 14222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135075.416672:0:14222:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x4:0x0].0x0 (ffff9fe9c33d0000) 00010000:00010000:3.0:1783135075.416675:0:14222:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1783135075.416679:0:14222:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fe9c0030a00, rc 0) 00000100:00100000:3.0:1783135075.416754:0:14222:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fe9fbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2b138366-7a70-4ff2-909d-348210e4a0a2+23:14637:x1869752374012160:12345-192.168.201.41@tcp:101:lhsmtool_posix.0 Request processed in 961us (1181us total) trans 8589934671 rc 0/0 00000100:00100000:3.0:1783135075.416762:0:14222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 109 00000100:00100000:1.0:1783135075.420358:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:0.0:1783135075.421680:0:14223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752374012416 00000100:00100000:0.0:1783135075.421697:0:14223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752374012416 00000100:00100000:0.0:1783135075.421795:0:14223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 110 00000100:00100000:0.0:1783135075.421816:0:14223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe8c6dfd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2b138366-7a70-4ff2-909d-348210e4a0a2+23:14637:x1869752374012416:12345-192.168.201.41@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1783135075.422056:0:14223:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ac200/0xd6c4b8f058680000 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135075.422078:0:14223:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ac200/0xd6c4b8f058680000 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135075.422114:0:14223:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ac200/0xd6c4b8f058680000 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783135075.422883:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:1.0:1783135075.423080:0:16237:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752374012544 00000100:00100000:1.0:1783135075.423088:0:16237:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752374012544 00000100:00100000:1.0:1783135075.423147:0:16237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 6 00000100:00100000:1.0:1783135075.423156:0:16237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fe69ec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2b138366-7a70-4ff2-909d-348210e4a0a2+24:2368:x1869752374012544:12345-192.168.201.41@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1783135075.423173:0:16237:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783135075.423203:0:16237:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c0030a00/0xd6c4b8f05867fff2 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb77c8 expref: 24 pid: 14222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135075.423225:0:16237:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x4:0x0].0x0 (ffff9fe9c33d0000) 00010000:00010000:1.0:1783135075.423230:0:16237:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783135075.423319:0:16237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fe69ec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2b138366-7a70-4ff2-909d-348210e4a0a2+23:2368:x1869752374012544:12345-192.168.201.41@tcp:103:ldlm_bl.0 Request processed in 163us (440us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135075.423326:0:16237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 6 00010000:00010000:1.0:1783135075.425003:0:14223:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ac200/0xd6c4b8f058680000 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135075.425023:0:14223:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ac200/0xd6c4b8f058680000 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135075.425032:0:14223:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ac200/0xd6c4b8f058680000 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135075.425143:0:14223:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe9f68ac200 already unused, calling callback (ffffffffc1f634f0) 00010000:00010000:1.0:1783135075.425149:0:14223:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ac200/0xd6c4b8f058680000 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135075.425159:0:14223:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ac200/0xd6c4b8f058680000 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135075.425190:0:14223:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x4:0x0].0x0 (ffff9fe9c33d0000) 00010000:00010000:1.0:1783135075.425194:0:14223:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1783135075.425199:0:14223:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ac200/0xd6c4b8f058680000 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135075.425206:0:14223:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ac200/0xd6c4b8f058680000 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14223 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783135075.425614:0:14223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe8c6dfd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2b138366-7a70-4ff2-909d-348210e4a0a2+23:14637:x1869752374012416:12345-192.168.201.41@tcp:57:lhsmtool_posix.0 Request processed in 3805us (5265us total) trans 8589934672 rc 0/0 00000100:00100000:1.0:1783135075.425626:0:14223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 110 00000040:00080000:0.0:1783135075.425955:0:14257:0:(llog.c:800:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1783135075.425962:0:14257:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1783135075.426513:0:14257:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 64768 count 4 00000040:00080000:0.0:1783135075.426526:0:14257:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:3.0:1783135075.432275:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:1.0:1783135075.432389:0:16002:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752374012800 00000100:00100000:1.0:1783135075.432403:0:16002:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752374012800 00000100:00100000:1.0:1783135075.432478:0:16002:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 27 00000100:00100000:1.0:1783135075.432491:0:16002:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fe7d1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:2b138366-7a70-4ff2-909d-348210e4a0a2+23:14637:x1869752374012800:12345-192.168.201.41@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1783135075.442001:0:16002:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fe7d1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:2b138366-7a70-4ff2-909d-348210e4a0a2+24:14637:x1869752374012800:12345-192.168.201.41@tcp:35:lhsmtool_posix.0 Request processed in 9498us (9727us total) trans 8589934673 rc 0/0 00000100:00100000:1.0:1783135075.442020:0:16002:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 27 00000040:00080000:2.0:1783135075.443727:0:16500:0:(llog.c:800:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1783135075.443744:0:16500:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1783135075.447331:0:16500:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 4 count 4 00000040:00080000:2.0:1783135075.447346:0:16500:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:0.0:1783135075.460581:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1783135075.460604:0:3286:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9fe8ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1869752384450304:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1783135075.460678:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135075.460736:0:14863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384450304 00000100:00100000:0.0:1783135075.460745:0:14863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384450304 00000100:00100000:0.0:1783135075.463356:0:14863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1783135075.463372:0:14863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fe8fed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3286:x1869752384450304:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1783135075.463403:0:14863:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 49348608 pending 0 free 3859808256 avail 3856662528 00000100:00100000:0.0:1783135075.463482:0:14863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fe8fed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3286:x1869752384450304:12345-0@lo:13:osp-pre-0-0.0 Request processed in 118us (2805us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135075.463488:0:14863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00080000:0.0:1783135075.463517:0:14218:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1783135075.463559:0:3286:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9fe8ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1869752384450304:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1783135075.642050:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:1.0:1783135075.642103:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:0.0:1783135075.642118:0:14217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752374012928 00000100:00100000:1.0:1783135075.642132:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:0.0:1783135075.642133:0:14217:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752374012928 00000100:00100000:1.0:1783135075.642162:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:1.0:1783135075.642192:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:0.0:1783135075.642208:0:14217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 117 00000100:00100000:0.0:1783135075.642223:0:14217:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9ca9b8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58985142-d56f-4f22-9f82-f587934b3bed+13:2368:x1869752374012928:12345-192.168.201.41@tcp:400:kworker.0 00000100:00100000:1.0:1783135075.642232:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:1.0:1783135075.642258:0:14858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752374013184 00000100:00100000:1.0:1783135075.642263:0:14858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752374013184 00000100:00100000:1.0:1783135075.642313:0:14858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752374013440 00000100:00100000:1.0:1783135075.642316:0:14858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752374013440 00000100:00100000:1.0:1783135075.642348:0:14858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752374013056 00000100:00100000:0.0:1783135075.642351:0:14217:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9ca9b8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58985142-d56f-4f22-9f82-f587934b3bed+13:2368:x1869752374012928:12345-192.168.201.41@tcp:400:kworker.0 Request processed in 130us (325us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135075.642353:0:14858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752374013056 00000100:00100000:1.0:1783135075.642368:0:14858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752374013568 00000100:00100000:1.0:1783135075.642372:0:14858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752374013568 00000100:00100000:0.0:1783135075.642383:0:14217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 117 00000100:00100000:1.0:1783135075.642397:0:14858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 14 00000100:00100000:1.0:1783135075.642408:0:14858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe8c6dfce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2b138366-7a70-4ff2-909d-348210e4a0a2+5:2368:x1869752374013184:12345-192.168.201.41@tcp:400:kworker.0 00000100:00100000:1.0:1783135075.642449:0:14858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe8c6dfce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2b138366-7a70-4ff2-909d-348210e4a0a2+5:2368:x1869752374013184:12345-192.168.201.41@tcp:400:kworker.0 Request processed in 44us (346us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135075.642456:0:14858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 14 00000100:00100000:1.0:1783135075.642473:0:14858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 15 00000100:00100000:1.0:1783135075.642479:0:14858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe8c6dff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:aa2f4fd1-78f9-41b4-ba50-d28d753ff635+5:2368:x1869752374013440:12345-192.168.201.41@tcp:400:kworker.0 00000100:00100000:1.0:1783135075.642507:0:14858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe8c6dff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:aa2f4fd1-78f9-41b4-ba50-d28d753ff635+5:2368:x1869752374013440:12345-192.168.201.41@tcp:400:kworker.0 Request processed in 27us (375us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135075.642524:0:14858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 15 00000100:00100000:1.0:1783135075.642538:0:14858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 16 00000100:00100000:1.0:1783135075.642544:0:14858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe8c6dff100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2b138366-7a70-4ff2-909d-348210e4a0a2+6:2368:x1869752374013056:12345-192.168.201.41@tcp:400:kworker.0 00000100:00100000:1.0:1783135075.642571:0:14858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe8c6dff100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2b138366-7a70-4ff2-909d-348210e4a0a2+6:2368:x1869752374013056:12345-192.168.201.41@tcp:400:kworker.0 Request processed in 27us (409us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135075.642577:0:14858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 16 00000100:00100000:1.0:1783135075.642588:0:14858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 17 00000100:00100000:1.0:1783135075.642594:0:14858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe8c6dfc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:aa2f4fd1-78f9-41b4-ba50-d28d753ff635+5:2368:x1869752374013568:12345-192.168.201.41@tcp:400:kworker.0 00000100:00100000:1.0:1783135075.642619:0:14858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe8c6dfc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:aa2f4fd1-78f9-41b4-ba50-d28d753ff635+5:2368:x1869752374013568:12345-192.168.201.41@tcp:400:kworker.0 Request processed in 25us (389us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135075.642626:0:14858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 17 00000100:00100000:1.0:1783135075.642652:0:16395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752374013312 00000100:00100000:1.0:1783135075.642656:0:16395:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752374013312 00000100:00100000:1.0:1783135075.642701:0:16395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 21 00000100:00100000:1.0:1783135075.642709:0:16395:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe8c6dfdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aa2f4fd1-78f9-41b4-ba50-d28d753ff635+6:2368:x1869752374013312:12345-192.168.201.41@tcp:400:kworker.0 00000100:00100000:1.0:1783135075.642757:0:16395:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe8c6dfdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aa2f4fd1-78f9-41b4-ba50-d28d753ff635+6:2368:x1869752374013312:12345-192.168.201.41@tcp:400:kworker.0 Request processed in 49us (565us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135075.642764:0:16395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 21 00000100:00080000:1.0:1783135075.642968:0:14218:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1783135075.642974:0:14218:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1783135075.642976:0:14218:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1783135075.679869:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:1.0:1783135075.679950:0:14224:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752374013824 00000100:00100000:1.0:1783135075.679965:0:14224:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752374013824 00000100:00100000:1.0:1783135075.680092:0:14224:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 111 00000100:00100000:1.0:1783135075.680106:0:14224:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fe8ff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2b138366-7a70-4ff2-909d-348210e4a0a2+24:14650:x1869752374013824:12345-192.168.201.41@tcp:101:lfs.0 00010000:00010000:1.0:1783135075.680159:0:14224:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783135075.680731:0:14224:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe8c5550a00/0xd6c4b8f058680007 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4428da03f5eb77cf expref: -99 pid: 14224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135075.681388:0:14224:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ace00/0xd6c4b8f05868000e lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135075.681409:0:14224:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ace00/0xd6c4b8f05868000e lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14224 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135075.681427:0:14224:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ace00/0xd6c4b8f05868000e lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14224 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783135075.681443:0:14224:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x4:0x0]: returning size 0 00010000:00010000:0.0:1783135075.681621:0:14224:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe8c5550a00/0xd6c4b8f058680007 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb77cf expref: 27 pid: 14224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135075.681642:0:14224:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ace00/0xd6c4b8f05868000e lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb77cf expref: 26 pid: 14224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135075.681653:0:14224:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x4:0x0].0x0 (ffff9fe9c33d0000) 00010000:00010000:0.0:1783135075.681656:0:14224:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1783135075.681660:0:14224:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fe9f68ace00, rc 0) 00000100:00100000:0.0:1783135075.681804:0:14224:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fe8ff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2b138366-7a70-4ff2-909d-348210e4a0a2+26:14650:x1869752374013824:12345-192.168.201.41@tcp:101:lfs.0 Request processed in 1701us (1950us total) trans 8589934674 rc 0/0 00000100:00100000:0.0:1783135075.681814:0:14224:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 111 00000100:00100000:1.0:1783135075.687021:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:0.0:1783135075.687164:0:14222:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752374013952 00000100:00100000:0.0:1783135075.687252:0:14222:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752374013952 00000100:00100000:0.0:1783135075.687466:0:14222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 112 00000100:00100000:0.0:1783135075.687479:0:14222:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fea00bcc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2b138366-7a70-4ff2-909d-348210e4a0a2+26:14650:x1869752374013952:12345-192.168.201.41@tcp:54:lfs.0 00010000:00010000:0.0:1783135075.687641:0:14222:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ade00/0xd6c4b8f05868001c lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135075.687664:0:14222:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ade00/0xd6c4b8f05868001c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135075.687678:0:14222:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ade00/0xd6c4b8f05868001c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135075.687715:0:14222:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ade00/0xd6c4b8f05868001c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135075.687722:0:14222:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ade00/0xd6c4b8f05868001c lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135075.687730:0:14222:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ade00/0xd6c4b8f05868001c lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135075.687737:0:14222:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe9f68ade00 already unused, calling callback (ffffffffc1f634f0) 00010000:00010000:0.0:1783135075.687742:0:14222:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ade00/0xd6c4b8f05868001c lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135075.687751:0:14222:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ade00/0xd6c4b8f05868001c lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135075.687765:0:14222:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x4:0x0].0x0 (ffff9fe9c33d0000) 00010000:00010000:0.0:1783135075.687769:0:14222:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1783135075.687775:0:14222:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ade00/0xd6c4b8f05868001c lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14222 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135075.687872:0:14222:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ade00/0xd6c4b8f05868001c lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14222 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783135075.688059:0:14222:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fea00bcc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2b138366-7a70-4ff2-909d-348210e4a0a2+26:14650:x1869752374013952:12345-192.168.201.41@tcp:54:lfs.0 Request processed in 581us (1050us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135075.688069:0:14222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 112 00000100:00100000:0.0:1783135075.788085:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:1.0:1783135075.788218:0:14858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752374014080 00000100:00100000:1.0:1783135075.788232:0:14858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752374014080 00000100:00100000:1.0:1783135075.788352:0:14858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 29 00000100:00100000:1.0:1783135075.788364:0:14858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fe8fe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2b138366-7a70-4ff2-909d-348210e4a0a2+6:2370:x1869752374014080:12345-192.168.201.41@tcp:101:cat.0 00010000:00010000:1.0:1783135075.788389:0:14858:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783135075.788417:0:14858:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008683403b/0xd6c4b8f058680023 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4428da03f5eb77d6 expref: -99 pid: 14858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1783135075.788452:0:14858:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x22:0x0] initial LVB size: 13, mtime: 0x6a487b60, atime: 0x6a487b5f, ctime: 0x6a487b60, blocks: 0xb 00010000:00010000:1.0:1783135075.788478:0:14858:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=358s v=(0 0) 00010000:00010000:1.0:1783135075.788483:0:14858:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783135075.788495:0:14858:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008683403b/0xd6c4b8f058680023 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb77d6 expref: 7 pid: 14858 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135075.788517:0:14858:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000008683403b/0xd6c4b8f058680023 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb77d6 expref: 7 pid: 14858 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135075.788533:0:14858:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fe8c5551a00, rc 0) 00000100:00100000:1.0:1783135075.788617:0:14858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fe8fe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2b138366-7a70-4ff2-909d-348210e4a0a2+7:2370:x1869752374014080:12345-192.168.201.41@tcp:101:cat.0 Request processed in 255us (548us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135075.788625:0:14858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 29 00000100:00100000:3.0:1783135075.793169:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:1.0:1783135075.793401:0:14865:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752374014208 00000100:00100000:1.0:1783135075.793415:0:14865:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752374014208 00002000:00100000:1.0:1783135075.793477:0:14865:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x22:0x0] (0->4095) req@ffff9fe9fe7d2a00 x1869752374014208/t0(0) o3->2b138366-7a70-4ff2-909d-348210e4a0a2@192.168.201.41@tcp:246/0 lens 488/0 e 0 to 0 dl 1783135086 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:100 00002000:00100000:1.0:1783135075.793508:0:14865:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9fe9fe7d2a00 with x1869752374014208 ext(0->4095) 00002000:00010000:1.0:1783135075.793516:0:14865:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9fe9fe7d2a00 00000100:00100000:1.0:1783135075.793559:0:14865:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 3 00000100:00100000:1.0:1783135075.793570:0:14865:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fe7d2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:2b138366-7a70-4ff2-909d-348210e4a0a2+7:2369:x1869752374014208:12345-192.168.201.41@tcp:3:cat.0 00000100:00100000:1.0:1783135075.793995:0:14865:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fe7d2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:2b138366-7a70-4ff2-909d-348210e4a0a2+7:2369:x1869752374014208:12345-192.168.201.41@tcp:3:cat.0 Request processed in 426us (840us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1783135075.794004:0:14865:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 3 00002000:00100000:1.0:1783135075.794011:0:14865:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x22:0x0] (0->4095) req@ffff9fe9fe7d2a00 x1869752374014208/t0(0) o3->2b138366-7a70-4ff2-909d-348210e4a0a2@192.168.201.41@tcp:246/0 lens 488/4536 e 0 to 0 dl 1783135086 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:100 00002000:00100000:1.0:1783135075.794020:0:14865:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9fe9fe7d2a00 with x1869752374014208 ext(0->4095) 00002000:00010000:1.0:1783135075.794028:0:14865:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9fe9fe7d2a00 00010000:00010000:0.0:1783135075.843623:0:15220:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783135076.869640:0:14210:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783135077.891520:0:14211:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783135078.915567:0:15220:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783135079.043738:0:3288:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9fe8fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1869752384450432:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1783135079.043960:0:3286:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9f6fe5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1869752384450688:0@lo:400:kworker.0 00000100:00100000:0.0:1783135079.043998:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135079.044056:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1783135079.044062:0:3286:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9f6fe7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1869752384450816:0@lo:400:kworker.0 00000100:00100000:0.0:1783135079.044083:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135079.044129:0:14861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384450688 00000100:00100000:0.0:1783135079.044136:0:14861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384450688 00000100:00100000:1.0:1783135079.044196:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135079.044221:0:3288:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9f6fe4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3288:1869752384450944:0@lo:400:kworker.0 00000100:00100000:1.0:1783135079.044247:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135079.044264:0:3288:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1783135079.044269:0:3288:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9f6fe5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c1fe35bd-99cf-438e-8ada-ed586b673efa:3288:1869752384450560:0@lo:400:kworker.0 00000100:00100000:1.0:1783135079.044314:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135079.044341:0:14860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384450816 00000100:00100000:1.0:1783135079.044345:0:14860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384450816 00000100:00100000:1.0:1783135079.044392:0:14860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1783135079.044401:0:14860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fe8fea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3286:x1869752384450816:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783135079.044503:0:14860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fe8fea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3286:x1869752384450816:12345-0@lo:400:kworker.0 Request processed in 103us (419us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135079.044705:0:14216:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384450560 00000100:00100000:2.0:1783135079.044723:0:14216:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384450560 00000100:00100000:2.0:1783135079.044754:0:14216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:2.0:1783135079.044761:0:14216:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9ca9bb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1fe35bd-99cf-438e-8ada-ed586b673efa+19:3288:x1869752384450560:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783135079.044794:0:14216:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9ca9bb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1fe35bd-99cf-438e-8ada-ed586b673efa+19:3288:x1869752384450560:12345-0@lo:400:kworker.0 Request processed in 34us (478us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135079.044800:0:14216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:3.0:1783135079.044939:0:3289:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9f6fe7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3289:1869752384451072:0@lo:400:kworker.0 00000100:00100000:3.0:1783135079.045002:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135079.045050:0:14224:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384450944 00000100:00100000:3.0:1783135079.045054:0:14224:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384450944 00000100:00100000:3.0:1783135079.045080:0:14224:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384451072 00000100:00100000:3.0:1783135079.045083:0:14224:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384451072 00000100:00100000:3.0:1783135079.045104:0:14224:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1783135079.045111:0:14224:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fec14000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3288:x1869752384450944:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783135079.045158:0:14224:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fec14000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3288:x1869752384450944:12345-0@lo:400:kworker.0 Request processed in 47us (910us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135079.045164:0:14224:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1783135079.045175:0:14224:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1783135079.045180:0:14224:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fe7d3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3289:x1869752384451072:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783135079.045207:0:14224:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fe7d3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3289:x1869752384451072:12345-0@lo:400:kworker.0 Request processed in 27us (204us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135079.045224:0:14224:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1783135079.045264:0:3289:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9f6fe7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3289:1869752384451072:0@lo:400:kworker.0 00000100:00100000:3.0:1783135079.045315:0:14863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384450432 00000100:00100000:3.0:1783135079.045319:0:14863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384450432 00000100:00100000:3.0:1783135079.045340:0:14863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1783135079.045346:0:14863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fec14a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3288:x1869752384450432:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1783135079.045374:0:14863:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 49348608 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1783135079.045406:0:14863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fec14a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3288:x1869752384450432:12345-0@lo:13:osp-pre-1-0.0 Request processed in 59us (1209us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135079.045412:0:14863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1783135079.045431:0:3286:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9f6fe4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3286:1869752384451200:0@lo:400:kworker.0 00000100:00100000:3.0:1783135079.045454:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135079.045475:0:3286:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934601 gen 2 00000004:00080000:3.0:1783135079.045480:0:3286:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589934599 committed transno 8589934601 00000004:00080000:3.0:1783135079.045493:0:3286:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9fe9fe438000, transno 8589934601 00000100:00100000:3.0:1783135079.045503:0:3286:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9f6fe7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1869752384450816:0@lo:400:kworker.0 00000100:00100000:3.0:1783135079.045519:0:14224:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384451200 00000100:00100000:3.0:1783135079.045522:0:14224:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384451200 00000100:00100000:3.0:1783135079.045544:0:14224:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1783135079.045549:0:14224:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fe7d1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3286:x1869752384451200:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783135079.045578:0:14224:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fe7d1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3286:x1869752384451200:12345-0@lo:400:kworker.0 Request processed in 29us (123us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135079.045584:0:14224:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1783135079.045607:0:3286:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9f6fe4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3286:1869752384451200:0@lo:400:kworker.0 00000100:00080000:3.0:1783135079.045643:0:14218:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1783135079.045652:0:14218:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1783135079.045894:0:14861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1783135079.045901:0:14861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fe8fc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3286:x1869752384450688:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783135079.045937:0:14861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fe8fc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3286:x1869752384450688:12345-0@lo:400:kworker.0 Request processed in 37us (1939us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135079.045943:0:14861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00080000:0.0:1783135079.045962:0:14218:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1783135079.045979:0:3286:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9f6fe5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1869752384450688:0@lo:400:kworker.0 00000100:00100000:0.0:1783135079.046010:0:3288:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9f6fe5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c1fe35bd-99cf-438e-8ada-ed586b673efa:3288:1869752384450560:0@lo:400:kworker.0 00000100:00100000:0.0:1783135079.046019:0:3288:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9f6fe4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3288:1869752384450944:0@lo:400:kworker.0 00000100:00100000:0.0:1783135079.046042:0:3288:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9fe8fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1869752384450432:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1783135079.046187:0:14860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000001:00080000:3.0:1783135079.706876:0:6602:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934598 is committed 00000001:00080000:3.0:1783135079.706898:0:6602:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934597 is committed 00000001:00080000:2.0:1783135079.790879:0:5791:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934674 is committed 00000020:00080000:2.0:1783135079.790914:0:5791:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9fe9cb3e9b40 refcount 2 committed 0 result 0 batchid 4294967528 00000020:00080000:2.0:1783135079.790921:0:5791:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9fe9cb2bd900 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9fe9cb3e96c0 00000020:00080000:2.0:1783135079.790925:0:5791:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff9fe9cb2bdf00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9fe9f654d800 00000020:00080000:2.0:1783135079.790983:0:5791:0:(update_trans.c:1341:distribute_txn_batchid_cb()) lustre-MDT0000: 4294967527 batchid updated 00000020:00080000:1.0:1783135079.791032:0:14261:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4294967528 committed batchid 4294967527 00000020:00080000:1.0:1783135079.791434:0:14261:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294967527 00010000:00010000:0.0:1783135079.939545:0:14210:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783135080.593438:0:3287:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9f6fe6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1869752384451328:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1783135080.593528:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135080.593692:0:14863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384451328 00000100:00100000:2.0:1783135080.593701:0:14863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384451328 00000100:00100000:2.0:1783135080.593757:0:14863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1783135080.593767:0:14863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9f6fe4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3287:x1869752384451328:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1783135080.593823:0:14863:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 49348608 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1783135080.593872:0:14863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9f6fe4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3287:x1869752384451328:12345-0@lo:13:osp-pre-0-0.0 Request processed in 107us (345us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135080.593880:0:14863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1783135080.593921:0:3287:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934598 gen 2 00000004:00080000:2.0:1783135080.593934:0:3287:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589934598 committed transno 8589934598 00000100:00100000:2.0:1783135080.593956:0:3287:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9f6fe6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1869752384451328:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1783135080.744879:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:0.0:1783135080.745002:0:14215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752374014336 00000100:00100000:0.0:1783135080.745011:0:14215:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752374014336 00000100:00100000:0.0:1783135080.745097:0:14215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 119 00000100:00100000:0.0:1783135080.745108:0:14215:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9ca9bac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:58985142-d56f-4f22-9f82-f587934b3bed+13:2370:x1869752374014336:12345-192.168.201.41@tcp:400:kworker.0 00000100:00100000:0.0:1783135080.745175:0:14215:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9ca9bac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:58985142-d56f-4f22-9f82-f587934b3bed+13:2370:x1869752374014336:12345-192.168.201.41@tcp:400:kworker.0 Request processed in 69us (306us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135080.745183:0:14215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 119 00000100:00100000:3.0:1783135080.745920:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:3.0:1783135080.745965:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:3.0:1783135080.745997:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:1.0:1783135080.746085:0:14858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752374014592 00000100:00100000:1.0:1783135080.746091:0:14858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752374014592 00000100:00100000:1.0:1783135080.746142:0:14858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 20 00000100:00100000:1.0:1783135080.746151:0:14858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fea00bcd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2b138366-7a70-4ff2-909d-348210e4a0a2+6:2370:x1869752374014592:12345-192.168.201.41@tcp:400:kworker.0 00000100:00100000:1.0:1783135080.746194:0:14858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fea00bcd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2b138366-7a70-4ff2-909d-348210e4a0a2+6:2370:x1869752374014592:12345-192.168.201.41@tcp:400:kworker.0 Request processed in 44us (228us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135080.746201:0:14858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 20 00000100:00100000:3.0:1783135080.748203:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:1.0:1783135080.748499:0:15538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752374014720 00000100:00100000:1.0:1783135080.748508:0:15538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752374014720 00000100:00100000:1.0:1783135080.748558:0:15538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 21 00000100:00100000:1.0:1783135080.748568:0:15538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fea16300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2b138366-7a70-4ff2-909d-348210e4a0a2+5:2370:x1869752374014720:12345-192.168.201.41@tcp:400:kworker.0 00000100:00100000:1.0:1783135080.748637:0:15538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fea16300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2b138366-7a70-4ff2-909d-348210e4a0a2+5:2370:x1869752374014720:12345-192.168.201.41@tcp:400:kworker.0 Request processed in 70us (439us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135080.748644:0:15538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 21 00000100:00080000:1.0:1783135080.748678:0:14218:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1783135080.748682:0:14218:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1783135080.750242:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:3.0:1783135080.750369:0:14858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752374014976 00000100:00100000:3.0:1783135080.750377:0:14858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752374014976 00000100:00100000:3.0:1783135080.750431:0:14858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 30 00000100:00100000:3.0:1783135080.750442:0:14858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fec16680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:aa2f4fd1-78f9-41b4-ba50-d28d753ff635+5:2366:x1869752374014976:12345-192.168.201.41@tcp:9:kworker.0 00000020:00000080:3.0:1783135080.750468:0:14858:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xd6c4b8f05867f9d2 00000100:00080000:3.0:1783135080.750484:0:14858:0:(import.c:65:import_set_state_nolock()) ffff9fe8c5f1b000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1783135080.750517:0:14858:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934598 00000100:00100000:3.0:1783135080.750766:0:14858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fec16680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:aa2f4fd1-78f9-41b4-ba50-d28d753ff635+2:2366:x1869752374014976:12345-192.168.201.41@tcp:9:kworker.0 Request processed in 325us (529us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135080.750774:0:14858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 30 00010000:00010000:3.0:1783135080.750802:0:14211:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1783135080.751498:0:14218:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1783135080.751577:0:14224:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752374014464 00000100:00100000:2.0:1783135080.751584:0:14224:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752374014464 00000100:00100000:2.0:1783135080.751640:0:14224:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752374014848 00000100:00100000:2.0:1783135080.751644:0:14224:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752374014848 00000100:00100000:2.0:1783135080.751665:0:14224:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 25 00000100:00100000:2.0:1783135080.751670:0:14224:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fe7d0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2b138366-7a70-4ff2-909d-348210e4a0a2+13:2370:x1869752374014464:12345-192.168.201.41@tcp:400:kworker.0 00000100:00100000:2.0:1783135080.751715:0:14224:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fe7d0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2b138366-7a70-4ff2-909d-348210e4a0a2+13:2370:x1869752374014464:12345-192.168.201.41@tcp:400:kworker.0 Request processed in 44us (5796us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135080.751723:0:14224:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 25 00000100:00100000:2.0:1783135080.751737:0:14224:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 26 00000100:00100000:2.0:1783135080.751744:0:14224:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fea15180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aa2f4fd1-78f9-41b4-ba50-d28d753ff635+6:2370:x1869752374014848:12345-192.168.201.41@tcp:400:kworker.0 00000100:00100000:2.0:1783135080.751769:0:14224:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fea15180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aa2f4fd1-78f9-41b4-ba50-d28d753ff635+6:2370:x1869752374014848:12345-192.168.201.41@tcp:400:kworker.0 Request processed in 26us (5771us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135080.751775:0:14224:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 26 00000100:00080000:1.0:1783135080.751976:0:14218:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1783135080.752497:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:2.0:1783135080.758200:0:14861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752374015104 00000100:00100000:2.0:1783135080.758227:0:14861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752374015104 00000100:00100000:2.0:1783135080.758337:0:14861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 31 00000100:00100000:2.0:1783135080.758349:0:14861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fec14700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:aa2f4fd1-78f9-41b4-ba50-d28d753ff635+5:2366:x1869752374015104:12345-192.168.201.41@tcp:9:kworker.0 00000020:00000080:2.0:1783135080.758380:0:14861:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xd6c4b8f05867f9d9 00000100:00080000:2.0:1783135080.758395:0:14861:0:(import.c:65:import_set_state_nolock()) ffff9fe9f6723000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1783135080.758435:0:14861:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934601 00000100:00080000:1.0:1783135080.758869:0:14218:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1783135080.758885:0:15220:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783135080.761937:0:14861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fec14700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:aa2f4fd1-78f9-41b4-ba50-d28d753ff635+2:2366:x1869752374015104:12345-192.168.201.41@tcp:9:kworker.0 Request processed in 3577us (9428us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135080.761990:0:14861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 31 00010000:00010000:0.0:1783135080.964757:0:14210:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1783135081.607464:0:14257:0:(llog.c:800:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1783135081.607475:0:14257:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1783135081.607522:0:14257:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 4 count 4 00000040:00080000:2.0:1783135081.607528:0:14257:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:2.0:1783135081.991306:0:14211:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783135082.915393:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:3.0:1783135082.915503:0:14224:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752374015232 00000100:00100000:3.0:1783135082.915512:0:14224:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752374015232 00000100:00080000:1.0:1783135082.915621:0:14218:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1783135082.915695:0:14224:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 113 00000100:00100000:3.0:1783135082.915705:0:14224:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9f6fe6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2b138366-7a70-4ff2-909d-348210e4a0a2+13:14369:x1869752374015232:12345-192.168.201.41@tcp:60:lhsmtool_posix.0 00000100:00100000:3.0:1783135082.915891:0:14224:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9f6fe6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2b138366-7a70-4ff2-909d-348210e4a0a2+13:14369:x1869752374015232:12345-192.168.201.41@tcp:60:lhsmtool_posix.0 Request processed in 187us (506us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135082.915899:0:14224:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 113 00000100:00100000:3.0:1783135082.933938:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:1.0:1783135082.935396:0:16002:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752374015488 00000100:00100000:1.0:1783135082.935443:0:16002:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752374015488 00000100:00100000:1.0:1783135082.935531:0:16002:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 28 00000100:00100000:1.0:1783135082.935543:0:16002:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fdc34c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:2b138366-7a70-4ff2-909d-348210e4a0a2+13:14369:x1869752374015488:12345-192.168.201.41@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1783135082.938356:0:16002:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fdc34c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:2b138366-7a70-4ff2-909d-348210e4a0a2+14:14369:x1869752374015488:12345-192.168.201.41@tcp:35:lhsmtool_posix.0 Request processed in 2798us (4415us total) trans 8589934675 rc 0/0 00000100:00100000:1.0:1783135082.938374:0:16002:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 28 00010000:00010000:1.0:1783135083.011647:0:15220:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783135084.035596:0:14210:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783135084.163669:0:3289:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1783135084.163693:0:3289:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9fe8fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1869752384451456:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1783135084.163788:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135084.163926:0:14863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384451456 00000100:00100000:0.0:1783135084.163935:0:14863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384451456 00000100:00100000:0.0:1783135084.163998:0:14863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1783135084.164008:0:14863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9f6fe4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3289:x1869752384451456:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1783135084.164055:0:14863:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1783135084.164102:0:14863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9f6fe4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3289:x1869752384451456:12345-0@lo:13:osp-pre-1-0.0 Request processed in 96us (313us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135084.164110:0:14863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1783135084.164155:0:3289:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9fe8fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1869752384451456:0@lo:13:osp-pre-1-0.0 00000100:00080000:2.0:1783135084.164315:0:14218:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1783135084.164689:0:3286:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9fea17b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1869752384451712:0@lo:400:kworker.0 00000100:00100000:2.0:1783135084.164723:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135084.164760:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1783135084.164767:0:3286:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9fea14000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3286:1869752384451840:0@lo:400:kworker.0 00000100:00100000:2.0:1783135084.164792:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135084.165174:0:14858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384451712 00000100:00100000:3.0:1783135084.165194:0:14858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384451712 00000100:00100000:3.0:1783135084.165242:0:14858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1783135084.165251:0:14858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9f6fe6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3286:x1869752384451712:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783135084.165323:0:14858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9f6fe6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3286:x1869752384451712:12345-0@lo:400:kworker.0 Request processed in 73us (600us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135084.165330:0:14858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1783135084.165363:0:14223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384451840 00000100:00100000:3.0:1783135084.165367:0:14223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384451840 00000100:00100000:3.0:1783135084.165395:0:14223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1783135084.165401:0:14223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9f6fe4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3286:x1869752384451840:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783135084.165432:0:14223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9f6fe4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3286:x1869752384451840:12345-0@lo:400:kworker.0 Request processed in 31us (638us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135084.165439:0:14223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1783135084.165471:0:3286:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9fea14000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3286:1869752384451840:0@lo:400:kworker.0 00000100:00100000:3.0:1783135084.165482:0:3286:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9fea17b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1869752384451712:0@lo:400:kworker.0 00000100:00100000:1.0:1783135084.165619:0:3288:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9fe828700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3288:1869752384451968:0@lo:400:kworker.0 00000100:00100000:1.0:1783135084.165651:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135084.165683:0:3288:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1783135084.165689:0:3288:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9fea14700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c1fe35bd-99cf-438e-8ada-ed586b673efa:3288:1869752384451584:0@lo:400:kworker.0 00000100:00100000:1.0:1783135084.165714:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135084.165747:0:3288:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9fe829880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3288:1869752384452096:0@lo:400:kworker.0 00000100:00100000:1.0:1783135084.165766:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135084.165791:0:14224:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384451968 00000100:00100000:1.0:1783135084.165794:0:14224:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384451968 00000100:00100000:1.0:1783135084.165820:0:14224:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384452096 00000100:00100000:1.0:1783135084.165823:0:14224:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384452096 00000100:00100000:1.0:1783135084.165842:0:14224:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1783135084.165849:0:14224:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fec17b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3288:x1869752384451968:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783135084.165882:0:14224:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fec17b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3288:x1869752384451968:12345-0@lo:400:kworker.0 Request processed in 33us (230us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135084.165888:0:14224:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1783135084.165912:0:14224:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1783135084.165918:0:14224:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fec15180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3288:x1869752384452096:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783135084.165942:0:14224:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fec15180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3288:x1869752384452096:12345-0@lo:400:kworker.0 Request processed in 24us (174us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135084.165955:0:14224:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1783135084.165985:0:3288:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9fe829880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3288:1869752384452096:0@lo:400:kworker.0 00000100:00100000:1.0:1783135084.165994:0:3288:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9fe828700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3288:1869752384451968:0@lo:400:kworker.0 00000100:00100000:2.0:1783135084.166334:0:14216:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384451584 00000100:00100000:2.0:1783135084.166339:0:14216:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384451584 00000100:00100000:2.0:1783135084.166389:0:14216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:2.0:1783135084.166396:0:14216:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9ca9b9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1fe35bd-99cf-438e-8ada-ed586b673efa+19:3288:x1869752384451584:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783135084.166436:0:14216:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9ca9b9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c1fe35bd-99cf-438e-8ada-ed586b673efa+19:3288:x1869752384451584:12345-0@lo:400:kworker.0 Request processed in 40us (720us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135084.166442:0:14216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00080000:2.0:1783135084.166467:0:14218:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1783135084.166472:0:14218:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1783135084.166488:0:3288:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9fea14700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c1fe35bd-99cf-438e-8ada-ed586b673efa:3288:1869752384451584:0@lo:400:kworker.0 00000001:00080000:2.0:1783135084.754710:0:5791:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934675 is committed 00000020:00080000:2.0:1783135084.754808:0:5791:0:(update_trans.c:1341:distribute_txn_batchid_cb()) lustre-MDT0000: 4294967528 batchid updated 00000020:00080000:0.0:1783135084.756310:0:14261:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294967528 00000020:00080000:0.0:1783135084.756325:0:14261:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294967528 00000001:00100000:1.0:1783135084.759545:0:6602:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of aa2f4fd1-78f9-41b4-ba50-d28d753ff635 00000020:00000080:1.0:1783135084.759554:0:6602:0:(genops.c:906:class_export_put()) final put ffff9fe8c5f18800/aa2f4fd1-78f9-41b4-ba50-d28d753ff635 00000020:00000080:3.0:1783135084.759760:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9fe8c5f18800/aa2f4fd1-78f9-41b4-ba50-d28d753ff635 for lustre-OST0000 00000020:00000080:3.0:1783135084.759823:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9fe8c5f1b000 for lustre-OST0000 00000001:00100000:2.0:1783135084.760268:0:7470:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of aa2f4fd1-78f9-41b4-ba50-d28d753ff635 00000020:00000080:2.0:1783135084.760273:0:7470:0:(genops.c:906:class_export_put()) final put ffff9fe9f6a11000/aa2f4fd1-78f9-41b4-ba50-d28d753ff635 00000020:00000080:3.0:1783135084.760661:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9fe9f6a11000/aa2f4fd1-78f9-41b4-ba50-d28d753ff635 for lustre-OST0001 00000020:00000080:3.0:1783135084.760690:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9fe9f6723000 for lustre-OST0001 00010000:00010000:2.0:1783135085.059437:0:14211:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783135085.699526:0:3286:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9f6fe6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1869752384452224:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1783135085.699595:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135085.700338:0:14863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384452224 00000100:00100000:0.0:1783135085.700347:0:14863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384452224 00000100:00100000:0.0:1783135085.700398:0:14863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1783135085.700407:0:14863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fe82b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1869752384452224:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1783135085.700457:0:14863:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1783135085.700514:0:14863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fe82b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1869752384452224:12345-0@lo:13:osp-pre-0-0.0 Request processed in 106us (917us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135085.700524:0:14863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1783135085.700566:0:3286:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9f6fe6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1869752384452224:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1783135085.863886:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:0.0:1783135085.863962:0:14215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752374015616 00000100:00100000:0.0:1783135085.863975:0:14215:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752374015616 00000100:00100000:0.0:1783135085.864049:0:14215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 121 00000100:00100000:0.0:1783135085.864060:0:14215:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9ca9bbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:58985142-d56f-4f22-9f82-f587934b3bed+13:2369:x1869752374015616:12345-192.168.201.41@tcp:400:kworker.0 00000100:00100000:0.0:1783135085.864147:0:14215:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9ca9bbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:58985142-d56f-4f22-9f82-f587934b3bed+13:2369:x1869752374015616:12345-192.168.201.41@tcp:400:kworker.0 Request processed in 89us (276us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135085.864155:0:14215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 121 00000100:00100000:3.0:1783135085.872053:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:3.0:1783135085.872104:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:3.0:1783135085.872151:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:3.0:1783135085.872196:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:3.0:1783135085.872235:0:14860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752374016000 00000100:00100000:3.0:1783135085.872247:0:14860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752374016000 00000100:00100000:3.0:1783135085.872344:0:14860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752374015872 00000100:00100000:3.0:1783135085.872348:0:14860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752374015872 00000100:00100000:3.0:1783135085.872376:0:14860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 23 00000100:00100000:3.0:1783135085.872389:0:14860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fe828700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2b138366-7a70-4ff2-909d-348210e4a0a2+5:2370:x1869752374016000:12345-192.168.201.41@tcp:400:kworker.0 00000100:00100000:3.0:1783135085.872497:0:14860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fe828700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2b138366-7a70-4ff2-909d-348210e4a0a2+5:2370:x1869752374016000:12345-192.168.201.41@tcp:400:kworker.0 Request processed in 109us (390us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135085.872507:0:14860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 23 00000100:00100000:3.0:1783135085.872529:0:14860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 24 00000100:00100000:3.0:1783135085.872536:0:14860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fe829880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2b138366-7a70-4ff2-909d-348210e4a0a2+6:2370:x1869752374015872:12345-192.168.201.41@tcp:400:kworker.0 00000100:00100000:3.0:1783135085.872564:0:14860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fe829880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2b138366-7a70-4ff2-909d-348210e4a0a2+6:2370:x1869752374015872:12345-192.168.201.41@tcp:400:kworker.0 Request processed in 29us (413us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135085.872572:0:14860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 24 00000100:00100000:3.0:1783135085.872591:0:14222:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752374015744 00000100:00100000:3.0:1783135085.872595:0:14222:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752374015744 00000100:00100000:3.0:1783135085.872627:0:14222:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752374016128 00000100:00100000:3.0:1783135085.872631:0:14222:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752374016128 00000100:00100000:3.0:1783135085.872652:0:14222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 30 00000100:00100000:3.0:1783135085.872658:0:14222:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fe82b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2b138366-7a70-4ff2-909d-348210e4a0a2+13:2369:x1869752374015744:12345-192.168.201.41@tcp:400:kworker.0 00000100:00100000:3.0:1783135085.872693:0:14222:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fe82b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2b138366-7a70-4ff2-909d-348210e4a0a2+13:2369:x1869752374015744:12345-192.168.201.41@tcp:400:kworker.0 Request processed in 34us (664us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135085.872700:0:14222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 30 00000100:00100000:1.0:1783135085.872823:0:14224:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 31 00000100:00100000:1.0:1783135085.872845:0:14224:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fea14700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aa2f4fd1-78f9-41b4-ba50-d28d753ff635+6:2370:x1869752374016128:12345-192.168.201.41@tcp:400:kworker.0 00000100:00080000:3.0:1783135085.872866:0:14218:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1783135085.872880:0:14218:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1783135085.872883:0:14218:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1783135085.872947:0:14224:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fea14700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aa2f4fd1-78f9-41b4-ba50-d28d753ff635+6:2370:x1869752374016128:12345-192.168.201.41@tcp:400:kworker.0 Request processed in 107us (744us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135085.872958:0:14224:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 31 00010000:00010000:1.0:1783135086.088775:0:15220:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1783135086.639817:0:16705:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1d: Test Project ID with remote access ========================================================== 23:18:04 (1783135084) 00010000:00010000:0.0:1783135087.107941:0:14210:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783135088.134765:0:14211:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783135089.157089:0:15220:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783135089.283881:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1783135089.283915:0:3286:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9fe8fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1869752384452352:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1783135089.284014:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135089.284130:0:14862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384452352 00000100:00100000:1.0:1783135089.284204:0:14862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384452352 00000100:00100000:1.0:1783135089.284334:0:14862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1783135089.284349:0:14862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fea17b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1869752384452352:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1783135089.284401:0:14862:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00080000:3.0:1783135089.284564:0:14218:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1783135089.284611:0:14862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fea17b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1869752384452352:12345-0@lo:13:osp-pre-1-0.0 Request processed in 266us (595us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135089.284620:0:14862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1783135089.284707:0:3286:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9fe8fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1869752384452352:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1783135089.286529:0:3288:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9fe8fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c1fe35bd-99cf-438e-8ada-ed586b673efa:3288:1869752384452480:0@lo:400:kworker.0 00000100:00100000:2.0:1783135089.286612:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135089.286687:0:3288:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9fe8ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3288:1869752384452992:0@lo:400:kworker.0 00000100:00100000:2.0:1783135089.286722:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135089.286753:0:3288:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1783135089.286758:0:3288:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9fe8fd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1869752384452608:0@lo:400:kworker.0 00000100:00100000:2.0:1783135089.286784:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135089.286820:0:14222:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384452992 00000100:00100000:2.0:1783135089.286828:0:14222:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384452992 00000100:00100000:2.0:1783135089.286890:0:14222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1783135089.286899:0:14222:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9f6fe7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3288:x1869752384452992:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783135089.286959:0:14222:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9f6fe7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3288:x1869752384452992:12345-0@lo:400:kworker.0 Request processed in 61us (237us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135089.286967:0:14222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1783135089.286991:0:14860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384452608 00000100:00100000:2.0:1783135089.286994:0:14860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384452608 00000100:00100000:2.0:1783135089.287024:0:14860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1783135089.287031:0:14860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9f6fe5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3288:x1869752384452608:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783135089.287064:0:14860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9f6fe5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3288:x1869752384452608:12345-0@lo:400:kworker.0 Request processed in 34us (278us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135089.287093:0:14860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00080000:2.0:1783135089.287119:0:14218:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1783135089.287124:0:14218:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1783135089.287154:0:3288:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9fe8fd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1869752384452608:0@lo:400:kworker.0 00000100:00100000:2.0:1783135089.287166:0:3288:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9fe8ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3288:1869752384452992:0@lo:400:kworker.0 00000100:00100000:3.0:1783135089.287275:0:3286:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9fe8fe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3286:1869752384452736:0@lo:400:kworker.0 00000100:00100000:3.0:1783135089.287344:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135089.287375:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1783135089.287381:0:3286:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9fe8fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3286:1869752384452864:0@lo:400:kworker.0 00000100:00100000:3.0:1783135089.287406:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135089.287482:0:14217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384452480 00000100:00100000:0.0:1783135089.287487:0:14217:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384452480 00000100:00100000:0.0:1783135089.287529:0:14217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:0.0:1783135089.287537:0:14217:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9f5ceb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1fe35bd-99cf-438e-8ada-ed586b673efa+19:3288:x1869752384452480:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783135089.287577:0:14217:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9f5ceb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c1fe35bd-99cf-438e-8ada-ed586b673efa+19:3288:x1869752384452480:12345-0@lo:400:kworker.0 Request processed in 42us (966us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135089.287584:0:14217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:1.0:1783135089.287693:0:14224:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384452736 00000100:00100000:1.0:1783135089.287698:0:14224:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384452736 00000100:00100000:1.0:1783135089.287730:0:14224:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384452864 00000100:00100000:1.0:1783135089.287733:0:14224:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384452864 00000100:00100000:1.0:1783135089.287757:0:14224:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1783135089.287773:0:14224:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fea14000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3286:x1869752384452736:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783135089.287816:0:14224:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fea14000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3286:x1869752384452736:12345-0@lo:400:kworker.0 Request processed in 44us (471us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135089.287823:0:14224:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1783135089.287839:0:14224:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1783135089.287845:0:14224:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9f6cb3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3286:x1869752384452864:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783135089.287870:0:14224:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9f6cb3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3286:x1869752384452864:12345-0@lo:400:kworker.0 Request processed in 26us (464us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135089.287876:0:14224:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00080000:1.0:1783135089.287892:0:14218:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1783135089.287913:0:3286:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9fe8fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3286:1869752384452864:0@lo:400:kworker.0 00000100:00100000:1.0:1783135089.287924:0:3286:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9fe8fe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3286:1869752384452736:0@lo:400:kworker.0 00000100:00100000:2.0:1783135089.290835:0:3288:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9fe8fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c1fe35bd-99cf-438e-8ada-ed586b673efa:3288:1869752384452480:0@lo:400:kworker.0 00010000:00010000:0.0:1783135090.179672:0:14210:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783135090.820218:0:3289:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9f6fe6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1869752384453120:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1783135090.820486:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135090.820574:0:14863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384453120 00000100:00100000:2.0:1783135090.820585:0:14863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384453120 00000100:00100000:2.0:1783135090.820919:0:14863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1783135090.820931:0:14863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fec16a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3289:x1869752384453120:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1783135090.821413:0:14863:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1783135090.821865:0:14863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fec16a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3289:x1869752384453120:12345-0@lo:13:osp-pre-0-0.0 Request processed in 933us (1376us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135090.821877:0:14863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1783135090.823013:0:3289:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9f6fe6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1869752384453120:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1783135090.942862:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:0.0:1783135090.943095:0:14225:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752374016384 00000100:00100000:0.0:1783135090.943116:0:14225:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752374016384 00000100:00100000:0.0:1783135090.943203:0:14225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 29 00000100:00100000:0.0:1783135090.943217:0:14225:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9f6cb1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2b138366-7a70-4ff2-909d-348210e4a0a2+13:15324:x1869752374016384:12345-192.168.201.41@tcp:35:umount.0 00000100:00080000:1.0:1783135090.945039:0:14218:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783135090.946405:0:14225:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9f6cb1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2b138366-7a70-4ff2-909d-348210e4a0a2+14:15324:x1869752374016384:12345-192.168.201.41@tcp:35:umount.0 Request processed in 3178us (3546us total) trans 8589934676 rc 0/0 00000100:00100000:0.0:1783135090.946422:0:14225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 29 00000100:00100000:1.0:1783135090.951200:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:2.0:1783135090.951414:0:14226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752374016640 00000100:00100000:2.0:1783135090.951427:0:14226:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752374016640 00000100:00100000:2.0:1783135090.951511:0:14226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 30 00000100:00100000:2.0:1783135090.951522:0:14226:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fec15500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2b138366-7a70-4ff2-909d-348210e4a0a2+14:15324:x1869752374016640:12345-192.168.201.41@tcp:35:umount.0 00000100:00100000:2.0:1783135090.952505:0:14226:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fec15500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2b138366-7a70-4ff2-909d-348210e4a0a2+15:15324:x1869752374016640:12345-192.168.201.41@tcp:35:umount.0 Request processed in 980us (1316us total) trans 8589934677 rc 0/0 00000100:00100000:2.0:1783135090.952516:0:14226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 30 00000100:00100000:1.0:1783135090.983593:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:1.0:1783135090.983647:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:1.0:1783135090.983672:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:1.0:1783135090.983696:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:1.0:1783135090.983722:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:3.0:1783135090.983748:0:14209:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752374016768 00000100:00100000:3.0:1783135090.983764:0:14209:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752374016768 00000100:00100000:1.0:1783135090.983795:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:1.0:1783135090.983840:0:14224:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752374017408 00000100:00100000:1.0:1783135090.983849:0:14224:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752374017408 00000100:00100000:3.0:1783135090.983850:0:14209:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752374016896 00000100:00100000:3.0:1783135090.983858:0:14209:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752374016896 00000100:00100000:3.0:1783135090.983881:0:14209:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752374017024 00000100:00100000:3.0:1783135090.983885:0:14209:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752374017024 00000100:00100000:1.0:1783135090.983933:0:14224:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 35 00000100:00100000:1.0:1783135090.983945:0:14224:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fec17100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aa2f4fd1-78f9-41b4-ba50-d28d753ff635+6:2367:x1869752374017408:12345-192.168.201.41@tcp:400:kworker.0 00000100:00100000:3.0:1783135090.984050:0:14209:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 7 00000100:00100000:3.0:1783135090.984064:0:14209:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fec15c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:58985142-d56f-4f22-9f82-f587934b3bed+15:2370:x1869752374016768:12345-192.168.201.41@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783135090.984081:0:14209:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783135090.984102:0:14209:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fe8c5551400/0xd6c4b8f05867f8ba lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb756e expref: 15 pid: 14217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135090.984134:0:14209:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783135090.984347:0:14209:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fec15c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:58985142-d56f-4f22-9f82-f587934b3bed+14:2370:x1869752374016768:12345-192.168.201.41@tcp:103:ldlm_bl.0 Request processed in 286us (768us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135090.984356:0:14209:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 7 00000100:00100000:3.0:1783135090.984398:0:14209:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 8 00000100:00100000:3.0:1783135090.984406:0:14209:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fec15880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:58985142-d56f-4f22-9f82-f587934b3bed+13:2370:x1869752374016896:12345-192.168.201.41@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783135090.984415:0:14209:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783135090.984427:0:14209:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fe9c7828a00/0xd6c4b8f05867f8c1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb7598 expref: 13 pid: 14216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135090.984439:0:14209:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783135090.984461:0:14209:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fec15880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:58985142-d56f-4f22-9f82-f587934b3bed+12:2370:x1869752374016896:12345-192.168.201.41@tcp:103:ldlm_bl.0 Request processed in 57us (814us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135090.984468:0:14209:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 8 00000100:00100000:3.0:1783135090.984480:0:14209:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 9 00000100:00100000:3.0:1783135090.984486:0:14209:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fec16300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:58985142-d56f-4f22-9f82-f587934b3bed+11:2369:x1869752374017024:12345-192.168.201.41@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783135090.984493:0:14209:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783135090.984505:0:14209:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fe9f68ad200/0xd6c4b8f05867f9fc lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb7639 expref: 11 pid: 14215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135090.984516:0:14209:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783135090.984534:0:14209:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fec16300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:58985142-d56f-4f22-9f82-f587934b3bed+10:2369:x1869752374017024:12345-192.168.201.41@tcp:103:ldlm_bl.0 Request processed in 48us (861us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135090.984541:0:14209:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 9 00000100:00100000:3.0:1783135090.984574:0:15538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752374017152 00000100:00100000:3.0:1783135090.984579:0:15538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752374017152 00000100:00100000:3.0:1783135090.984614:0:15538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752374017280 00000100:00100000:3.0:1783135090.984697:0:15538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752374017280 00000100:00100000:3.0:1783135090.984726:0:15538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 26 00000100:00100000:3.0:1783135090.984733:0:15538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fec17480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2b138366-7a70-4ff2-909d-348210e4a0a2+6:2368:x1869752374017280:12345-192.168.201.41@tcp:400:kworker.0 00000100:00100000:3.0:1783135090.984772:0:15538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fec17480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2b138366-7a70-4ff2-909d-348210e4a0a2+6:2368:x1869752374017280:12345-192.168.201.41@tcp:400:kworker.0 Request processed in 38us (1048us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135090.984785:0:15538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 26 00000100:00100000:3.0:1783135090.984799:0:15538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 32 00000100:00100000:3.0:1783135090.984805:0:15538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fec15f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2b138366-7a70-4ff2-909d-348210e4a0a2+5:2366:x1869752374017152:12345-192.168.201.41@tcp:9:umount.0 00000020:00000080:3.0:1783135090.984834:0:15538:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xd6c4b8f05867f8dd 00000100:00080000:3.0:1783135090.984844:0:15538:0:(import.c:65:import_set_state_nolock()) ffff9fe8c5f1d800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1783135090.984881:0:15538:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934601 00000100:00100000:1.0:1783135090.984944:0:14224:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fec17100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aa2f4fd1-78f9-41b4-ba50-d28d753ff635+6:2367:x1869752374017408:12345-192.168.201.41@tcp:400:kworker.0 Request processed in 997us (1145us total) trans 0 rc 0/0 00010000:00010000:2.0:1783135090.985229:0:14211:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783135090.985385:0:14224:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 35 00000100:00080000:1.0:1783135090.985434:0:14218:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1783135090.985440:0:14218:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1783135090.985445:0:14218:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1783135090.985486:0:15538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fec15f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2b138366-7a70-4ff2-909d-348210e4a0a2+2:2366:x1869752374017152:12345-192.168.201.41@tcp:9:umount.0 Request processed in 674us (1783us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135090.985495:0:15538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 32 00000100:00100000:1.0:1783135090.992514:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:2.0:1783135090.992660:0:14861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752374017664 00000100:00100000:2.0:1783135090.992677:0:14861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752374017664 00000100:00100000:2.0:1783135090.992784:0:14861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 33 00000100:00100000:2.0:1783135090.992813:0:14861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fec14e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2b138366-7a70-4ff2-909d-348210e4a0a2+6:2366:x1869752374017664:12345-192.168.201.41@tcp:9:umount.0 00000020:00000080:2.0:1783135090.992874:0:14861:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xd6c4b8f05867f8d6 00000020:00010000:2.0:1783135090.992889:0:14861:0:(genops.c:1942:obd_stale_export_put()) Put export ffff9fe9c8f8d000: total 0 00000100:00080000:2.0:1783135090.992894:0:14861:0:(import.c:65:import_set_state_nolock()) ffff9fe9c8f8c800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1783135090.993024:0:14861:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934598 00000100:00100000:2.0:1783135090.994801:0:14861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fec14e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2b138366-7a70-4ff2-909d-348210e4a0a2+4:2366:x1869752374017664:12345-192.168.201.41@tcp:9:umount.0 Request processed in 1629us (1936us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135090.994820:0:14861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 33 00000020:00010000:1.0:1783135091.001330:0:15220:0:(genops.c:1928:obd_stale_export_get()) Get export ffff9fe9c8f8d000: total 0 00010000:00010000:3.0:1783135091.001777:0:15220:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff9fe9c8f8d000, canceled 0 locks, left on hash table 1. 00010000:00010000:3.0:1783135091.001853:0:15220:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008683403b/0xd6c4b8f058680023 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb77d6 expref: 3 pid: 14858 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135091.001880:0:15220:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff9fe9c8f8d000, canceled 1 locks, left on hash table 0. 00010000:00010000:3.0:1783135091.001893:0:15220:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783135091.001895:0:15220:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783135091.001897:0:15220:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783135091.008712:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:0.0:1783135091.008855:0:14222:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752374018432 00000100:00100000:0.0:1783135091.008870:0:14222:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752374018432 00000100:00100000:0.0:1783135091.008942:0:14222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 114 00000100:00100000:0.0:1783135091.008965:0:14222:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fec17800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2b138366-7a70-4ff2-909d-348210e4a0a2+15:2366:x1869752374018432:12345-192.168.201.41@tcp:39:umount.0 00000020:00000080:0.0:1783135091.009016:0:14222:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xd6c4b8f05867f8cf 00000020:00010000:0.0:1783135091.009037:0:14222:0:(genops.c:1942:obd_stale_export_put()) Put export ffff9fe8c5f1a000: total 0 00000100:00080000:0.0:1783135091.009042:0:14222:0:(import.c:65:import_set_state_nolock()) ffff9fe8c6041800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1783135091.009085:0:14222:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934677 00000020:00010000:1.0:1783135091.009714:0:14210:0:(genops.c:1928:obd_stale_export_get()) Get export ffff9fe8c5f1a000: total 0 00010000:00010000:1.0:1783135091.009720:0:14210:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783135091.009805:0:14210:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff9fe8c5f1a000, canceled 0 locks, left on hash table 8. 00010000:00010000:1.0:1783135091.009854:0:14210:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x4:0x0].0x0 (ffff9fe9c33d0000) 00010000:00010000:1.0:1783135091.009859:0:14210:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1783135091.009872:0:14210:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ace00/0xd6c4b8f05868000e lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb77cf expref: 14 pid: 14224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135091.009899:0:14210:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9fe9cc3c1f00) 00010000:00010000:1.0:1783135091.009901:0:14210:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1783135091.009907:0:14210:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829800/0xd6c4b8f05867fa42 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb7640 expref: 13 pid: 14224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135091.009929:0:14210:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9fe9c8301a00) 00010000:00010000:1.0:1783135091.009932:0:14210:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1783135091.009937:0:14210:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ad800/0xd6c4b8f05867fb1b lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb767f expref: 12 pid: 14223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135091.009951:0:14210:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x4:0x0].0x0 (ffff9fe9c33d0000) 00010000:00010000:1.0:1783135091.009970:0:14210:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1783135091.009975:0:14210:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c1523200/0xd6c4b8f05867ff0b lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb7789 expref: 11 pid: 16395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135091.009991:0:14210:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9fe9c8301a00) 00010000:00010000:1.0:1783135091.009993:0:14210:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1783135091.010142:0:14210:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe8c5550200/0xd6c4b8f05867fdc2 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb773c expref: 10 pid: 14224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135091.010164:0:14210:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9fe9cc3c1800) 00010000:00010000:1.0:1783135091.010166:0:14210:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783135091.010170:0:14210:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c1523c00/0xd6c4b8f05867fa5e lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb7647 expref: 9 pid: 14223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135091.010186:0:14210:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fe9cc3c1600) 00010000:00010000:1.0:1783135091.010189:0:14210:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1783135091.010193:0:14210:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c1522400/0xd6c4b8f05867fa96 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb7655 expref: 8 pid: 14223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135091.010205:0:14210:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x4:0x0].0x0 (ffff9fe9c33d0000) 00010000:00010000:1.0:1783135091.010207:0:14210:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1783135091.010211:0:14210:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c0030000/0xd6c4b8f05867ffe4 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb77c1 expref: 7 pid: 16395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135091.010225:0:14210:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff9fe8c5f1a000, canceled 8 locks, left on hash table 0. 00010000:00010000:1.0:1783135091.010240:0:14210:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783135091.010242:0:14210:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783135091.010244:0:14210:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783135091.010925:0:14222:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fec17800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2b138366-7a70-4ff2-909d-348210e4a0a2+5:2366:x1869752374018432:12345-192.168.201.41@tcp:39:umount.0 Request processed in 1955us (2220us total) trans 8589934678 rc 0/0 00000100:00100000:0.0:1783135091.010939:0:14222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 114 00010000:00010000:2.0:1783135091.203450:0:14211:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1783135091.983589:0:14257:0:(llog.c:800:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1783135091.983626:0:14257:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1783135091.983705:0:14257:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 4 count 4 00000040:00080000:3.0:1783135091.983714:0:14257:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:3.0:1783135092.227975:0:15220:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783135092.767897:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:0.0:1783135092.767933:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:0.0:1783135092.767974:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:2.0:1783135092.768167:0:16237:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752374018560 00000100:00100000:2.0:1783135092.768177:0:16237:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752374018560 00000100:00100000:2.0:1783135092.768233:0:16237:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752374018816 00000100:00100000:2.0:1783135092.768235:0:16237:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752374018816 00000100:00100000:2.0:1783135092.768245:0:16237:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752374018688 00000100:00100000:2.0:1783135092.768247:0:16237:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752374018688 00000100:00100000:2.0:1783135092.768260:0:16237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 10 00000100:00100000:2.0:1783135092.768268:0:16237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fe8ff100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:58985142-d56f-4f22-9f82-f587934b3bed+12:2369:x1869752374018560:12345-192.168.201.41@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783135092.768321:0:16237:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783135092.768339:0:16237:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fe9f68acc00/0xd6c4b8f05867f9b6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb75d0 expref: 12 pid: 14217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135092.768357:0:16237:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783135092.768403:0:16237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fe8ff100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:58985142-d56f-4f22-9f82-f587934b3bed+11:2369:x1869752374018560:12345-192.168.201.41@tcp:103:ldlm_bl.0 Request processed in 135us (526us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135092.768411:0:16237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 10 00000100:00100000:2.0:1783135092.768425:0:16237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 11 00000100:00100000:2.0:1783135092.768431:0:16237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fe8fc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:58985142-d56f-4f22-9f82-f587934b3bed+10:2369:x1869752374018816:12345-192.168.201.41@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783135092.768454:0:16237:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783135092.768462:0:16237:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fe8c5551000/0xd6c4b8f05867f9f5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb7632 expref: 10 pid: 14216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135092.768470:0:16237:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783135092.768484:0:16237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fe8fc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:58985142-d56f-4f22-9f82-f587934b3bed+9:2369:x1869752374018816:12345-192.168.201.41@tcp:103:ldlm_bl.0 Request processed in 54us (551us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135092.768490:0:16237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 11 00000100:00100000:2.0:1783135092.768500:0:16237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 12 00000100:00100000:2.0:1783135092.768505:0:16237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fe8fc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:58985142-d56f-4f22-9f82-f587934b3bed+8:2369:x1869752374018688:12345-192.168.201.41@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783135092.768511:0:16237:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783135092.768518:0:16237:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fe8c5550000/0xd6c4b8f05867f9bd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb75fa expref: 8 pid: 14216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135092.768525:0:16237:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783135092.768536:0:16237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fe8fc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:58985142-d56f-4f22-9f82-f587934b3bed+7:2369:x1869752374018688:12345-192.168.201.41@tcp:103:ldlm_bl.0 Request processed in 31us (562us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135092.768542:0:16237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 12 00000100:00100000:3.0:1783135092.776154:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:1.0:1783135092.776725:0:14224:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752374019072 00000100:00100000:1.0:1783135092.776747:0:14224:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752374019072 00000100:00100000:1.0:1783135092.776848:0:14224:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 115 00000100:00100000:1.0:1783135092.776858:0:14224:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9f6cb2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aa2f4fd1-78f9-41b4-ba50-d28d753ff635+6:2366:x1869752374019072:12345-192.168.201.41@tcp:39:umount.0 00000020:00000080:1.0:1783135092.776905:0:14224:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xd6c4b8f05867f9cb 00000020:00010000:1.0:1783135092.776913:0:14224:0:(genops.c:1942:obd_stale_export_put()) Put export ffff9fe9c8f89000: total 0 00000100:00080000:1.0:1783135092.776917:0:14224:0:(import.c:65:import_set_state_nolock()) ffff9fe9c8f88800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1783135092.776950:0:14224:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934678 00000020:00010000:0.0:1783135092.777169:0:14210:0:(genops.c:1928:obd_stale_export_get()) Get export ffff9fe9c8f89000: total 0 00010000:00010000:0.0:1783135092.777208:0:14210:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff9fe9c8f89000, canceled 0 locks, left on hash table 1. 00010000:00010000:0.0:1783135092.777240:0:14210:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fe9cc3c1600) 00010000:00010000:0.0:1783135092.777243:0:14210:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1783135092.777251:0:14210:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c1522c00/0xd6c4b8f05867faa4 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb765c expref: 5 pid: 14224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135092.777275:0:14210:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff9fe9c8f89000, canceled 1 locks, left on hash table 0. 00010000:00010000:0.0:1783135092.777300:0:14210:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783135092.777302:0:14210:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783135092.777309:0:14210:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783135092.777615:0:14224:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9f6cb2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aa2f4fd1-78f9-41b4-ba50-d28d753ff635+3:2366:x1869752374019072:12345-192.168.201.41@tcp:39:umount.0 Request processed in 758us (1585us total) trans 8589934679 rc 0/0 00000100:00100000:1.0:1783135092.777624:0:14224:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 115 00000100:00080000:2.0:1783135092.785239:0:14218:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1783135092.802094:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:3.0:1783135092.802194:0:14216:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752374019328 00000100:00100000:3.0:1783135092.802204:0:14216:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752374019328 00000100:00100000:3.0:1783135092.802264:0:14216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 123 00000100:00100000:3.0:1783135092.802273:0:14216:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9f5ce9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58985142-d56f-4f22-9f82-f587934b3bed+7:2366:x1869752374019328:12345-192.168.201.41@tcp:251:umount.0 00000020:00000080:3.0:1783135092.802365:0:14216:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xd6c4b8f05867f8ac 00000020:00010000:3.0:1783135092.802373:0:14216:0:(genops.c:1942:obd_stale_export_put()) Put export ffff9fe8c5f1f800: total 0 00000100:00080000:3.0:1783135092.802377:0:14216:0:(import.c:65:import_set_state_nolock()) ffff9fe8c5f1e000 : changing import state from FULL to CLOSED 00000100:00100000:3.0:1783135092.802443:0:14216:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9f5ce9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58985142-d56f-4f22-9f82-f587934b3bed+3:2366:x1869752374019328:12345-192.168.201.41@tcp:251:umount.0 Request processed in 171us (357us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135092.802451:0:14216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 123 00000020:00010000:2.0:1783135092.803239:0:14211:0:(genops.c:1928:obd_stale_export_get()) Get export ffff9fe8c5f1f800: total 0 00010000:00010000:2.0:1783135092.803314:0:14211:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff9fe8c5f1f800, canceled 0 locks, left on hash table 1. 00010000:00010000:2.0:1783135092.803346:0:14211:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fe8c5550400/0xd6c4b8f05867f8b3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb7567 expref: 2 pid: 14217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135092.803361:0:14211:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff9fe8c5f1f800, canceled 1 locks, left on hash table 0. 00000020:00000080:2.0:1783135092.803369:0:14211:0:(genops.c:906:class_export_put()) final put ffff9fe8c5f1f800/58985142-d56f-4f22-9f82-f587934b3bed 00010000:00010000:2.0:1783135092.803394:0:14211:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783135092.803396:0:14211:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783135092.803398:0:14211:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1783135092.803495:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9fe8c5f1f800/58985142-d56f-4f22-9f82-f587934b3bed for MGS 00000020:00000080:0.0:1783135092.803532:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9fe8c5f1e000 for MGS 00010000:00010000:0.0:1783135093.251489:0:15220:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783135094.299939:0:14210:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783135094.404084:0:3288:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9fe7d0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1869752384453504:0@lo:400:kworker.0 00000100:00100000:1.0:1783135094.404180:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135094.404260:0:3288:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1783135094.404266:0:3288:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9fe7d1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3288:1869752384453632:0@lo:400:kworker.0 00000100:00100000:1.0:1783135094.404374:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135094.404416:0:14858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384453504 00000100:00100000:1.0:1783135094.404424:0:14858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384453504 00000100:00100000:1.0:1783135094.404493:0:14858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1783135094.404504:0:14858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe8c590df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3288:x1869752384453504:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783135094.404625:0:3286:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9fec14380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c1fe35bd-99cf-438e-8ada-ed586b673efa:3286:1869752384453248:0@lo:400:kworker.0 00000100:00100000:3.0:1783135094.404669:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135094.404697:0:3286:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9fe7d1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3286:1869752384453760:0@lo:400:kworker.0 00000100:00100000:3.0:1783135094.404721:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135094.404744:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1783135094.404749:0:3286:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9fec16d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1869752384453376:0@lo:400:kworker.0 00000100:00100000:3.0:1783135094.404772:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135094.404790:0:3286:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe8c590e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3286:1869752384453888:0@lo:400:kworker.0 00000100:00100000:3.0:1783135094.404809:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135094.404835:0:14215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384453248 00000100:00100000:3.0:1783135094.404839:0:14215:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384453248 00000100:00100000:3.0:1783135094.404869:0:14215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:3.0:1783135094.404876:0:14215:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9f5cea850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c1fe35bd-99cf-438e-8ada-ed586b673efa+19:3286:x1869752384453248:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783135094.404910:0:14215:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9f5cea850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c1fe35bd-99cf-438e-8ada-ed586b673efa+19:3286:x1869752384453248:12345-0@lo:400:kworker.0 Request processed in 35us (240us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135094.404919:0:14215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:3.0:1783135094.404954:0:14860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384453376 00000100:00100000:3.0:1783135094.404958:0:14860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384453376 00000100:00100000:3.0:1783135094.404988:0:14860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1783135094.404995:0:14860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9f6cb2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3286:x1869752384453376:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783135094.405034:0:14860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9f6cb2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3286:x1869752384453376:12345-0@lo:400:kworker.0 Request processed in 40us (262us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135094.405040:0:14860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1783135094.405085:0:3286:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9fec16d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1869752384453376:0@lo:400:kworker.0 00000100:00100000:3.0:1783135094.405095:0:3286:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9fec14380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c1fe35bd-99cf-438e-8ada-ed586b673efa:3286:1869752384453248:0@lo:400:kworker.0 00000100:00080000:3.0:1783135094.405158:0:14218:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1783135094.405164:0:14218:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1783135094.405175:0:16395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384453632 00000100:00100000:3.0:1783135094.405178:0:16395:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384453632 00000100:00100000:3.0:1783135094.405202:0:16395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384453760 00000100:00100000:3.0:1783135094.405204:0:16395:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384453760 00000100:00100000:3.0:1783135094.405221:0:16395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384453888 00000100:00100000:3.0:1783135094.405224:0:16395:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384453888 00000100:00100000:3.0:1783135094.405238:0:16395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1783135094.405244:0:16395:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe8c590f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3288:x1869752384453632:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783135094.405337:0:14222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1783135094.405347:0:14222:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9f6cb1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3286:x1869752384453760:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783135094.405387:0:14222:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9f6cb1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3286:x1869752384453760:12345-0@lo:400:kworker.0 Request processed in 42us (664us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135094.405393:0:14222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1783135094.405407:0:14222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1783135094.405412:0:14222:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9f6cb2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3286:x1869752384453888:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783135094.405436:0:14222:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9f6cb2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3286:x1869752384453888:12345-0@lo:400:kworker.0 Request processed in 25us (626us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135094.405442:0:14222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1783135094.405466:0:3286:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe8c590e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3286:1869752384453888:0@lo:400:kworker.0 00000100:00100000:0.0:1783135094.405483:0:3286:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9fe7d1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3286:1869752384453760:0@lo:400:kworker.0 00000100:00100000:1.0:1783135094.406707:0:14858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe8c590df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3288:x1869752384453504:12345-0@lo:400:kworker.0 Request processed in 2200us (2523us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135094.406717:0:14858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1783135094.413459:0:16395:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe8c590f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3288:x1869752384453632:12345-0@lo:400:kworker.0 Request processed in 8197us (9067us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135094.413481:0:16395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00080000:3.0:1783135094.413570:0:14218:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783135094.415681:0:3288:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9fe7d1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3288:1869752384453632:0@lo:400:kworker.0 00000100:00100000:3.0:1783135094.418788:0:3288:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9fe7d0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1869752384453504:0@lo:400:kworker.0 00000100:00100000:3.0:1783135094.418843:0:3288:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe8c590f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1869752384454016:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1783135094.418943:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135094.421983:0:14862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384454016 00000100:00100000:0.0:1783135094.421999:0:14862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384454016 00000100:00100000:0.0:1783135094.422079:0:14862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1783135094.422091:0:14862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fec14380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3288:x1869752384454016:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1783135094.422146:0:14862:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1783135094.422250:0:14862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fec14380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3288:x1869752384454016:12345-0@lo:13:osp-pre-1-0.0 Request processed in 160us (3307us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135094.422258:0:14862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1783135094.422750:0:3288:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe8c590f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1869752384454016:0@lo:13:osp-pre-1-0.0 00000001:00100000:1.0:1783135095.069367:0:5791:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 2b138366-7a70-4ff2-909d-348210e4a0a2 00000001:00080000:1.0:1783135095.069393:0:5791:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934678 is committed 00000001:00100000:1.0:1783135095.069405:0:5791:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of aa2f4fd1-78f9-41b4-ba50-d28d753ff635 00000001:00080000:1.0:1783135095.069412:0:5791:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934679 is committed 00000020:00000080:1.0:1783135095.069432:0:5791:0:(genops.c:906:class_export_put()) final put ffff9fe9c8f89000/aa2f4fd1-78f9-41b4-ba50-d28d753ff635 00000020:00000080:1.0:1783135095.069457:0:5791:0:(genops.c:906:class_export_put()) final put ffff9fe8c5f1a000/2b138366-7a70-4ff2-909d-348210e4a0a2 00000020:00000080:1.0:1783135095.069479:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9fe9c8f89000/aa2f4fd1-78f9-41b4-ba50-d28d753ff635 for lustre-MDT0000 00000001:00100000:3.0:1783135095.081467:0:7470:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 2b138366-7a70-4ff2-909d-348210e4a0a2 00000020:00000080:3.0:1783135095.081481:0:7470:0:(genops.c:906:class_export_put()) final put ffff9fe8c5f1d000/2b138366-7a70-4ff2-909d-348210e4a0a2 00000020:00000080:1.0:1783135095.093805:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9fe8c5f1a000/2b138366-7a70-4ff2-909d-348210e4a0a2 for lustre-MDT0000 00000020:00000080:1.0:1783135095.093916:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9fe9c8f88800 for lustre-MDT0000 00000020:00000080:1.0:1783135095.093924:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9fe8c5f1d000/2b138366-7a70-4ff2-909d-348210e4a0a2 for lustre-OST0001 00000020:00000080:1.0:1783135095.093945:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9fe8c6041800 for lustre-MDT0000 00000020:00000080:1.0:1783135095.093949:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9fe8c5f1d800 for lustre-OST0001 00000001:00100000:0.0:1783135095.105446:0:6602:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 2b138366-7a70-4ff2-909d-348210e4a0a2 00000020:00000080:0.0:1783135095.105460:0:6602:0:(genops.c:906:class_export_put()) final put ffff9fe9c8f8d000/2b138366-7a70-4ff2-909d-348210e4a0a2 00000020:00000080:3.0:1783135095.111520:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9fe9c8f8d000/2b138366-7a70-4ff2-909d-348210e4a0a2 for lustre-OST0000 00000020:00000080:3.0:1783135095.113496:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9fe9c8f8c800 for lustre-OST0000 00010000:00010000:3.0:1783135095.369314:0:14211:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783135095.941406:0:3288:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1783135095.941439:0:3288:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9fe8fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1869752384454144:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1783135095.945916:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135095.945999:0:14862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384454144 00000100:00100000:0.0:1783135095.946010:0:14862:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384454144 00000100:00100000:0.0:1783135095.946076:0:14862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1783135095.946088:0:14862:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fe8fdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3288:x1869752384454144:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1783135095.946146:0:14862:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1783135095.946230:0:14862:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fe8fdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3288:x1869752384454144:12345-0@lo:13:osp-pre-0-0.0 Request processed in 144us (326us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135095.946238:0:14862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1783135095.951324:0:3288:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9fe8fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1869752384454144:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1783135096.389986:0:15220:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1783135096.608246:0:16902:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:1.0:1783135096.637156:0:16902:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:1.0:1783135096.637226:0:16902:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.141@tcp lock: ffff9fe9c7828c00/0xd6c4b8f05867f69f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xd6c4b8f05867f6a6 expref: -99 pid: 14204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135096.637244:0:16902:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.141@tcp lock: ffff9fe9c7828c00/0xd6c4b8f05867f69f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xd6c4b8f05867f6a6 expref: -99 pid: 14204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135096.637253:0:16902:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.141@tcp lock: ffff9fe9c7828c00/0xd6c4b8f05867f69f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0xd6c4b8f05867f6a6 expref: -99 pid: 14204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135096.637262:0:16902:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.141@tcp lock: ffff9fe9c7828c00/0xd6c4b8f05867f69f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0xd6c4b8f05867f6a6 expref: -99 pid: 14204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135096.637441:0:14210:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783135096.637533:0:14210:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.141@tcp lock: ffff9fe9c7828c00/0xd6c4b8f05867f69f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0xd6c4b8f05867f6a6 expref: -99 pid: 14204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135096.637544:0:14210:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe9c7828c00 already unused, calling callback (ffffffffc1b40c20) 10000000:00010000:0.0:1783135096.637549:0:14210:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.141@tcp lock: ffff9fe9c7828c00/0xd6c4b8f05867f69f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0xd6c4b8f05867f6a6 expref: -99 pid: 14204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135096.637560:0:14210:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.141@tcp lock: ffff9fe9c7828c00/0xd6c4b8f05867f69f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0xd6c4b8f05867f6a6 expref: -99 pid: 14204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1783135096.637569:0:14210:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.141@tcp lock: ffff9fe9c7828c00/0xd6c4b8f05867f69f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0xd6c4b8f05867f6a6 expref: -99 pid: 14204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783135096.637595:0:14210:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1783135096.637598:0:14210:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 00010000:00010000:0.0:1783135096.637645:0:14210:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.141@tcp lock: ffff9fe9c7828c00/0xd6c4b8f05867f69f lrc: 3/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xd6c4b8f05867f6a6 expref: -99 pid: 14204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135096.637652:0:14210:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1783135096.637688:0:16902:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 10000000:01000000:1.0:1783135096.637696:0:16902:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 10000000:01000000:1.0:1783135096.637701:0:16902:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:1.0:1783135096.637729:0:16902:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1783135096.637735:0:16902:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:1.0:1783135096.637743:0:16902:0:(pinger.c:400:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1783135096.637758:0:16902:0:(import.c:65:import_set_state_nolock()) ffff9fe9f6a13000 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:3.0:1783135096.637824:0:3286:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9fe8fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c1fe35bd-99cf-438e-8ada-ed586b673efa:3286:1869752384454272:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1783135096.637920:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135096.638073:0:3285:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe8c590ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3285:1869752384454400:0@lo:39:umount.0 00000100:00100000:2.0:1783135096.638116:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1783135096.638238:0:14210:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.141@tcp lock: ffff9fe9c7828c00/0xd6c4b8f05867f69f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xd6c4b8f05867f6a6 expref: -99 pid: 14204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135096.638248:0:14210:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.141@tcp lock: ffff9fe9c7828c00/0xd6c4b8f05867f69f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xd6c4b8f05867f6a6 expref: -99 pid: 14204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135096.638266:0:14210:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783135096.638268:0:14210:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783135096.638270:0:14210:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783135096.638464:0:16237:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384454272 00000100:00100000:3.0:1783135096.638473:0:16237:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384454272 00000100:00100000:3.0:1783135096.638552:0:16237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1783135096.638562:0:16237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fe69c050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c1fe35bd-99cf-438e-8ada-ed586b673efa+19:3286:x1869752384454272:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1783135096.638577:0:16237:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783135096.638595:0:16237:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fe9d2b74400/0xd6c4b8f05867f6a6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xd6c4b8f05867f69f expref: 19 pid: 14215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135096.638609:0:16237:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783135096.638652:0:16237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fe69c050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c1fe35bd-99cf-438e-8ada-ed586b673efa+18:3286:x1869752384454272:12345-0@lo:103:ldlm_bl.0 Request processed in 91us (731us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135096.638659:0:16237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1783135096.638780:0:3286:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9fe8fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c1fe35bd-99cf-438e-8ada-ed586b673efa:3286:1869752384454272:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1783135096.638998:0:14222:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384454400 00000100:00100000:1.0:1783135096.639016:0:14222:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384454400 00000100:00100000:1.0:1783135096.639089:0:14222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:1.0:1783135096.639097:0:14222:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9f6fe6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1869752384454400:12345-0@lo:39:umount.0 00000020:00000080:1.0:1783135096.639128:0:14222:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xd6c4b8f05867f6d7 00000100:00080000:1.0:1783135096.639138:0:14222:0:(import.c:65:import_set_state_nolock()) ffff9fea01d1a800 : changing import state from FULL to CLOSED 00000100:00100000:1.0:1783135096.639215:0:14222:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9f6fe6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+1:3285:x1869752384454400:12345-0@lo:39:umount.0 Request processed in 119us (1097us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135096.639222:0:14222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000020:00000080:1.0:1783135096.639230:0:14222:0:(genops.c:906:class_export_put()) final put ffff9fea01d1d000/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:2.0:1783135096.639312:0:483:0:(genops.c:865:class_export_destroy()) destroying export ffff9fea01d1d000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:2.0:1783135096.639366:0:483:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9fea01d1a800 for lustre-MDT0000 00000100:00080000:2.0:1783135096.639396:0:3285:0:(import.c:65:import_set_state_nolock()) ffff9fe9f6a13000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:2.0:1783135096.639406:0:3285:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe8c590ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3285:1869752384454400:0@lo:39:umount.0 00010000:00010000:3.0:1783135096.639501:0:14211:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1783135096.639711:0:16902:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1783135096.639715:0:16902:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:1.0:1783135096.639721:0:16902:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:1.0:1783135096.641173:0:16902:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.141@tcp lock: ffff9fe9c7828000/0xd6c4b8f05867f605 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xd6c4b8f05867f60c expref: -99 pid: 14204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135096.641193:0:16902:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.141@tcp lock: ffff9fe9c7828000/0xd6c4b8f05867f605 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xd6c4b8f05867f60c expref: -99 pid: 14204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135096.641201:0:16902:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.141@tcp lock: ffff9fe9c7828000/0xd6c4b8f05867f605 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0xd6c4b8f05867f60c expref: -99 pid: 14204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135096.641208:0:16902:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.141@tcp lock: ffff9fe9c7828000/0xd6c4b8f05867f605 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0xd6c4b8f05867f60c expref: -99 pid: 14204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135096.641306:0:16902:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783135096.641314:0:16902:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.141@tcp lock: ffff9fe9c7828200/0xd6c4b8f05867f89e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd6c4b8f05867f8a5 expref: -99 pid: 14219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135096.641321:0:16902:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.141@tcp lock: ffff9fe9c7828200/0xd6c4b8f05867f89e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd6c4b8f05867f8a5 expref: -99 pid: 14219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135096.641350:0:16902:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.141@tcp lock: ffff9fe9c7828200/0xd6c4b8f05867f89e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xd6c4b8f05867f8a5 expref: -99 pid: 14219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135096.641356:0:16902:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.141@tcp lock: ffff9fe9c7828200/0xd6c4b8f05867f89e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xd6c4b8f05867f8a5 expref: -99 pid: 14219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135096.641475:0:15220:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1783135096.641484:0:15220:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.141@tcp lock: ffff9fe9c7828000/0xd6c4b8f05867f605 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0xd6c4b8f05867f60c expref: -99 pid: 14204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135096.641492:0:15220:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe9c7828000 already unused, calling callback (ffffffffc1b40c20) 10000000:00010000:0.0:1783135096.641496:0:15220:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.141@tcp lock: ffff9fe9c7828000/0xd6c4b8f05867f605 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0xd6c4b8f05867f60c expref: -99 pid: 14204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135096.641505:0:15220:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.141@tcp lock: ffff9fe9c7828000/0xd6c4b8f05867f605 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0xd6c4b8f05867f60c expref: -99 pid: 14204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1783135096.641512:0:15220:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.141@tcp lock: ffff9fe9c7828000/0xd6c4b8f05867f605 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0xd6c4b8f05867f60c expref: -99 pid: 14204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783135096.641528:0:15220:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1783135096.641538:0:15220:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 00010000:00010000:0.0:1783135096.641580:0:15220:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.141@tcp lock: ffff9fe9c7828000/0xd6c4b8f05867f605 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xd6c4b8f05867f60c expref: -99 pid: 14204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135096.641587:0:15220:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1783135096.641642:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00010000:00010000:0.0:1783135096.641727:0:15220:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.141@tcp lock: ffff9fe9c7828000/0xd6c4b8f05867f605 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xd6c4b8f05867f60c expref: -99 pid: 14204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135096.641736:0:15220:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.141@tcp lock: ffff9fe9c7828000/0xd6c4b8f05867f605 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xd6c4b8f05867f60c expref: -99 pid: 14204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135096.641754:0:15220:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783135096.641757:0:15220:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.141@tcp lock: ffff9fe9c7828200/0xd6c4b8f05867f89e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xd6c4b8f05867f8a5 expref: -99 pid: 14219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135096.641762:0:15220:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe9c7828200 already unused, calling callback (ffffffffc1b40c20) 10000000:00010000:0.0:1783135096.641765:0:15220:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.141@tcp lock: ffff9fe9c7828200/0xd6c4b8f05867f89e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xd6c4b8f05867f8a5 expref: -99 pid: 14219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135096.641771:0:15220:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.141@tcp lock: ffff9fe9c7828200/0xd6c4b8f05867f89e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xd6c4b8f05867f8a5 expref: -99 pid: 14219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1783135096.641777:0:15220:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.141@tcp lock: ffff9fe9c7828200/0xd6c4b8f05867f89e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xd6c4b8f05867f8a5 expref: -99 pid: 14219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783135096.641782:0:15220:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:0.0:1783135096.641784:0:15220:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 00010000:00010000:0.0:1783135096.641797:0:15220:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.141@tcp lock: ffff9fe9c7828200/0xd6c4b8f05867f89e lrc: 3/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xd6c4b8f05867f8a5 expref: -99 pid: 14219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135096.641803:0:15220:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1783135096.641847:0:15220:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.141@tcp lock: ffff9fe9c7828200/0xd6c4b8f05867f89e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xd6c4b8f05867f8a5 expref: -99 pid: 14219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135096.641855:0:15220:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783135096.641857:0:15220:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783135096.641859:0:15220:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783135096.641865:0:3289:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1783135096.641884:0:3289:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9fe8ffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c1fe35bd-99cf-438e-8ada-ed586b673efa:3289:1869752384454656:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1783135096.641968:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135096.642210:0:3286:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9fe8fca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c1fe35bd-99cf-438e-8ada-ed586b673efa:3286:1869752384454528:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1783135096.642243:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135096.642349:0:14209:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384454656 00000100:00100000:3.0:1783135096.642357:0:14209:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384454656 00000100:00100000:3.0:1783135096.642458:0:14209:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384454528 00000100:00100000:3.0:1783135096.642462:0:14209:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384454528 00000100:00100000:2.0:1783135096.642546:0:16237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1783135096.642560:0:16237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fe8fd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c1fe35bd-99cf-438e-8ada-ed586b673efa+19:3289:x1869752384454656:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1783135096.642577:0:16237:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783135096.642594:0:16237:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fe9d2b75200/0xd6c4b8f05867f8a5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xd6c4b8f05867f89e expref: 19 pid: 14215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135096.642613:0:16237:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783135096.642658:0:16237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fe8fd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c1fe35bd-99cf-438e-8ada-ed586b673efa+18:3289:x1869752384454656:12345-0@lo:103:ldlm_bl.0 Request processed in 101us (691us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135096.642666:0:16237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1783135096.642685:0:16237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1783135096.642691:0:16237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fec15c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c1fe35bd-99cf-438e-8ada-ed586b673efa+17:3286:x1869752384454528:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1783135096.642698:0:16237:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783135096.642706:0:16237:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fe9fe43f000/0xd6c4b8f05867f60c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xd6c4b8f05867f605 expref: 17 pid: 14216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135096.642728:0:16237:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783135096.642753:0:16237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fec15c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c1fe35bd-99cf-438e-8ada-ed586b673efa+16:3286:x1869752384454528:12345-0@lo:103:ldlm_bl.0 Request processed in 62us (510us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135096.642759:0:16237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1783135096.642795:0:3289:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9fe8ffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c1fe35bd-99cf-438e-8ada-ed586b673efa:3289:1869752384454656:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1783135096.642943:0:16902:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1783135096.642951:0:16902:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.141@tcp lock: ffff9fe9c7828200/0xd6c4b8f05867f89e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xd6c4b8f05867f8a5 expref: -99 pid: 14219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783135096.642966:0:16902:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:1.0:1783135096.642976:0:16902:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.141@tcp lock: ffff9fe9c0030200/0xd6c4b8f05867fa1f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd6c4b8f05867fa26 expref: -99 pid: 14219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135096.642983:0:16902:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.141@tcp lock: ffff9fe9c0030200/0xd6c4b8f05867fa1f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xd6c4b8f05867fa26 expref: -99 pid: 14219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135096.642989:0:16902:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.141@tcp lock: ffff9fe9c0030200/0xd6c4b8f05867fa1f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xd6c4b8f05867fa26 expref: -99 pid: 14219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135096.642996:0:16902:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.141@tcp lock: ffff9fe9c0030200/0xd6c4b8f05867fa1f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xd6c4b8f05867fa26 expref: -99 pid: 14219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135096.643009:0:16902:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783135096.643014:0:16902:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.141@tcp lock: ffff9fe9c7829200/0xd6c4b8f05867f5f7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd6c4b8f05867f5fe expref: -99 pid: 14204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135096.643020:0:16902:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.141@tcp lock: ffff9fe9c7829200/0xd6c4b8f05867f5f7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd6c4b8f05867f5fe expref: -99 pid: 14204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135096.643033:0:16902:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.141@tcp lock: ffff9fe9c7829200/0xd6c4b8f05867f5f7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xd6c4b8f05867f5fe expref: -99 pid: 14204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135096.643039:0:16902:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.141@tcp lock: ffff9fe9c7829200/0xd6c4b8f05867f5f7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xd6c4b8f05867f5fe expref: -99 pid: 14204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135096.643051:0:16902:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:1.0:1783135096.643055:0:16902:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 10000000:01000000:1.0:1783135096.643058:0:16902:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00000020:01000004:1.0:1783135096.643094:0:16902:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-MDT0000 00000020:01000000:1.0:1783135096.643099:0:16902:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='F') 00000020:00000080:1.0:1783135096.643104:0:16902:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1783135096.643111:0:16902:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 2/5 00000020:00080000:1.0:1783135096.643116:0:16902:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff9fe9fe490800 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1783135096.643123:0:16902:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff9fe9d12ea800 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1783135096.643129:0:16902:0:(genops.c:1574:class_disconnect_exports()) OBD device 5 (ffff9fea00c419c0) has exports, disconnecting them 00000020:00080000:1.0:1783135096.643134:0:16902:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9fe9fe490800), last request at 1783135094 00000020:00000080:1.0:1783135096.643143:0:16902:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xd6c4b8f05867f890 00000100:00080000:1.0:1783135096.643163:0:16902:0:(import.c:65:import_set_state_nolock()) ffff9fe9fe494800 : changing import state from FULL to CLOSED 00000020:00080000:1.0:1783135096.643217:0:16902:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9fe9fe490800): rc 0 00000020:00000080:1.0:1783135096.643220:0:16902:0:(genops.c:906:class_export_put()) final put ffff9fe9fe490800/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:1.0:1783135096.643232:0:16902:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9fe9d12ea800), last request at 1783135094 00000020:00000080:1.0:1783135096.643235:0:16902:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xd6c4b8f05867f755 00000100:00080000:1.0:1783135096.643241:0:16902:0:(import.c:65:import_set_state_nolock()) ffff9fe8c5ff9000 : changing import state from FULL to CLOSED 00000020:00080000:1.0:1783135096.643247:0:16902:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9fe9d12ea800): rc 0 00000020:00000080:1.0:1783135096.643249:0:16902:0:(genops.c:906:class_export_put()) final put ffff9fe9d12ea800/lustre-MDT0000-lwp-OST0000_UUID 00000004:00000080:1.0:1783135096.643258:0:16902:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffb1f240f63ae0 00000100:00080000:1.0:1783135096.643310:0:16902:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1783135096.643314:0:16902:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934598 gen 3 00000004:00080000:1.0:1783135096.643330:0:16902:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:1.0:1783135096.643387:0:16902:0:(pinger.c:400:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:1.0:1783135096.643406:0:16902:0:(import.c:65:import_set_state_nolock()) ffff9fe9c979c800 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:1.0:1783135096.643425:0:16902:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1783135096.643427:0:16902:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934601 gen 3 00000004:00080000:1.0:1783135096.643436:0:16902:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:1.0:1783135096.643509:0:16902:0:(pinger.c:400:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:1.0:1783135096.643530:0:16902:0:(import.c:65:import_set_state_nolock()) ffff9fe9f5c91000 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:1.0:1783135096.643587:0:16902:0:(genops.c:1579:class_disconnect_exports()) OBD device 5 (ffff9fea00c419c0) has no exports 00000100:00100000:2.0:1783135096.643711:0:3285:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe8c590f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3285:1869752384454784:0@lo:9:umount.0 00000100:00100000:2.0:1783135096.643760:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135096.643799:0:3285:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe8c590c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3285:1869752384454912:0@lo:9:umount.0 00000100:00100000:2.0:1783135096.643835:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135096.643958:0:14860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384454784 00000100:00100000:1.0:1783135096.643964:0:14860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384454784 00000100:00100000:1.0:1783135096.644022:0:14860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384454912 00000100:00100000:1.0:1783135096.644025:0:14860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384454912 00000100:00100000:1.0:1783135096.644047:0:14860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1783135096.644054:0:14860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9f6fe6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3285:x1869752384454784:12345-0@lo:9:umount.0 00000020:00000080:1.0:1783135096.644081:0:14860:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xd6c4b8f05867f771 00000100:00080000:1.0:1783135096.644088:0:14860:0:(import.c:65:import_set_state_nolock()) ffff9fe9f6a10800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1783135096.644122:0:14860:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934598 00000100:00080000:2.0:1783135096.644571:0:14218:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1783135096.644577:0:14218:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1783135096.644769:0:14860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9f6fe6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+2:3285:x1869752384454784:12345-0@lo:9:umount.0 Request processed in 713us (1006us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135096.644778:0:14860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1783135096.644797:0:14860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1783135096.644805:0:14860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9f6fe5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3285:x1869752384454912:12345-0@lo:9:umount.0 00000020:00000080:1.0:1783135096.644834:0:14860:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xd6c4b8f05867f8f2 00000100:00080000:1.0:1783135096.644840:0:14860:0:(import.c:65:import_set_state_nolock()) ffff9fe9c8f8f000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1783135096.644859:0:14860:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934601 00000100:00100000:1.0:1783135096.645088:0:14860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9f6fe5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+2:3285:x1869752384454912:12345-0@lo:9:umount.0 Request processed in 283us (1251us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135096.645096:0:14860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00010000:00010000:3.0:1783135096.645297:0:14211:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1783135096.645307:0:14211:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.141@tcp lock: ffff9fe9c0030200/0xd6c4b8f05867fa1f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xd6c4b8f05867fa26 expref: -99 pid: 14219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135096.645318:0:14211:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe9c0030200 already unused, calling callback (ffffffffc1b40c20) 10000000:00010000:3.0:1783135096.645329:0:14211:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.141@tcp lock: ffff9fe9c0030200/0xd6c4b8f05867fa1f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xd6c4b8f05867fa26 expref: -99 pid: 14219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135096.645341:0:14211:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.141@tcp lock: ffff9fe9c0030200/0xd6c4b8f05867fa1f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xd6c4b8f05867fa26 expref: -99 pid: 14219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1783135096.645350:0:14211:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.141@tcp lock: ffff9fe9c0030200/0xd6c4b8f05867fa1f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xd6c4b8f05867fa26 expref: -99 pid: 14219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783135096.645357:0:14211:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:3.0:1783135096.645360:0:14211:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:3.0:1783135096.645364:0:14211:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:3.0:1783135096.645397:0:14211:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.141@tcp lock: ffff9fe9c0030200/0xd6c4b8f05867fa1f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xd6c4b8f05867fa26 expref: -99 pid: 14219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135096.645404:0:14211:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1783135096.645429:0:14211:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.141@tcp lock: ffff9fe9c0030200/0xd6c4b8f05867fa1f lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xd6c4b8f05867fa26 expref: -99 pid: 14219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135096.645437:0:14211:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.141@tcp lock: ffff9fe9c0030200/0xd6c4b8f05867fa1f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xd6c4b8f05867fa26 expref: -99 pid: 14219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135096.645463:0:14211:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783135096.645468:0:14211:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.141@tcp lock: ffff9fe9c7829200/0xd6c4b8f05867f5f7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xd6c4b8f05867f5fe expref: -99 pid: 14204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135096.645474:0:14211:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe9c7829200 already unused, calling callback (ffffffffc1b40c20) 10000000:00010000:3.0:1783135096.645477:0:14211:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.141@tcp lock: ffff9fe9c7829200/0xd6c4b8f05867f5f7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xd6c4b8f05867f5fe expref: -99 pid: 14204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135096.645484:0:14211:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.141@tcp lock: ffff9fe9c7829200/0xd6c4b8f05867f5f7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xd6c4b8f05867f5fe expref: -99 pid: 14204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1783135096.645498:0:14211:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.141@tcp lock: ffff9fe9c7829200/0xd6c4b8f05867f5f7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xd6c4b8f05867f5fe expref: -99 pid: 14204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783135096.645504:0:14211:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:3.0:1783135096.645507:0:14211:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:3.0:1783135096.645509:0:14211:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:3.0:1783135096.645537:0:14211:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.141@tcp lock: ffff9fe9c7829200/0xd6c4b8f05867f5f7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xd6c4b8f05867f5fe expref: -99 pid: 14204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135096.645543:0:14211:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1783135096.645557:0:14211:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.141@tcp lock: ffff9fe9c7829200/0xd6c4b8f05867f5f7 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xd6c4b8f05867f5fe expref: -99 pid: 14204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135096.645564:0:14211:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.141@tcp lock: ffff9fe9c7829200/0xd6c4b8f05867f5f7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xd6c4b8f05867f5fe expref: -99 pid: 14204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135096.645579:0:14211:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783135096.645581:0:14211:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783135096.645582:0:14211:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1783135096.645594:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9fe9fe490800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00000080:3.0:1783135096.645642:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9fe9d12ea800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:3.0:1783135096.645670:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9fe9fe494800 for lustre-MDT0000 00000020:00000080:3.0:1783135096.645676:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9fe8c5ff9000 for lustre-MDT0000 00000100:00100000:3.0:1783135096.645701:0:3288:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1783135096.645717:0:3288:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9fec15880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c1fe35bd-99cf-438e-8ada-ed586b673efa:3288:1869752384455040:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1783135096.645762:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135096.645804:0:3287:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1783135096.645924:0:3287:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9fec16300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c1fe35bd-99cf-438e-8ada-ed586b673efa:3287:1869752384455168:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1783135096.645961:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135096.645989:0:14209:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384455040 00000100:00100000:3.0:1783135096.645996:0:14209:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384455040 00000100:00100000:3.0:1783135096.646028:0:14209:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384455168 00000100:00100000:3.0:1783135096.646030:0:14209:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384455168 00000100:00100000:3.0:1783135096.646044:0:14209:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1783135096.646051:0:14209:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fec16d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c1fe35bd-99cf-438e-8ada-ed586b673efa+17:3288:x1869752384455040:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1783135096.646063:0:14209:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783135096.646079:0:14209:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fe9c0031600/0xd6c4b8f05867fa26 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xd6c4b8f05867fa1f expref: 17 pid: 14216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135096.646094:0:14209:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783135096.646121:0:14209:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fec16d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c1fe35bd-99cf-438e-8ada-ed586b673efa+16:3288:x1869752384455040:12345-0@lo:103:ldlm_bl.0 Request processed in 70us (359us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135096.646128:0:14209:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1783135096.646144:0:14209:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1783135096.646149:0:14209:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fe90c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c1fe35bd-99cf-438e-8ada-ed586b673efa+15:3287:x1869752384455168:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1783135096.646157:0:14209:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783135096.646165:0:14209:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fe9d2b75000/0xd6c4b8f05867f5fe lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xd6c4b8f05867f5f7 expref: 15 pid: 14217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135096.646178:0:14209:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783135096.646201:0:14209:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fe90c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c1fe35bd-99cf-438e-8ada-ed586b673efa+14:3287:x1869752384455168:12345-0@lo:103:ldlm_bl.0 Request processed in 52us (239us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135096.646207:0:14209:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1783135096.646240:0:3288:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9fec15880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c1fe35bd-99cf-438e-8ada-ed586b673efa:3288:1869752384455040:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1783135096.646265:0:3287:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9fec16300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c1fe35bd-99cf-438e-8ada-ed586b673efa:3287:1869752384455168:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1783135096.646328:0:3286:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9fe8fca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c1fe35bd-99cf-438e-8ada-ed586b673efa:3286:1869752384454528:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1783135096.646435:0:14210:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783135096.646586:0:15220:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1783135096.647262:0:3285:0:(import.c:65:import_set_state_nolock()) ffff9fe9c979c800 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:2.0:1783135096.647300:0:3285:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:2.0:1783135096.647302:0:3285:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1783135096.647307:0:3285:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe8c590f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3285:1869752384454784:0@lo:9:umount.0 00000100:00080000:2.0:1783135096.647322:0:3285:0:(import.c:65:import_set_state_nolock()) ffff9fe9f5c91000 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:2.0:1783135096.647334:0:3285:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:2.0:1783135096.647336:0:3285:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1783135096.647339:0:3285:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe8c590c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3285:1869752384454912:0@lo:9:umount.0 00000020:00080000:1.0:1783135096.654828:0:16902:0:(genops.c:1579:class_disconnect_exports()) OBD device 5 (ffff9fea00c419c0) has no exports 00000020:00000080:1.0:1783135096.902554:0:16902:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xd6c4b8f05867f652 00000020:00000080:1.0:1783135096.902574:0:16902:0:(genops.c:906:class_export_put()) final put ffff9fe9e013a800/lustre-QMT0000_UUID 00000020:01000000:1.0:1783135096.902599:0:16902:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:3.0:1783135096.902665:0:483:0:(genops.c:865:class_export_destroy()) destroying export ffff9fe9e013a800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:0.0:1783135096.902762:0:16902:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1783135096.902777:0:16902:0:(obd_config.c:955:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1783135096.902784:0:16902:0:(genops.c:1579:class_disconnect_exports()) OBD device 7 (ffff9fe8c57c19c0) has no exports 00000020:00000080:0.0:1783135096.905089:0:16902:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xd6c4b8f05867f64b 00000020:00000080:0.0:1783135096.905108:0:16902:0:(genops.c:906:class_export_put()) final put ffff9fea01d35800/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1783135096.905212:0:16902:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1783135096.905226:0:16902:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:0.0:1783135096.905230:0:16902:0:(genops.c:906:class_export_put()) final put ffff9fea01d30800/lustre-QMT0000_UUID 00000020:00000080:0.0:1783135096.905233:0:16902:0:(genops.c:865:class_export_destroy()) destroying export ffff9fea01d30800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:0.0:1783135096.905246:0:16902:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000020:00000080:3.0:1783135096.905524:0:483:0:(genops.c:865:class_export_destroy()) destroying export ffff9fea01d35800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:0.0:1783135096.905596:0:16902:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9fe9d144b420 - data ffff9fe9f84420d8/ffff9fe8c6778c00 00000020:01000000:0.0:1783135096.905766:0:16902:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9fe9ea7cb0c0 - data ffff9fe9d8d75af8/ffff9fe9ea391800 00000001:00000004:0.0:1783135097.071938:0:16902:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934679 00000100:00080000:1.0:1783135097.132415:0:16902:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1783135097.132424:0:16902:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934598 gen 4 00000004:00080000:1.0:1783135097.132439:0:16902:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1783135097.132442:0:16902:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:3.0:1783135097.132934:0:14245:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:3.0:1783135097.132939:0:14245:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0xa:0x0] index 2 count 1 00000040:00080000:3.0:1783135097.132952:0:14245:0:(llog.c:857:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 2 count 2 00000100:00080000:1.0:1783135097.133908:0:16902:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1783135097.133913:0:16902:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934601 gen 4 00000004:00080000:1.0:1783135097.133936:0:16902:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1783135097.133938:0:16902:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:3.0:1783135097.134154:0:14247:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:3.0:1783135097.134158:0:14247:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0xc:0x0] index 3 count 1 00000040:00080000:3.0:1783135097.134165:0:14247:0:(llog.c:857:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 2 count 2 00000020:00000080:3.0:1783135097.166740:0:16902:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xd6c4b8f05867f61a 00000020:00000080:3.0:1783135097.166754:0:16902:0:(genops.c:906:class_export_put()) final put ffff9fe9d12eb000/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1783135097.167353:0:483:0:(genops.c:865:class_export_destroy()) destroying export ffff9fe9d12eb000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1783135097.167717:0:16902:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xd6c4b8f05867f62f 00000020:00000080:3.0:1783135097.167723:0:16902:0:(genops.c:906:class_export_put()) final put ffff9fea01d1b000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:3.0:1783135097.167791:0:16902:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:3.0:1783135097.167798:0:16902:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1783135097.167806:0:16902:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1783135097.167810:0:16902:0:(genops.c:1579:class_disconnect_exports()) OBD device 4 (ffff9fea00c43380) has no exports 00000004:01000000:3.0:1783135097.168003:0:16902:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:3.0:1783135097.168011:0:16902:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xd6c4b8f05867f67c 00000020:00000080:3.0:1783135097.168016:0:16902:0:(genops.c:906:class_export_put()) final put ffff9fe9f5c95800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1783135097.168149:0:483:0:(genops.c:865:class_export_destroy()) destroying export ffff9fea01d1b000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:3.0:1783135097.168199:0:16902:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:3.0:1783135097.168203:0:16902:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1783135097.168207:0:16902:0:(obd_config.c:955:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1783135097.168210:0:16902:0:(genops.c:1579:class_disconnect_exports()) OBD device 9 (ffff9fe8c57c0000) has no exports 00000020:00000080:3.0:1783135097.168215:0:16902:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xd6c4b8f05867f675 00000020:00000080:3.0:1783135097.168219:0:16902:0:(genops.c:906:class_export_put()) final put ffff9fe9f5c90800/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1783135097.168237:0:483:0:(genops.c:865:class_export_destroy()) destroying export ffff9fe9f5c95800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00010000:01000000:3.0:1783135097.168718:0:16902:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:3.0:1783135097.168723:0:16902:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1783135097.168727:0:16902:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934601 gen 5 00000004:00080000:3.0:1783135097.168733:0:16902:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1783135097.168745:0:16902:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1783135097.168796:0:483:0:(genops.c:865:class_export_destroy()) destroying export ffff9fe9f5c90800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1783135097.168941:0:16902:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1783135097.168949:0:16902:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1783135097.168954:0:16902:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xd6c4b8f05867f667 00000020:00000080:3.0:1783135097.168959:0:16902:0:(genops.c:906:class_export_put()) final put ffff9fe9f5c95000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1783135097.168977:0:483:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9fe9f5c91000 for lustre-OST0001-osc-MDT0000 00000020:00000080:2.0:1783135097.168982:0:483:0:(genops.c:906:class_export_put()) final put ffff9fe9f5c97800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1783135097.168991:0:483:0:(genops.c:865:class_export_destroy()) destroying export ffff9fe9f5c97800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:2.0:1783135097.168996:0:483:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:01000000:3.0:1783135097.169124:0:16902:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:3.0:1783135097.169129:0:16902:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1783135097.169133:0:16902:0:(obd_config.c:955:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1783135097.169135:0:16902:0:(genops.c:1579:class_disconnect_exports()) OBD device 8 (ffff9fe9d0e83380) has no exports 00000020:00000080:3.0:1783135097.169140:0:16902:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xd6c4b8f05867f660 00000020:00000080:3.0:1783135097.169143:0:16902:0:(genops.c:906:class_export_put()) final put ffff9fe9c979e800/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1783135097.169164:0:483:0:(genops.c:865:class_export_destroy()) destroying export ffff9fe9f5c95000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00010000:01000000:3.0:1783135097.169662:0:16902:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:3.0:1783135097.169666:0:16902:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1783135097.169668:0:16902:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934598 gen 5 00000004:00080000:3.0:1783135097.169672:0:16902:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1783135097.169673:0:16902:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1783135097.169715:0:483:0:(genops.c:865:class_export_destroy()) destroying export ffff9fe9c979e800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1783135097.169793:0:16902:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1783135097.169799:0:16902:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1783135097.169824:0:16902:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1783135097.169828:0:16902:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1783135097.169831:0:16902:0:(genops.c:906:class_export_put()) final put ffff9fe9f6f8e800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1783135097.169834:0:16902:0:(genops.c:865:class_export_destroy()) destroying export ffff9fe9f6f8e800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:3.0:1783135097.169838:0:16902:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1783135097.169950:0:16902:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xd6c4b8f05867f636 00000020:00000080:3.0:1783135097.169954:0:16902:0:(genops.c:906:class_export_put()) final put ffff9fea01d19000/lustre-MDD0000_UUID 00000020:00000080:2.0:1783135097.169974:0:483:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9fe9c979c800 for lustre-OST0000-osc-MDT0000 00000020:00000080:2.0:1783135097.169979:0:483:0:(genops.c:906:class_export_put()) final put ffff9fe9c9b14000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1783135097.169982:0:483:0:(genops.c:865:class_export_destroy()) destroying export ffff9fe9c9b14000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:2.0:1783135097.169985:0:483:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:01000000:3.0:1783135097.170099:0:16902:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:3.0:1783135097.170103:0:16902:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1783135097.170106:0:16902:0:(obd_config.c:955:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1783135097.170108:0:16902:0:(genops.c:1579:class_disconnect_exports()) OBD device 6 (ffff9fea00c44d40) has no exports 00000020:00000080:3.0:1783135097.170126:0:16902:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1783135097.170130:0:16902:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:3.0:1783135097.170133:0:16902:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xd6c4b8f05867f63d 00000020:00000080:3.0:1783135097.170143:0:16902:0:(genops.c:906:class_export_put()) final put ffff9fea01d1f800/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1783135097.170161:0:483:0:(genops.c:865:class_export_destroy()) destroying export ffff9fea01d19000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:2.0:1783135097.170165:0:483:0:(genops.c:906:class_export_put()) final put ffff9fe9d12e8000/lustre-MDD0000_UUID 00000020:00000080:2.0:1783135097.170167:0:483:0:(genops.c:865:class_export_destroy()) destroying export ffff9fe9d12e8000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:2.0:1783135097.170171:0:483:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:01000004:3.0:1783135097.170399:0:16902:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9fe9f6f8d000 from lustre-MDT0000, refs=3 00000020:01000004:3.0:1783135097.170403:0:16902:0:(obd_mount.c:701:lustre_put_lsi()) put ffff9fe9f6f8d000 3 00000020:01000004:3.0:1783135097.170406:0:16902:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9fe9f6f8d000 from lustre-MDT0000 00000020:00000080:3.0:1783135097.170424:0:16902:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1783135097.170429:0:16902:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:3.0:1783135097.170431:0:16902:0:(genops.c:906:class_export_put()) final put ffff9fe9d12e8800/lustre-MDT0000_UUID 00000020:00000080:3.0:1783135097.170434:0:16902:0:(genops.c:865:class_export_destroy()) destroying export ffff9fe9d12e8800/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:3.0:1783135097.170442:0:16902:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:3.0:1783135097.170467:0:16902:0:(obd_mount.c:569:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000004:3.0:1783135097.170470:0:16902:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:3.0:1783135097.170473:0:16902:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:3.0:1783135097.170475:0:16902:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1783135097.170478:0:16902:0:(obd_config.c:955:class_cleanup()) MGS: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1783135097.170484:0:16902:0:(genops.c:1840:print_export_data()) MGS: ACTIVE ffff9fe8c57df800 c1fe35bd-99cf-438e-8ada-ed586b673efa 0@lo 13 (0 0 8) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1783135097.170489:0:16902:0:(genops.c:1574:class_disconnect_exports()) OBD device 1 (ffff9fe9d0e84d40) has exports, disconnecting them 00000020:00080000:3.0:1783135097.170493:0:16902:0:(genops.c:1549:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff9fe8c57df800), last request at 1783135038 00000020:00000080:3.0:1783135097.170505:0:16902:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xd6c4b8f05867f5db 00000020:00010000:3.0:1783135097.170521:0:16902:0:(genops.c:1942:obd_stale_export_put()) Put export ffff9fe8c57df800: total 1 00000100:00080000:3.0:1783135097.170533:0:16902:0:(import.c:65:import_set_state_nolock()) ffff9fe8c57da000 : changing import state from FULL to CLOSED 00000020:00080000:3.0:1783135097.170585:0:16902:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9fe8c57df800): rc 0 00000020:00080000:3.0:1783135097.170590:0:16902:0:(genops.c:1579:class_disconnect_exports()) OBD device 1 (ffff9fe9d0e84d40) has no exports 00000100:00100000:3.0:1783135097.170640:0:14215:0:(service.c:3183:ptlrpc_main()) ll_mgs_0000: service thread [ffff9fea01d20c00:14215] 0 exiting: rc = 1 00000100:00100000:3.0:1783135097.170713:0:14216:0:(service.c:3183:ptlrpc_main()) ll_mgs_0001: service thread [ffff9fe9cb2f5800:14216] 1 exiting: rc = 0 00000020:00010000:1.0:1783135097.170817:0:14211:0:(genops.c:1928:obd_stale_export_get()) Get export ffff9fe8c57df800: total 1 00010000:00010000:1.0:1783135097.170822:0:14211:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783135097.170849:0:14211:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff9fe8c57df800, canceled 0 locks, left on hash table 8. 00010000:00010000:1.0:1783135097.170874:0:14211:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fe9fe43e600/0xd6c4b8f05867f716 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xd6c4b8f05867f70f expref: 9 pid: 14215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135097.170889:0:14211:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fe9fe43fc00/0xd6c4b8f05867f708 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xd6c4b8f05867f701 expref: 8 pid: 14216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135097.170904:0:14211:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fe9f68ac600/0xd6c4b8f05867f851 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xd6c4b8f05867f84a expref: 7 pid: 14215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135097.170913:0:14211:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fe9f68ad600/0xd6c4b8f05867f740 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xd6c4b8f05867f739 expref: 6 pid: 14217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135097.170923:0:14211:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fe9fe43e800/0xd6c4b8f05867f5f0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xd6c4b8f05867f5e9 expref: 5 pid: 14216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135097.170942:0:14211:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fe8c5550c00/0xd6c4b8f05867fa0a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xd6c4b8f05867fa03 expref: 4 pid: 14216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135097.170952:0:14211:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fe8c5550600/0xd6c4b8f05867fa18 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xd6c4b8f05867fa11 expref: 3 pid: 14215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135097.170963:0:14211:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fe9c7828e00/0xd6c4b8f05867f87b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xd6c4b8f05867f874 expref: 2 pid: 14215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135097.170974:0:14211:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff9fe8c57df800, canceled 8 locks, left on hash table 0. 00000020:00000080:1.0:1783135097.170986:0:14211:0:(genops.c:906:class_export_put()) final put ffff9fe8c57df800/c1fe35bd-99cf-438e-8ada-ed586b673efa 00000020:00000080:2.0:1783135097.171007:0:483:0:(genops.c:865:class_export_destroy()) destroying export ffff9fea01d1f800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:00010000:1.0:1783135097.171068:0:14211:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783135097.171070:0:14211:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783135097.171072:0:14211:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1783135097.171092:0:483:0:(genops.c:865:class_export_destroy()) destroying export ffff9fe8c57df800/c1fe35bd-99cf-438e-8ada-ed586b673efa for MGS 00000020:00000080:2.0:1783135097.171177:0:483:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9fe8c57da000 for MGS 00000100:00100000:0.0:1783135097.172126:0:14217:0:(service.c:3183:ptlrpc_main()) ll_mgs_0002: service thread [ffff9fe8c4e59000:14217] 2 exiting: rc = 0 00000100:00100000:3.0:1783135097.300945:0:16902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783135097.300956:0:16902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783135097.300964:0:16902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783135097.300970:0:16902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783135097.300977:0:16902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783135097.300983:0:16902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783135097.302090:0:16902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783135097.302451:0:16902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783135097.302832:0:16902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783135097.302839:0:16902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783135097.302845:0:16902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783135097.302851:0:16902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783135097.303004:0:16902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783135097.303098:0:16902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783135097.303264:0:16902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783135097.303800:0:16902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783135097.304165:0:16902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783135097.305146:0:16902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783135097.305152:0:16902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783135097.305157:0:16902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783135097.305163:0:16902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783135097.305798:0:16902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783135097.305811:0:16902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783135097.305817:0:16902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783135097.305822:0:16902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783135097.305827:0:16902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783135097.305833:0:16902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783135097.305838:0:16902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783135097.305843:0:16902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783135097.305849:0:16902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783135097.305855:0:16902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783135097.305860:0:16902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783135097.306200:0:16902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783135097.306666:0:16902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783135097.306673:0:16902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783135097.306679:0:16902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783135097.306685:0:16902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783135097.306691:0:16902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783135097.306697:0:16902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783135097.306703:0:16902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783135097.307215:0:16902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783135097.307228:0:16902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783135097.307825:0:16902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783135097.307850:0:16902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783135097.307855:0:16902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783135097.307860:0:16902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783135097.307867:0:16902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783135097.307873:0:16902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783135097.308123:0:16902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783135097.308131:0:16902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783135097.308136:0:16902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783135097.308141:0:16902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783135097.308146:0:16902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783135097.308151:0:16902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783135097.308161:0:16902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783135097.308168:0:16902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783135097.308177:0:16902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783135097.308187:0:16902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783135097.308196:0:16902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783135097.308207:0:16902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783135097.308217:0:16902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783135097.308226:0:16902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783135097.308238:0:16902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783135097.308249:0:16902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 20000000:01000000:3.0:1783135097.308960:0:16902:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:3.0:1783135097.308964:0:16902:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 00000020:01000000:3.0:1783135097.312152:0:16902:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9fe9f43fa180 - data ffff9fe9d8faf870/ffff9fe8c58b8c00 00000020:01000000:3.0:1783135097.312427:0:16902:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9fe9ea7cbc00 - data ffff9fe9d8f5d000/ffff9fe9f665ac00 00000020:00000080:3.0:1783135097.313999:0:16902:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xd6c4b8f05867f5c6 00000020:00000080:3.0:1783135097.314136:0:16902:0:(genops.c:906:class_export_put()) final put ffff9fe9f6f88000/lustre-MDT0000-osd_UUID 00000020:01000004:3.0:1783135097.314199:0:16902:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9fe9f6f8d000 from MGS, refs=2 00000020:01000004:3.0:1783135097.314206:0:16902:0:(obd_mount.c:701:lustre_put_lsi()) put ffff9fe9f6f8d000 2 00000020:01000004:3.0:1783135097.314209:0:16902:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9fe9f6f8d000 from MGS 00000020:00000080:3.0:1783135097.314255:0:16902:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1783135097.314265:0:16902:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:3.0:1783135097.314267:0:16902:0:(genops.c:906:class_export_put()) final put ffff9fe9f6f8c000/MGS 00000020:00000080:3.0:1783135097.314273:0:16902:0:(genops.c:865:class_export_destroy()) destroying export ffff9fe9f6f8c000/MGS for MGS 00000020:01000000:3.0:1783135097.314304:0:16902:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:3.0:1783135097.314409:0:16902:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:3.0:1783135097.314413:0:16902:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1783135097.314418:0:16902:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1783135097.314424:0:16902:0:(genops.c:1840:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff9fe9f6a14000 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1783135097.314433:0:16902:0:(genops.c:1574:class_disconnect_exports()) OBD device 10 (ffff9fe8c57c4d40) has exports, disconnecting them 00000020:00080000:3.0:1783135097.314438:0:16902:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff9fe9f6a14000), last request at 1783135039 00000020:00000080:3.0:1783135097.314442:0:16902:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xd6c4b8f05867f6b4 00000020:00080000:3.0:1783135097.314452:0:16902:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9fe9f6a14000): rc 0 00000020:00000080:3.0:1783135097.314459:0:16902:0:(genops.c:906:class_export_put()) final put ffff9fe9f6a14000/lustre-MDT0000-lwp-MDT0000 00000020:00000080:2.0:1783135097.315141:0:483:0:(genops.c:865:class_export_destroy()) destroying export ffff9fe9f6f88000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1783135097.315427:0:483:0:(genops.c:865:class_export_destroy()) destroying export ffff9fe9f6a14000/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:3.0:1783135097.316421:0:16902:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:3.0:1783135097.316429:0:16902:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1783135097.316434:0:16902:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:3.0:1783135097.316438:0:16902:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1783135097.316682:0:16902:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1783135097.316690:0:16902:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:3.0:1783135097.316697:0:16902:0:(obd_mount.c:701:lustre_put_lsi()) put ffff9fe9f6f8d000 1 00000020:00000080:3.0:1783135097.316706:0:16902:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xd6c4b8f05867f5b8 00000020:00000080:3.0:1783135097.316713:0:16902:0:(genops.c:906:class_export_put()) final put ffff9fe9f6f8a000/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1783135097.317262:0:483:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9fe9f6a13000 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:2.0:1783135097.317275:0:483:0:(genops.c:906:class_export_put()) final put ffff9fe9e013b800/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:2.0:1783135097.317305:0:483:0:(genops.c:865:class_export_destroy()) destroying export ffff9fe9e013b800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:2.0:1783135097.317312:0:483:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000000:3.0:1783135097.317557:0:16902:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:3.0:1783135097.317565:0:16902:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1783135097.317576:0:16902:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1783135097.317582:0:16902:0:(genops.c:1579:class_disconnect_exports()) OBD device 0 (ffff9fe9d0e80000) has no exports 00000020:00000080:2.0:1783135097.321226:0:483:0:(genops.c:865:class_export_destroy()) destroying export ffff9fe9f6f8a000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1783135097.335417:0:16902:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1783135097.335435:0:16902:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:1.0:1783135097.335441:0:16902:0:(genops.c:906:class_export_put()) final put ffff9fe9f6f8d800/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1783135097.335446:0:16902:0:(genops.c:865:class_export_destroy()) destroying export ffff9fe9f6f8d800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:1.0:1783135097.335458:0:16902:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:1.0:1783135097.335684:0:16902:0:(obd_mount.c:659:lustre_free_lsi()) Freeing lsi ffff9fe9f6f8f000 00000020:01000000:1.0:1783135097.335719:0:16902:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:1.0:1783135097.335726:0:16902:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1783135097.335733:0:16902:0:(obd_config.c:955:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1783135097.335739:0:16902:0:(genops.c:1579:class_disconnect_exports()) OBD device 3 (ffff9fe9d0e819c0) has no exports 00000100:00100000:1.0:1783135097.335840:0:14222:0:(service.c:3183:ptlrpc_main()) mdt00_000: service thread [ffff9fe9d13f9e00:14222] 0 exiting: rc = 1 00000100:00100000:1.0:1783135097.336588:0:14224:0:(service.c:3183:ptlrpc_main()) mdt00_002: service thread [ffff9fe9e2ebfe00:14224] 2 exiting: rc = 0 00000100:00100000:3.0:1783135097.337374:0:16395:0:(service.c:3183:ptlrpc_main()) mdt00_003: service thread [ffff9fe9d1377000:16395] 3 exiting: rc = 0 00000100:00100000:2.0:1783135097.341910:0:14223:0:(service.c:3183:ptlrpc_main()) mdt00_001: service thread [ffff9fe9e2ebfa00:14223] 1 exiting: rc = 0 00000100:00100000:1.0:1783135097.342126:0:16902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135097.342134:0:16902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135097.342140:0:16902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135097.342146:0:16902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135097.342165:0:16902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135097.342170:0:16902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135097.342180:0:16902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135097.342191:0:16902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135097.342200:0:16902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135097.342208:0:16902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135097.342219:0:16902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135097.342227:0:16902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135097.342239:0:16902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135097.342248:0:16902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135097.342260:0:16902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135097.342272:0:16902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135097.342304:0:16902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135097.342314:0:16902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135097.342325:0:16902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135097.342336:0:16902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135097.342348:0:16902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135097.342357:0:16902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135097.342368:0:16902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135097.342377:0:16902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135097.342388:0:16902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135097.342397:0:16902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135097.342404:0:16902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135097.342409:0:16902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135097.342414:0:16902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135097.342420:0:16902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135097.342429:0:16902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135097.342435:0:16902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135097.342440:0:16902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135097.342446:0:16902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135097.342455:0:16902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135097.342464:0:16902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135097.342473:0:16902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135097.342481:0:16902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135097.342491:0:16902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135097.342518:0:16902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135097.342537:0:16902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135097.342547:0:16902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135097.342559:0:16902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135097.342568:0:16902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135097.342577:0:16902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135097.342589:0:16902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135097.342599:0:16902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135097.342607:0:16902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135097.342619:0:16902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135097.342628:0:16902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135097.342639:0:16902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135097.342648:0:16902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135097.342656:0:16902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135097.342664:0:16902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135097.342675:0:16902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135097.342683:0:16902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135097.342692:0:16902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135097.342703:0:16902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135097.342712:0:16902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135097.342721:0:16902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135097.342731:0:16902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135097.342740:0:16902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135097.342749:0:16902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135097.342760:0:16902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135097.348830:0:14226:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_001: service thread [ffff9fe9c9da8e00:14226] 1 exiting: rc = 0 00000100:00100000:0.0:1783135097.349014:0:14225:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_000: service thread [ffff9fea01d20000:14225] 0 exiting: rc = 1 00000100:00100000:3.0:1783135097.349906:0:16002:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_002: service thread [ffff9fe9c8e05400:16002] 2 exiting: rc = 0 00000100:00100000:1.0:1783135097.350271:0:16902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135097.350402:0:16902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135097.350410:0:16902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135097.350415:0:16902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135097.350420:0:16902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135097.350430:0:16902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135097.350436:0:16902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135097.350442:0:16902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135097.350447:0:16902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135097.350638:0:16902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135097.350663:0:16902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135097.350674:0:16902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135097.350682:0:16902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135097.350691:0:16902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135097.350701:0:16902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135097.350710:0:16902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135097.350718:0:16902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135097.350729:0:16902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135097.350737:0:16902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135097.350746:0:16902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135097.350753:0:16902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135097.350762:0:16902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135097.350773:0:16902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135097.350780:0:16902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135097.350789:0:16902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135097.350794:0:16902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135097.350799:0:16902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135097.350807:0:16902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135097.350812:0:16902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135097.350817:0:16902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135097.350823:0:16902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135097.350828:0:16902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135097.350833:0:16902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135097.350838:0:16902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135097.350843:0:16902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135097.350851:0:16902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135097.350860:0:16902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135097.350868:0:16902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135097.350880:0:16902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135097.350888:0:16902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135097.350896:0:16902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135097.350907:0:16902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135097.350916:0:16902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135097.350924:0:16902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135097.350932:0:16902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135097.350953:0:16902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135097.350964:0:16902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135097.350972:0:16902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135097.350980:0:16902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135097.350987:0:16902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135097.350998:0:16902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135097.351006:0:16902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135097.351013:0:16902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135097.351021:0:16902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135097.351032:0:16902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135097.351040:0:16902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135097.351048:0:16902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135097.351056:0:16902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135097.351064:0:16902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135097.351072:0:16902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135097.351082:0:16902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135097.351090:0:16902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135097.351095:0:16902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135097.351101:0:16902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135097.352119:0:14227:0:(service.c:3183:ptlrpc_main()) mdt_out00_000: service thread [ffff9fe9e03b1200:14227] 0 exiting: rc = 1 00000100:00100000:2.0:1783135097.352907:0:14228:0:(service.c:3183:ptlrpc_main()) mdt_out00_001: service thread [ffff9fe9e03b1800:14228] 1 exiting: rc = 0 00000100:00100000:1.0:1783135097.353049:0:16902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135097.353064:0:16902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135097.353076:0:16902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135097.353085:0:16902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135097.353092:0:16902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135097.353106:0:16902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135097.353116:0:16902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135097.353124:0:16902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135097.353129:0:16902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135097.353135:0:16902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135097.353140:0:16902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135097.353146:0:16902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135097.353166:0:16902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135097.353174:0:16902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135097.353179:0:16902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135097.353195:0:16902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135097.353201:0:16902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135097.353207:0:16902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135097.353217:0:16902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135097.353225:0:16902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135097.353237:0:16902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135097.353246:0:16902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135097.353254:0:16902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135097.353263:0:16902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135097.353328:0:16902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135097.353338:0:16902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135097.353349:0:16902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135097.353358:0:16902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135097.353367:0:16902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135097.353379:0:16902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135097.353387:0:16902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135097.353399:0:16902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135097.353406:0:16902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135097.353411:0:16902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135097.353418:0:16902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135097.353427:0:16902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135097.353451:0:16902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135097.353464:0:16902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135097.353473:0:16902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135097.353485:0:16902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135097.353494:0:16902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135097.353524:0:16902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135097.353533:0:16902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135097.353544:0:16902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135097.353554:0:16902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135097.353567:0:16902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135097.353579:0:16902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135097.353590:0:16902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135097.353623:0:16902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135097.353636:0:16902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135097.353656:0:16902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135097.353664:0:16902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135097.353676:0:16902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135097.353685:0:16902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135097.353697:0:16902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135097.353706:0:16902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135097.353715:0:16902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135097.353724:0:16902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135097.353736:0:16902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135097.353745:0:16902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135097.353775:0:16902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135097.353788:0:16902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135097.353795:0:16902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135097.353801:0:16902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135097.364463:0:14229:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0000: service thread [ffff9fe9d281a800:14229] 0 exiting: rc = 1 00000100:00100000:1.0:1783135097.364685:0:14230:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0001: service thread [ffff9fe9d281a200:14230] 1 exiting: rc = 0 00000100:00100000:1.0:1783135097.364744:0:16902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135097.364751:0:16902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135097.364756:0:16902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135097.364761:0:16902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135097.364765:0:16902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135097.364770:0:16902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135097.364775:0:16902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135097.364779:0:16902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135097.364784:0:16902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135097.364788:0:16902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135097.364792:0:16902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135097.364797:0:16902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135097.364802:0:16902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135097.364807:0:16902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135097.364812:0:16902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135097.364816:0:16902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135097.364820:0:16902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135097.364825:0:16902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135097.364829:0:16902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135097.364834:0:16902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135097.364852:0:16902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135097.364856:0:16902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135097.364861:0:16902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135097.364866:0:16902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135097.364870:0:16902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135097.364875:0:16902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135097.364879:0:16902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135097.364884:0:16902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135097.364889:0:16902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135097.364894:0:16902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135097.364898:0:16902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135097.364903:0:16902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135097.364908:0:16902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135097.364913:0:16902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135097.364917:0:16902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135097.364922:0:16902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135097.364928:0:16902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135097.364933:0:16902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135097.364938:0:16902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135097.364965:0:16902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135097.364971:0:16902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135097.364975:0:16902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135097.364980:0:16902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135097.364987:0:16902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135097.364992:0:16902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135097.364997:0:16902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135097.365001:0:16902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135097.365006:0:16902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135097.365010:0:16902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135097.365018:0:16902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135097.365022:0:16902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135097.365027:0:16902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135097.365031:0:16902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135097.365035:0:16902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135097.365040:0:16902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135097.365051:0:16902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135097.365055:0:16902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135097.365060:0:16902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135097.365064:0:16902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135097.365069:0:16902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135097.365076:0:16902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135097.365081:0:16902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135097.365085:0:16902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135097.365090:0:16902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135097.365913:0:14232:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0001: service thread [ffff9fe9d281ae00:14232] 1 exiting: rc = 0 00000100:00100000:1.0:1783135097.366066:0:14231:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0000: service thread [ffff9fe9d281bc00:14231] 0 exiting: rc = 1 00000100:00100000:1.0:1783135097.366109:0:16902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135097.366115:0:16902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135097.366120:0:16902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135097.366126:0:16902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135097.366131:0:16902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135097.366136:0:16902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135097.366140:0:16902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135097.366145:0:16902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135097.366151:0:16902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135097.366156:0:16902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135097.366161:0:16902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135097.366166:0:16902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135097.366176:0:16902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135097.366184:0:16902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135097.366188:0:16902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135097.366196:0:16902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135097.366201:0:16902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135097.366205:0:16902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135097.366210:0:16902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135097.366217:0:16902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135097.366222:0:16902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135097.366226:0:16902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135097.366231:0:16902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135097.366235:0:16902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135097.366239:0:16902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135097.366250:0:16902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135097.366255:0:16902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135097.366259:0:16902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135097.366264:0:16902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135097.366271:0:16902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135097.366276:0:16902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135097.366296:0:16902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135097.366301:0:16902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135097.366305:0:16902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135097.366309:0:16902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135097.366314:0:16902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135097.366318:0:16902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135097.366323:0:16902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135097.366328:0:16902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135097.366333:0:16902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135097.366337:0:16902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135097.366342:0:16902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135097.366346:0:16902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135097.366351:0:16902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135097.366355:0:16902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135097.366360:0:16902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135097.366364:0:16902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135097.366367:0:16902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135097.366371:0:16902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135097.366375:0:16902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135097.366380:0:16902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135097.366384:0:16902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135097.366388:0:16902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135097.366393:0:16902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135097.366397:0:16902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135097.366401:0:16902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135097.366405:0:16902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135097.366409:0:16902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135097.366414:0:16902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135097.366418:0:16902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135097.366429:0:16902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135097.366434:0:16902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135097.366439:0:16902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135097.366443:0:16902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135097.366689:0:14233:0:(service.c:3183:ptlrpc_main()) mdt_fld_0000: service thread [ffff9fe9d281ac00:14233] 0 exiting: rc = 1 00000100:00100000:2.0:1783135097.366826:0:14234:0:(service.c:3183:ptlrpc_main()) mdt_fld_0001: service thread [ffff9fe9d281a000:14234] 1 exiting: rc = 0 00000100:00100000:1.0:1783135097.366941:0:16902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135097.366946:0:16902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135097.366951:0:16902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135097.366956:0:16902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135097.366966:0:16902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135097.366971:0:16902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135097.366975:0:16902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135097.366980:0:16902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135097.366984:0:16902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135097.366989:0:16902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135097.366994:0:16902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135097.366999:0:16902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135097.367003:0:16902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135097.367008:0:16902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135097.367012:0:16902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135097.367017:0:16902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135097.367021:0:16902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135097.367026:0:16902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135097.367030:0:16902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135097.367035:0:16902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135097.367038:0:16902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135097.367046:0:16902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135097.367050:0:16902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135097.367054:0:16902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135097.367058:0:16902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135097.367062:0:16902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135097.367065:0:16902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135097.367070:0:16902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135097.367074:0:16902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135097.367079:0:16902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135097.367090:0:16902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135097.367095:0:16902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135097.367100:0:16902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135097.367105:0:16902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135097.367110:0:16902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135097.367114:0:16902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135097.367118:0:16902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135097.367123:0:16902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135097.367127:0:16902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135097.367132:0:16902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135097.367136:0:16902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135097.367141:0:16902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135097.367146:0:16902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135097.367151:0:16902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135097.367156:0:16902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135097.367161:0:16902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135097.367165:0:16902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135097.367170:0:16902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135097.367174:0:16902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135097.367179:0:16902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135097.367184:0:16902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135097.367189:0:16902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135097.367194:0:16902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135097.367199:0:16902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135097.367207:0:16902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135097.367215:0:16902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135097.367221:0:16902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135097.367226:0:16902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135097.367230:0:16902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135097.367235:0:16902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135097.367242:0:16902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135097.367246:0:16902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135097.367251:0:16902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135097.367255:0:16902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135097.368008:0:14235:0:(service.c:3183:ptlrpc_main()) mdt_io00_000: service thread [ffff9fe9ca6c7000:14235] 0 exiting: rc = 1 00000100:00100000:1.0:1783135097.368206:0:14236:0:(service.c:3183:ptlrpc_main()) mdt_io00_001: service thread [ffff9fe9ca6c7800:14236] 1 exiting: rc = 0 00000100:00100000:1.0:1783135097.368384:0:14237:0:(service.c:3183:ptlrpc_main()) mdt_io00_002: service thread [ffff9fe9ca6c7a00:14237] 2 exiting: rc = 0 00000100:00100000:1.0:1783135097.368430:0:16902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135097.368436:0:16902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135097.368448:0:16902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135097.368454:0:16902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135097.368459:0:16902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135097.368464:0:16902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135097.368469:0:16902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135097.368473:0:16902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135097.368478:0:16902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135097.368484:0:16902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135097.368488:0:16902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135097.368520:0:16902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135097.368525:0:16902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135097.368531:0:16902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135097.368536:0:16902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135097.368541:0:16902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135097.368547:0:16902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135097.368552:0:16902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135097.368557:0:16902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135097.368561:0:16902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135097.368566:0:16902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135097.368571:0:16902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135097.368575:0:16902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135097.368579:0:16902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135097.368584:0:16902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135097.368591:0:16902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135097.368597:0:16902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135097.368602:0:16902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135097.368608:0:16902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135097.368613:0:16902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135097.368619:0:16902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135097.368624:0:16902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135097.368629:0:16902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135097.368634:0:16902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135097.368646:0:16902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135097.368662:0:16902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135097.368669:0:16902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135097.368675:0:16902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135097.368679:0:16902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135097.368684:0:16902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135097.368690:0:16902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135097.368695:0:16902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135097.368699:0:16902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135097.368704:0:16902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135097.368708:0:16902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135097.368713:0:16902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135097.368718:0:16902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135097.368723:0:16902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135097.368727:0:16902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135097.368732:0:16902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135097.368737:0:16902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135097.368742:0:16902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135097.368747:0:16902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135097.368752:0:16902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135097.368756:0:16902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135097.368761:0:16902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135097.368765:0:16902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135097.368770:0:16902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135097.368846:0:16902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135097.368851:0:16902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135097.368855:0:16902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135097.368861:0:16902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135097.368866:0:16902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135097.368879:0:16902:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:1.0:1783135097.376151:0:16902:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1783135097.376163:0:16902:0:(obd_config.c:883:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:1.0:1783135097.376169:0:16902:0:(genops.c:906:class_export_put()) final put ffff9fe9dff18800/MDS_uuid 00000020:00000080:1.0:1783135097.376173:0:16902:0:(genops.c:865:class_export_destroy()) destroying export ffff9fe9dff18800/MDS_uuid for MDS 00000020:01000000:1.0:1783135097.376180:0:16902:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:1.0:1783135097.376334:0:16902:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-MDT0000 complete 00010000:00010000:0.0:1783135097.511895:0:14210:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783135098.568308:0:15220:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783135099.567711:0:3287:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9f6fe4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c1fe35bd-99cf-438e-8ada-ed586b673efa:3287:1869752384455296:0@lo:400:kworker.0 00000400:00000100:2.0:1783135099.567764:0:3287:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1869752384455296 offset 0 length 224: 4 00000100:00100000:2.0:1783135099.567823:0:3288:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9f6fe5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3288:1869752384455424:0@lo:400:kworker.0 00000400:00000100:2.0:1783135099.567845:0:3288:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1869752384455424 offset 0 length 224: 4 00000100:00100000:2.0:1783135099.567858:0:3288:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1783135099.567863:0:3288:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9f6fe5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3288:1869752384455552:0@lo:400:kworker.0 00000400:00000100:2.0:1783135099.567877:0:3288:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1869752384455552 offset 0 length 224: 4 00010000:00010000:0.0:1783135099.591975:0:14211:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1783135100.110086:0:7470:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1783135100.110095:0:7470:0:(genops.c:906:class_export_put()) final put ffff9fe9c8f8d800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1783135100.110339:0:483:0:(genops.c:865:class_export_destroy()) destroying export ffff9fe9c8f8d800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:2.0:1783135100.110384:0:483:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9fe9c8f8f000 for lustre-OST0001 00000001:00100000:0.0:1783135100.116622:0:6602:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1783135100.116637:0:6602:0:(genops.c:906:class_export_put()) final put ffff9fe9f6a11800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1783135100.116787:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9fe9f6a11800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:2.0:1783135100.116836:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9fe9f6a10800 for lustre-OST0000 00010000:00010000:1.0:1783135100.619023:0:14210:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783135101.643111:0:15220:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1783135101.688319:0:17054:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:0.0:1783135101.708297:0:17054:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-OST0000 00010000:00010000:0.0:1783135101.708349:0:17054:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.141@tcp lock: ffff9fe9d2b75c00/0xd6c4b8f05867f739 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xd6c4b8f05867f740 expref: -99 pid: 14857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135101.708368:0:17054:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.141@tcp lock: ffff9fe9d2b75c00/0xd6c4b8f05867f739 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xd6c4b8f05867f740 expref: -99 pid: 14857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135101.708376:0:17054:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.141@tcp lock: ffff9fe9d2b75c00/0xd6c4b8f05867f739 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0xd6c4b8f05867f740 expref: -99 pid: 14857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135101.708382:0:17054:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.141@tcp lock: ffff9fe9d2b75c00/0xd6c4b8f05867f739 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0xd6c4b8f05867f740 expref: -99 pid: 14857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135101.708407:0:17054:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1783135101.708412:0:17054:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:0.0:1783135101.708439:0:17054:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1783135101.708456:0:17054:0:(client.c:3588:ptlrpc_abort_inflight()) @@@ inflight req@ffff9fe9f6fe5880 x1869752384455424/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783135115 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783135101.708474:0:17054:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:0.0:1783135101.708478:0:17054:0:(pinger.c:400:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1783135101.708500:0:17054:0:(import.c:65:import_set_state_nolock()) ffff9fe9e0d13000 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:2.0:1783135101.708686:0:3285:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9fe8ff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3285:1869752384455680:0@lo:39:umount.0 00000400:00000100:2.0:1783135101.708906:0:3285:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1869752384455680 offset 0 length 224: 4 00000100:00100000:3.0:1783135101.710094:0:3288:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9f6fe5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3288:1869752384455424:0@lo:400:kworker.0 00010000:00010000:1.0:1783135101.713710:0:14211:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783135101.713736:0:14211:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.141@tcp lock: ffff9fe9d2b75c00/0xd6c4b8f05867f739 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0xd6c4b8f05867f740 expref: -99 pid: 14857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135101.713750:0:14211:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe9d2b75c00 already unused, calling callback (ffffffffc1b40c20) 10000000:00010000:1.0:1783135101.713755:0:14211:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.141@tcp lock: ffff9fe9d2b75c00/0xd6c4b8f05867f739 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0xd6c4b8f05867f740 expref: -99 pid: 14857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135101.713768:0:14211:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.141@tcp lock: ffff9fe9d2b75c00/0xd6c4b8f05867f739 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1008400000000 nid: local remote: 0xd6c4b8f05867f740 expref: -99 pid: 14857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783135101.713777:0:14211:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.141@tcp lock: ffff9fe9d2b75c00/0xd6c4b8f05867f739 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1009400000000 nid: local remote: 0xd6c4b8f05867f740 expref: -99 pid: 14857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783135101.713783:0:14211:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1783135101.713787:0:14211:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:1.0:1783135101.713790:0:14211:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:1.0:1783135101.713837:0:14211:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.141@tcp lock: ffff9fe9d2b75c00/0xd6c4b8f05867f739 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0xd6c4b8f05867f740 expref: -99 pid: 14857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135101.713844:0:14211:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1783135101.713874:0:14211:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.141@tcp lock: ffff9fe9d2b75c00/0xd6c4b8f05867f739 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0xd6c4b8f05867f740 expref: -99 pid: 14857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135101.713881:0:14211:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.141@tcp lock: ffff9fe9d2b75c00/0xd6c4b8f05867f739 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0xd6c4b8f05867f740 expref: -99 pid: 14857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135101.713895:0:14211:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783135101.713897:0:14211:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783135101.713913:0:14211:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783135101.714132:0:3286:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe8c590f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c1fe35bd-99cf-438e-8ada-ed586b673efa:3286:1869752384455808:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1783135101.714209:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135101.714943:0:14209:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384455808 00000100:00100000:0.0:1783135101.714952:0:14209:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384455808 00000100:00100000:0.0:1783135101.714991:0:14209:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1783135101.714998:0:14209:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9f6fe4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3286:x1869752384455808:12345-0@lo:103:ldlm_bl.0 00010000:00020000:0.0:1783135101.715005:0:14209:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1783135101 with bad export cookie 15475697561966736859 00000100:00100000:0.0:1783135101.741959:0:14209:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9f6fe4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3286:x1869752384455808:12345-0@lo:103:ldlm_bl.0 Request processed in 26951us (27741us total) trans 0 rc -107/-107 00000100:00100000:0.0:1783135101.741991:0:14209:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00080000:3.0:1783135101.744546:0:3286:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.201.141@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1783135101.744554:0:3286:0:(import.c:65:import_set_state_nolock()) ffff9fe8c57da800 MGS: changing import state from FULL to DISCONN 00000100:02020000:3.0:1783135101.744573:0:3286:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.201.141@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00000100:00080000:3.0:1783135101.750168:0:3286:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.201.141@tcp not replayable, auto-deactivating 00000100:00080000:3.0:1783135101.750174:0:3286:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:3.0:1783135101.750184:0:3286:0:(client.c:3588:ptlrpc_abort_inflight()) @@@ inflight req@ffff9fe9f6fe4e00 x1869752384455296/t0(0) o400->MGC192.168.201.141@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1783135115 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783135101.750207:0:3286:0:(client.c:3588:ptlrpc_abort_inflight()) @@@ inflight req@ffff9fe8c590f480 x1869752384455808/t0(0) o103->MGC192.168.201.141@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1783135117 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 10000000:01000000:3.0:1783135101.750215:0:3286:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:3.0:1783135101.750218:0:3286:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:3.0:1783135101.750219:0:3286:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:3.0:1783135101.750223:0:3286:0:(import.c:65:import_set_state_nolock()) ffff9fe8c57da800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1783135101.750227:0:3286:0:(import.c:512:import_select_connection()) MGC192.168.201.141@tcp: connect to NID 0@lo last attempt 321 00000100:00080000:3.0:1783135101.750236:0:3286:0:(import.c:626:import_select_connection()) MGC192.168.201.141@tcp: import ffff9fe8c57da800 using connection 192.168.201.141@tcp/0@lo 00000100:00100000:2.0:1783135101.750503:0:3287:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9f6fe4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c1fe35bd-99cf-438e-8ada-ed586b673efa:3287:1869752384455296:0@lo:400:kworker.0 00000100:00100000:2.0:1783135101.751040:0:3286:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9fe9f6fe4e00 x1869752384455936/t0(0) o250->MGC192.168.201.141@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1783135101.751456:0:3285:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9f6fe4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c1fe35bd-99cf-438e-8ada-ed586b673efa:3285:1869752384455936:0@lo:250:ptlrpcd_00_00.0 00000400:00000100:3.0:1783135101.751514:0:3285:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1869752384455936 offset 0 length 520: 4 00000100:00100000:3.0:1783135101.751598:0:3286:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe8c590f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c1fe35bd-99cf-438e-8ada-ed586b673efa:3286:1869752384455808:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1783135102.659921:0:14210:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783135103.683490:0:15220:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1783135104.689639:0:36:0:(pinger.c:231:ptlrpc_pinger_process_import()) c1fe35bd-99cf-438e-8ada-ed586b673efa->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1783135104.689651:0:36:0:(pinger.c:249:ptlrpc_pinger_process_import()) c1fe35bd-99cf-438e-8ada-ed586b673efa->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1783135104.689735:0:3287:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9fe8fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3287:1869752384456064:0@lo:400:kworker.0 00000400:00000100:2.0:1783135104.689790:0:3287:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1869752384456064 offset 0 length 224: 4 00010000:00010000:1.0:1783135104.777541:0:14211:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783135105.795623:0:14210:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1783135106.692797:0:36:0:(pinger.c:231:ptlrpc_pinger_process_import()) c1fe35bd-99cf-438e-8ada-ed586b673efa->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1783135106.692815:0:36:0:(pinger.c:249:ptlrpc_pinger_process_import()) c1fe35bd-99cf-438e-8ada-ed586b673efa->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1783135106.692958:0:3288:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9fe8fc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3288:1869752384456192:0@lo:400:kworker.0 00000400:00000100:3.0:1783135106.693076:0:3288:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1869752384456192 offset 0 length 224: 4 00010000:00010000:0.0:1783135106.820600:0:15220:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783135107.848494:0:14211:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783135108.868420:0:14210:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783135110.022397:0:15220:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783135111.043646:0:14211:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783135111.299431:0:3285:0:(client.c:2489:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1783135101/real 1783135101] req@ffff9fe9f6fe4e00 x1869752384455936/t0(0) o250->MGC192.168.201.141@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1783135111 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'ptlrpcd_00_00.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783135111.299471:0:3285:0:(client.c:2520:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9fe9f6fe4e00 x1869752384455936/t0(0) o250->MGC192.168.201.141@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1783135111 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'ptlrpcd_00_00.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783135111.299482:0:3285:0:(client.c:2489:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1783135101/real 1783135101] req@ffff9fe9fe8ff100 x1869752384455680/t0(0) o39->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1783135111 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783135111.299494:0:3285:0:(client.c:2520:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9fe9fe8ff100 x1869752384455680/t0(0) o39->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1783135111 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1783135111.299530:0:3285:0:(import.c:65:import_set_state_nolock()) ffff9fe8c57da800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1783135111.299555:0:3285:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:3.0:1783135111.299559:0:3285:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9f6fe4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c1fe35bd-99cf-438e-8ada-ed586b673efa:3285:1869752384455936:0@lo:250:ptlrpcd_00_00.0 00000100:00080000:3.0:1783135111.299565:0:3285:0:(import.c:65:import_set_state_nolock()) ffff9fe9e0d13000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:3.0:1783135111.299589:0:3285:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9fe8ff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3285:1869752384455680:0@lo:39:umount.0 00000100:00080000:1.0:1783135111.299615:0:17054:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1783135111.299621:0:17054:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:1.0:1783135111.299626:0:17054:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:1.0:1783135111.300636:0:17054:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.141@tcp lock: ffff9fe9c7829600/0xd6c4b8f05867f70f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xd6c4b8f05867f716 expref: -99 pid: 14857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135111.300649:0:17054:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.141@tcp lock: ffff9fe9c7829600/0xd6c4b8f05867f70f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xd6c4b8f05867f716 expref: -99 pid: 14857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135111.300656:0:17054:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.141@tcp lock: ffff9fe9c7829600/0xd6c4b8f05867f70f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xd6c4b8f05867f716 expref: -99 pid: 14857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135111.300662:0:17054:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.141@tcp lock: ffff9fe9c7829600/0xd6c4b8f05867f70f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xd6c4b8f05867f716 expref: -99 pid: 14857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135111.300692:0:17054:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783135111.300698:0:17054:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.141@tcp lock: ffff9fe9c0030800/0xd6c4b8f05867fa11 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd6c4b8f05867fa18 expref: -99 pid: 14219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135111.300703:0:17054:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.141@tcp lock: ffff9fe9c0030800/0xd6c4b8f05867fa11 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xd6c4b8f05867fa18 expref: -99 pid: 14219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135111.300709:0:17054:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.141@tcp lock: ffff9fe9c0030800/0xd6c4b8f05867fa11 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xd6c4b8f05867fa18 expref: -99 pid: 14219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135111.300725:0:17054:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.141@tcp lock: ffff9fe9c0030800/0xd6c4b8f05867fa11 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xd6c4b8f05867fa18 expref: -99 pid: 14219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135111.300744:0:17054:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:1.0:1783135111.300748:0:17054:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00000020:01000004:1.0:1783135111.300820:0:17054:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-OST0000 00000020:01000000:1.0:1783135111.300825:0:17054:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='F') 00000020:00000080:1.0:1783135111.300829:0:17054:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1783135111.300833:0:17054:0:(obd_config.c:955:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1783135111.300837:0:17054:0:(genops.c:1579:class_disconnect_exports()) OBD device 13 (ffff9fe8c57c3380) has no exports 00000020:00080000:1.0:1783135111.300860:0:17054:0:(genops.c:1579:class_disconnect_exports()) OBD device 13 (ffff9fe8c57c3380) has no exports 00010000:00010000:3.0:1783135111.301074:0:15220:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1783135111.301080:0:15220:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.141@tcp lock: ffff9fe9c7829600/0xd6c4b8f05867f70f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xd6c4b8f05867f716 expref: -99 pid: 14857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135111.301087:0:15220:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe9c7829600 already unused, calling callback (ffffffffc1b40c20) 10000000:00010000:3.0:1783135111.301091:0:15220:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.141@tcp lock: ffff9fe9c7829600/0xd6c4b8f05867f70f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xd6c4b8f05867f716 expref: -99 pid: 14857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135111.301102:0:15220:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.141@tcp lock: ffff9fe9c7829600/0xd6c4b8f05867f70f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0xd6c4b8f05867f716 expref: -99 pid: 14857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1783135111.301108:0:15220:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.141@tcp lock: ffff9fe9c7829600/0xd6c4b8f05867f70f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0xd6c4b8f05867f716 expref: -99 pid: 14857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783135111.301113:0:15220:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1783135111.301116:0:15220:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 10000000:01000000:3.0:1783135111.301118:0:15220:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 00010000:00010000:3.0:1783135111.301130:0:15220:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9fe8c57da800 00010000:00010000:3.0:1783135111.301133:0:15220:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.141@tcp lock: ffff9fe9c7829600/0xd6c4b8f05867f70f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0xd6c4b8f05867f716 expref: -99 pid: 14857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135111.301139:0:15220:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.141@tcp lock: ffff9fe9c7829600/0xd6c4b8f05867f70f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0xd6c4b8f05867f716 expref: -99 pid: 14857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135111.301155:0:15220:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783135111.301159:0:15220:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.141@tcp lock: ffff9fe9c0030800/0xd6c4b8f05867fa11 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xd6c4b8f05867fa18 expref: -99 pid: 14219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135111.301164:0:15220:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe9c0030800 already unused, calling callback (ffffffffc1b40c20) 10000000:00010000:3.0:1783135111.301167:0:15220:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.141@tcp lock: ffff9fe9c0030800/0xd6c4b8f05867fa11 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xd6c4b8f05867fa18 expref: -99 pid: 14219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135111.301172:0:15220:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.141@tcp lock: ffff9fe9c0030800/0xd6c4b8f05867fa11 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xd6c4b8f05867fa18 expref: -99 pid: 14219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1783135111.301178:0:15220:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.141@tcp lock: ffff9fe9c0030800/0xd6c4b8f05867fa11 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xd6c4b8f05867fa18 expref: -99 pid: 14219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783135111.301185:0:15220:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:3.0:1783135111.301187:0:15220:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:3.0:1783135111.301188:0:15220:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:3.0:1783135111.301192:0:15220:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9fe8c57da800 00010000:00010000:3.0:1783135111.301195:0:15220:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.141@tcp lock: ffff9fe9c0030800/0xd6c4b8f05867fa11 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xd6c4b8f05867fa18 expref: -99 pid: 14219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135111.301200:0:15220:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.141@tcp lock: ffff9fe9c0030800/0xd6c4b8f05867fa11 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xd6c4b8f05867fa18 expref: -99 pid: 14219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135111.301207:0:15220:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783135111.301208:0:15220:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783135111.301210:0:15220:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1783135111.301276:0:36:0:(pinger.c:231:ptlrpc_pinger_process_import()) c1fe35bd-99cf-438e-8ada-ed586b673efa->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1783135111.301344:0:36:0:(pinger.c:239:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1783135111.301348:0:36:0:(import.c:65:import_set_state_nolock()) ffff9fe8c57da800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1783135111.301353:0:36:0:(import.c:512:import_select_connection()) MGC192.168.201.141@tcp: connect to NID 0@lo last attempt 384 00000100:00080000:0.0:1783135111.301357:0:36:0:(import.c:591:import_select_connection()) MGC192.168.201.141@tcp: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1783135111.301362:0:36:0:(import.c:626:import_select_connection()) MGC192.168.201.141@tcp: import ffff9fe8c57da800 using connection 192.168.201.141@tcp/0@lo 00000100:00100000:0.0:1783135111.301386:0:36:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9fe9fe8fd180 x1869752384456320/t0(0) o250->MGC192.168.201.141@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1783135111.301482:0:3285:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9fe8fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c1fe35bd-99cf-438e-8ada-ed586b673efa:3285:1869752384456320:0@lo:250:kworker.0 00000400:00000100:3.0:1783135111.301531:0:3285:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1869752384456320 offset 0 length 520: 4 00010000:00010000:2.0:1783135111.301839:0:14210:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783135111.301855:0:3289:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9fe8fe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3289:1869752384456448:0@lo:400:kworker.0 00000400:00000100:2.0:1783135111.301875:0:3289:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1869752384456448 offset 0 length 224: 4 00000020:01000000:1.0:1783135111.303632:0:17054:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9fe9e9da8180 - data ffff9fe9f13c7510/ffff9fe8c45f0000 00000020:01000000:1.0:1783135111.303767:0:17054:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9fe9d25f1d20 - data ffff9fe9f117b0d8/ffff9fe8c4fcac00 00100000:10000000:1.0:1783135111.310004:0:17054:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:2.0:1783135111.337702:0:17054:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xd6c4b8f05867f724 00000020:00000080:2.0:1783135111.337711:0:17054:0:(genops.c:906:class_export_put()) final put ffff9fe9c9b11000/lustre-OST0000-osd_UUID 00000020:01000004:2.0:1783135111.337724:0:17054:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9fe8c47e2000 from lustre-OST0000, refs=2 00000020:01000004:2.0:1783135111.337727:0:17054:0:(obd_mount.c:701:lustre_put_lsi()) put ffff9fe8c47e2000 2 00000020:01000004:2.0:1783135111.337730:0:17054:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9fe8c47e2000 from lustre-OST0000 00000020:00000080:2.0:1783135111.337751:0:17054:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1783135111.337759:0:17054:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:2.0:1783135111.337772:0:17054:0:(genops.c:906:class_export_put()) final put ffff9fe8c4e40800/lustre-OST0000_UUID 00000020:00000080:2.0:1783135111.337775:0:17054:0:(genops.c:865:class_export_destroy()) destroying export ffff9fe8c4e40800/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:2.0:1783135111.337780:0:17054:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:01000004:2.0:1783135111.337818:0:17054:0:(obd_mount.c:569:lustre_stop_mgc()) MGC still has 1 references. 00000020:01000000:2.0:1783135111.337822:0:17054:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:2.0:1783135111.337824:0:17054:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1783135111.337829:0:17054:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1783135111.337835:0:17054:0:(genops.c:1840:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff9fe9e0d13800 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1783135111.337840:0:17054:0:(genops.c:1574:class_disconnect_exports()) OBD device 14 (ffff9fe9c8ef99c0) has exports, disconnecting them 00000020:00080000:2.0:1783135111.337844:0:17054:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff9fe9e0d13800), last request at 1783135046 00000020:00000080:2.0:1783135111.337848:0:17054:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xd6c4b8f05867f74e 00000020:00080000:2.0:1783135111.337855:0:17054:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9fe9e0d13800): rc 0 00000020:00000080:2.0:1783135111.337859:0:17054:0:(genops.c:906:class_export_put()) final put ffff9fe9e0d13800/lustre-MDT0000-lwp-OST0000 00010000:01000000:3.0:1783135111.338667:0:17054:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:3.0:1783135111.338671:0:17054:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1783135111.338675:0:17054:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:3.0:1783135111.338681:0:17054:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1783135111.338791:0:17054:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1783135111.338795:0:17054:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000004:3.0:1783135111.338799:0:17054:0:(obd_mount.c:701:lustre_put_lsi()) put ffff9fe8c47e2000 1 00000020:00000080:3.0:1783135111.338802:0:17054:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xd6c4b8f05867f6f3 00000020:00000080:3.0:1783135111.338805:0:17054:0:(genops.c:906:class_export_put()) final put ffff9fe8c47e5000/lustre-OST0000-osd_UUID 00000020:01000000:3.0:1783135111.338809:0:17054:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:3.0:1783135111.338812:0:17054:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1783135111.338814:0:17054:0:(obd_config.c:955:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1783135111.338817:0:17054:0:(genops.c:1579:class_disconnect_exports()) OBD device 11 (ffff9fe9c8efcd40) has no exports 00000020:00000080:0.0:1783135111.339342:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9fe9c9b11000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:0.0:1783135111.339349:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9fe9e0d13800/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00000020:00000080:0.0:1783135111.339354:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9fe9e0d13000 for lustre-MDT0000-lwp-OST0000 00000020:00000080:0.0:1783135111.339359:0:36:0:(genops.c:906:class_export_put()) final put ffff9fe9e0d11000/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:0.0:1783135111.339361:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9fe9e0d11000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:0.0:1783135111.339364:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:0.0:1783135111.339399:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9fe8c47e5000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:0.0:1783135111.372201:0:17054:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1783135111.372214:0:17054:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:0.0:1783135111.372230:0:17054:0:(genops.c:906:class_export_put()) final put ffff9fe8c47e6000/lustre-OST0000-osd_UUID 00000020:00000080:0.0:1783135111.372235:0:17054:0:(genops.c:865:class_export_destroy()) destroying export ffff9fe8c47e6000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:0.0:1783135111.372244:0:17054:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:0.0:1783135111.372401:0:17054:0:(obd_mount.c:659:lustre_free_lsi()) Freeing lsi ffff9fe8c47e2800 00000020:02000400:0.0:1783135111.372454:0:17054:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-OST0000 complete 00010000:00010000:2.0:1783135112.099856:0:14211:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783135113.197742:0:15220:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783135114.243473:0:14210:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783135115.267972:0:14211:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00000400:1.0:1783135115.849016:0:3288:0:(client.c:2489:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1783135099/real 1783135099] req@ffff9fe9f6fe5f80 x1869752384455552/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1783135115 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783135115.872372:0:3288:0:(client.c:2533:ptlrpc_expire_one_request()) @@@ TIMEOUT-NORESEND: req@ffff9fe9f6fe5f80 x1869752384455552/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1783135115 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1783135115.872390:0:3288:0:(import.c:65:import_set_state_nolock()) ffff9fe8c5f1f000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1783135115.872394:0:3288:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:1.0:1783135115.894773:0:3288:0:(import.c:418:ptlrpc_pinger_force()) lustre-MDT0000_UUID: waking up pinger s:DISCONN 00000100:00080000:0.0:1783135115.895946:0:36:0:(pinger.c:231:ptlrpc_pinger_process_import()) c1fe35bd-99cf-438e-8ada-ed586b673efa->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1783135115.895953:0:36:0:(pinger.c:249:ptlrpc_pinger_process_import()) c1fe35bd-99cf-438e-8ada-ed586b673efa->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1783135115.895957:0:36:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1783135115.895961:0:36:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1783135115.895965:0:36:0:(import.c:65:import_set_state_nolock()) ffff9fe8c5f1f000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1783135115.895977:0:36:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 335 00000100:00080000:0.0:1783135115.895988:0:36:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9fe8c5f1f000 using connection 192.168.201.141@tcp/0@lo 00000100:00100000:0.0:1783135115.896038:0:36:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9fe9fe8fdf80 x1869752384456576/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1783135115.896097:0:3285:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9fe8fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3285:1869752384456576:0@lo:38:kworker.0 00000400:00000100:0.0:1783135115.896170:0:3285:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1869752384456576 offset 0 length 520: 4 00000100:00100000:1.0:1783135115.896627:0:3288:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9f6fe5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3288:1869752384455552:0@lo:400:kworker.0 00000020:01000004:3.0:1783135115.967406:0:17207:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:3.0:1783135115.977489:0:17207:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-OST0001 00010000:00010000:3.0:1783135115.977571:0:17207:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.141@tcp lock: ffff9fe9f68adc00/0xd6c4b8f05867f874 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd6c4b8f05867f87b expref: -99 pid: 15525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135115.977586:0:17207:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.141@tcp lock: ffff9fe9f68adc00/0xd6c4b8f05867f874 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xd6c4b8f05867f87b expref: -99 pid: 15525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135115.977594:0:17207:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.141@tcp lock: ffff9fe9f68adc00/0xd6c4b8f05867f874 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xd6c4b8f05867f87b expref: -99 pid: 15525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135115.977601:0:17207:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.141@tcp lock: ffff9fe9f68adc00/0xd6c4b8f05867f874 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xd6c4b8f05867f87b expref: -99 pid: 15525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135115.977626:0:17207:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1783135115.977632:0:17207:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:3.0:1783135115.977657:0:17207:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1783135115.977680:0:17207:0:(client.c:3588:ptlrpc_abort_inflight()) @@@ inflight req@ffff9fe9fe8fc380 x1869752384456064/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783135120 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00010000:00010000:2.0:1783135115.977759:0:15220:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783135115.977766:0:15220:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.141@tcp lock: ffff9fe9f68adc00/0xd6c4b8f05867f874 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xd6c4b8f05867f87b expref: -99 pid: 15525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135115.977798:0:15220:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe9f68adc00 already unused, calling callback (ffffffffc1b40c20) 10000000:00010000:2.0:1783135115.977802:0:15220:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.141@tcp lock: ffff9fe9f68adc00/0xd6c4b8f05867f874 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xd6c4b8f05867f87b expref: -99 pid: 15525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135115.977810:0:15220:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.141@tcp lock: ffff9fe9f68adc00/0xd6c4b8f05867f874 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xd6c4b8f05867f87b expref: -99 pid: 15525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783135115.977818:0:15220:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.141@tcp lock: ffff9fe9f68adc00/0xd6c4b8f05867f874 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xd6c4b8f05867f87b expref: -99 pid: 15525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783135115.977823:0:15220:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1783135115.977826:0:15220:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:2.0:1783135115.977828:0:15220:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:2.0:1783135115.977841:0:15220:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9fe8c57da800 00010000:00010000:2.0:1783135115.977845:0:15220:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.141@tcp lock: ffff9fe9f68adc00/0xd6c4b8f05867f874 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xd6c4b8f05867f87b expref: -99 pid: 15525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135115.977851:0:15220:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.141@tcp lock: ffff9fe9f68adc00/0xd6c4b8f05867f874 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xd6c4b8f05867f87b expref: -99 pid: 15525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135115.977861:0:15220:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783135115.977863:0:15220:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783135115.977865:0:15220:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783135115.977896:0:17207:0:(client.c:3588:ptlrpc_abort_inflight()) @@@ inflight req@ffff9fe9fe8fc000 x1869752384456192/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783135122 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783135115.977916:0:17207:0:(client.c:3588:ptlrpc_abort_inflight()) @@@ inflight req@ffff9fe9fe8fe300 x1869752384456448/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783135127 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783135115.977933:0:17207:0:(client.c:3588:ptlrpc_abort_inflight()) @@@ inflight req@ffff9fe9fe8fdf80 x1869752384456576/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1783135125 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783135115.977946:0:17207:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:3.0:1783135115.977952:0:17207:0:(pinger.c:400:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1783135115.977957:0:17207:0:(import.c:65:import_set_state_nolock()) ffff9fe8c5f1f000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:3.0:1783135115.977962:0:17207:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1783135115.977965:0:17207:0:(client.c:3588:ptlrpc_abort_inflight()) @@@ inflight req@ffff9fe9fe8fc380 x1869752384456064/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783135120 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783135115.978011:0:3289:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9fe8fe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3289:1869752384456448:0@lo:400:kworker.0 00000100:00100000:1.0:1783135115.978049:0:3288:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9fe8fc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3288:1869752384456192:0@lo:400:kworker.0 00000100:00100000:0.0:1783135115.978097:0:3287:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9fe8fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3287:1869752384456064:0@lo:400:kworker.0 00000100:00100000:3.0:1783135115.978244:0:17207:0:(client.c:3588:ptlrpc_abort_inflight()) @@@ inflight req@ffff9fe9fe8fc000 x1869752384456192/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783135122 ref 1 fl Complete:ENQU/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783135115.978253:0:17207:0:(client.c:3588:ptlrpc_abort_inflight()) @@@ inflight req@ffff9fe9fe8fe300 x1869752384456448/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783135127 ref 1 fl Complete:ENQU/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783135115.978260:0:17207:0:(client.c:3588:ptlrpc_abort_inflight()) @@@ inflight req@ffff9fe9fe8fdf80 x1869752384456576/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1783135125 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783135115.978267:0:17207:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:0.0:1783135115.978419:0:3285:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9fe8fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3285:1869752384456576:0@lo:38:kworker.0 00000100:00100000:3.0:1783135115.978503:0:17207:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:3.0:1783135115.979719:0:17207:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.141@tcp lock: ffff9fe9d2b75600/0xd6c4b8f05867f84a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd6c4b8f05867f851 expref: -99 pid: 15525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135115.979732:0:17207:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.141@tcp lock: ffff9fe9d2b75600/0xd6c4b8f05867f84a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xd6c4b8f05867f851 expref: -99 pid: 15525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135115.979753:0:17207:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.141@tcp lock: ffff9fe9d2b75600/0xd6c4b8f05867f84a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xd6c4b8f05867f851 expref: -99 pid: 15525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135115.979760:0:17207:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.141@tcp lock: ffff9fe9d2b75600/0xd6c4b8f05867f84a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xd6c4b8f05867f851 expref: -99 pid: 15525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135115.979815:0:17207:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783135115.979823:0:17207:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.141@tcp lock: ffff9fe9c0031000/0xd6c4b8f05867fa03 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd6c4b8f05867fa0a expref: -99 pid: 14219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135115.979831:0:17207:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.141@tcp lock: ffff9fe9c0031000/0xd6c4b8f05867fa03 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd6c4b8f05867fa0a expref: -99 pid: 14219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135115.979837:0:17207:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.141@tcp lock: ffff9fe9c0031000/0xd6c4b8f05867fa03 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xd6c4b8f05867fa0a expref: -99 pid: 14219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135115.979843:0:17207:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.141@tcp lock: ffff9fe9c0031000/0xd6c4b8f05867fa03 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xd6c4b8f05867fa0a expref: -99 pid: 14219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135115.980223:0:14210:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1783135115.980229:0:14210:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.141@tcp lock: ffff9fe9d2b75600/0xd6c4b8f05867f84a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xd6c4b8f05867f851 expref: -99 pid: 15525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135115.980248:0:14210:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe9d2b75600 already unused, calling callback (ffffffffc1b40c20) 10000000:00010000:2.0:1783135115.980252:0:14210:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.141@tcp lock: ffff9fe9d2b75600/0xd6c4b8f05867f84a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xd6c4b8f05867f851 expref: -99 pid: 15525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135115.980261:0:14210:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.141@tcp lock: ffff9fe9d2b75600/0xd6c4b8f05867f84a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xd6c4b8f05867f851 expref: -99 pid: 15525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783135115.980267:0:14210:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.141@tcp lock: ffff9fe9d2b75600/0xd6c4b8f05867f84a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xd6c4b8f05867f851 expref: -99 pid: 15525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783135115.980273:0:14210:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1783135115.980276:0:14210:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0001: stopping, won't requeue 00010000:00010000:2.0:1783135115.980313:0:14210:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9fe8c57da800 00010000:00010000:2.0:1783135115.980318:0:14210:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.141@tcp lock: ffff9fe9d2b75600/0xd6c4b8f05867f84a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xd6c4b8f05867f851 expref: -99 pid: 15525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135115.980325:0:14210:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.141@tcp lock: ffff9fe9d2b75600/0xd6c4b8f05867f84a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xd6c4b8f05867f851 expref: -99 pid: 15525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135115.980335:0:14210:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783135115.980338:0:14210:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.141@tcp lock: ffff9fe9c0031000/0xd6c4b8f05867fa03 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xd6c4b8f05867fa0a expref: -99 pid: 14219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135115.980344:0:14210:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe9c0031000 already unused, calling callback (ffffffffc1b40c20) 10000000:00010000:2.0:1783135115.980347:0:14210:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.141@tcp lock: ffff9fe9c0031000/0xd6c4b8f05867fa03 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xd6c4b8f05867fa0a expref: -99 pid: 14219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135115.980353:0:14210:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.141@tcp lock: ffff9fe9c0031000/0xd6c4b8f05867fa03 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xd6c4b8f05867fa0a expref: -99 pid: 14219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783135115.980366:0:14210:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.141@tcp lock: ffff9fe9c0031000/0xd6c4b8f05867fa03 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xd6c4b8f05867fa0a expref: -99 pid: 14219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783135115.980371:0:14210:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:2.0:1783135115.980373:0:14210:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 00010000:00010000:2.0:1783135115.980378:0:14210:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9fe8c57da800 00010000:00010000:2.0:1783135115.980381:0:14210:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.141@tcp lock: ffff9fe9c0031000/0xd6c4b8f05867fa03 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0xd6c4b8f05867fa0a expref: -99 pid: 14219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135115.980388:0:14210:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783135115.980389:0:14210:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783135115.980391:0:14210:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783135115.980510:0:17207:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1783135115.980515:0:17207:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.141@tcp lock: ffff9fe9c0031000/0xd6c4b8f05867fa03 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0xd6c4b8f05867fa0a expref: -99 pid: 14219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783135115.980529:0:17207:0:(mgc_request.c:130:config_log_put()) dropping config log params 10000000:01000000:3.0:1783135115.980534:0:17207:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0001 10000000:01000000:3.0:1783135115.980536:0:17207:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0001 (0) 00000020:01000004:3.0:1783135115.980558:0:17207:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-OST0001 00000020:01000000:3.0:1783135115.980562:0:17207:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-OST0001 (flags='F') 00000020:00000080:3.0:1783135115.980567:0:17207:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1783135115.980578:0:17207:0:(obd_config.c:955:class_cleanup()) lustre-OST0001: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1783135115.980582:0:17207:0:(genops.c:1579:class_disconnect_exports()) OBD device 16 (ffff9fe8c562b380) has no exports 00000020:00080000:3.0:1783135115.980605:0:17207:0:(genops.c:1579:class_disconnect_exports()) OBD device 16 (ffff9fe8c562b380) has no exports 00000020:01000000:3.0:1783135115.982613:0:17207:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9fe9e9da8d80 - data ffff9fe8c4b10bd0/ffff9fe9fff5cc00 00000020:01000000:3.0:1783135115.982778:0:17207:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9fe9cb36c4e0 - data ffff9fe8c4acf438/ffff9fe8c58ba800 00010000:00010000:2.0:1783135115.983708:0:14211:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00100000:10000000:3.0:1783135115.992253:0:17207:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0001-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:1.0:1783135116.012875:0:17207:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xd6c4b8f05867f85f 00000020:00000080:1.0:1783135116.012889:0:17207:0:(genops.c:906:class_export_put()) final put ffff9fe8c6045800/lustre-OST0001-osd_UUID 00000020:01000004:1.0:1783135116.012933:0:17207:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9fe9f6724800 from lustre-OST0001, refs=2 00000020:01000004:1.0:1783135116.012937:0:17207:0:(obd_mount.c:701:lustre_put_lsi()) put ffff9fe9f6724800 2 00000020:01000004:1.0:1783135116.012941:0:17207:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9fe9f6724800 from lustre-OST0001 00000020:00000080:1.0:1783135116.012970:0:17207:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1783135116.012983:0:17207:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:00000080:1.0:1783135116.012988:0:17207:0:(genops.c:906:class_export_put()) final put ffff9fe8c6043000/lustre-OST0001_UUID 00000020:00000080:1.0:1783135116.012991:0:17207:0:(genops.c:865:class_export_destroy()) destroying export ffff9fe8c6043000/lustre-OST0001_UUID for lustre-OST0001 00000020:01000000:1.0:1783135116.012999:0:17207:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001 (lustre-OST0001_UUID) 00000100:00080000:1.0:1783135116.013111:0:17207:0:(pinger.c:400:ptlrpc_pinger_del_import()) removing pingable import c1fe35bd-99cf-438e-8ada-ed586b673efa->MGS 00010000:00010000:1.0:1783135116.013132:0:17207:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.141@tcp lock: ffff9fe9c7828800/0xd6c4b8f05867f701 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xd6c4b8f05867f708 expref: -99 pid: 14857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783135116.013145:0:17207:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.141@tcp lock: ffff9fe9c7828800/0xd6c4b8f05867f701 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xd6c4b8f05867f708 expref: -99 pid: 14857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783135116.013152:0:17207:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 10000000:01000000:1.0:1783135116.013156:0:17207:0:(mgc_request.c:954:mgc_blocking_ast()) log nodemap: disconnecting, won't requeue 10000000:01000000:1.0:1783135116.013160:0:17207:0:(mgc_request.c:130:config_log_put()) dropping config log nodemap 00010000:00010000:1.0:1783135116.013177:0:17207:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9fe8c57da800 00000020:00000080:2.0:1783135116.013308:0:483:0:(genops.c:865:class_export_destroy()) destroying export ffff9fe8c6045800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00010000:00010000:1.0:1783135116.013364:0:17207:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.141@tcp lock: ffff9fe9c7828800/0xd6c4b8f05867f701 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xd6c4b8f05867f708 expref: -99 pid: 14857 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135116.013388:0:17207:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.141@tcp lock: ffff9fe9c7829a00/0xd6c4b8f05867f5e9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xd6c4b8f05867f5f0 expref: -99 pid: 14204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783135116.013395:0:17207:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.141@tcp lock: ffff9fe9c7829a00/0xd6c4b8f05867f5e9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xd6c4b8f05867f5f0 expref: -99 pid: 14204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783135116.013401:0:17207:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1783135116.013404:0:17207:0:(mgc_request.c:954:mgc_blocking_ast()) log lustre-s: disconnecting, won't requeue 10000000:01000000:1.0:1783135116.013406:0:17207:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:1.0:1783135116.013426:0:17207:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9fe8c57da800 00010000:00010000:1.0:1783135116.013429:0:17207:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.141@tcp lock: ffff9fe9c7829a00/0xd6c4b8f05867f5e9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xd6c4b8f05867f5f0 expref: -99 pid: 14204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1783135116.013450:0:17207:0:(import.c:65:import_set_state_nolock()) ffff9fe8c57da800 MGS: changing import state from CONNECTING to CLOSED 10000000:01000000:1.0:1783135116.013455:0:17207:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:1.0:1783135116.013458:0:17207:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:1.0:1783135116.013460:0:17207:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:1.0:1783135116.013464:0:17207:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:1.0:1783135116.013478:0:17207:0:(client.c:3588:ptlrpc_abort_inflight()) @@@ inflight req@ffff9fe9fe8fd180 x1869752384456320/t0(0) o250->MGC192.168.201.141@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1783135126 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:01000000:1.0:1783135116.013542:0:17207:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:1.0:1783135116.013545:0:17207:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 13s for inflight to error out 00000100:00100000:2.0:1783135116.013789:0:3285:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9fe8fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c1fe35bd-99cf-438e-8ada-ed586b673efa:3285:1869752384456320:0@lo:250:kworker.0 10000000:01000000:1.0:1783135116.013859:0:17207:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:1.0:1783135116.013867:0:17207:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xd6c4b8f05867f5d4 00000020:00000080:1.0:1783135116.013873:0:17207:0:(genops.c:906:class_export_put()) final put ffff9fe9dff19000/c1fe35bd-99cf-438e-8ada-ed586b673efa 00000020:01000000:1.0:1783135116.013890:0:17207:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of MGC192.168.201.141@tcp (flags='') 00000020:00000080:1.0:1783135116.013898:0:17207:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1783135116.013904:0:17207:0:(obd_config.c:955:class_cleanup()) MGC192.168.201.141@tcp: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1783135116.013908:0:17207:0:(genops.c:1579:class_disconnect_exports()) OBD device 2 (ffff9fea00c40000) has no exports 10000000:01000000:3.0:1783135116.013964:0:14219:0:(mgc_request.c:708:mgc_requeue_thread()) Ending requeue thread 10000000:01000000:1.0:1783135116.014053:0:17207:0:(obd_class.h:671:obd_cleanup_client_import()) MGC192.168.201.141@tcp: client import never connected 00000100:00080000:1.0:1783135116.014057:0:17207:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:1.0:1783135116.014059:0:17207:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:1.0:1783135116.014061:0:17207:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:1.0:1783135116.014063:0:17207:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:1.0:1783135116.014106:0:17207:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1783135116.014111:0:17207:0:(obd_config.c:883:class_detach()) detach on obd MGC192.168.201.141@tcp (uuid c1fe35bd-99cf-438e-8ada-ed586b673efa) 00000020:01000000:1.0:1783135116.014117:0:17207:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0001 (flags='F') 00000020:00000080:1.0:1783135116.014120:0:17207:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1783135116.014124:0:17207:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1783135116.014129:0:17207:0:(genops.c:1840:print_export_data()) lustre-MDT0000-lwp-OST0001: ACTIVE ffff9fe8c5f19000 lustre-MDT0000-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1783135116.014135:0:17207:0:(genops.c:1574:class_disconnect_exports()) OBD device 17 (ffff9fe9ca89cd40) has exports, disconnecting them 00000020:00080000:1.0:1783135116.014149:0:17207:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0001: disconnecting export at 0@lo (ffff9fe8c5f19000), last request at 1783135053 00000020:00000080:1.0:1783135116.014153:0:17207:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xd6c4b8f05867f889 00000020:00080000:1.0:1783135116.014164:0:17207:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9fe8c5f19000): rc 0 00000020:00000080:1.0:1783135116.014168:0:17207:0:(genops.c:906:class_export_put()) final put ffff9fe8c5f19000/lustre-MDT0000-lwp-OST0001 00000020:00000080:2.0:1783135116.015031:0:483:0:(genops.c:865:class_export_destroy()) destroying export ffff9fe9dff19000/c1fe35bd-99cf-438e-8ada-ed586b673efa for MGC192.168.201.141@tcp 00000020:00000080:2.0:1783135116.015050:0:483:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9fe8c57da800 for MGC192.168.201.141@tcp 00000020:00000080:2.0:1783135116.015057:0:483:0:(genops.c:906:class_export_put()) final put ffff9fe8c57df000/c1fe35bd-99cf-438e-8ada-ed586b673efa 00000020:00000080:2.0:1783135116.015059:0:483:0:(genops.c:865:class_export_destroy()) destroying export ffff9fe8c57df000/c1fe35bd-99cf-438e-8ada-ed586b673efa for MGC192.168.201.141@tcp 00000020:01000000:2.0:1783135116.015064:0:483:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGC192.168.201.141@tcp (c1fe35bd-99cf-438e-8ada-ed586b673efa) 00000020:00000080:2.0:1783135116.015560:0:483:0:(genops.c:865:class_export_destroy()) destroying export ffff9fe8c5f19000/lustre-MDT0000-lwp-OST0001 for lustre-MDT0000-lwp-OST0001 00010000:01000000:2.0:1783135116.017390:0:17207:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0001: client import never connected 00000100:00080000:2.0:1783135116.017399:0:17207:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1783135116.017405:0:17207:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:2.0:1783135116.017414:0:17207:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:2.0:1783135116.017519:0:15220:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-1 blwis in pool) 00010000:00010000:2.0:1783135116.017690:0:14210:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-2 blwis in pool) 00010000:00010000:2.0:1783135116.017791:0:14211:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-3 blwis in pool) 00000100:00100000:3.0:1783135116.017955:0:14205:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_000: service thread [ffff9fe9c80fd000:14205] 0 exiting: rc = 1 00000020:00000080:3.0:1783135116.018007:0:483:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9fe8c5f1f000 for lustre-MDT0000-lwp-OST0001 00000100:00100000:1.0:1783135116.026472:0:14206:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_001: service thread [ffff9fe9dff3ce00:14206] 1 exiting: rc = 0 00000100:00100000:2.0:1783135116.026679:0:17207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783135116.027093:0:16237:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_003: service thread [ffff9fe9e2ea2200:16237] 3 exiting: rc = 0 00000100:00100000:1.0:1783135116.027390:0:14207:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_000: service thread [ffff9fe9d1390e00:14207] 0 exiting: rc = 1 00000100:00100000:0.0:1783135116.027562:0:14209:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_002: service thread [ffff9fe8c47bac00:14209] 2 exiting: rc = 0 00000100:00100000:0.0:1783135116.027665:0:14208:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_001: service thread [ffff9fe8c47bba00:14208] 1 exiting: rc = 0 00000100:00100000:2.0:1783135116.027830:0:17207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135116.027839:0:17207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135116.027847:0:17207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135116.027853:0:17207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135116.027860:0:17207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135116.027867:0:17207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135116.027874:0:17207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135116.027881:0:17207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135116.027886:0:17207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135116.027893:0:17207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135116.027899:0:17207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135116.027906:0:17207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135116.027911:0:17207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135116.027917:0:17207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135116.027923:0:17207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135116.027928:0:17207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135116.027933:0:17207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135116.027939:0:17207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135116.027945:0:17207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135116.027951:0:17207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135116.027956:0:17207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135116.027962:0:17207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135116.027968:0:17207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135116.027973:0:17207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135116.027979:0:17207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135116.027985:0:17207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135116.027991:0:17207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135116.027998:0:17207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135116.028003:0:17207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135116.028009:0:17207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135116.028014:0:17207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135116.028020:0:17207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135116.028026:0:17207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135116.028046:0:17207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135116.028052:0:17207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135116.028059:0:17207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135116.028065:0:17207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135116.028070:0:17207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135116.028076:0:17207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135116.028083:0:17207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135116.028088:0:17207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135116.028094:0:17207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135116.028099:0:17207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135116.028104:0:17207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135116.028109:0:17207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135116.028114:0:17207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135116.028120:0:17207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135116.028126:0:17207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135116.028132:0:17207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135116.028137:0:17207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135116.028142:0:17207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135116.028147:0:17207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135116.028152:0:17207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135116.028158:0:17207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135116.028163:0:17207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135116.028169:0:17207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135116.028175:0:17207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135116.028197:0:17207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135116.028430:0:17207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135116.028439:0:17207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135116.028445:0:17207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135116.028451:0:17207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135116.028457:0:17207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135116.028463:0:17207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:2.0:1783135116.029729:0:17207:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1783135116.029744:0:17207:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000020:00000080:2.0:1783135116.029751:0:17207:0:(genops.c:906:class_export_put()) final put ffff9fe8c5f19800/lustre-MDT0000-lwp-OST0001_UUID 00000020:00000080:2.0:1783135116.029757:0:17207:0:(genops.c:865:class_export_destroy()) destroying export ffff9fe8c5f19800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000-lwp-OST0001 00000020:01000000:2.0:1783135116.029777:0:17207:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0001 (lustre-MDT0000-lwp-OST0001_UUID) 00000020:01000004:2.0:1783135116.029835:0:17207:0:(obd_mount.c:701:lustre_put_lsi()) put ffff9fe9f6724800 1 00000020:00000080:2.0:1783135116.029842:0:17207:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xd6c4b8f05867f843 00000020:00000080:2.0:1783135116.029851:0:17207:0:(genops.c:906:class_export_put()) final put ffff9fe9f6726000/lustre-OST0001-osd_UUID 00000020:01000000:2.0:1783135116.029906:0:17207:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osd (flags='') 00000020:00000080:2.0:1783135116.029912:0:17207:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1783135116.029918:0:17207:0:(obd_config.c:955:class_cleanup()) lustre-OST0001-osd: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1783135116.029922:0:17207:0:(genops.c:1579:class_disconnect_exports()) OBD device 15 (ffff9fe8c562cd40) has no exports 00000020:00000080:3.0:1783135116.032607:0:483:0:(genops.c:865:class_export_destroy()) destroying export ffff9fe9f6726000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:0.0:1783135116.053829:0:17207:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1783135116.053849:0:17207:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00000020:00000080:0.0:1783135116.053856:0:17207:0:(genops.c:906:class_export_put()) final put ffff9fe9f6726800/lustre-OST0001-osd_UUID 00000020:00000080:0.0:1783135116.053862:0:17207:0:(genops.c:865:class_export_destroy()) destroying export ffff9fe9f6726800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:0.0:1783135116.053871:0:17207:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osd (lustre-OST0001-osd_UUID) 00000020:01000004:0.0:1783135116.054151:0:17207:0:(obd_mount.c:659:lustre_free_lsi()) Freeing lsi ffff9fe9f6724000 00000020:01000000:0.0:1783135116.054194:0:17207:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of OSS (flags='F') 00000020:00000080:0.0:1783135116.054210:0:17207:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1783135116.054215:0:17207:0:(obd_config.c:955:class_cleanup()) OSS: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1783135116.054220:0:17207:0:(genops.c:1579:class_disconnect_exports()) OBD device 12 (ffff9fe9c8efb380) has no exports 00000020:00000080:0.0:1783135116.054258:0:17207:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1783135116.054265:0:17207:0:(obd_config.c:883:class_detach()) detach on obd OSS (uuid OSS_uuid) 00000020:00000080:0.0:1783135116.054269:0:17207:0:(genops.c:906:class_export_put()) final put ffff9fe8c47e6800/OSS_uuid 00000020:00000080:0.0:1783135116.054271:0:17207:0:(genops.c:865:class_export_destroy()) destroying export ffff9fe8c47e6800/OSS_uuid for OSS 00000020:01000000:0.0:1783135116.054275:0:17207:0:(genops.c:441:class_free_dev()) finishing cleanup of obd OSS (OSS_uuid) 00000100:00100000:0.0:1783135116.054478:0:15538:0:(service.c:3183:ptlrpc_main()) ll_ost00_003: service thread [ffff9fe9c325e600:15538] 3 exiting: rc = 0 00000100:00080000:2.0:1783135116.054627:0:14218:0:(pinger.c:550:ping_evictor_main()) Exiting Ping Evictor 00000100:00100000:1.0:1783135116.054797:0:14858:0:(service.c:3183:ptlrpc_main()) ll_ost00_000: service thread [ffff9fe9c8f28c00:14858] 0 exiting: rc = 1 00000100:00100000:1.0:1783135116.054855:0:14860:0:(service.c:3183:ptlrpc_main()) ll_ost00_001: service thread [ffff9fe9ca2b2800:14860] 1 exiting: rc = 0 00000100:00100000:2.0:1783135116.057495:0:14861:0:(service.c:3183:ptlrpc_main()) ll_ost00_002: service thread [ffff9fe8c57d6800:14861] 2 exiting: rc = 0 00000100:00100000:0.0:1783135116.057685:0:17207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135116.057697:0:17207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135116.057702:0:17207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135116.057708:0:17207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135116.057714:0:17207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135116.057719:0:17207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135116.057726:0:17207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135116.057732:0:17207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135116.057739:0:17207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135116.057744:0:17207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135116.057750:0:17207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135116.057755:0:17207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135116.057761:0:17207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135116.057767:0:17207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135116.057772:0:17207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135116.057778:0:17207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135116.057784:0:17207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135116.057789:0:17207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135116.057795:0:17207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135116.057802:0:17207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135116.057808:0:17207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135116.057814:0:17207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135116.057820:0:17207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135116.057825:0:17207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135116.057853:0:17207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135116.057859:0:17207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135116.057865:0:17207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135116.057870:0:17207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135116.057876:0:17207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135116.057882:0:17207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135116.057888:0:17207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135116.057893:0:17207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135116.057900:0:17207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135116.057909:0:17207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135116.057914:0:17207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135116.057920:0:17207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135116.057926:0:17207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135116.057932:0:17207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135116.057953:0:17207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135116.057960:0:17207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135116.057966:0:17207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135116.057971:0:17207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135116.057976:0:17207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135116.057982:0:17207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135116.057988:0:17207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135116.057994:0:17207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135116.058000:0:17207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135116.058008:0:17207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135116.058014:0:17207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135116.058020:0:17207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135116.058026:0:17207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135116.058032:0:17207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135116.058038:0:17207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135116.058043:0:17207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135116.058049:0:17207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135116.058054:0:17207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135116.058060:0:17207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135116.058066:0:17207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135116.058071:0:17207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135116.058087:0:17207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135116.058097:0:17207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135116.058103:0:17207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135116.058108:0:17207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135116.058113:0:17207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135116.061554:0:14863:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_001: service thread [ffff9fe9f5cd2a00:14863] 1 exiting: rc = 0 00000100:00100000:2.0:1783135116.061785:0:14862:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_000: service thread [ffff9fe8c57d6c00:14862] 0 exiting: rc = 1 00000100:00100000:0.0:1783135116.061886:0:17207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135116.061898:0:17207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135116.061906:0:17207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135116.061913:0:17207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135116.061921:0:17207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135116.061928:0:17207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135116.061936:0:17207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135116.061943:0:17207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135116.061951:0:17207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135116.061958:0:17207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135116.061970:0:17207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135116.061978:0:17207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135116.061987:0:17207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135116.061995:0:17207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135116.062002:0:17207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135116.062010:0:17207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135116.062016:0:17207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135116.062035:0:17207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135116.062044:0:17207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135116.062050:0:17207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135116.062056:0:17207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135116.062062:0:17207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135116.062068:0:17207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135116.062074:0:17207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135116.062079:0:17207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135116.062085:0:17207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135116.062090:0:17207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135116.062096:0:17207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135116.062102:0:17207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135116.062110:0:17207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135116.062136:0:17207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135116.062143:0:17207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135116.062149:0:17207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135116.062155:0:17207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135116.062160:0:17207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135116.062166:0:17207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135116.062171:0:17207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135116.062176:0:17207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135116.062195:0:17207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135116.062543:0:17207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135116.062554:0:17207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135116.062560:0:17207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135116.062567:0:17207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135116.062573:0:17207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135116.062578:0:17207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135116.062584:0:17207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135116.062590:0:17207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135116.062596:0:17207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135116.062602:0:17207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135116.062607:0:17207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135116.062612:0:17207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135116.062617:0:17207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135116.062622:0:17207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135116.062628:0:17207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135116.062634:0:17207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135116.062639:0:17207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135116.062645:0:17207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135116.062651:0:17207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135116.062656:0:17207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135116.062661:0:17207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135116.062670:0:17207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135116.062679:0:17207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135116.062685:0:17207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135116.062691:0:17207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783135116.064498:0:14864:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_000: service thread [ffff9fe9f6c4b000:14864] 0 exiting: rc = 1 00000100:00100000:2.0:1783135116.064632:0:14866:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_002: service thread [ffff9fe9fec80800:14866] 2 exiting: rc = 0 00000100:00100000:1.0:1783135116.064849:0:14865:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_001: service thread [ffff9fe9f6c4a000:14865] 1 exiting: rc = 0 00000100:00100000:2.0:1783135116.064955:0:17207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135116.064965:0:17207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135116.064972:0:17207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135116.064979:0:17207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135116.064985:0:17207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135116.064992:0:17207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135116.064999:0:17207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135116.065006:0:17207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135116.065013:0:17207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135116.065019:0:17207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135116.065026:0:17207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135116.065032:0:17207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135116.065038:0:17207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135116.065056:0:17207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135116.065063:0:17207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135116.065069:0:17207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135116.065075:0:17207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135116.065081:0:17207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135116.065087:0:17207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135116.065094:0:17207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135116.065100:0:17207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135116.065123:0:17207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135116.065130:0:17207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135116.065136:0:17207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135116.065141:0:17207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135116.065147:0:17207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135116.065152:0:17207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135116.065158:0:17207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135116.065164:0:17207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135116.065170:0:17207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135116.065176:0:17207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135116.065194:0:17207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135116.065273:0:17207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135116.065311:0:17207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135116.065318:0:17207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135116.065324:0:17207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135116.065331:0:17207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135116.065352:0:17207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135116.065360:0:17207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135116.065366:0:17207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135116.065372:0:17207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135116.065378:0:17207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135116.065385:0:17207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135116.065392:0:17207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135116.065398:0:17207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135116.065404:0:17207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135116.065411:0:17207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135116.065418:0:17207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135116.065424:0:17207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135116.065429:0:17207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135116.065435:0:17207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135116.065441:0:17207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135116.065447:0:17207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135116.065454:0:17207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135116.065472:0:17207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135116.065479:0:17207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135116.065498:0:17207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135116.065514:0:17207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135116.065521:0:17207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135116.065527:0:17207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135116.065533:0:17207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135116.065539:0:17207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135116.065545:0:17207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135116.065552:0:17207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135116.071873:0:14867:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_000: service thread [ffff9fe9fec81400:14867] 0 exiting: rc = 1 00000100:00100000:3.0:1783135116.072042:0:14868:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_001: service thread [ffff9fe9fec80600:14868] 1 exiting: rc = 0 00000100:00100000:2.0:1783135116.072163:0:17207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135116.072171:0:17207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135116.072177:0:17207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135116.072194:0:17207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135116.072210:0:17207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135116.072216:0:17207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135116.072224:0:17207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135116.072230:0:17207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135116.072236:0:17207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135116.072242:0:17207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135116.072248:0:17207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135116.072253:0:17207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135116.072259:0:17207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135116.072265:0:17207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135116.072271:0:17207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135116.072413:0:17207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135116.072422:0:17207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135116.072428:0:17207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135116.072432:0:17207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135116.072438:0:17207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135116.072443:0:17207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135116.072449:0:17207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135116.072455:0:17207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135116.072463:0:17207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135116.072470:0:17207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135116.072476:0:17207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135116.072482:0:17207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135116.072500:0:17207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135116.072506:0:17207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135116.072513:0:17207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135116.072519:0:17207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135116.072525:0:17207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135116.072530:0:17207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135116.072536:0:17207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135116.072542:0:17207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135116.072547:0:17207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135116.072553:0:17207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135116.072559:0:17207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135116.072566:0:17207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135116.072572:0:17207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135116.072579:0:17207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135116.072586:0:17207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135116.072594:0:17207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135116.072603:0:17207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135116.072609:0:17207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135116.072615:0:17207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135116.072620:0:17207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135116.072627:0:17207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135116.072633:0:17207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135116.072640:0:17207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135116.072647:0:17207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135116.072654:0:17207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135116.072660:0:17207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135116.072671:0:17207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135116.072680:0:17207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135116.072687:0:17207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135116.072693:0:17207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135116.072700:0:17207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135116.072706:0:17207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135116.072713:0:17207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135116.072720:0:17207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135116.072726:0:17207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135116.072739:0:17207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135116.072744:0:17207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135116.074059:0:14869:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_000: service thread [ffff9fe9ca914800:14869] 0 exiting: rc = 1 00000100:00100000:1.0:1783135116.074271:0:14870:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_001: service thread [ffff9fe9ca915a00:14870] 1 exiting: rc = 0 00000100:00100000:0.0:1783135116.074873:0:17207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135116.074894:0:17207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135116.074902:0:17207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135116.074910:0:17207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135116.074918:0:17207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135116.074925:0:17207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135116.074932:0:17207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135116.074940:0:17207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135116.074947:0:17207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135116.074955:0:17207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135116.074963:0:17207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135116.074970:0:17207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135116.074979:0:17207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135116.074990:0:17207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135116.075015:0:17207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135116.075026:0:17207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135116.075035:0:17207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135116.075043:0:17207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135116.075053:0:17207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135116.075060:0:17207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135116.075067:0:17207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135116.075075:0:17207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135116.075084:0:17207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135116.075093:0:17207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135116.075101:0:17207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135116.075108:0:17207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135116.075133:0:17207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135116.075142:0:17207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135116.075148:0:17207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135116.075155:0:17207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135116.075163:0:17207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135116.075171:0:17207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135116.075192:0:17207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135116.075208:0:17207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135116.075231:0:17207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135116.075239:0:17207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135116.075246:0:17207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135116.075253:0:17207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135116.075274:0:17207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135116.075309:0:17207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135116.075316:0:17207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135116.075324:0:17207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135116.075331:0:17207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135116.075338:0:17207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135116.075345:0:17207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135116.075352:0:17207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135116.075359:0:17207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135116.075368:0:17207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135116.075375:0:17207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135116.075382:0:17207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135116.075405:0:17207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135116.075413:0:17207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135116.075421:0:17207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135116.075428:0:17207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135116.075436:0:17207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135116.075444:0:17207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135116.075453:0:17207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135116.075461:0:17207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135116.075469:0:17207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135116.075477:0:17207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135116.075484:0:17207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135116.075491:0:17207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135116.075499:0:17207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135116.075514:0:17207:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:02000400:1.0:1783135116.086642:0:17207:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-OST0001 complete 00000001:02000400:3.0:1783135141.227008:0:17821:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg141-server.virtnet: executing load_modules_local 00000020:01000004:3.0:1783135151.997523:0:18234:0:(obd_mount.c:914:lmd_print()) mount data: 00000020:01000004:3.0:1783135151.997528:0:18234:0:(obd_mount.c:917:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:3.0:1783135151.997653:0:18234:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff9fe8c47e7000 00000020:01000004:3.0:1783135151.997668:0:18234:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200005, mountfl=0 00000020:01000004:3.0:1783135151.997676:0:18234:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:3.0:1783135151.997689:0:18234:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff9fe8c56299c0) 00000020:00000080:3.0:1783135151.997703:0:18234:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:0.0:1783135152.015252:0:18234:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:0.0:1783135152.017084:0:18234:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x36:0x0] (8/32) 00100000:10000000:0.0:1783135152.017496:0:18234:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-client under 451: rc = 0 00100000:10000000:0.0:1783135152.017602:0:18234:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0000 under 451: rc = 0 00100000:10000000:0.0:1783135152.018634:0:18234:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:0.0:1783135152.018718:0:18234:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled nodemap under 451: rc = 0 00100000:10000000:0.0:1783135152.018902:0:18234:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-MDT0000 under 451: rc = 0 00100000:10000000:0.0:1783135152.019105:0:18234:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0001 under 451: rc = 0 00100000:10000000:0.0:1783135152.019208:0:18234:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled params under 451: rc = 0 00100000:10000000:0.0:1783135152.019497:0:18234:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre under 453: rc = 0 00100000:10000000:0.0:1783135152.020729:0:18234:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled dt-0x0 under 771: rc = 0 00100000:10000000:0.0:1783135152.020898:0:18234:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled md-0x0 under 771: rc = 0 00100000:10000000:0.0:1783135152.021926:0:18234:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000-MDT0000 under 774: rc = 0 00100000:10000000:0.0:1783135152.022334:0:18234:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 774: rc = 0 00100000:10000000:0.0:1783135152.022614:0:18234:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000-MDT0000 under 774: rc = 0 00100000:10000000:0.0:1783135152.022932:0:18234:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 774: rc = 0 00100000:10000000:0.0:1783135152.023355:0:18234:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000-MDT0000 under 774: rc = 0 00100000:10000000:0.0:1783135152.023620:0:18234:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 774: rc = 0 00100000:10000000:0.0:1783135152.024066:0:18234:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000-MDT0000 under 774: rc = 0 00100000:10000000:0.0:1783135152.024347:0:18234:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 774: rc = 0 00100000:10000000:0.0:1783135152.024604:0:18234:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 774: rc = 0 00100000:10000000:0.0:1783135152.024909:0:18234:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000-MDT0000 under 774: rc = 0 00100000:10000000:0.0:1783135152.025269:0:18234:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000-MDT0000 under 774: rc = 0 00100000:10000000:0.0:1783135152.025530:0:18234:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 774: rc = 0 00100000:10000000:0.0:1783135152.026137:0:18234:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_14 under 593: rc = 0 00100000:10000000:0.0:1783135152.026415:0:18234:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_14 under 593: rc = 0 00100000:10000000:0.0:1783135152.026666:0:18234:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_07 under 593: rc = 0 00100000:10000000:0.0:1783135152.027120:0:18234:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_07 under 593: rc = 0 00100000:10000000:0.0:1783135152.027391:0:18234:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_00 under 593: rc = 0 00100000:10000000:0.0:1783135152.027665:0:18234:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_00 under 593: rc = 0 00100000:10000000:0.0:1783135152.028053:0:18234:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_13 under 593: rc = 0 00100000:10000000:0.0:1783135152.028325:0:18234:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_13 under 593: rc = 0 00100000:10000000:0.0:1783135152.028573:0:18234:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_04 under 593: rc = 0 00100000:10000000:0.0:1783135152.028904:0:18234:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_04 under 593: rc = 0 00100000:10000000:0.0:1783135152.029216:0:18234:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_03 under 593: rc = 0 00100000:10000000:0.0:1783135152.029504:0:18234:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_09 under 593: rc = 0 00100000:10000000:0.0:1783135152.029810:0:18234:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_03 under 593: rc = 0 00100000:10000000:0.0:1783135152.030127:0:18234:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_09 under 593: rc = 0 00100000:10000000:0.0:1783135152.030407:0:18234:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_10 under 593: rc = 0 00100000:10000000:0.0:1783135152.030675:0:18234:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_10 under 593: rc = 0 00100000:10000000:0.0:1783135152.031080:0:18234:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_12 under 593: rc = 0 00100000:10000000:0.0:1783135152.031395:0:18234:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_12 under 593: rc = 0 00100000:10000000:0.0:1783135152.031715:0:18234:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_01 under 593: rc = 0 00100000:10000000:0.0:1783135152.032134:0:18234:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_01 under 593: rc = 0 00100000:10000000:0.0:1783135152.032414:0:18234:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_06 under 593: rc = 0 00100000:10000000:0.0:1783135152.032692:0:18234:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_06 under 593: rc = 0 00100000:10000000:0.0:1783135152.033106:0:18234:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_15 under 593: rc = 0 00100000:10000000:0.0:1783135152.033388:0:18234:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_15 under 593: rc = 0 00100000:10000000:0.0:1783135152.033644:0:18234:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_11 under 593: rc = 0 00100000:10000000:0.0:1783135152.034577:0:18234:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_11 under 593: rc = 0 00100000:10000000:0.0:1783135152.034916:0:18234:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_08 under 593: rc = 0 00100000:10000000:0.0:1783135152.035247:0:18234:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_02 under 593: rc = 0 00100000:10000000:0.0:1783135152.040517:0:18234:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_08 under 593: rc = 0 00100000:10000000:0.0:1783135152.040804:0:18234:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_02 under 593: rc = 0 00100000:10000000:0.0:1783135152.041619:0:18234:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_05 under 593: rc = 0 00100000:10000000:0.0:1783135152.041888:0:18234:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_05 under 593: rc = 0 00100000:10000000:0.0:1783135152.042421:0:18234:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled [0x200000400:0x1:0x0] under 275: rc = 0 00100000:10000000:0.0:1783135152.043391:0:18234:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x20000:0x0] (8/32) 00100000:10000000:0.0:1783135152.043595:0:18234:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 644: rc = 0 00100000:10000000:0.0:1783135152.043796:0:18234:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2020000:0x0] (8/32) 00100000:10000000:0.0:1783135152.043867:0:18234:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 644: rc = 0 00100000:10000000:0.0:1783135152.044052:0:18234:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1020000:0x0] (8/32) 00100000:10000000:0.0:1783135152.044124:0:18234:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 644: rc = 0 00100000:10000000:0.0:1783135152.044566:0:18234:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x10000:0x0] (8/32) 00100000:10000000:0.0:1783135152.044647:0:18234:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 772: rc = 0 00100000:10000000:0.0:1783135152.044847:0:18234:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1010000:0x0] (8/32) 00100000:10000000:0.0:1783135152.044919:0:18234:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 772: rc = 0 00100000:10000000:0.0:1783135152.045121:0:18234:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2010000:0x0] (8/32) 00100000:10000000:0.0:1783135152.045194:0:18234:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 772: rc = 0 00000020:00000080:0.0:1783135152.046436:0:18234:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:0.0:1783135152.046445:0:18234:0:(osd_handler.c:1569:osd_obd_connect()) connect #0 00000020:00000080:0.0:1783135152.046457:0:18234:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xd6c4b8f058680031 00000020:01000004:0.0:1783135152.046465:0:18234:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:0.0:1783135152.046469:0:18234:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:0.0:1783135152.046474:0:18234:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9fe8c47e7000 from MGS 00000020:01000004:0.0:1783135152.046477:0:18234:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:0.0:1783135152.046486:0:18234:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff9fe9c8efcd40) 00000020:00000080:0.0:1783135152.046495:0:18234:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:0.0:1783135152.046548:0:18234:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9fe8c47e7000 from MGS, refs=2 00080000:01000000:0.0:1783135152.046565:0:18234:0:(osd_handler.c:1569:osd_obd_connect()) connect #1 00000020:00000080:0.0:1783135152.046571:0:18234:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xd6c4b8f05868003f 00000100:00100000:0.0:1783135152.046658:0:18234:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:0.0:1783135152.046762:0:18234:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:0.0:1783135152.046767:0:18234:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:0.0:1783135152.049007:0:18234:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:0.0:1783135152.049028:0:18234:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:0.0:1783135152.050222:0:18234:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1783135152.050437:0:18234:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:0.0:1783135152.052660:0:18234:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:0.0:1783135152.053267:0:18234:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:0.0:1783135152.053354:0:18234:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:0.0:1783135152.053690:0:18234:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:0.0:1783135152.053697:0:18234:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:2.0:1783135152.054689:0:18240:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783135152.054692:0:18240:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783135152.054694:0:18240:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783135152.055014:0:18241:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783135152.055016:0:18241:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783135152.055018:0:18241:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783135152.055624:0:18234:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:2.0:1783135152.060945:0:18240:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:1.0:1783135152.064454:0:18234:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:1.0:1783135152.064475:0:18234:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:1.0:1783135152.064478:0:18234:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:3.0:1783135152.067102:0:18243:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:1.0:1783135152.067262:0:18234:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:1.0:1783135152.067379:0:18234:0:(mgs_llog.c:683:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1783135152.067828:0:18234:0:(mgs_llog.c:683:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:1.0:1783135152.070256:0:18234:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1783135152.070434:0:18234:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:1.0:1783135152.070440:0:18234:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:1.0:1783135152.073480:0:18234:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:1.0:1783135152.073492:0:18234:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:2.0:1783135152.074145:0:18234:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:2.0:1783135152.074153:0:18234:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:2.0:1783135152.075068:0:18234:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:2.0:1783135152.075092:0:18234:0:(obd_mount.c:402:lustre_start_mgc()) Start MGC 'MGC192.168.201.141@tcp' 00000020:01000004:2.0:1783135152.075094:0:18234:0:(obd_mount.c:411:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:2.0:1783135152.075124:0:18234:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD MGC192.168.201.141@tcp (typ=mgc) 00000020:00000080:2.0:1783135152.075138:0:18234:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.201.141@tcp (ffff9fe9ca89cd40) 00000020:00000080:2.0:1783135152.075156:0:18234:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:2.0:1783135152.075224:0:18234:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9fe9c9d3a000@MGC192.168.201.141@tcp: add connection 192.168.201.141@tcp at head 00010000:00010000:2.0:1783135152.075516:0:18234:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.201.141@tcp-0 is initialized 00000040:01000000:2.0:1783135152.075523:0:18234:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.141@tcp ctxt 1 is initialized 10000000:01000000:2.0:1783135152.078300:0:18249:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000100:00080000:1.0:1783135152.079450:0:18248:0:(pinger.c:468:ping_evictor_main()) Starting Ping Evictor 00000020:00000080:0.0:1783135152.079672:0:18234:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.201.141@tcp (uuid 06a7653e-5f5a-4acc-ba93-0eff19f145f0) 00000020:00000080:0.0:1783135152.079693:0:18234:0:(genops.c:1406:class_connect()) connect: client 06a7653e-5f5a-4acc-ba93-0eff19f145f0, cookie 0xd6c4b8f05868004d 00000100:00080000:0.0:1783135152.079707:0:18234:0:(import.c:512:import_select_connection()) MGC192.168.201.141@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1783135152.079714:0:18234:0:(import.c:626:import_select_connection()) MGC192.168.201.141@tcp: import ffff9fe9c9d3a000 using connection 192.168.201.141@tcp/0@lo 00000100:00100000:0.0:1783135152.079750:0:18234:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9fe9fe8fed80 x1869752384456704/t0(0) o250->MGC192.168.201.141@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1783135152.079776:0:18234:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import 06a7653e-5f5a-4acc-ba93-0eff19f145f0->MGS 00000020:01000004:0.0:1783135152.079802:0:18234:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:0.0:1783135152.079807:0:18234:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:0.0:1783135152.079820:0:18234:0:(genops.c:413:class_newdev()) Allocate new device MDS (ffff9fe9c8ef99c0) 00000020:00000080:0.0:1783135152.079831:0:18234:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:2.0:1783135152.081096:0:3285:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9fe8fed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:06a7653e-5f5a-4acc-ba93-0eff19f145f0:3285:1869752384456704:0@lo:250:mount.lustre.0 00000100:00100000:2.0:1783135152.081172:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135152.081261:0:18245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384456704 00000100:00100000:0.0:1783135152.081269:0:18245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384456704 00000100:00100000:0.0:1783135152.081318:0:18245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1783135152.081326:0:18245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe8c6df7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3285:x1869752384456704:12345-0@lo:250:mount.lustre.0 00010000:00080000:0.0:1783135152.081349:0:18245:0:(ldlm_lib.c:1432:target_handle_connect()) MGS: connection from 06a7653e-5f5a-4acc-ba93-0eff19f145f0@0@lo t0 exp 0000000000000000 cur 434 last 0 00000020:00000080:0.0:1783135152.081372:0:18245:0:(genops.c:1406:class_connect()) connect: client 06a7653e-5f5a-4acc-ba93-0eff19f145f0, cookie 0xd6c4b8f05868005b 00000100:00080000:0.0:1783135152.081487:0:18245:0:(import.c:65:import_set_state_nolock()) ffff9fe9cb7de800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1783135152.081544:0:18245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe8c6df7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:06a7653e-5f5a-4acc-ba93-0eff19f145f0+5:3285:x1869752384456704:12345-0@lo:250:mount.lustre.0 Request processed in 218us (371us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135152.081563:0:18245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1783135152.081596:0:3285:0:(client.c:3111:ptlrpc_free_committed()) MGC192.168.201.141@tcp: committing for last_committed 0 gen 1 00000100:00080000:2.0:1783135152.081606:0:3285:0:(import.c:1134:ptlrpc_connect_interpret()) MGC192.168.201.141@tcp: connect to target with instance 0 00000100:00080000:2.0:1783135152.081615:0:3285:0:(import.c:961:ptlrpc_connect_set_flags()) MGC192.168.201.141@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:2.0:1783135152.081621:0:3285:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:2.0:1783135152.081625:0:3285:0:(import.c:65:import_set_state_nolock()) ffff9fe9c9d3a000 MGS: changing import state from CONNECTING to FULL 10000000:01000000:2.0:1783135152.081628:0:3285:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:2.0:1783135152.081638:0:3285:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:2.0:1783135152.081644:0:3285:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9fe8fed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:06a7653e-5f5a-4acc-ba93-0eff19f145f0:3285:1869752384456704:0@lo:250:mount.lustre.0 00000100:00100000:0.0:1783135152.092655:0:18234:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1783135152.092846:0:18234:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:0.0:1783135152.092852:0:18234:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:1.0:1783135152.093639:0:18234:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:1.0:1783135152.093646:0:18234:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:0.0:1783135152.094107:0:18234:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:0.0:1783135152.094115:0:18234:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:0.0:1783135152.094828:0:18234:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1783135152.095034:0:18234:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:0.0:1783135152.095039:0:18234:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:0.0:1783135152.095449:0:18234:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:0.0:1783135152.095455:0:18234:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:0.0:1783135152.129055:0:18234:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1783135152.129271:0:18234:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:0.0:1783135152.129417:0:18234:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:0.0:1783135152.130245:0:18234:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:0.0:1783135152.130252:0:18234:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:0.0:1783135152.130995:0:18234:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1783135152.131150:0:18234:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:0.0:1783135152.131157:0:18234:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:0.0:1783135152.131730:0:18234:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:0.0:1783135152.131736:0:18234:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:0.0:1783135152.132175:0:18234:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1783135152.132490:0:18234:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:0.0:1783135152.132494:0:18234:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:0.0:1783135152.132897:0:18234:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:0.0:1783135152.132903:0:18234:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:0.0:1783135152.133415:0:18234:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1783135152.133532:0:18234:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:0.0:1783135152.133536:0:18234:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:0.0:1783135152.133881:0:18234:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:0.0:1783135152.133887:0:18234:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:1.0:1783135152.148916:0:18234:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1783135152.149594:0:18234:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:1.0:1783135152.149603:0:18234:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:1.0:1783135152.150872:0:18234:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:1.0:1783135152.150881:0:18234:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:1.0:1783135152.151709:0:18234:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:1.0:1783135152.151722:0:18234:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:1.0:1783135152.152430:0:18234:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:1.0:1783135152.152452:0:18234:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:1.0:1783135152.152458:0:18234:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.141@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:1.0:1783135152.152599:0:18234:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.141@tcp ctxt 0 is initialized 00000020:01000004:1.0:1783135152.152635:0:18234:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.201.141@tcp, index=0000, flags=0x20005 00000020:01000004:1.0:1783135152.152639:0:18234:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1783135152.152641:0:18234:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1783135152.152643:0:18234:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1783135152.152644:0:18234:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1783135152.152645:0:18234:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1783135152.152646:0:18234:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1783135152.152647:0:18234:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1783135152.152649:0:18234:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1783135152.152650:0:18234:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1783135152.152652:0:18234:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1783135152.152654:0:18234:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:1.0:1783135152.152656:0:18234:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1783135152.152657:0:18234:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1783135152.152658:0:18234:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1783135152.152659:0:18234:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1783135152.152660:0:18234:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1783135152.152661:0:18234:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1783135152.152662:0:18234:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1783135152.152663:0:18234:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1783135152.152665:0:18234:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1783135152.152665:0:18234:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1783135152.152702:0:18234:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:1.0:1783135152.152723:0:18234:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe8c590ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:06a7653e-5f5a-4acc-ba93-0eff19f145f0:18234:1869752384456832:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1783135152.152793:0:18234:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135152.152883:0:18234:0:(client.c:2701:ptlrpc_set_wait()) set ffff9fe9d29e4480 going to sleep for 11 seconds 00000100:00100000:0.0:1783135152.152928:0:18247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384456832 00000100:00100000:0.0:1783135152.152935:0:18247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384456832 00000100:00100000:0.0:1783135152.153009:0:18247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1783135152.153019:0:18247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe8c6df5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:06a7653e-5f5a-4acc-ba93-0eff19f145f0+5:18234:x1869752384456832:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1783135152.153073:0:18247:0:(mgs_llog.c:683:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1783135152.153076:0:18247:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:0.0:1783135152.153079:0:18247:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 10000000:01000000:3.0:1783135152.153621:0:18268:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:0.0:1783135152.154207:0:18247:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 8 20000000:01000000:3.0:1783135152.155640:0:18269:0:(mgs_llog.c:341:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:3.0:1783135152.155646:0:18269:0:(mgs_llog.c:325:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:3.0:1783135152.155649:0:18269:0:(mgs_llog.c:325:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:3.0:1783135152.155684:0:18269:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 20000000:01000000:0.0:1783135152.155953:0:18247:0:(mgs_llog.c:683:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1783135152.155963:0:18247:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:0.0:1783135152.168421:0:18247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe8c6df5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:06a7653e-5f5a-4acc-ba93-0eff19f145f0+5:18234:x1869752384456832:12345-0@lo:253:mount.lustre.0 Request processed in 15396us (15619us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135152.168436:0:18247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1783135152.168534:0:18234:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe8c590ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:06a7653e-5f5a-4acc-ba93-0eff19f145f0:18234:1869752384456832:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1783135152.168547:0:18234:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:1.0:1783135152.168561:0:18234:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1783135152.168563:0:18234:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1783135152.168583:0:18234:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1783135152.168585:0:18234:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1783135152.168586:0:18234:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1783135152.168588:0:18234:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1783135152.168589:0:18234:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1783135152.168591:0:18234:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1783135152.168592:0:18234:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1783135152.168593:0:18234:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1783135152.168613:0:18234:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9fe8c47e7000 from lustre-MDT0000 10000000:01000000:1.0:1783135152.168638:0:18234:0:(mgc_request.c:1945:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:1.0:1783135152.168641:0:18234:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1783135152.168645:0:18234:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff9fe9ca89cd40 10000000:01000000:1.0:1783135152.168649:0:18234:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1783135152.168656:0:18234:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-sptlrpc-ffff9fe9ca89cd40 from 1 10000000:01000000:1.0:1783135152.168659:0:18234:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1783135152.168700:0:18234:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.141@tcp lock: ffff9fe8c5550800/0xd6c4b8f058680062 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135152.168712:0:18234:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.141@tcp lock: ffff9fe8c5550800/0xd6c4b8f058680062 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135152.168722:0:18234:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.141@tcp lock: ffff9fe8c5550800/0xd6c4b8f058680062 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783135152.168743:0:18234:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe8c590ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:06a7653e-5f5a-4acc-ba93-0eff19f145f0:18234:1869752384456960:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1783135152.168780:0:18234:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135152.168816:0:18234:0:(client.c:2701:ptlrpc_set_wait()) set ffff9fe9d29e4b40 going to sleep for 11 seconds 00000100:00100000:0.0:1783135152.168923:0:18245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384456960 00000100:00100000:0.0:1783135152.168930:0:18245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384456960 00000100:00100000:0.0:1783135152.169100:0:18245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1783135152.169112:0:18245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fe69c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:06a7653e-5f5a-4acc-ba93-0eff19f145f0+5:18234:x1869752384456960:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1783135152.169124:0:18245:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783135152.169138:0:18245:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fe9f68ad600/0xd6c4b8f058680069 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd6c4b8f058680062 expref: -99 pid: 18245 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135152.169160:0:18245:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fe9f68ad600/0xd6c4b8f058680069 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd6c4b8f058680062 expref: 6 pid: 18245 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135152.169170:0:18245:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fe9f68ad600/0xd6c4b8f058680069 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd6c4b8f058680062 expref: 6 pid: 18245 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135152.169180:0:18245:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fe9f68ad600, rc 0) 00000100:00100000:0.0:1783135152.169220:0:18245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fe69c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:06a7653e-5f5a-4acc-ba93-0eff19f145f0+6:18234:x1869752384456960:12345-0@lo:101:mount.lustre.0 Request processed in 111us (440us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135152.169226:0:18245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1783135152.169335:0:18234:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe8c590ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:06a7653e-5f5a-4acc-ba93-0eff19f145f0:18234:1869752384456960:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1783135152.169347:0:18234:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.141@tcp lock: ffff9fe8c5550800/0xd6c4b8f058680062 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd6c4b8f058680069 expref: -99 pid: 18234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135152.169366:0:18234:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.141@tcp lock: ffff9fe8c5550800/0xd6c4b8f058680062 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd6c4b8f058680069 expref: -99 pid: 18234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783135152.169409:0:18234:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9fe90df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:06a7653e-5f5a-4acc-ba93-0eff19f145f0:18234:1869752384457088:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1783135152.169433:0:18234:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135152.169449:0:18234:0:(client.c:2701:ptlrpc_set_wait()) set ffff9fe9c2fa8300 going to sleep for 11 seconds 00000100:00100000:0.0:1783135152.169532:0:18247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384457088 00000100:00100000:0.0:1783135152.169536:0:18247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384457088 00000100:00100000:0.0:1783135152.169581:0:18247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1783135152.169588:0:18247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fe69c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:06a7653e-5f5a-4acc-ba93-0eff19f145f0+6:18234:x1869752384457088:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1783135152.169828:0:18247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fe69c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:06a7653e-5f5a-4acc-ba93-0eff19f145f0+6:18234:x1869752384457088:12345-0@lo:501:mount.lustre.0 Request processed in 240us (393us total) trans 0 rc -2/-2 00000100:00100000:0.0:1783135152.169835:0:18247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1783135152.170223:0:18234:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9fe90df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:06a7653e-5f5a-4acc-ba93-0eff19f145f0:18234:1869752384457088:0@lo:501:mount.lustre.0 10000000:01000000:3.0:1783135152.170247:0:18234:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.201.141@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1783135152.170332:0:18234:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.141@tcp lock: ffff9fe8c5550800/0xd6c4b8f058680062 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd6c4b8f058680069 expref: -99 pid: 18234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135152.170342:0:18234:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.141@tcp lock: ffff9fe8c5550800/0xd6c4b8f058680062 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd6c4b8f058680069 expref: -99 pid: 18234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783135152.170350:0:18234:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9fe8c47e7000 10000000:01000000:3.0:1783135152.170354:0:18234:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1783135152.170358:0:18234:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff9fe8c47e7000 10000000:01000000:3.0:1783135152.170360:0:18234:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:3.0:1783135152.170363:0:18234:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-barrier-ffff9fe8c47e7000 from 1 10000000:01000000:3.0:1783135152.170365:0:18234:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:3.0:1783135152.170384:0:18234:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.141@tcp lock: ffff9fe9c0031000/0xd6c4b8f058680070 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135152.170392:0:18234:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.141@tcp lock: ffff9fe9c0031000/0xd6c4b8f058680070 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135152.170401:0:18234:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.141@tcp lock: ffff9fe9c0031000/0xd6c4b8f058680070 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783135152.170419:0:18234:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9fe90df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:06a7653e-5f5a-4acc-ba93-0eff19f145f0:18234:1869752384457216:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1783135152.170444:0:18234:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135152.170461:0:18234:0:(client.c:2701:ptlrpc_set_wait()) set ffff9fe9c2fa8300 going to sleep for 11 seconds 00000100:00100000:0.0:1783135152.170506:0:18247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384457216 00000100:00100000:0.0:1783135152.170511:0:18247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384457216 00000100:00100000:0.0:1783135152.170540:0:18247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1783135152.170546:0:18247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fe69ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:06a7653e-5f5a-4acc-ba93-0eff19f145f0+6:18234:x1869752384457216:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1783135152.170563:0:18247:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783135152.170665:0:18247:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fe9f68ac000/0xd6c4b8f058680077 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd6c4b8f058680070 expref: -99 pid: 18247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135152.170685:0:18247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fe9f68ac000/0xd6c4b8f058680077 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd6c4b8f058680070 expref: 7 pid: 18247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135152.170694:0:18247:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fe9f68ac000/0xd6c4b8f058680077 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd6c4b8f058680070 expref: 7 pid: 18247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135152.170702:0:18247:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fe9f68ac000, rc 0) 00000100:00100000:0.0:1783135152.170737:0:18247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fe69ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:06a7653e-5f5a-4acc-ba93-0eff19f145f0+7:18234:x1869752384457216:12345-0@lo:101:mount.lustre.0 Request processed in 191us (291us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135152.170742:0:18247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1783135152.170800:0:18234:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9fe90df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:06a7653e-5f5a-4acc-ba93-0eff19f145f0:18234:1869752384457216:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1783135152.170810:0:18234:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.141@tcp lock: ffff9fe9c0031000/0xd6c4b8f058680070 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd6c4b8f058680077 expref: -99 pid: 18234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135152.170818:0:18234:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.141@tcp lock: ffff9fe9c0031000/0xd6c4b8f058680070 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd6c4b8f058680077 expref: -99 pid: 18234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783135152.170829:0:18234:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.201.141@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:3.0:1783135152.170906:0:18234:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.141@tcp lock: ffff9fe9c0031000/0xd6c4b8f058680070 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd6c4b8f058680077 expref: -99 pid: 18234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135152.170915:0:18234:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.141@tcp lock: ffff9fe9c0031000/0xd6c4b8f058680070 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd6c4b8f058680077 expref: -99 pid: 18234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783135152.170921:0:18234:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1783135152.170924:0:18234:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1783135152.170928:0:18234:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff9fe8c47e7000 10000000:01000000:3.0:1783135152.170930:0:18234:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:3.0:1783135152.170933:0:18234:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:3.0:1783135152.170935:0:18234:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1783135152.170956:0:18234:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.141@tcp lock: ffff9fe9c0030800/0xd6c4b8f05868007e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135152.170963:0:18234:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.141@tcp lock: ffff9fe9c0030800/0xd6c4b8f05868007e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135152.170977:0:18234:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.141@tcp lock: ffff9fe9c0030800/0xd6c4b8f05868007e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783135152.171000:0:18234:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9fe90df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:06a7653e-5f5a-4acc-ba93-0eff19f145f0:18234:1869752384457344:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1783135152.171025:0:18234:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135152.171044:0:18234:0:(client.c:2701:ptlrpc_set_wait()) set ffff9fe9c2fa8300 going to sleep for 11 seconds 00000100:00100000:1.0:1783135152.171090:0:18246:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384457344 00000100:00100000:1.0:1783135152.171095:0:18246:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384457344 00000100:00100000:1.0:1783135152.171122:0:18246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1783135152.171128:0:18246:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fe69fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:06a7653e-5f5a-4acc-ba93-0eff19f145f0+7:18234:x1869752384457344:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1783135152.171135:0:18246:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783135152.171149:0:18246:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fe8c5551e00/0xd6c4b8f058680085 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xd6c4b8f05868007e expref: -99 pid: 18246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135152.171163:0:18246:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fe8c5551e00/0xd6c4b8f058680085 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd6c4b8f05868007e expref: 8 pid: 18246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135152.171171:0:18246:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fe8c5551e00/0xd6c4b8f058680085 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd6c4b8f05868007e expref: 8 pid: 18246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135152.171178:0:18246:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fe8c5551e00, rc 0) 00000100:00100000:1.0:1783135152.171210:0:18246:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fe69fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:06a7653e-5f5a-4acc-ba93-0eff19f145f0+8:18234:x1869752384457344:12345-0@lo:101:mount.lustre.0 Request processed in 82us (184us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135152.171215:0:18246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1783135152.171621:0:18234:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9fe90df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:06a7653e-5f5a-4acc-ba93-0eff19f145f0:18234:1869752384457344:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1783135152.171632:0:18234:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.141@tcp lock: ffff9fe9c0030800/0xd6c4b8f05868007e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd6c4b8f058680085 expref: -99 pid: 18234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135152.171641:0:18234:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.141@tcp lock: ffff9fe9c0030800/0xd6c4b8f05868007e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xd6c4b8f058680085 expref: -99 pid: 18234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783135152.171683:0:18234:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9fe90df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:06a7653e-5f5a-4acc-ba93-0eff19f145f0:18234:1869752384457472:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1783135152.171706:0:18234:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135152.171721:0:18234:0:(client.c:2701:ptlrpc_set_wait()) set ffff9fe9c2fa8300 going to sleep for 11 seconds 00000100:00100000:0.0:1783135152.171814:0:18247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384457472 00000100:00100000:0.0:1783135152.171818:0:18247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384457472 00000100:00100000:0.0:1783135152.171845:0:18247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1783135152.171851:0:18247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fe69d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:06a7653e-5f5a-4acc-ba93-0eff19f145f0+8:18234:x1869752384457472:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1783135152.172214:0:18247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fe69d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:06a7653e-5f5a-4acc-ba93-0eff19f145f0+9:18234:x1869752384457472:12345-0@lo:501:mount.lustre.0 Request processed in 362us (506us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135152.172227:0:18247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1783135152.172463:0:18234:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9fe90df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:06a7653e-5f5a-4acc-ba93-0eff19f145f0:18234:1869752384457472:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1783135152.172492:0:18234:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9fe90df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:06a7653e-5f5a-4acc-ba93-0eff19f145f0:18234:1869752384457600:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1783135152.172527:0:18234:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135152.172543:0:18234:0:(client.c:2701:ptlrpc_set_wait()) set ffff9fe9c2fa8300 going to sleep for 11 seconds 00000100:00100000:0.0:1783135152.172854:0:18245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384457600 00000100:00100000:0.0:1783135152.172859:0:18245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384457600 00000100:00100000:0.0:1783135152.172924:0:18245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1783135152.172932:0:18245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fe69dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:06a7653e-5f5a-4acc-ba93-0eff19f145f0+9:18234:x1869752384457600:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1783135152.173251:0:18245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fe69dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:06a7653e-5f5a-4acc-ba93-0eff19f145f0+9:18234:x1869752384457600:12345-0@lo:503:mount.lustre.0 Request processed in 319us (722us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135152.173258:0:18245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1783135152.173358:0:18234:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9fe90df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:06a7653e-5f5a-4acc-ba93-0eff19f145f0:18234:1869752384457600:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1783135152.174246:0:18270:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9f6fe4380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:06a7653e-5f5a-4acc-ba93-0eff19f145f0:18270:1869752384457728:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783135152.174401:0:18270:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135152.174455:0:18270:0:(client.c:2701:ptlrpc_set_wait()) set ffff9fe9d1552f00 going to sleep for 11 seconds 00000100:00100000:1.0:1783135152.174488:0:18246:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384457728 00000100:00100000:1.0:1783135152.174494:0:18246:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384457728 00000100:00100000:1.0:1783135152.174565:0:18246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1783135152.174580:0:18246:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fe69c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:06a7653e-5f5a-4acc-ba93-0eff19f145f0+9:18270:x1869752384457728:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783135152.174826:0:18246:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fe69c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:06a7653e-5f5a-4acc-ba93-0eff19f145f0+9:18270:x1869752384457728:12345-0@lo:502:llog_process_th.0 Request processed in 253us (424us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135152.174832:0:18246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1783135152.174897:0:18270:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9f6fe4380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:06a7653e-5f5a-4acc-ba93-0eff19f145f0:18270:1869752384457728:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1783135152.174922:0:18270:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1783135152.174932:0:18270:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783135152.174934:0:18270:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:2.0:1783135152.174940:0:18270:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:2.0:1783135152.174943:0:18270:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1783135152.174971:0:18270:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff9fe9ca89b380) 00000020:00000080:2.0:1783135152.175212:0:18270:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:2.0:1783135152.175220:0:18270:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00080000:01000000:2.0:1783135152.175311:0:18270:0:(osd_handler.c:1569:osd_obd_connect()) connect #2 00000020:00000080:2.0:1783135152.175318:0:18270:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xd6c4b8f058680093 00000020:00000080:2.0:1783135152.175515:0:18270:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:2.0:1783135152.175519:0:18270:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1783135152.175522:0:18270:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783135152.175523:0:18270:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:2.0:1783135152.175526:0:18270:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1783135152.175529:0:18270:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783135152.175531:0:18270:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:2.0:1783135152.175534:0:18270:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1783135152.175540:0:18270:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff9fe9ca898000) 00000020:00000080:2.0:1783135152.175548:0:18270:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:2.0:1783135152.175562:0:18270:0:(obd_config.c:1470:class_process_config()) processing cmd: cf007 00000020:00000080:2.0:1783135152.175564:0:18270:0:(obd_config.c:1514:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:2.0:1783135152.175573:0:18270:0:(obd_config.c:1148:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:2.0:1783135152.175580:0:18270:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1783135152.175617:0:18270:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9fe8c47e7000 from lustre-MDT0000, refs=3 00000020:00000080:2.0:1783135152.175628:0:18270:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff9fe9ca8999c0) 00000020:00000080:2.0:1783135152.175644:0:18270:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:2.0:1783135152.175686:0:18270:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:2.0:1783135152.175691:0:18270:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xd6c4b8f0586800a8 00000020:00000080:2.0:1783135152.175770:0:18270:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:2.0:1783135152.175775:0:18270:0:(mdd_device.c:1596:mdd_obd_connect()) connect #0 00000020:00000080:2.0:1783135152.175779:0:18270:0:(genops.c:1406:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0xd6c4b8f0586800af 00080000:01000000:2.0:1783135152.175783:0:18270:0:(osd_handler.c:1569:osd_obd_connect()) connect #3 00000020:00000080:2.0:1783135152.175786:0:18270:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xd6c4b8f0586800b6 00010000:00010000:1.0:1783135152.280958:0:18270:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:00000004:1.0:1783135152.282523:0:18270:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 3, last_transno is 8589934679 00000001:00080000:1.0:1783135152.282986:0:18270:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:1.0:1783135152.284762:0:18270:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff9fe8c45699c0) 00000020:00000080:1.0:1783135152.284785:0:18270:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:1.0:1783135152.284852:0:18270:0:(osd_handler.c:1569:osd_obd_connect()) connect #4 00000020:00000080:1.0:1783135152.284860:0:18270:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xd6c4b8f0586800c4 00000020:00000080:1.0:1783135152.303236:0:18270:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:1.0:1783135152.307932:0:18270:0:(genops.c:1406:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0xd6c4b8f0586800cb 00000020:00000080:1.0:1783135152.308456:0:18270:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:1.0:1783135152.308467:0:18270:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1783135152.308473:0:18270:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783135152.308475:0:18270:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:1.0:1783135152.308479:0:18270:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1783135152.308481:0:18270:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #8 00000020:01000000:1.0:1783135152.308483:0:18270:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1783135152.308485:0:18270:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1783135152.308493:0:18270:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1783135152.308496:0:18270:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783135152.308498:0:18270:0:(obd_config.c:1561:class_process_config()) marker 8 (0x6) lustre sys.timeout 00000020:01000000:1.0:1783135152.308501:0:18270:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1783135152.308506:0:18270:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783135152.308508:0:18270:0:(obd_config.c:1561:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:1.0:1783135152.308513:0:18270:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000004:01000000:1.0:1783135152.308547:0:18270:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:1.0:1783135152.308576:0:18270:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1783135152.308579:0:18270:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783135152.308581:0:18270:0:(obd_config.c:1561:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:1.0:1783135152.308584:0:18270:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1783135152.308587:0:18270:0:(obd_mount.c:952:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:1.0:1783135152.308596:0:18270:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783135152.308598:0:18270:0:(obd_config.c:1561:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:1.0:1783135152.308601:0:18270:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1783135152.308607:0:18270:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.201.141@tcp to nid 0x20000c0a8c98d (192.168.201.141@tcp) 00000020:01000000:1.0:1783135152.308634:0:18270:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1783135152.308637:0:18270:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1783135152.308652:0:18270:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff9fe8c4568000) 00000020:00000080:1.0:1783135152.308666:0:18270:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:1.0:1783135152.308671:0:18270:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1783135152.308810:0:18270:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:1.0:1783135152.308817:0:18270:0:(osd_handler.c:1569:osd_obd_connect()) connect #5 00000020:00000080:1.0:1783135152.308823:0:18270:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xd6c4b8f0586800d9 00010000:00080000:1.0:1783135152.308859:0:18270:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9fe9fdc3a800@lustre-OST0000-osc-MDT0000: add connection 192.168.201.141@tcp at head 00010000:00010000:1.0:1783135152.309070:0:18270:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-1 is initialized 00000040:01000000:1.0:1783135152.309524:0:18270:0:(llog_osd.c:2237:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1783135152.309583:0:18270:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:1.0:1783135152.313182:0:18270:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1783135152.313244:0:18270:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].3, 64 off8384 00000040:00080000:1.0:1783135152.313339:0:18270:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x10:0x0].1, 64 off8256 00000040:00080000:1.0:1783135152.313639:0:18274:0:(llog.c:800:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:1.0:1783135152.313643:0:18274:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x10:0x0] at index 3 of catalog [0x1:0x2:0x0] 00000020:00000080:1.0:1783135152.314679:0:18270:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1783135152.314688:0:18270:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1783135152.314779:0:18270:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:1.0:1783135152.314797:0:18270:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xd6c4b8f0586800e0 00000100:00080000:1.0:1783135152.314807:0:18270:0:(import.c:512:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1783135152.314813:0:18270:0:(import.c:626:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9fe9fdc3a800 using connection 192.168.201.141@tcp/0@lo 00000100:00100000:1.0:1783135152.314845:0:18270:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9fe8c590ca80 x1869752384457856/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1783135152.314910:0:3285:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe8c590ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3285:1869752384457856:0@lo:8:llog_process_th.0 00000400:00000100:2.0:1783135152.314964:0:3285:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1869752384457856 offset 0 length 520: 4 00000100:00080000:1.0:1783135152.315025:0:18270:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:1.0:1783135152.315075:0:18270:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1783135152.315078:0:18270:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783135152.315080:0:18270:0:(obd_config.c:1561:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:1.0:1783135152.315083:0:18270:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1783135152.315085:0:18270:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #14 00000020:01000000:1.0:1783135152.315087:0:18270:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1783135152.315088:0:18270:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1783135152.315090:0:18270:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1783135152.315091:0:18270:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783135152.315093:0:18270:0:(obd_config.c:1561:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:1.0:1783135152.315095:0:18270:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1783135152.315098:0:18270:0:(obd_mount.c:952:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:1.0:1783135152.315101:0:18270:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783135152.315108:0:18270:0:(obd_config.c:1561:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:1.0:1783135152.315111:0:18270:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1783135152.315115:0:18270:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.201.141@tcp to nid 0x20000c0a8c98d (192.168.201.141@tcp) 00000020:01000000:1.0:1783135152.315133:0:18270:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1783135152.315135:0:18270:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1783135152.315144:0:18270:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff9fe8c456cd40) 00000020:00000080:1.0:1783135152.315155:0:18270:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:1.0:1783135152.315158:0:18270:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1783135152.315220:0:18270:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:1.0:1783135152.315226:0:18270:0:(osd_handler.c:1569:osd_obd_connect()) connect #6 00000020:00000080:1.0:1783135152.315231:0:18270:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xd6c4b8f0586800ee 00010000:00080000:1.0:1783135152.315276:0:18270:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9fe9f8a5c000@lustre-OST0001-osc-MDT0000: add connection 192.168.201.141@tcp at head 00010000:00010000:1.0:1783135152.315483:0:18270:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-2 is initialized 00000040:01000000:1.0:1783135152.315686:0:18270:0:(llog_osd.c:2237:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1783135152.315706:0:18270:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:1.0:1783135152.316532:0:18270:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1783135152.316609:0:18270:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].3, 64 off8384 00000040:00080000:1.0:1783135152.316677:0:18270:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x12:0x0].1, 64 off8256 00000040:00080000:3.0:1783135152.317194:0:18276:0:(llog.c:800:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:3.0:1783135152.317199:0:18276:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x12:0x0] at index 3 of catalog [0x1:0x5:0x0] 00000020:00000080:1.0:1783135152.318010:0:18270:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1783135152.318020:0:18270:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1783135152.318050:0:18270:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:1.0:1783135152.318066:0:18270:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xd6c4b8f0586800f5 00000100:00080000:1.0:1783135152.318076:0:18270:0:(import.c:512:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1783135152.318083:0:18270:0:(import.c:626:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9fe9f8a5c000 using connection 192.168.201.141@tcp/0@lo 00000100:00100000:1.0:1783135152.318116:0:18270:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9fe8c590c000 x1869752384457984/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1783135152.318146:0:18270:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:1.0:1783135152.318246:0:18270:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1783135152.318262:0:18270:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783135152.318264:0:18270:0:(obd_config.c:1561:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:1.0:1783135152.318276:0:18270:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1783135152.318307:0:18270:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783135152.318309:0:18270:0:(obd_config.c:1561:class_process_config()) marker 21 (0x1) lustre sys.timeout 00000020:00000080:1.0:1783135152.318313:0:18270:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1783135152.318315:0:18270:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1783135152.318318:0:18270:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1783135152.318320:0:18270:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783135152.318321:0:18270:0:(obd_config.c:1561:class_process_config()) marker 21 (0x2) lustre sys.timeout 00000020:01000000:1.0:1783135152.318323:0:18270:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1783135152.318325:0:18270:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783135152.318327:0:18270:0:(obd_config.c:1561:class_process_config()) marker 25 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1783135152.318330:0:18270:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1783135152.318366:0:18270:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe8c590e680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:06a7653e-5f5a-4acc-ba93-0eff19f145f0:18270:1869752384458112:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783135152.318443:0:18270:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135152.318476:0:18270:0:(client.c:2701:ptlrpc_set_wait()) set ffff9fe9f42c33c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783135152.318608:0:3285:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe8c590c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3285:1869752384457984:0@lo:8:llog_process_th.0 00000400:00000100:2.0:1783135152.318642:0:3285:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1869752384457984 offset 0 length 520: 4 00000100:00100000:0.0:1783135152.318743:0:18245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384458112 00000100:00100000:0.0:1783135152.318751:0:18245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384458112 00000100:00100000:0.0:1783135152.318797:0:18245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1783135152.318806:0:18245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fe69f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:06a7653e-5f5a-4acc-ba93-0eff19f145f0+9:18270:x1869752384458112:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783135152.319027:0:18245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fe69f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:06a7653e-5f5a-4acc-ba93-0eff19f145f0+9:18270:x1869752384458112:12345-0@lo:502:llog_process_th.0 Request processed in 220us (582us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135152.319036:0:18245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1783135152.319353:0:18270:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe8c590e680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:06a7653e-5f5a-4acc-ba93-0eff19f145f0:18270:1869752384458112:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1783135152.319383:0:18270:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1783135152.319388:0:18270:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783135152.319390:0:18270:0:(obd_config.c:1561:class_process_config()) marker 25 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1783135152.319394:0:18270:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:2.0:1783135152.319651:0:18234:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-36 (rc=0) 10000000:01000000:2.0:1783135152.319669:0:18234:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.201.141@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1783135152.319732:0:18234:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.141@tcp lock: ffff9fe9c0030800/0xd6c4b8f05868007e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd6c4b8f058680085 expref: -99 pid: 18234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135152.319744:0:18234:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.141@tcp lock: ffff9fe9c0030800/0xd6c4b8f05868007e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd6c4b8f058680085 expref: -99 pid: 18234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783135152.319752:0:18234:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-mdtir-ffff9fe8c47e7000 from 1 10000000:01000000:2.0:1783135152.319754:0:18234:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1783135152.319786:0:18234:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.141@tcp lock: ffff9fe9c1523200/0xd6c4b8f0586800fc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135152.319794:0:18234:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.141@tcp lock: ffff9fe9c1523200/0xd6c4b8f0586800fc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135152.319804:0:18234:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.141@tcp lock: ffff9fe9c1523200/0xd6c4b8f0586800fc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783135152.319832:0:18234:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9f6fe4380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:06a7653e-5f5a-4acc-ba93-0eff19f145f0:18234:1869752384458240:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1783135152.319867:0:18234:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135152.319899:0:18234:0:(client.c:2701:ptlrpc_set_wait()) set ffff9fe9d15520c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783135152.320004:0:18246:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384458240 00000100:00100000:1.0:1783135152.320009:0:18246:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384458240 00000100:00100000:1.0:1783135152.320041:0:18246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1783135152.320049:0:18246:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fe69e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:06a7653e-5f5a-4acc-ba93-0eff19f145f0+9:18234:x1869752384458240:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1783135152.320058:0:18246:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783135152.320072:0:18246:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fe8c5550c00/0xd6c4b8f058680103 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd6c4b8f0586800fc expref: -99 pid: 18246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135152.320094:0:18246:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fe8c5550c00/0xd6c4b8f058680103 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd6c4b8f0586800fc expref: 10 pid: 18246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135152.320114:0:18246:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fe8c5550c00/0xd6c4b8f058680103 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd6c4b8f0586800fc expref: 10 pid: 18246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135152.320123:0:18246:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fe8c5550c00, rc 0) 00000100:00100000:1.0:1783135152.320162:0:18246:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fe69e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:06a7653e-5f5a-4acc-ba93-0eff19f145f0+10:18234:x1869752384458240:12345-0@lo:101:mount.lustre.0 Request processed in 113us (294us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135152.320168:0:18246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1783135152.320237:0:18234:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9f6fe4380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:06a7653e-5f5a-4acc-ba93-0eff19f145f0:18234:1869752384458240:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1783135152.320267:0:18234:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.141@tcp lock: ffff9fe9c1523200/0xd6c4b8f0586800fc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd6c4b8f058680103 expref: -99 pid: 18234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135152.320276:0:18234:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.141@tcp lock: ffff9fe9c1523200/0xd6c4b8f0586800fc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd6c4b8f058680103 expref: -99 pid: 18234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783135152.320860:0:18234:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9fe90df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:06a7653e-5f5a-4acc-ba93-0eff19f145f0:18234:1869752384458368:0@lo:256:mount.lustre.0 00000100:00100000:3.0:1783135152.320897:0:18234:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135152.320913:0:18234:0:(client.c:2701:ptlrpc_set_wait()) set ffff9fe9d29d2900 going to sleep for 11 seconds 00000100:00100000:2.0:1783135152.321157:0:18247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384458368 00000100:00100000:2.0:1783135152.321162:0:18247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384458368 00000100:00100000:2.0:1783135152.321228:0:18247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1783135152.321237:0:18247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fe69cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:06a7653e-5f5a-4acc-ba93-0eff19f145f0+10:18234:x1869752384458368:12345-0@lo:256:mount.lustre.0 20000000:01000000:2.0:1783135152.321262:0:18247:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:2.0:1783135152.321268:0:18247:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:2.0:1783135152.321352:0:18247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fe69cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:06a7653e-5f5a-4acc-ba93-0eff19f145f0+10:18234:x1869752384458368:12345-0@lo:256:mount.lustre.0 Request processed in 115us (453us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135152.321359:0:18247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1783135152.321423:0:18234:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9fe90df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:06a7653e-5f5a-4acc-ba93-0eff19f145f0:18234:1869752384458368:0@lo:256:mount.lustre.0 10000000:01000000:3.0:1783135152.322194:0:18234:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.201.141@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1783135152.322629:0:18234:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.141@tcp lock: ffff9fe9c1523200/0xd6c4b8f0586800fc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd6c4b8f058680103 expref: -99 pid: 18234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135152.322641:0:18234:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.141@tcp lock: ffff9fe9c1523200/0xd6c4b8f0586800fc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd6c4b8f058680103 expref: -99 pid: 18234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783135152.322650:0:18234:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff9fe8c47e7000 from 1 10000000:01000000:3.0:1783135152.322652:0:18234:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1783135152.322685:0:18234:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.141@tcp lock: ffff9fe9c0031600/0xd6c4b8f05868010a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135152.322693:0:18234:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.141@tcp lock: ffff9fe9c0031600/0xd6c4b8f05868010a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135152.322704:0:18234:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.141@tcp lock: ffff9fe9c0031600/0xd6c4b8f05868010a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783135152.322791:0:18234:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9fe90df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:06a7653e-5f5a-4acc-ba93-0eff19f145f0:18234:1869752384458496:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1783135152.322896:0:18234:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135152.322934:0:18234:0:(client.c:2701:ptlrpc_set_wait()) set ffff9fe9d29d2900 going to sleep for 11 seconds 00000100:00100000:1.0:1783135152.323062:0:18246:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384458496 00000100:00100000:1.0:1783135152.323069:0:18246:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384458496 00000100:00100000:1.0:1783135152.323111:0:18246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1783135152.323120:0:18246:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fe69f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:06a7653e-5f5a-4acc-ba93-0eff19f145f0+10:18234:x1869752384458496:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1783135152.323132:0:18246:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783135152.323146:0:18246:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fe8c5551200/0xd6c4b8f058680111 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd6c4b8f05868010a expref: -99 pid: 18246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135152.323170:0:18246:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fe8c5551200/0xd6c4b8f058680111 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd6c4b8f05868010a expref: 11 pid: 18246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135152.323182:0:18246:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fe8c5551200/0xd6c4b8f058680111 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd6c4b8f05868010a expref: 11 pid: 18246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135152.323191:0:18246:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fe8c5551200, rc 0) 00000100:00100000:1.0:1783135152.323237:0:18246:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fe69f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:06a7653e-5f5a-4acc-ba93-0eff19f145f0+11:18234:x1869752384458496:12345-0@lo:101:mount.lustre.0 Request processed in 118us (340us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135152.323243:0:18246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1783135152.323374:0:18234:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9fe90df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:06a7653e-5f5a-4acc-ba93-0eff19f145f0:18234:1869752384458496:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1783135152.323388:0:18234:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.141@tcp lock: ffff9fe9c0031600/0xd6c4b8f05868010a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd6c4b8f058680111 expref: -99 pid: 18234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135152.323398:0:18234:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.141@tcp lock: ffff9fe9c0031600/0xd6c4b8f05868010a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd6c4b8f058680111 expref: -99 pid: 18234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783135152.323452:0:18234:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9fe90df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:06a7653e-5f5a-4acc-ba93-0eff19f145f0:18234:1869752384458624:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1783135152.323478:0:18234:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135152.323497:0:18234:0:(client.c:2701:ptlrpc_set_wait()) set ffff9fe9d29d2900 going to sleep for 11 seconds 00000100:00100000:1.0:1783135152.323588:0:18246:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384458624 00000100:00100000:1.0:1783135152.323592:0:18246:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384458624 00000100:00100000:1.0:1783135152.323617:0:18246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1783135152.323623:0:18246:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fe69d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:06a7653e-5f5a-4acc-ba93-0eff19f145f0+11:18234:x1869752384458624:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1783135152.324201:0:18246:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fe69d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:06a7653e-5f5a-4acc-ba93-0eff19f145f0+11:18234:x1869752384458624:12345-0@lo:501:mount.lustre.0 Request processed in 577us (721us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135152.324208:0:18246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1783135152.324571:0:18234:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9fe90df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:06a7653e-5f5a-4acc-ba93-0eff19f145f0:18234:1869752384458624:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1783135152.324685:0:18234:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9fe8fdc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:06a7653e-5f5a-4acc-ba93-0eff19f145f0:18234:1869752384458752:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1783135152.324743:0:18234:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135152.324772:0:18234:0:(client.c:2701:ptlrpc_set_wait()) set ffff9fe9e9c68900 going to sleep for 11 seconds 00000100:00100000:2.0:1783135152.324880:0:18247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384458752 00000100:00100000:2.0:1783135152.324885:0:18247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384458752 00000100:00100000:2.0:1783135152.324924:0:18247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1783135152.324931:0:18247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fe69e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:06a7653e-5f5a-4acc-ba93-0eff19f145f0+11:18234:x1869752384458752:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1783135152.325084:0:18247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fe69e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:06a7653e-5f5a-4acc-ba93-0eff19f145f0+11:18234:x1869752384458752:12345-0@lo:503:mount.lustre.0 Request processed in 153us (341us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135152.325091:0:18247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1783135152.325209:0:18234:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9fe8fdc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:06a7653e-5f5a-4acc-ba93-0eff19f145f0:18234:1869752384458752:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1783135152.325843:0:18278:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9fe90ca80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:06a7653e-5f5a-4acc-ba93-0eff19f145f0:18278:1869752384458880:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783135152.325883:0:18278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135152.325943:0:18278:0:(client.c:2701:ptlrpc_set_wait()) set ffff9fe9d29d2cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1783135152.325978:0:18246:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384458880 00000100:00100000:1.0:1783135152.325983:0:18246:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384458880 00000100:00100000:1.0:1783135152.326050:0:18246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1783135152.326057:0:18246:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fe69d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:06a7653e-5f5a-4acc-ba93-0eff19f145f0+11:18278:x1869752384458880:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783135152.326352:0:18278:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9fe90ca80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:06a7653e-5f5a-4acc-ba93-0eff19f145f0:18278:1869752384458880:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1783135152.326377:0:18278:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1783135152.326386:0:18278:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783135152.326388:0:18278:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1783135152.326398:0:18278:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9fe8c47e7000 00000020:00000080:3.0:1783135152.326414:0:18278:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1783135152.326422:0:18278:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1783135152.326425:0:18278:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783135152.326426:0:18278:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1783135152.326429:0:18278:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1783135152.326431:0:18278:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783135152.326438:0:18278:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1783135152.326444:0:18278:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9fe8c47e7000 00000020:00000080:3.0:1783135152.326446:0:18278:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1783135152.326501:0:18278:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1783135152.326505:0:18278:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783135152.326507:0:18278:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:3.0:1783135152.326510:0:18278:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1783135152.326513:0:18278:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783135152.326514:0:18278:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1783135152.326518:0:18278:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9fe8c47e7000 00000020:00000080:3.0:1783135152.326520:0:18278:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1783135152.326568:0:18278:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9fe90ca80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:06a7653e-5f5a-4acc-ba93-0eff19f145f0:18278:1869752384459008:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783135152.326601:0:18278:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135152.330015:0:18246:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fe69d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:06a7653e-5f5a-4acc-ba93-0eff19f145f0+11:18278:x1869752384458880:12345-0@lo:502:llog_process_th.0 Request processed in 3947us (4120us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135152.330030:0:18246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1783135152.331871:0:18246:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384459008 00000100:00100000:1.0:1783135152.331884:0:18246:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384459008 00000100:00100000:1.0:1783135152.331922:0:18246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1783135152.331931:0:18246:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fe69f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:06a7653e-5f5a-4acc-ba93-0eff19f145f0+11:18278:x1869752384459008:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783135152.332197:0:18246:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fe69f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:06a7653e-5f5a-4acc-ba93-0eff19f145f0+11:18278:x1869752384459008:12345-0@lo:502:llog_process_th.0 Request processed in 266us (5594us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135152.332205:0:18246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1783135152.334666:0:18278:0:(client.c:2701:ptlrpc_set_wait()) set ffff9fe9d29d2cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1783135152.334708:0:18278:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9fe90ca80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:06a7653e-5f5a-4acc-ba93-0eff19f145f0:18278:1869752384459008:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1783135152.336119:0:18278:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1783135152.336129:0:18278:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783135152.336131:0:18278:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:3.0:1783135152.336140:0:18278:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:1.0:1783135152.336415:0:18234:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:1.0:1783135152.336434:0:18234:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.201.141@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1783135152.336490:0:18234:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.141@tcp lock: ffff9fe9c0031600/0xd6c4b8f05868010a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd6c4b8f058680111 expref: -99 pid: 18234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135152.336507:0:18234:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.141@tcp lock: ffff9fe9c0031600/0xd6c4b8f05868010a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd6c4b8f058680111 expref: -99 pid: 18234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783135152.336578:0:18234:0:(mgc_request.c:1945:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1783135152.336581:0:18234:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9fe8c47e7000 10000000:01000000:1.0:1783135152.336584:0:18234:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9fe8c47e7000 10000000:01000000:1.0:1783135152.336588:0:18234:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1783135152.336594:0:18234:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff9fe8c47e7000 from 1 10000000:01000000:1.0:1783135152.336597:0:18234:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1783135152.336631:0:18234:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.141@tcp lock: ffff9fe8c5551600/0xd6c4b8f058680118 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135152.336639:0:18234:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.141@tcp lock: ffff9fe8c5551600/0xd6c4b8f058680118 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135152.336649:0:18234:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.141@tcp lock: ffff9fe8c5551600/0xd6c4b8f058680118 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783135152.336671:0:18234:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe8c590e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:06a7653e-5f5a-4acc-ba93-0eff19f145f0:18234:1869752384459136:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1783135152.336805:0:18234:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135152.336841:0:18234:0:(client.c:2701:ptlrpc_set_wait()) set ffff9fe9f42c36c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783135152.336860:0:18246:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384459136 00000100:00100000:1.0:1783135152.336867:0:18246:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384459136 00000100:00100000:1.0:1783135152.336907:0:18246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1783135152.336918:0:18246:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fff54850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:06a7653e-5f5a-4acc-ba93-0eff19f145f0+11:18234:x1869752384459136:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1783135152.336931:0:18246:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783135152.336943:0:18246:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fe8c5550200/0xd6c4b8f05868011f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xd6c4b8f058680118 expref: -99 pid: 18246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135152.336967:0:18246:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fe8c5550200/0xd6c4b8f05868011f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd6c4b8f058680118 expref: 12 pid: 18246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135152.336989:0:18246:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fe8c5550200/0xd6c4b8f05868011f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd6c4b8f058680118 expref: 12 pid: 18246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135152.336998:0:18246:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fe8c5550200, rc 0) 00000100:00100000:1.0:1783135152.337036:0:18246:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fff54850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:06a7653e-5f5a-4acc-ba93-0eff19f145f0+12:18234:x1869752384459136:12345-0@lo:101:mount.lustre.0 Request processed in 119us (231us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135152.337043:0:18246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1783135152.337089:0:18234:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe8c590e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:06a7653e-5f5a-4acc-ba93-0eff19f145f0:18234:1869752384459136:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1783135152.337102:0:18234:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.141@tcp lock: ffff9fe8c5551600/0xd6c4b8f058680118 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd6c4b8f05868011f expref: -99 pid: 18234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135152.337110:0:18234:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.141@tcp lock: ffff9fe8c5551600/0xd6c4b8f058680118 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xd6c4b8f05868011f expref: -99 pid: 18234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783135152.337149:0:18234:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe8c590e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:06a7653e-5f5a-4acc-ba93-0eff19f145f0:18234:1869752384459264:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1783135152.337170:0:18234:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135152.337183:0:18234:0:(client.c:2701:ptlrpc_set_wait()) set ffff9fe9f42c36c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783135152.337642:0:18247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384459264 00000100:00100000:2.0:1783135152.337649:0:18247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384459264 00000100:00100000:2.0:1783135152.337684:0:18247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1783135152.337691:0:18247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fff57050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:06a7653e-5f5a-4acc-ba93-0eff19f145f0+12:18234:x1869752384459264:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1783135152.338006:0:18247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fff57050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:06a7653e-5f5a-4acc-ba93-0eff19f145f0+12:18234:x1869752384459264:12345-0@lo:501:mount.lustre.0 Request processed in 254us (773us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135152.338022:0:18247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1783135152.338256:0:18234:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe8c590e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:06a7653e-5f5a-4acc-ba93-0eff19f145f0:18234:1869752384459264:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1783135152.338319:0:18234:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe8c590e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:06a7653e-5f5a-4acc-ba93-0eff19f145f0:18234:1869752384459392:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1783135152.338356:0:18234:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135152.338377:0:18234:0:(client.c:2701:ptlrpc_set_wait()) set ffff9fe9f42c36c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783135152.338408:0:18245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384459392 00000100:00100000:1.0:1783135152.338412:0:18245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384459392 00000100:00100000:1.0:1783135152.338433:0:18245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1783135152.338440:0:18245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fff57c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:06a7653e-5f5a-4acc-ba93-0eff19f145f0+12:18234:x1869752384459392:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1783135152.338597:0:18245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fff57c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:06a7653e-5f5a-4acc-ba93-0eff19f145f0+12:18234:x1869752384459392:12345-0@lo:503:mount.lustre.0 Request processed in 157us (240us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135152.338604:0:18245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1783135152.338652:0:18234:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe8c590e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:06a7653e-5f5a-4acc-ba93-0eff19f145f0:18234:1869752384459392:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1783135152.341066:0:18283:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9fe8fdc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:06a7653e-5f5a-4acc-ba93-0eff19f145f0:18283:1869752384459520:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783135152.341146:0:18283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135152.341199:0:18283:0:(client.c:2701:ptlrpc_set_wait()) set ffff9fe9f89803c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783135152.341263:0:18247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384459520 00000100:00100000:1.0:1783135152.341270:0:18247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384459520 00000100:00100000:1.0:1783135152.341342:0:18247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1783135152.341353:0:18247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fff55c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:06a7653e-5f5a-4acc-ba93-0eff19f145f0+12:18283:x1869752384459520:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783135152.341602:0:18247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fff55c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:06a7653e-5f5a-4acc-ba93-0eff19f145f0+12:18283:x1869752384459520:12345-0@lo:502:llog_process_th.0 Request processed in 250us (456us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135152.341611:0:18247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1783135152.341884:0:18283:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9fe8fdc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:06a7653e-5f5a-4acc-ba93-0eff19f145f0:18283:1869752384459520:0@lo:502:llog_process_th.0 00000020:01000004:0.0:1783135152.341949:0:18283:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:0.0:1783135152.341967:0:18283:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff9fe9c8ef8000) 00000020:00000080:0.0:1783135152.341985:0:18283:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type lwp with refcount 2 00000020:01000004:0.0:1783135152.342155:0:18283:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9fe8c47e7000 from lustre-MDT0000, refs=4 00000020:01000004:0.0:1783135152.342159:0:18283:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9fe8c47e7000 from lustre-MDT0000, refs=4 00000020:01000004:0.0:1783135152.342162:0:18283:0:(obd_mount.c:701:lustre_put_lsi()) put ffff9fe8c47e7000 4 00010000:00080000:0.0:1783135152.342191:0:18283:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9fe9e0d14800@lustre-MDT0000-lwp-MDT0000: add connection 192.168.201.141@tcp at head 00010000:00010000:0.0:1783135152.347993:0:18283:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-3 is initialized 00000020:00000080:0.0:1783135152.348093:0:18283:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:0.0:1783135152.348131:0:18283:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1783135152.348145:0:18283:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0xd6c4b8f05868012d 00000100:00080000:0.0:1783135152.348156:0:18283:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1783135152.348162:0:18283:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff9fe9e0d14800 using connection 192.168.201.141@tcp/0@lo 00000100:00100000:0.0:1783135152.348199:0:18283:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9fe9fe8fdc00 x1869752384459648/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1783135152.348243:0:3285:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9fe8fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3285:1869752384459648:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1783135152.349892:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1783135152.349957:0:18283:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1783135152.350406:0:18252:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384459648 00000100:00100000:1.0:1783135152.350416:0:18252:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384459648 00000100:00100000:1.0:1783135152.350447:0:18252:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1783135152.350454:0:18252:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fe8fe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3285:x1869752384459648:12345-0@lo:38:llog_process_th.0 00000100:00100000:1.0:1783135152.350514:0:18252:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fe8fe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3285:x1869752384459648:12345-0@lo:38:llog_process_th.0 Request processed in 60us (625us total) trans 0 rc -11/-11 00000100:00100000:1.0:1783135152.350522:0:18252:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1783135152.350605:0:3285:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1783135152.350613:0:3285:0:(import.c:65:import_set_state_nolock()) ffff9fe9e0d14800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1783135152.350617:0:3285:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1783135152.350621:0:3285:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9fe8fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3285:1869752384459648:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1783135152.353004:0:18283:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe8c590e680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:06a7653e-5f5a-4acc-ba93-0eff19f145f0:18283:1869752384459776:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783135152.353078:0:18283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135152.353112:0:18246:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384459776 00000100:00100000:1.0:1783135152.353124:0:18246:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384459776 00000100:00100000:1.0:1783135152.353166:0:18246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1783135152.353174:0:18246:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fff56c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:06a7653e-5f5a-4acc-ba93-0eff19f145f0+12:18283:x1869752384459776:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783135152.353642:0:18246:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fff56c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:06a7653e-5f5a-4acc-ba93-0eff19f145f0+12:18283:x1869752384459776:12345-0@lo:502:llog_process_th.0 Request processed in 467us (563us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135152.353650:0:18246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1783135152.353706:0:18283:0:(client.c:2701:ptlrpc_set_wait()) set ffff9fe9f42c3e40 going to sleep for 11 seconds 00000100:00100000:1.0:1783135152.354822:0:18283:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe8c590e680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:06a7653e-5f5a-4acc-ba93-0eff19f145f0:18283:1869752384459776:0@lo:502:llog_process_th.0 00000040:00080000:1.0:1783135152.354860:0:18283:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:1.0:1783135152.354935:0:18234:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:1.0:1783135152.354957:0:18234:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.201.141@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1783135152.354978:0:18234:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.141@tcp lock: ffff9fe8c5551600/0xd6c4b8f058680118 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd6c4b8f05868011f expref: -99 pid: 18234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135152.354989:0:18234:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.141@tcp lock: ffff9fe8c5551600/0xd6c4b8f058680118 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd6c4b8f05868011f expref: -99 pid: 18234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1783135152.355037:0:18234:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1783135152.355039:0:18234:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1783135152.355041:0:18234:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1783135152.355042:0:18234:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1783135152.355043:0:18234:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1783135152.355044:0:18234:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1783135152.355046:0:18234:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1783135152.355047:0:18234:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1783135152.355049:0:18234:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1783135152.355050:0:18234:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1783135152.355053:0:18234:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:1.0:1783135152.355056:0:18234:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1783135152.355058:0:18234:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1783135152.355059:0:18234:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1783135152.355060:0:18234:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1783135152.355065:0:18234:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1783135152.355066:0:18234:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1783135152.355066:0:18234:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1783135152.355067:0:18234:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1783135152.355068:0:18234:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1783135152.355069:0:18234:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1783135152.355085:0:18234:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:1.0:1783135152.355098:0:18234:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe8c590e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:06a7653e-5f5a-4acc-ba93-0eff19f145f0:18234:1869752384459904:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1783135152.355143:0:18234:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135152.355169:0:18234:0:(client.c:2701:ptlrpc_set_wait()) set ffff9fe9f42c3240 going to sleep for 11 seconds 00000100:00100000:0.0:1783135152.355525:0:18245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384459904 00000100:00100000:0.0:1783135152.355531:0:18245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384459904 00000100:00100000:0.0:1783135152.355645:0:18245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1783135152.355655:0:18245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fff57450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:06a7653e-5f5a-4acc-ba93-0eff19f145f0+12:18234:x1869752384459904:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1783135152.355678:0:18245:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1783135152.355691:0:18245:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:1.0:1783135152.403355:0:18245:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1783135152.403377:0:18245:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:2.0:1783135152.403600:0:18268:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1783135152.403606:0:18268:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1783135152.403631:0:18268:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9fe9c1523c00/0xd6c4b8f058680134 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18268 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135152.403654:0:18268:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9fe8c5550c00/0xd6c4b8f058680103 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd6c4b8f0586800fc expref: 12 pid: 18246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135152.403663:0:18268:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9fe9c1523c00/0xd6c4b8f058680134 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 18268 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135152.403705:0:18268:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9fe8c5550c00/0xd6c4b8f058680103 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd6c4b8f0586800fc expref: 12 pid: 18246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135152.403726:0:18268:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9fe8c5550c00/0xd6c4b8f058680103 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd6c4b8f0586800fc expref: 12 pid: 18246 timeout: 534 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783135152.403742:0:18268:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9f6fe7100 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:18268:1869752384460032:0@lo:104: 00000100:00100000:2.0:1783135152.403815:0:18268:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135152.403960:0:18268:0:(client.c:2701:ptlrpc_set_wait()) set ffff9fe9d1552a80 going to sleep for 11 seconds 00000100:00100000:1.0:1783135152.404252:0:18235:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384460032 00000100:00100000:1.0:1783135152.404261:0:18235:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384460032 00000100:00100000:1.0:1783135152.405173:0:18235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1783135152.405184:0:18235:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9f6fe7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:06a7653e-5f5a-4acc-ba93-0eff19f145f0+3:18268:x1869752384460032:12345-0@lo:104: 00010000:00010000:1.0:1783135152.405196:0:18235:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.141@tcp lock: ffff9fe9c1523200/0xd6c4b8f0586800fc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xd6c4b8f058680103 expref: -99 pid: 18234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135152.405257:0:18235:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1783135152.405263:0:18235:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9f6fe7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:06a7653e-5f5a-4acc-ba93-0eff19f145f0+3:18268:x1869752384460032:12345-0@lo:104: Request processed in 82us (1450us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135152.405270:0:18235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1783135152.405989:0:18268:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9f6fe7100 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:18268:1869752384460032:0@lo:104: 00010000:00010000:2.0:1783135152.406012:0:18268:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9fe9c1523c00/0xd6c4b8f058680134 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 18268 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135152.406031:0:18241:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783135152.406036:0:18241:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.141@tcp lock: ffff9fe9c1523200/0xd6c4b8f0586800fc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xd6c4b8f058680103 expref: -99 pid: 18234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135152.406043:0:18241:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe9c1523200 already unused, calling callback (ffffffffc1b40c20) 10000000:00010000:2.0:1783135152.406058:0:18241:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.141@tcp lock: ffff9fe9c1523200/0xd6c4b8f0586800fc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xd6c4b8f058680103 expref: -99 pid: 18234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135152.406068:0:18241:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.141@tcp lock: ffff9fe9c1523200/0xd6c4b8f0586800fc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xd6c4b8f058680103 expref: -99 pid: 18234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783135152.406075:0:18241:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.141@tcp lock: ffff9fe9c1523200/0xd6c4b8f0586800fc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xd6c4b8f058680103 expref: -99 pid: 18234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783135152.406080:0:18241:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1783135152.406118:0:18241:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.141@tcp lock: ffff9fe9c1523200/0xd6c4b8f0586800fc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd6c4b8f058680103 expref: -99 pid: 18234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135152.406124:0:18241:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1783135152.406153:0:18241:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.141@tcp lock: ffff9fe9c1523200/0xd6c4b8f0586800fc lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd6c4b8f058680103 expref: -99 pid: 18234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135152.406160:0:18241:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.141@tcp lock: ffff9fe9c1523200/0xd6c4b8f0586800fc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd6c4b8f058680103 expref: -99 pid: 18234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135152.406177:0:18241:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783135152.406179:0:18241:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783135152.406180:0:18241:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783135152.406202:0:3287:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1783135152.406214:0:3287:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9f6fe7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:06a7653e-5f5a-4acc-ba93-0eff19f145f0:3287:1869752384460160:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1783135152.406261:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135152.406342:0:18237:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384460160 00000100:00100000:2.0:1783135152.406348:0:18237:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384460160 00010000:00010000:2.0:1783135152.406367:0:18237:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9fe8c5550c00/0xd6c4b8f058680103 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd6c4b8f0586800fc expref: 13 pid: 18246 timeout: 534 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783135152.406414:0:18237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1783135152.406423:0:18237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9f6fe4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:06a7653e-5f5a-4acc-ba93-0eff19f145f0+13:3287:x1869752384460160:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1783135152.406435:0:18237:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783135152.406440:0:18237:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9fe8c5550c00/0xd6c4b8f058680103 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd6c4b8f0586800fc expref: 13 pid: 18246 timeout: 534 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135152.406450:0:18237:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9fe8c5550c00/0xd6c4b8f058680103 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd6c4b8f0586800fc expref: 13 pid: 18246 timeout: 534 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135152.406463:0:18237:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fe8c5550c00/0xd6c4b8f058680103 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd6c4b8f0586800fc expref: 13 pid: 18246 timeout: 534 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135152.406476:0:18237:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9fe9c1523c00/0xd6c4b8f058680134 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 18268 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135152.406484:0:18237:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fe9c1523c00/0xd6c4b8f058680134 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 18268 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1783135152.406497:0:18237:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.002892569s 00010000:00010000:2.0:1783135152.406501:0:18237:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9fe9c1523c00/0xd6c4b8f058680134 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 18268 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135152.406509:0:18237:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9fe9c1523c00/0xd6c4b8f058680134 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 18268 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135152.406515:0:18237:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9fe9c1523c00/0xd6c4b8f058680134 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 18268 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135152.406521:0:18237:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9fe9c1523c00/0xd6c4b8f058680134 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 18268 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135152.406533:0:18237:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe9c1523c00 already unused, calling callback (ffffffffc1527ce0) 00010000:00010000:2.0:1783135152.406537:0:18237:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9fe9c1523c00/0xd6c4b8f058680134 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 18268 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135152.406543:0:18237:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9fe9c1523c00/0xd6c4b8f058680134 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 18268 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135152.406853:0:18237:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9fe9c1523c00/0xd6c4b8f058680134 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18268 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135152.406864:0:18237:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783135152.406897:0:18237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9f6fe4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:06a7653e-5f5a-4acc-ba93-0eff19f145f0+12:3287:x1869752384460160:12345-0@lo:103:ldlm_bl.0 Request processed in 476us (635us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135152.406904:0:18237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1783135152.406935:0:3287:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9f6fe7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:06a7653e-5f5a-4acc-ba93-0eff19f145f0:3287:1869752384460160:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1783135152.406996:0:18268:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9fe9c1523c00/0xd6c4b8f058680134 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18268 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135152.407004:0:18268:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9fe9c1523c00/0xd6c4b8f058680134 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18268 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135152.407011:0:18268:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fe9c1523c00/0xd6c4b8f058680134 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18268 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783135152.414815:0:18245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fff57450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:06a7653e-5f5a-4acc-ba93-0eff19f145f0+11:18234:x1869752384459904:12345-0@lo:253:mount.lustre.0 Request processed in 59152us (59661us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135152.414831:0:18245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1783135152.414942:0:18234:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe8c590e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:06a7653e-5f5a-4acc-ba93-0eff19f145f0:18234:1869752384459904:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1783135152.414958:0:18234:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:1.0:1783135152.414961:0:18234:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1783135152.414963:0:18234:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1783135152.414964:0:18234:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1783135152.414966:0:18234:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1783135152.414967:0:18234:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1783135152.414968:0:18234:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1783135152.414969:0:18234:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1783135152.414971:0:18234:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1783135152.414986:0:18234:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1783135152.414987:0:18234:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1783135152.415005:0:18234:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:2.0:1783135152.425462:0:18234:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:2.0:1783135152.425649:0:18234:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:2.0:1783135152.426209:0:18234:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:2.0:1783135152.426410:0:18234:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:2.0:1783135152.426699:0:18234:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:2.0:1783135152.426848:0:18234:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:1.0:1783135152.428001:0:18234:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:1.0:1783135152.428163:0:18234:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:1.0:1783135152.428781:0:18234:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:1.0:1783135152.429009:0:18234:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:1.0:1783135152.429254:0:18234:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:0.0:1783135152.429858:0:18234:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 00000020:00080000:0.0:1783135152.465205:0:18234:0:(update_trans.c:1487:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 4294967528 00000040:01000000:0.0:1783135152.465850:0:18234:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000040:01000000:0.0:1783135152.466222:0:18292:0:(llog_osd.c:2237:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:00080000:0.0:1783135152.469017:0:18292:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1783135152.471161:0:18292:0:(llog.c:857:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1783135152.471244:0:18292:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:0.0:1783135152.471249:0:18292:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000040:01000000:1.0:1783135152.472531:0:18234:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:1.0:1783135152.472684:0:18234:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:1.0:1783135152.473406:0:18234:0:(mdd_device.c:553:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:1.0:1783135152.473417:0:18234:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000020:00080000:2.0:1783135152.473658:0:18291:0:(update_trans.c:1530:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 4294967528 00000020:00080000:2.0:1783135152.473663:0:18291:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294967528 00000040:00080000:1.0:1783135152.474369:0:18234:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1783135152.476556:0:18234:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:0.0:1783135152.477425:0:18234:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:0.0:1783135152.477461:0:18234:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:0.0:1783135152.478152:0:18234:0:(llog_cat.c:1213:llog_cat_set_first_idx()) catlog [0xa:0x7:0x0] first idx 1, last_idx 2 00080000:10000000:0.0:1783135152.479853:0:18234:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x37:0x0] (8/8/4) registered 00000001:00000004:0.0:1783135152.486806:0:18234:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 3, last_transno is 12884901888 00000001:00080000:1.0:1783135152.525213:0:18234:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:1.0:1783135152.525364:0:18234:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffb1f241b5b988 00100000:10000000:1.0:1783135152.525375:0:18234:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:1.0:1783135152.527012:0:18234:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1783135152.527031:0:18234:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.141@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1783135152.527055:0:18234:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=45 00000080:00000004:1.0:1783135152.527089:0:18234:0:(super25.c:187:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00010000:00010000:2.0:1783135153.093645:0:18240:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1783135153.411575:0:18286:0:(llog.c:800:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1783135153.411588:0:18286:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1783135153.412392:0:18286:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 4 count 4 00000040:00080000:1.0:1783135153.412404:0:18286:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 10000000:01000000:1.0:1783135153.863382:0:18249:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1783135153.863393:0:18249:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-mdtir-ffff9fe8c47e7000 from 9 10000000:01000000:1.0:1783135153.863400:0:18249:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1783135153.863466:0:18249:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.141@tcp lock: ffff9fe8c5551c00/0xd6c4b8f05868013b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18249 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135153.863485:0:18249:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.141@tcp lock: ffff9fe8c5551c00/0xd6c4b8f05868013b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18249 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135153.863516:0:18249:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.141@tcp lock: ffff9fe8c5551c00/0xd6c4b8f05868013b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18249 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783135153.863560:0:18249:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe8c590e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:06a7653e-5f5a-4acc-ba93-0eff19f145f0:18249:1869752384460288:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1783135153.863659:0:18249:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135153.863777:0:18249:0:(client.c:2701:ptlrpc_set_wait()) set ffff9fe9e0328780 going to sleep for 11 seconds 00000100:00100000:3.0:1783135153.863823:0:18247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384460288 00000100:00100000:3.0:1783135153.863833:0:18247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384460288 00000100:00100000:3.0:1783135153.863928:0:18247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1783135153.863948:0:18247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fff54050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:06a7653e-5f5a-4acc-ba93-0eff19f145f0+11:18249:x1869752384460288:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783135153.863968:0:18247:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783135153.863985:0:18247:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fe9c0030200/0xd6c4b8f058680142 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd6c4b8f05868013b expref: -99 pid: 18247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135153.864015:0:18247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fe9c0030200/0xd6c4b8f058680142 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd6c4b8f05868013b expref: 12 pid: 18247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135153.864027:0:18247:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fe9c0030200/0xd6c4b8f058680142 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd6c4b8f05868013b expref: 12 pid: 18247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135153.864038:0:18247:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fe9c0030200, rc 0) 00000100:00100000:3.0:1783135153.864095:0:18247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fff54050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:06a7653e-5f5a-4acc-ba93-0eff19f145f0+12:18249:x1869752384460288:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 149us (437us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135153.864102:0:18247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1783135153.864185:0:18249:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe8c590e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:06a7653e-5f5a-4acc-ba93-0eff19f145f0:18249:1869752384460288:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783135153.864202:0:18249:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.141@tcp lock: ffff9fe8c5551c00/0xd6c4b8f05868013b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd6c4b8f058680142 expref: -99 pid: 18249 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135153.864211:0:18249:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.141@tcp lock: ffff9fe8c5551c00/0xd6c4b8f05868013b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd6c4b8f058680142 expref: -99 pid: 18249 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783135153.864265:0:18249:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9fe8fc700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:06a7653e-5f5a-4acc-ba93-0eff19f145f0:18249:1869752384460416:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1783135153.864325:0:18249:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135153.871892:0:18249:0:(client.c:2701:ptlrpc_set_wait()) set ffff9fe9fe944900 going to sleep for 11 seconds 00000100:00100000:1.0:1783135153.872036:0:18246:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384460416 00000100:00100000:1.0:1783135153.872048:0:18246:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384460416 00000100:00100000:1.0:1783135153.872122:0:18246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1783135153.872132:0:18246:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fff55050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:06a7653e-5f5a-4acc-ba93-0eff19f145f0+12:18249:x1869752384460416:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1783135153.872164:0:18246:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1783135153.872185:0:18246:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1783135153.872189:0:18246:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 9 00000100:00100000:1.0:1783135153.872358:0:18246:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fff55050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:06a7653e-5f5a-4acc-ba93-0eff19f145f0+12:18249:x1869752384460416:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 226us (8031us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135153.872373:0:18246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1783135153.872438:0:18249:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9fe8fc700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:06a7653e-5f5a-4acc-ba93-0eff19f145f0:18249:1869752384460416:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1783135153.872509:0:18249:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.201.141@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1783135153.872533:0:18249:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.141@tcp lock: ffff9fe8c5551c00/0xd6c4b8f05868013b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd6c4b8f058680142 expref: -99 pid: 18249 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135153.872546:0:18249:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.141@tcp lock: ffff9fe8c5551c00/0xd6c4b8f05868013b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd6c4b8f058680142 expref: -99 pid: 18249 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135154.116460:0:18241:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1783135154.435562:0:18286:0:(llog.c:800:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1783135154.435574:0:18286:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1783135154.436951:0:18286:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 3 count 1 00000040:00080000:1.0:1783135154.437020:0:18286:0:(llog_cat.c:1256:llog_cat_cleanup()) cancel plain log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1783135154.437050:0:18286:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 1 00010000:00010000:2.0:1783135155.140442:0:18240:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783135156.163853:0:18241:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783135157.189742:0:18240:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1783135157.387019:0:8:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1783135157.387026:0:8:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1783135157.387029:0:8:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1783135157.387032:0:8:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1783135157.387034:0:8:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1783135157.387037:0:8:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1783135157.387040:0:8:0:(import.c:65:import_set_state_nolock()) ffff9fe9e0d14800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1783135157.387052:0:8:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff9fe9e0d14800 using connection 192.168.201.141@tcp/0@lo 00000100:00100000:3.0:1783135157.387071:0:8:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9fe9fe90f800 x1869752384460672/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1783135157.390389:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1783135157.390413:0:3286:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9fe90ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:06a7653e-5f5a-4acc-ba93-0eff19f145f0:3286:1869752384460544:0@lo:400:kworker.0 00000100:00100000:1.0:1783135157.390490:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135157.390957:0:3285:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9fe90f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3285:1869752384460672:0@lo:38:kworker.0 00000100:00100000:2.0:1783135157.391003:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135157.391965:0:18246:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384460544 00000100:00100000:0.0:1783135157.391975:0:18246:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384460544 00000100:00100000:0.0:1783135157.392026:0:18246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1783135157.392037:0:18246:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fff57850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:06a7653e-5f5a-4acc-ba93-0eff19f145f0+12:3286:x1869752384460544:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783135157.392106:0:18246:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fff57850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:06a7653e-5f5a-4acc-ba93-0eff19f145f0+12:3286:x1869752384460544:12345-0@lo:400:kworker.0 Request processed in 70us (1616us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135157.392121:0:18246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1783135157.392196:0:3286:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9fe90ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:06a7653e-5f5a-4acc-ba93-0eff19f145f0:3286:1869752384460544:0@lo:400:kworker.0 00000100:00100000:0.0:1783135157.403906:0:18254:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384460672 00000100:00100000:0.0:1783135157.403923:0:18254:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384460672 00000100:00100000:0.0:1783135157.403987:0:18254:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1783135157.403996:0:18254:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9f6fe7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3285:x1869752384460672:12345-0@lo:38:kworker.0 00010000:00080000:0.0:1783135157.404027:0:18254:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 439 last 0 00000020:00000080:0.0:1783135157.404066:0:18254:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0xd6c4b8f058680149 00000004:00100000:0.0:1783135157.404084:0:18254:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1783135157.404218:0:18254:0:(import.c:65:import_set_state_nolock()) ffff9fe9e0d13800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1783135157.406442:0:18254:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9f6fe7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3285:x1869752384460672:12345-0@lo:38:kworker.0 Request processed in 2435us (15428us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135157.406457:0:18254:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1783135157.413642:0:3285:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9fe9fe90f800 x1869752384460672/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1783135167 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1783135157.413668:0:3285:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 3 00000100:00080000:2.0:1783135157.413680:0:3285:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:2.0:1783135157.413687:0:3285:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1783135157.413690:0:3285:0:(import.c:65:import_set_state_nolock()) ffff9fe9e0d14800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1783135157.413699:0:3285:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9fe90f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3285:1869752384460672:0@lo:38:kworker.0 00010000:00010000:1.0:1783135158.228021:0:18241:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1783135158.425700:0:18536:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg141-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1783135159.235487:0:18240:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783135160.264724:0:18241:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783135161.283828:0:18240:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783135162.309093:0:18241:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1783135162.499574:0:8:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1783135162.499583:0:8:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1783135162.499588:0:8:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1783135162.499591:0:8:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1783135162.499660:0:3288:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9fe90f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:06a7653e-5f5a-4acc-ba93-0eff19f145f0:3288:1869752384460800:0@lo:400:kworker.0 00000100:00100000:2.0:1783135162.499696:0:3285:0:(client.c:2489:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1783135152/real 1783135152] req@ffff9fe8c590c000 x1869752384457984/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1783135162 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783135162.499731:0:3285:0:(client.c:2520:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9fe8c590c000 x1869752384457984/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1783135162 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783135162.499743:0:3285:0:(client.c:2489:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1783135152/real 1783135152] req@ffff9fe8c590ca80 x1869752384457856/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1783135162 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783135162.499757:0:3285:0:(client.c:2520:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9fe8c590ca80 x1869752384457856/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1783135162 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1783135162.499776:0:3285:0:(import.c:65:import_set_state_nolock()) ffff9fe9f8a5c000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1783135162.499796:0:3285:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1783135162.499802:0:3285:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe8c590c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3285:1869752384457984:0@lo:8:llog_process_th.0 00000100:00080000:2.0:1783135162.499812:0:3285:0:(import.c:65:import_set_state_nolock()) ffff9fe9fdc3a800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1783135162.499821:0:3285:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1783135162.499836:0:3285:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe8c590ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3285:1869752384457856:0@lo:8:llog_process_th.0 00000100:00100000:2.0:1783135162.500357:0:3289:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9fe90ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3289:1869752384460928:0@lo:400:kworker.0 00000100:00080000:0.0:1783135162.500411:0:8:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1783135162.500418:0:8:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1783135162.500421:0:8:0:(import.c:65:import_set_state_nolock()) ffff9fe9fdc3a800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1783135162.500428:0:8:0:(import.c:512:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 434 00000100:00080000:0.0:1783135162.500436:0:8:0:(import.c:591:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1783135162.500444:0:8:0:(import.c:626:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9fe9fdc3a800 using connection 192.168.201.141@tcp/0@lo 00000100:00100000:2.0:1783135162.500463:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135162.500476:0:8:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9fe9fe8fea00 x1869752384461056/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1783135162.500496:0:8:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1783135162.500499:0:8:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1783135162.500501:0:8:0:(import.c:65:import_set_state_nolock()) ffff9fe9f8a5c000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1783135162.500516:0:8:0:(import.c:512:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 434 00000100:00080000:0.0:1783135162.500519:0:8:0:(import.c:591:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1783135162.500522:0:8:0:(import.c:626:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9fe9f8a5c000 using connection 192.168.201.141@tcp/0@lo 00000100:00100000:0.0:1783135162.500532:0:8:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9fe9fe8fdf80 x1869752384461184/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1783135162.500596:0:18253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384460928 00000100:00100000:2.0:1783135162.500704:0:18253:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384460928 00000100:00100000:2.0:1783135162.500785:0:18253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1783135162.500799:0:18253:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9f6fe4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3289:x1869752384460928:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783135162.500811:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135162.500874:0:18245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384460800 00000100:00100000:3.0:1783135162.500882:0:18245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384460800 00000100:00100000:2.0:1783135162.500890:0:18253:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9f6fe4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3289:x1869752384460928:12345-0@lo:400:kworker.0 Request processed in 90us (425us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135162.500903:0:18253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1783135162.500935:0:18245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1783135162.500949:0:3285:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9fe8fea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3285:1869752384461056:0@lo:8:kworker.0 00000100:00100000:3.0:1783135162.500950:0:18245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fff55850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:06a7653e-5f5a-4acc-ba93-0eff19f145f0+12:3288:x1869752384460800:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783135162.501013:0:18245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fff55850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:06a7653e-5f5a-4acc-ba93-0eff19f145f0+12:3288:x1869752384460800:12345-0@lo:400:kworker.0 Request processed in 70us (203us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135162.501019:0:18245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1783135162.501130:0:3288:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9fe90f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:06a7653e-5f5a-4acc-ba93-0eff19f145f0:3288:1869752384460800:0@lo:400:kworker.0 00000400:00000100:2.0:1783135162.501174:0:3285:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1869752384461056 offset 0 length 520: 4 00000100:00100000:2.0:1783135162.501195:0:3285:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9fe8fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3285:1869752384461184:0@lo:8:kworker.0 00000400:00000100:2.0:1783135162.501209:0:3285:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1869752384461184 offset 0 length 520: 4 00010000:00080000:2.0:1783135162.501250:0:3289:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9fe9fe90ca80 x1869752384460928/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783135178 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783135162.501263:0:3289:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9fe90ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3289:1869752384460928:0@lo:400:kworker.0 00000020:00000080:2.0:1783135162.583272:0:18686:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffcfa4fd710 20000000:00000080:2.0:1783135162.583336:0:18686:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9fe9d11cb400 uarg=0000000000000000 20000000:01000000:2.0:1783135162.583395:0:18686:0:(mgs_llog.c:6177:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:2.0:1783135162.583401:0:18686:0:(mgs_llog.c:4638:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:2.0:1783135162.583406:0:18686:0:(mgs_llog.c:1376:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:2.0:1783135162.585117:0:18687:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 2 count 10 20000000:00000400:3.0:1783135162.585237:0:18686:0:(mgs_llog.c:1447:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 10000000:01000000:3.0:1783135162.591149:0:18686:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1783135162.591227:0:18686:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9fe9c1523400/0xd6c4b8f058680150 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135162.591263:0:18686:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9fe8c5551200/0xd6c4b8f058680111 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd6c4b8f05868010a expref: 11 pid: 18246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135162.591272:0:18686:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9fe9c1523400/0xd6c4b8f058680150 lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 18686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135162.591333:0:18686:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9fe8c5551200/0xd6c4b8f058680111 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd6c4b8f05868010a expref: 11 pid: 18246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135162.591350:0:18686:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9fe8c5551200/0xd6c4b8f058680111 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd6c4b8f05868010a expref: 11 pid: 18246 timeout: 544 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783135162.591365:0:18686:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9f6fe4000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:18686:1869752384461312:0@lo:104: 00000100:00100000:2.0:1783135162.591446:0:18686:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135162.591506:0:18686:0:(client.c:2701:ptlrpc_set_wait()) set ffff9fe9c339d780 going to sleep for 11 seconds 00000100:00100000:3.0:1783135162.591781:0:18236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384461312 00000100:00100000:3.0:1783135162.591787:0:18236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384461312 00000100:00100000:3.0:1783135162.591833:0:18236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1783135162.591842:0:18236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9f6fe6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:06a7653e-5f5a-4acc-ba93-0eff19f145f0+3:18686:x1869752384461312:12345-0@lo:104: 00010000:00010000:3.0:1783135162.591854:0:18236:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.141@tcp lock: ffff9fe9c0031600/0xd6c4b8f05868010a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xd6c4b8f058680111 expref: -99 pid: 18234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135162.591916:0:18236:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1783135162.591922:0:18236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9f6fe6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:06a7653e-5f5a-4acc-ba93-0eff19f145f0+3:18686:x1869752384461312:12345-0@lo:104: Request processed in 82us (477us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135162.591931:0:18686:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9f6fe4000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:18686:1869752384461312:0@lo:104: 00000100:00100000:3.0:1783135162.591934:0:18236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:2.0:1783135162.591950:0:18686:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9fe9c1523400/0xd6c4b8f058680150 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 18686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135162.592128:0:18240:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783135162.592134:0:18240:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.141@tcp lock: ffff9fe9c0031600/0xd6c4b8f05868010a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xd6c4b8f058680111 expref: -99 pid: 18234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135162.592139:0:18240:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe9c0031600 already unused, calling callback (ffffffffc1b40c20) 10000000:00010000:1.0:1783135162.592142:0:18240:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.141@tcp lock: ffff9fe9c0031600/0xd6c4b8f05868010a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xd6c4b8f058680111 expref: -99 pid: 18234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135162.592148:0:18240:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.141@tcp lock: ffff9fe9c0031600/0xd6c4b8f05868010a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xd6c4b8f058680111 expref: -99 pid: 18234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783135162.592153:0:18240:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.141@tcp lock: ffff9fe9c0031600/0xd6c4b8f05868010a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xd6c4b8f058680111 expref: -99 pid: 18234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783135162.592157:0:18240:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1783135162.592206:0:18240:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.141@tcp lock: ffff9fe9c0031600/0xd6c4b8f05868010a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd6c4b8f058680111 expref: -99 pid: 18234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135162.592210:0:18240:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1783135162.592238:0:18240:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.141@tcp lock: ffff9fe9c0031600/0xd6c4b8f05868010a lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd6c4b8f058680111 expref: -99 pid: 18234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783135162.592252:0:3286:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe8c590c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:06a7653e-5f5a-4acc-ba93-0eff19f145f0:3286:1869752384461440:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1783135162.592255:0:18240:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.141@tcp lock: ffff9fe9c0031600/0xd6c4b8f05868010a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd6c4b8f058680111 expref: -99 pid: 18234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135162.592274:0:18240:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783135162.592277:0:18240:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783135162.592298:0:18240:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783135162.592300:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135162.592336:0:18237:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384461440 00000100:00100000:1.0:1783135162.592340:0:18237:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384461440 00010000:00010000:1.0:1783135162.592358:0:18237:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9fe8c5551200/0xd6c4b8f058680111 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd6c4b8f05868010a expref: 12 pid: 18246 timeout: 544 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783135162.592386:0:18237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1783135162.592399:0:18237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9f6fe4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:06a7653e-5f5a-4acc-ba93-0eff19f145f0+12:3286:x1869752384461440:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1783135162.592410:0:18237:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783135162.592414:0:18237:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9fe8c5551200/0xd6c4b8f058680111 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd6c4b8f05868010a expref: 12 pid: 18246 timeout: 544 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135162.592425:0:18237:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9fe8c5551200/0xd6c4b8f058680111 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd6c4b8f05868010a expref: 12 pid: 18246 timeout: 544 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135162.592441:0:18237:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fe8c5551200/0xd6c4b8f058680111 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd6c4b8f05868010a expref: 12 pid: 18246 timeout: 544 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135162.592453:0:18237:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9fe9c1523400/0xd6c4b8f058680150 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 18686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135162.592463:0:18237:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fe9c1523400/0xd6c4b8f058680150 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 18686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135162.592486:0:18237:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9fe9c1523400/0xd6c4b8f058680150 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 18686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135162.592491:0:18237:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9fe9c1523400/0xd6c4b8f058680150 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 18686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135162.592495:0:18237:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9fe9c1523400/0xd6c4b8f058680150 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 18686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135162.592499:0:18237:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9fe9c1523400/0xd6c4b8f058680150 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 18686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135162.592502:0:18237:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe9c1523400 already unused, calling callback (ffffffffc1527ce0) 00010000:00010000:1.0:1783135162.592505:0:18237:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9fe9c1523400/0xd6c4b8f058680150 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 18686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135162.592509:0:18237:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9fe9c1523400/0xd6c4b8f058680150 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 18686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135162.592521:0:18237:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9fe9c1523400/0xd6c4b8f058680150 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135162.592529:0:18237:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1783135162.592538:0:18686:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9fe9c1523400/0xd6c4b8f058680150 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135162.592546:0:18686:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9fe9c1523400/0xd6c4b8f058680150 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135162.592552:0:18686:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fe9c1523400/0xd6c4b8f058680150 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783135162.592560:0:18237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9f6fe4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:06a7653e-5f5a-4acc-ba93-0eff19f145f0+11:3286:x1869752384461440:12345-0@lo:103:ldlm_bl.0 Request processed in 162us (260us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135162.592566:0:18237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1783135162.592590:0:3286:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe8c590c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:06a7653e-5f5a-4acc-ba93-0eff19f145f0:3286:1869752384461440:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1783135163.334353:0:18241:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783135164.356571:0:18240:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1783135164.549231:0:18249:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1783135164.549254:0:18249:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff9fe8c47e7000 from 10 10000000:01000000:1.0:1783135164.549259:0:18249:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1783135164.549501:0:18249:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.141@tcp lock: ffff9fe8c5551200/0xd6c4b8f058680157 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18249 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135164.549515:0:18249:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.141@tcp lock: ffff9fe8c5551200/0xd6c4b8f058680157 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18249 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135164.549529:0:18249:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.141@tcp lock: ffff9fe8c5551200/0xd6c4b8f058680157 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18249 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783135164.549563:0:18249:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe8c590c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:06a7653e-5f5a-4acc-ba93-0eff19f145f0:18249:1869752384461568:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1783135164.549648:0:18249:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135164.549758:0:18247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384461568 00000100:00100000:0.0:1783135164.549767:0:18247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384461568 00000100:00100000:0.0:1783135164.549826:0:18247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1783135164.549835:0:18247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fff56850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:06a7653e-5f5a-4acc-ba93-0eff19f145f0+11:18249:x1869752384461568:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783135164.549851:0:18247:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783135164.549867:0:18247:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fe9f68ace00/0xd6c4b8f05868015e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd6c4b8f058680157 expref: -99 pid: 18247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135164.549893:0:18247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fe9f68ace00/0xd6c4b8f05868015e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd6c4b8f058680157 expref: 12 pid: 18247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135164.549905:0:18247:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fe9f68ace00/0xd6c4b8f05868015e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd6c4b8f058680157 expref: 12 pid: 18247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135164.549915:0:18247:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fe9f68ace00, rc 0) 00000100:00100000:0.0:1783135164.549949:0:18247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fff56850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:06a7653e-5f5a-4acc-ba93-0eff19f145f0+12:18249:x1869752384461568:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 115us (302us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135164.549957:0:18247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1783135164.550016:0:18249:0:(client.c:2701:ptlrpc_set_wait()) set ffff9fe9ea79c600 going to sleep for 11 seconds 00000100:00100000:1.0:1783135164.550043:0:18249:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe8c590c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:06a7653e-5f5a-4acc-ba93-0eff19f145f0:18249:1869752384461568:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783135164.550057:0:18249:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.141@tcp lock: ffff9fe8c5551200/0xd6c4b8f058680157 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd6c4b8f05868015e expref: -99 pid: 18249 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135164.550066:0:18249:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.141@tcp lock: ffff9fe8c5551200/0xd6c4b8f058680157 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd6c4b8f05868015e expref: -99 pid: 18249 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783135164.550135:0:18249:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe8c590c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:06a7653e-5f5a-4acc-ba93-0eff19f145f0:18249:1869752384461696:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783135164.550159:0:18249:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135164.550180:0:18249:0:(client.c:2701:ptlrpc_set_wait()) set ffff9fe9ea79c600 going to sleep for 11 seconds 00000100:00100000:0.0:1783135164.550496:0:18246:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384461696 00000100:00100000:0.0:1783135164.550501:0:18246:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384461696 00000100:00100000:0.0:1783135164.550536:0:18246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1783135164.550544:0:18246:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fff56050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:06a7653e-5f5a-4acc-ba93-0eff19f145f0+12:18249:x1869752384461696:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783135164.550842:0:18246:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fff56050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:06a7653e-5f5a-4acc-ba93-0eff19f145f0+12:18249:x1869752384461696:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 298us (681us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135164.550856:0:18246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1783135164.551060:0:18249:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe8c590c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:06a7653e-5f5a-4acc-ba93-0eff19f145f0:18249:1869752384461696:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783135164.551164:0:18249:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9f6fe5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:06a7653e-5f5a-4acc-ba93-0eff19f145f0:18249:1869752384461824:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783135164.551208:0:18249:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135164.551268:0:18249:0:(client.c:2701:ptlrpc_set_wait()) set ffff9fe9c339d780 going to sleep for 11 seconds 00000100:00100000:0.0:1783135164.551762:0:18246:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384461824 00000100:00100000:0.0:1783135164.551768:0:18246:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384461824 00000100:00100000:0.0:1783135164.551836:0:18246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1783135164.551844:0:18246:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fff54450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:06a7653e-5f5a-4acc-ba93-0eff19f145f0+12:18249:x1869752384461824:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783135164.552043:0:18246:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fff54450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:06a7653e-5f5a-4acc-ba93-0eff19f145f0+12:18249:x1869752384461824:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 199us (834us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135164.552051:0:18246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1783135164.554387:0:18249:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9f6fe5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:06a7653e-5f5a-4acc-ba93-0eff19f145f0:18249:1869752384461824:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1783135164.556912:0:18749:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:1.0:1783135164.560940:0:18249:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:1.0:1783135164.560990:0:18249:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.201.141@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1783135164.561005:0:18249:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.141@tcp lock: ffff9fe8c5551200/0xd6c4b8f058680157 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd6c4b8f05868015e expref: -99 pid: 18249 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135164.561058:0:18249:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.141@tcp lock: ffff9fe8c5551200/0xd6c4b8f058680157 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd6c4b8f05868015e expref: -99 pid: 18249 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1783135164.677110:0:18286:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1783135165.380117:0:18241:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783135166.403653:0:18240:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783135167.431482:0:18241:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1783135167.646460:0:8:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1783135167.646470:0:8:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1783135167.646474:0:8:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1783135167.646478:0:8:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1783135167.646518:0:3289:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1783135167.646547:0:3289:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9f6fe6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3289:1869752384462080:0@lo:400:kworker.0 00000100:00100000:2.0:1783135167.646648:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135167.646730:0:18254:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384462080 00000100:00100000:2.0:1783135167.646739:0:18254:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384462080 00000100:00100000:2.0:1783135167.646800:0:18254:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1783135167.646810:0:18254:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9f6fe5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3289:x1869752384462080:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783135167.646873:0:18254:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9f6fe5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3289:x1869752384462080:12345-0@lo:400:kworker.0 Request processed in 64us (224us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135167.646882:0:18254:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1783135167.646929:0:3289:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9fe9f6fe6a00 x1869752384462080/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783135183 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783135167.646947:0:3289:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9f6fe6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3289:1869752384462080:0@lo:400:kworker.0 00000100:00100000:0.0:1783135167.648992:0:3287:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9f6fe5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:06a7653e-5f5a-4acc-ba93-0eff19f145f0:3287:1869752384461952:0@lo:400:kworker.0 00000100:00100000:0.0:1783135167.649093:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135167.649213:0:18247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384461952 00000100:00100000:3.0:1783135167.649223:0:18247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384461952 00000100:00100000:3.0:1783135167.649332:0:18247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1783135167.649343:0:18247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fff56450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:06a7653e-5f5a-4acc-ba93-0eff19f145f0+12:3287:x1869752384461952:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783135167.649408:0:18247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fff56450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:06a7653e-5f5a-4acc-ba93-0eff19f145f0+12:3287:x1869752384461952:12345-0@lo:400:kworker.0 Request processed in 67us (315us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135167.649416:0:18247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1783135167.649468:0:3287:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9f6fe5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:06a7653e-5f5a-4acc-ba93-0eff19f145f0:3287:1869752384461952:0@lo:400:kworker.0 00010000:00010000:2.0:1783135168.456590:0:18240:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1783135168.646966:0:18888:0:(obd_mount.c:914:lmd_print()) mount data: 00000020:01000004:1.0:1783135168.646972:0:18888:0:(obd_mount.c:917:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:1.0:1783135168.647110:0:18888:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff9fe9f8a5b800 00000020:01000004:1.0:1783135168.647131:0:18888:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:1.0:1783135168.647147:0:18888:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:1.0:1783135168.647166:0:18888:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff9fe8c456b380) 00000020:00000080:1.0:1783135168.647189:0:18888:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1783135168.712694:0:18888:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:2.0:1783135168.713024:0:18888:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:2.0:1783135168.713805:0:18888:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:2.0:1783135168.714072:0:18888:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:2.0:1783135168.720457:0:18888:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000003:0xb:0x0] (8/32) 00100000:10000000:2.0:1783135168.721904:0:18888:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-OST0000 under 451: rc = 0 00100000:10000000:2.0:1783135168.722473:0:18888:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled params under 451: rc = 0 00100000:10000000:2.0:1783135168.722582:0:18888:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-client under 451: rc = 0 00100000:10000000:2.0:1783135168.726128:0:18888:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000-OST0000 under 769: rc = 0 00100000:10000000:2.0:1783135168.726933:0:18888:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000 under 769: rc = 0 00100000:10000000:2.0:1783135168.727821:0:18888:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000-OST0000 under 769: rc = 0 00100000:10000000:2.0:1783135168.728188:0:18888:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000 under 769: rc = 0 00100000:10000000:2.0:1783135168.728833:0:18888:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000 under 769: rc = 0 00100000:10000000:2.0:1783135168.729205:0:18888:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000-OST0000 under 769: rc = 0 00000020:00000080:2.0:1783135168.730881:0:18888:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:2.0:1783135168.730900:0:18888:0:(osd_handler.c:1569:osd_obd_connect()) connect #0 00000020:00000080:2.0:1783135168.730919:0:18888:0:(genops.c:1406:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xd6c4b8f05868016c 00000020:01000004:2.0:1783135168.730931:0:18888:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:2.0:1783135168.731037:0:18888:0:(obd_mount.c:394:lustre_start_mgc()) MGC192.168.201.141@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1783135168.731042:0:18888:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.201.141@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1783135168.731052:0:18888:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0000 00000020:01000004:2.0:1783135168.731059:0:18888:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:2.0:1783135168.731078:0:18888:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff9fe9d0e819c0) 00000020:00000080:2.0:1783135168.731092:0:18888:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type ost with refcount 2 00000100:00100000:2.0:1783135168.733361:0:18888:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1783135168.733920:0:18888:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:2.0:1783135168.733937:0:18888:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:0.0:1783135168.735330:0:18888:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:0.0:1783135168.735345:0:18888:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:2.0:1783135168.738226:0:18888:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:2.0:1783135168.738243:0:18888:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:2.0:1783135168.742147:0:18888:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1783135168.744493:0:18888:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:2.0:1783135168.744508:0:18888:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:1.0:1783135168.750421:0:18888:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:1.0:1783135168.750443:0:18888:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:0.0:1783135168.792894:0:18888:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1783135168.793381:0:18888:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:0.0:1783135168.793390:0:18888:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:1.0:1783135168.794825:0:18888:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:1.0:1783135168.794839:0:18888:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:1.0:1783135168.804530:0:18888:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:1.0:1783135168.804556:0:18888:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:1.0:1783135168.814509:0:18888:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1783135168.814847:0:18888:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:1.0:1783135168.814854:0:18888:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:1.0:1783135168.817106:0:18888:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:1.0:1783135168.817123:0:18888:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:3.0:1783135168.885517:0:18888:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1783135168.885731:0:18888:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:3.0:1783135168.885739:0:18888:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:0.0:1783135168.887324:0:18888:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:0.0:1783135168.887335:0:18888:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:0.0:1783135168.887766:0:18888:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:0.0:1783135168.887802:0:18888:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:0.0:1783135168.887809:0:18888:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.141@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:1.0:1783135168.914566:0:18888:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.141@tcp ctxt 0 is initialized 00000020:01000004:1.0:1783135168.914612:0:18888:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.201.141@tcp, index=0000, flags=0x20002 00000020:01000004:1.0:1783135168.914617:0:18888:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1783135168.914619:0:18888:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1783135168.914620:0:18888:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1783135168.914621:0:18888:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1783135168.914623:0:18888:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1783135168.914624:0:18888:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1783135168.914626:0:18888:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1783135168.914632:0:18888:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1783135168.914634:0:18888:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1783135168.914637:0:18888:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:1.0:1783135168.914639:0:18888:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1783135168.914640:0:18888:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1783135168.914641:0:18888:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1783135168.914642:0:18888:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1783135168.914643:0:18888:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1783135168.914644:0:18888:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1783135168.914645:0:18888:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1783135168.914646:0:18888:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1783135168.914647:0:18888:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1783135168.914675:0:18888:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:1.0:1783135168.914696:0:18888:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe8c590fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:06a7653e-5f5a-4acc-ba93-0eff19f145f0:18888:1869752384462208:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1783135168.914886:0:18888:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135168.914970:0:18888:0:(client.c:2701:ptlrpc_set_wait()) set ffff9fe9ea79c840 going to sleep for 11 seconds 00000100:00100000:0.0:1783135168.915221:0:18246:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384462208 00000100:00100000:0.0:1783135168.915231:0:18246:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384462208 00000100:00100000:0.0:1783135168.915324:0:18246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1783135168.915335:0:18246:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fff55450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:06a7653e-5f5a-4acc-ba93-0eff19f145f0+12:18888:x1869752384462208:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1783135168.915399:0:18246:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:0.0:1783135168.915403:0:18246:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:0.0:1783135168.915407:0:18246:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:3.0:1783135168.936120:0:18246:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fff55450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:06a7653e-5f5a-4acc-ba93-0eff19f145f0+12:18888:x1869752384462208:12345-0@lo:253:mount.lustre.0 Request processed in 20773us (21220us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135168.936137:0:18246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1783135168.936540:0:18888:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe8c590fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:06a7653e-5f5a-4acc-ba93-0eff19f145f0:18888:1869752384462208:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1783135168.936557:0:18888:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:1.0:1783135168.936561:0:18888:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1783135168.936563:0:18888:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1783135168.936564:0:18888:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1783135168.936565:0:18888:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1783135168.936566:0:18888:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1783135168.936567:0:18888:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1783135168.936569:0:18888:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1783135168.936571:0:18888:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1783135168.936573:0:18888:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1783135168.936595:0:18888:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9fe9f8a5b800 from lustre-OST0000 10000000:01000000:1.0:1783135168.936629:0:18888:0:(mgc_request.c:1945:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:1.0:1783135168.936633:0:18888:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:1.0:1783135168.936640:0:18888:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9fe9ca89cd40 local copy 00010000:00010000:1.0:1783135168.936653:0:18888:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.141@tcp lock: ffff9fe8c5550800/0xd6c4b8f058680062 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd6c4b8f058680069 expref: -99 pid: 18234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783135168.937142:0:18888:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe8c590fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:06a7653e-5f5a-4acc-ba93-0eff19f145f0:18888:1869752384462336:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1783135168.937197:0:18888:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135168.937241:0:18888:0:(client.c:2701:ptlrpc_set_wait()) set ffff9fe9ea79cc00 going to sleep for 11 seconds 00000100:00100000:0.0:1783135168.937726:0:18245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384462336 00000100:00100000:0.0:1783135168.937734:0:18245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384462336 00000100:00100000:0.0:1783135168.937860:0:18245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1783135168.937871:0:18245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fff54c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:06a7653e-5f5a-4acc-ba93-0eff19f145f0+12:18888:x1869752384462336:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1783135168.938531:0:18245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fff54c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:06a7653e-5f5a-4acc-ba93-0eff19f145f0+12:18888:x1869752384462336:12345-0@lo:501:mount.lustre.0 Request processed in 660us (1332us total) trans 0 rc -2/-2 00000100:00100000:0.0:1783135168.938540:0:18245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1783135168.946180:0:18888:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe8c590fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:06a7653e-5f5a-4acc-ba93-0eff19f145f0:18888:1869752384462336:0@lo:501:mount.lustre.0 10000000:01000000:2.0:1783135168.946439:0:18888:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.201.141@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1783135168.946715:0:18888:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.201.141@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1783135168.946727:0:18888:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.141@tcp lock: ffff9fe8c5550800/0xd6c4b8f058680062 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd6c4b8f058680069 expref: -99 pid: 18234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135168.946739:0:18888:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.141@tcp lock: ffff9fe8c5550800/0xd6c4b8f058680062 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd6c4b8f058680069 expref: -99 pid: 18234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783135168.946888:0:18888:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9fe9f8a5b800 10000000:01000000:2.0:1783135168.946894:0:18888:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1783135168.946899:0:18888:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff9fe9ca89cd40 10000000:01000000:2.0:1783135168.946902:0:18888:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:2.0:1783135168.946905:0:18888:0:(mgc_request.c:1803:mgc_process_log()) Process log nodemap-ffff9fe9ca89cd40 from 1 10000000:01000000:2.0:1783135168.946907:0:18888:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:2.0:1783135168.947067:0:18888:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.141@tcp lock: ffff9fe9c1522400/0xd6c4b8f05868017a lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18888 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135168.947076:0:18888:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.141@tcp lock: ffff9fe9c1522400/0xd6c4b8f05868017a lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18888 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135168.947087:0:18888:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.141@tcp lock: ffff9fe9c1522400/0xd6c4b8f05868017a lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18888 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783135168.947111:0:18888:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9f6fe6a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:06a7653e-5f5a-4acc-ba93-0eff19f145f0:18888:1869752384462464:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1783135168.947176:0:18888:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135168.947237:0:18888:0:(client.c:2701:ptlrpc_set_wait()) set ffff9fe9c7b5f540 going to sleep for 11 seconds 00000100:00100000:3.0:1783135168.948970:0:18246:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384462464 00000100:00100000:3.0:1783135168.948983:0:18246:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384462464 00000100:00100000:3.0:1783135168.949057:0:18246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1783135168.949068:0:18246:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fff49450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:06a7653e-5f5a-4acc-ba93-0eff19f145f0+12:18888:x1869752384462464:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1783135168.949085:0:18246:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783135168.949104:0:18246:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fe9c0030600/0xd6c4b8f058680181 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd6c4b8f05868017a expref: -99 pid: 18246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135168.949131:0:18246:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fe9c0030600/0xd6c4b8f058680181 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd6c4b8f05868017a expref: 13 pid: 18246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135168.949158:0:18246:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fe9c0030600/0xd6c4b8f058680181 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd6c4b8f05868017a expref: 13 pid: 18246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135168.949166:0:18246:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fe9c0030600, rc 0) 00000100:00100000:3.0:1783135168.949235:0:18246:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fff49450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:06a7653e-5f5a-4acc-ba93-0eff19f145f0+13:18888:x1869752384462464:12345-0@lo:101:mount.lustre.0 Request processed in 168us (2059us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135168.949243:0:18246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1783135168.949686:0:18888:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9f6fe6a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:06a7653e-5f5a-4acc-ba93-0eff19f145f0:18888:1869752384462464:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1783135168.949705:0:18888:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.141@tcp lock: ffff9fe9c1522400/0xd6c4b8f05868017a lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd6c4b8f058680181 expref: -99 pid: 18888 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135168.949715:0:18888:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.141@tcp lock: ffff9fe9c1522400/0xd6c4b8f05868017a lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd6c4b8f058680181 expref: -99 pid: 18888 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783135168.949734:0:18888:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.201.141@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:2.0:1783135168.949751:0:18888:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.141@tcp lock: ffff9fe9c1522400/0xd6c4b8f05868017a lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd6c4b8f058680181 expref: -99 pid: 18888 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135168.949759:0:18888:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.141@tcp lock: ffff9fe9c1522400/0xd6c4b8f05868017a lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd6c4b8f058680181 expref: -99 pid: 18888 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783135168.949776:0:18888:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:2.0:1783135168.949781:0:18888:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1783135168.949787:0:18888:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:2.0:1783135168.949789:0:18888:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:2.0:1783135168.949812:0:18888:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.141@tcp lock: ffff9fe9c1523200/0xd6c4b8f058680188 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18888 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135168.949819:0:18888:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.141@tcp lock: ffff9fe9c1523200/0xd6c4b8f058680188 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18888 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135168.949827:0:18888:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.141@tcp lock: ffff9fe9c1523200/0xd6c4b8f058680188 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18888 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783135168.949845:0:18888:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9f6fe6a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:06a7653e-5f5a-4acc-ba93-0eff19f145f0:18888:1869752384462592:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1783135168.949879:0:18888:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135168.949939:0:18888:0:(client.c:2701:ptlrpc_set_wait()) set ffff9fe9c7b5f540 going to sleep for 11 seconds 00000100:00100000:0.0:1783135168.950182:0:18245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384462592 00000100:00100000:0.0:1783135168.950187:0:18245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384462592 00000100:00100000:0.0:1783135168.950226:0:18245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1783135168.950233:0:18245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fff48c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:06a7653e-5f5a-4acc-ba93-0eff19f145f0+13:18888:x1869752384462592:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1783135168.950242:0:18245:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783135168.950252:0:18245:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fe9f68ac600/0xd6c4b8f05868018f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xd6c4b8f058680188 expref: -99 pid: 18245 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135168.950315:0:18245:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fe9f68ac600/0xd6c4b8f05868018f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd6c4b8f058680188 expref: 14 pid: 18245 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135168.950324:0:18245:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fe9f68ac600/0xd6c4b8f05868018f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd6c4b8f058680188 expref: 14 pid: 18245 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135168.950332:0:18245:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fe9f68ac600, rc 0) 00000100:00100000:0.0:1783135168.950373:0:18245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fff48c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:06a7653e-5f5a-4acc-ba93-0eff19f145f0+14:18888:x1869752384462592:12345-0@lo:101:mount.lustre.0 Request processed in 141us (494us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135168.950379:0:18245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1783135168.950602:0:18888:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9f6fe6a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:06a7653e-5f5a-4acc-ba93-0eff19f145f0:18888:1869752384462592:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1783135168.950614:0:18888:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.141@tcp lock: ffff9fe9c1523200/0xd6c4b8f058680188 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xd6c4b8f05868018f expref: -99 pid: 18888 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135168.950623:0:18888:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.141@tcp lock: ffff9fe9c1523200/0xd6c4b8f058680188 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xd6c4b8f05868018f expref: -99 pid: 18888 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1783135168.951693:0:18888:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 14 count 14 00000040:00080000:2.0:1783135168.954818:0:18888:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1783135168.955109:0:18888:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].1, 224 off8416 00000040:00080000:2.0:1783135168.955155:0:18888:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].2, 128 off8544 00000040:00080000:2.0:1783135168.955189:0:18888:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].3, 112 off8656 00000040:00080000:2.0:1783135168.955237:0:18888:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].4, 224 off8880 00000040:00080000:2.0:1783135168.955325:0:18888:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].5, 224 off9104 00000040:00080000:2.0:1783135168.955363:0:18888:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].6, 80 off9184 00000040:00080000:2.0:1783135168.957092:0:18888:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].7, 224 off9408 00000040:00080000:2.0:1783135168.957157:0:18888:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].8, 224 off9632 00000040:00080000:2.0:1783135168.957188:0:18888:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].9, 80 off9712 00000040:00080000:2.0:1783135168.957238:0:18888:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].10, 224 off9936 00000040:00080000:2.0:1783135168.958696:0:18888:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].11, 224 off10160 00000040:00080000:2.0:1783135168.958831:0:18888:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].12, 120 off10280 00000040:00080000:2.0:1783135168.959179:0:18888:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].13, 224 off10504 00000040:00080000:2.0:1783135168.959191:0:18888:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 13 count 14 00000100:00100000:2.0:1783135168.959339:0:18888:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9f6fe6a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:06a7653e-5f5a-4acc-ba93-0eff19f145f0:18888:1869752384462720:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1783135168.959570:0:18888:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135168.959624:0:18888:0:(client.c:2701:ptlrpc_set_wait()) set ffff9fe9c7b5f780 going to sleep for 11 seconds 00000100:00100000:1.0:1783135168.959706:0:18247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384462720 00000100:00100000:1.0:1783135168.959714:0:18247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384462720 00000100:00100000:1.0:1783135168.959778:0:18247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1783135168.959789:0:18247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fff48850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:06a7653e-5f5a-4acc-ba93-0eff19f145f0+14:18888:x1869752384462720:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1783135168.960592:0:18247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fff48850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:06a7653e-5f5a-4acc-ba93-0eff19f145f0+14:18888:x1869752384462720:12345-0@lo:501:mount.lustre.0 Request processed in 804us (1022us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135168.960601:0:18247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1783135168.961137:0:18888:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9f6fe6a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:06a7653e-5f5a-4acc-ba93-0eff19f145f0:18888:1869752384462720:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1783135168.961183:0:18888:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9f6fe6a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:06a7653e-5f5a-4acc-ba93-0eff19f145f0:18888:1869752384462848:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1783135168.961246:0:18888:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135168.961310:0:18888:0:(client.c:2701:ptlrpc_set_wait()) set ffff9fe9c7b5f780 going to sleep for 11 seconds 00000100:00100000:3.0:1783135168.961839:0:18246:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384462848 00000100:00100000:3.0:1783135168.961847:0:18246:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384462848 00000100:00100000:3.0:1783135168.961946:0:18246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1783135168.961956:0:18246:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fff4b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:06a7653e-5f5a-4acc-ba93-0eff19f145f0+14:18888:x1869752384462848:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1783135168.962698:0:18246:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fff4b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:06a7653e-5f5a-4acc-ba93-0eff19f145f0+14:18888:x1869752384462848:12345-0@lo:503:mount.lustre.0 Request processed in 741us (1449us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135168.962706:0:18246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1783135168.969371:0:18888:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9f6fe6a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:06a7653e-5f5a-4acc-ba93-0eff19f145f0:18888:1869752384462848:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1783135168.970677:0:18888:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1783135168.970762:0:18888:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9f6fe6a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:06a7653e-5f5a-4acc-ba93-0eff19f145f0:18888:1869752384462976:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1783135168.970911:0:18888:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135168.971114:0:18888:0:(client.c:2701:ptlrpc_set_wait()) set ffff9fe9c7b5f780 going to sleep for 11 seconds 00000100:00100000:1.0:1783135168.971549:0:18247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384462976 00000100:00100000:1.0:1783135168.971558:0:18247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384462976 00000100:00100000:1.0:1783135168.971599:0:18247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1783135168.971607:0:18247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fff4bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:06a7653e-5f5a-4acc-ba93-0eff19f145f0+14:18888:x1869752384462976:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1783135168.972203:0:18247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fff4bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:06a7653e-5f5a-4acc-ba93-0eff19f145f0+14:18888:x1869752384462976:12345-0@lo:502:mount.lustre.0 Request processed in 594us (1292us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135168.972213:0:18247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1783135168.978534:0:18888:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9f6fe6a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:06a7653e-5f5a-4acc-ba93-0eff19f145f0:18888:1869752384462976:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1783135168.978884:0:18888:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].1, 224 off8416 00000040:00080000:2.0:1783135168.978970:0:18888:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].2, 128 off8544 00000040:00080000:2.0:1783135168.979009:0:18888:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].3, 112 off8656 00000040:00080000:2.0:1783135168.979079:0:18888:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].4, 224 off8880 00000040:00080000:2.0:1783135168.979123:0:18888:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].5, 224 off9104 00000040:00080000:2.0:1783135168.979159:0:18888:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].6, 80 off9184 00000040:00080000:2.0:1783135168.979212:0:18888:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].7, 224 off9408 00000040:00080000:2.0:1783135168.979249:0:18888:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].8, 224 off9632 00000040:00080000:2.0:1783135168.979665:0:18888:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].9, 80 off9712 00000040:00080000:2.0:1783135168.979722:0:18888:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].10, 224 off9936 00000040:00080000:2.0:1783135168.979758:0:18888:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].11, 224 off10160 00000040:00080000:2.0:1783135168.979809:0:18888:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].12, 120 off10280 00000100:00100000:2.0:1783135168.979860:0:18888:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9f6fe6a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:06a7653e-5f5a-4acc-ba93-0eff19f145f0:18888:1869752384463104:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1783135168.980084:0:18888:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135168.980179:0:18888:0:(client.c:2701:ptlrpc_set_wait()) set ffff9fe9c7b5f780 going to sleep for 11 seconds 00000100:00100000:3.0:1783135168.984114:0:18246:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384463104 00000100:00100000:3.0:1783135168.984129:0:18246:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384463104 00000100:00100000:3.0:1783135168.984185:0:18246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1783135168.984197:0:18246:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fff49c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:06a7653e-5f5a-4acc-ba93-0eff19f145f0+14:18888:x1869752384463104:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1783135168.985333:0:18246:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fff49c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:06a7653e-5f5a-4acc-ba93-0eff19f145f0+14:18888:x1869752384463104:12345-0@lo:502:mount.lustre.0 Request processed in 1134us (5245us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135168.985343:0:18246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1783135168.985609:0:18888:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9f6fe6a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:06a7653e-5f5a-4acc-ba93-0eff19f145f0:18888:1869752384463104:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1783135168.985737:0:18888:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].13, 224 off10504 00000040:00080000:2.0:1783135168.985754:0:18888:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 14 00000020:01000000:0.0:1783135168.992587:0:18902:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1783135168.992600:0:18902:0:(obd_mount.c:952:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:0.0:1783135168.992607:0:18902:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783135168.992610:0:18902:0:(obd_config.c:1561:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:0.0:1783135168.992622:0:18902:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1783135168.992640:0:18902:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff9fe9c8efb380) 00000020:00000080:0.0:1783135168.992664:0:18902:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type obdfilter with refcount 2 00000020:00000080:0.0:1783135168.992671:0:18902:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1783135168.992738:0:18902:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9fe9f8a5b800 from lustre-OST0000, refs=2 00080000:01000000:0.0:1783135168.992748:0:18902:0:(osd_handler.c:1569:osd_obd_connect()) connect #1 00000020:00000080:0.0:1783135168.992755:0:18902:0:(genops.c:1406:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xd6c4b8f05868019d 00010000:00010000:0.0:1783135168.997268:0:18902:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:00000004:0.0:1783135168.997921:0:18902:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 3, last_transno is 8589934598 00080000:10000000:0.0:1783135169.008719:0:18902:0:(osd_index.c:2102:osd_index_try()) lustre-OST0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00000020:00000080:0.0:1783135169.011873:0:18902:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:0.0:1783135169.011887:0:18902:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1783135169.011894:0:18902:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783135169.011896:0:18902:0:(obd_config.c:1561:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:0.0:1783135169.011900:0:18902:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1783135169.011902:0:18902:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #15 00000020:01000000:0.0:1783135169.011904:0:18902:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1783135169.011906:0:18902:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1783135169.011907:0:18902:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1783135169.011910:0:18902:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783135169.011911:0:18902:0:(obd_config.c:1561:class_process_config()) marker 15 (0x6) lustre sys.timeout 00000020:01000000:0.0:1783135169.011914:0:18902:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1783135169.011918:0:18902:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783135169.011919:0:18902:0:(obd_config.c:1561:class_process_config()) marker 22 (0x1) lustre sys.timeout 00000020:00000080:0.0:1783135169.011922:0:18902:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1783135169.011923:0:18902:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1783135169.011925:0:18902:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1783135169.014113:0:18902:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783135169.014121:0:18902:0:(obd_config.c:1561:class_process_config()) marker 22 (0x2) lustre sys.timeout 00000020:01000000:0.0:1783135169.014132:0:18902:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1783135169.014137:0:18902:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783135169.014139:0:18902:0:(obd_config.c:1561:class_process_config()) marker 26 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1783135169.014142:0:18902:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000020:01000000:0.0:1783135169.014212:0:18902:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1783135169.014222:0:18902:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783135169.014224:0:18902:0:(obd_config.c:1561:class_process_config()) marker 26 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1783135169.014227:0:18902:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 14 count 14 00000020:01000000:1.0:1783135169.014591:0:18888:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:1.0:1783135169.014625:0:18888:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.201.141@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:1.0:1783135169.014653:0:18888:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.141@tcp lock: ffff9fe9c1523200/0xd6c4b8f058680188 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xd6c4b8f05868018f expref: -99 pid: 18888 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135169.014666:0:18888:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.141@tcp lock: ffff9fe9c1523200/0xd6c4b8f058680188 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xd6c4b8f05868018f expref: -99 pid: 18888 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783135169.014675:0:18888:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff9fe9f8a5b800 from 1 10000000:01000000:1.0:1783135169.014678:0:18888:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1783135169.014736:0:18888:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.141@tcp lock: ffff9fe8c5550c00/0xd6c4b8f0586801a4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18888 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135169.014746:0:18888:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.141@tcp lock: ffff9fe8c5550c00/0xd6c4b8f0586801a4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18888 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135169.014759:0:18888:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.141@tcp lock: ffff9fe8c5550c00/0xd6c4b8f0586801a4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18888 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783135169.014786:0:18888:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe8c590d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:06a7653e-5f5a-4acc-ba93-0eff19f145f0:18888:1869752384463232:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1783135169.014863:0:18888:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135169.014921:0:18888:0:(client.c:2701:ptlrpc_set_wait()) set ffff9fe9ea79c540 going to sleep for 11 seconds 00000100:00100000:0.0:1783135169.015215:0:18247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384463232 00000100:00100000:0.0:1783135169.015224:0:18247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384463232 00000100:00100000:0.0:1783135169.016087:0:18247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1783135169.016104:0:18247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fff4ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:06a7653e-5f5a-4acc-ba93-0eff19f145f0+14:18888:x1869752384463232:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1783135169.016122:0:18247:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783135169.016137:0:18247:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fe9f68ad000/0xd6c4b8f0586801ab lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xd6c4b8f0586801a4 expref: -99 pid: 18247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135169.016166:0:18247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fe9f68ad000/0xd6c4b8f0586801ab lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd6c4b8f0586801a4 expref: 15 pid: 18247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135169.016178:0:18247:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fe9f68ad000/0xd6c4b8f0586801ab lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd6c4b8f0586801a4 expref: 15 pid: 18247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135169.016187:0:18247:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fe9f68ad000, rc 0) 00000100:00100000:0.0:1783135169.016248:0:18247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fff4ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:06a7653e-5f5a-4acc-ba93-0eff19f145f0+15:18888:x1869752384463232:12345-0@lo:101:mount.lustre.0 Request processed in 150us (1385us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135169.024630:0:18888:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe8c590d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:06a7653e-5f5a-4acc-ba93-0eff19f145f0:18888:1869752384463232:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1783135169.024662:0:18888:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.141@tcp lock: ffff9fe8c5550c00/0xd6c4b8f0586801a4 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd6c4b8f0586801ab expref: -99 pid: 18888 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135169.024676:0:18888:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.141@tcp lock: ffff9fe8c5550c00/0xd6c4b8f0586801a4 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xd6c4b8f0586801ab expref: -99 pid: 18888 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1783135169.025256:0:18888:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 10 00000040:00080000:1.0:1783135169.026134:0:18888:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1783135169.026576:0:18888:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].1, 224 off8416 00000040:00080000:1.0:1783135169.026625:0:18888:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].2, 112 off8528 00000040:00080000:1.0:1783135169.026679:0:18888:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].3, 224 off8752 00000040:00080000:1.0:1783135169.026721:0:18888:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].4, 224 off8976 00000040:00080000:1.0:1783135169.026757:0:18888:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].5, 112 off9088 00000040:00080000:1.0:1783135169.026809:0:18888:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].6, 224 off9312 00000040:00080000:1.0:1783135169.026846:0:18888:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].7, 224 off9536 00000040:00080000:1.0:1783135169.026883:0:18888:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].8, 128 off9664 00000040:00080000:1.0:1783135169.028501:0:18888:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].9, 224 off9888 00000040:00080000:1.0:1783135169.028522:0:18888:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 9 count 10 00000100:00100000:1.0:1783135169.028644:0:18888:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe8c590d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:06a7653e-5f5a-4acc-ba93-0eff19f145f0:18888:1869752384463360:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1783135169.028723:0:18888:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135169.028807:0:18888:0:(client.c:2701:ptlrpc_set_wait()) set ffff9fe9ea79c540 going to sleep for 11 seconds 00000100:00100000:0.0:1783135169.032124:0:18247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1783135169.032189:0:18247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384463360 00000100:00100000:0.0:1783135169.032197:0:18247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384463360 00000100:00100000:3.0:1783135169.032330:0:18246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1783135169.032342:0:18246:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fff4b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:06a7653e-5f5a-4acc-ba93-0eff19f145f0+15:18888:x1869752384463360:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1783135169.032643:0:18246:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fff4b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:06a7653e-5f5a-4acc-ba93-0eff19f145f0+15:18888:x1869752384463360:12345-0@lo:501:mount.lustre.0 Request processed in 303us (3919us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135169.032660:0:18246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1783135169.033348:0:18888:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe8c590d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:06a7653e-5f5a-4acc-ba93-0eff19f145f0:18888:1869752384463360:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1783135169.033400:0:18888:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe8c590d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:06a7653e-5f5a-4acc-ba93-0eff19f145f0:18888:1869752384463488:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1783135169.033453:0:18888:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135169.033489:0:18888:0:(client.c:2701:ptlrpc_set_wait()) set ffff9fe9ea79c540 going to sleep for 11 seconds 00000100:00100000:2.0:1783135169.033545:0:18245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384463488 00000100:00100000:2.0:1783135169.033556:0:18245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384463488 00000100:00100000:2.0:1783135169.033590:0:18245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1783135169.033596:0:18245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fff48050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:06a7653e-5f5a-4acc-ba93-0eff19f145f0+15:18888:x1869752384463488:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1783135169.033757:0:18245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fff48050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:06a7653e-5f5a-4acc-ba93-0eff19f145f0+15:18888:x1869752384463488:12345-0@lo:503:mount.lustre.0 Request processed in 160us (304us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135169.033764:0:18245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1783135169.033919:0:18888:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe8c590d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:06a7653e-5f5a-4acc-ba93-0eff19f145f0:18888:1869752384463488:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1783135169.034598:0:18888:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1783135169.034678:0:18888:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe8c590d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:06a7653e-5f5a-4acc-ba93-0eff19f145f0:18888:1869752384463616:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1783135169.034723:0:18888:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135169.034747:0:18888:0:(client.c:2701:ptlrpc_set_wait()) set ffff9fe9ea79c540 going to sleep for 11 seconds 00000100:00100000:2.0:1783135169.035061:0:18245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384463616 00000100:00100000:2.0:1783135169.035067:0:18245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384463616 00000100:00100000:2.0:1783135169.035095:0:18245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1783135169.035103:0:18245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fff49050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:06a7653e-5f5a-4acc-ba93-0eff19f145f0+15:18888:x1869752384463616:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1783135169.035296:0:18245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fff49050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:06a7653e-5f5a-4acc-ba93-0eff19f145f0+15:18888:x1869752384463616:12345-0@lo:502:mount.lustre.0 Request processed in 171us (551us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135169.035304:0:18245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1783135169.035557:0:18888:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe8c590d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:06a7653e-5f5a-4acc-ba93-0eff19f145f0:18888:1869752384463616:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1783135169.035800:0:18888:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].1, 224 off8416 00000040:00080000:1.0:1783135169.035863:0:18888:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].2, 112 off8528 00000040:00080000:1.0:1783135169.036758:0:18888:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].3, 224 off8752 00000040:00080000:1.0:1783135169.036826:0:18888:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].4, 224 off8976 00000040:00080000:1.0:1783135169.036860:0:18888:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].5, 112 off9088 00000040:00080000:1.0:1783135169.036915:0:18888:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].6, 224 off9312 00000040:00080000:1.0:1783135169.038099:0:18888:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].7, 224 off9536 00000040:00080000:1.0:1783135169.038146:0:18888:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].8, 128 off9664 00000100:00100000:1.0:1783135169.038194:0:18888:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe8c590d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:06a7653e-5f5a-4acc-ba93-0eff19f145f0:18888:1869752384463744:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1783135169.038430:0:18888:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135169.038465:0:18888:0:(client.c:2701:ptlrpc_set_wait()) set ffff9fe9ea79c540 going to sleep for 11 seconds 00000100:00100000:2.0:1783135169.038622:0:18245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384463744 00000100:00100000:2.0:1783135169.038629:0:18245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384463744 00000100:00100000:2.0:1783135169.038689:0:18245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1783135169.038700:0:18245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fff4b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:06a7653e-5f5a-4acc-ba93-0eff19f145f0+15:18888:x1869752384463744:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1783135169.038899:0:18245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fff4b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:06a7653e-5f5a-4acc-ba93-0eff19f145f0+15:18888:x1869752384463744:12345-0@lo:502:mount.lustre.0 Request processed in 201us (469us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135169.038907:0:18245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1783135169.039713:0:18888:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe8c590d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:06a7653e-5f5a-4acc-ba93-0eff19f145f0:18888:1869752384463744:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1783135169.039852:0:18888:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].9, 224 off9888 00000040:00080000:1.0:1783135169.039875:0:18888:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:3.0:1783135169.041374:0:18906:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1783135169.041385:0:18906:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783135169.041387:0:18906:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1783135169.041394:0:18906:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9fe9f8a5b800 00000020:00000080:3.0:1783135169.041396:0:18906:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1783135169.041404:0:18906:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1783135169.041406:0:18906:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783135169.041407:0:18906:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1783135169.041410:0:18906:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1783135169.041412:0:18906:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783135169.041413:0:18906:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1783135169.041416:0:18906:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9fe9f8a5b800 00000020:00000080:3.0:1783135169.041418:0:18906:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1783135169.041475:0:18906:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1783135169.041478:0:18906:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783135169.041480:0:18906:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:3.0:1783135169.041482:0:18906:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1783135169.041484:0:18906:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783135169.041485:0:18906:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1783135169.041489:0:18906:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9fe9f8a5b800 00000020:00000080:3.0:1783135169.041491:0:18906:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1783135169.041525:0:18906:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1783135169.041528:0:18906:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783135169.041530:0:18906:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:3.0:1783135169.041532:0:18906:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0xe:0x0] index 10 count 10 00000020:01000000:2.0:1783135169.044948:0:18888:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:2.0:1783135169.044991:0:18888:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.201.141@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1783135169.045021:0:18888:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.141@tcp lock: ffff9fe8c5550c00/0xd6c4b8f0586801a4 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd6c4b8f0586801ab expref: -99 pid: 18888 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135169.045034:0:18888:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.141@tcp lock: ffff9fe8c5550c00/0xd6c4b8f0586801a4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd6c4b8f0586801ab expref: -99 pid: 18888 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783135169.045092:0:18888:0:(mgc_request.c:1945:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1783135169.045096:0:18888:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9fe9f8a5b800 10000000:01000000:2.0:1783135169.045099:0:18888:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9fe9f8a5b800 10000000:01000000:2.0:1783135169.045103:0:18888:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1783135169.045108:0:18888:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff9fe9f8a5b800 from 1 10000000:01000000:2.0:1783135169.045111:0:18888:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1783135169.045149:0:18888:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.141@tcp lock: ffff9fe9c1523c00/0xd6c4b8f0586801b2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18888 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135169.045157:0:18888:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.141@tcp lock: ffff9fe9c1523c00/0xd6c4b8f0586801b2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18888 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135169.045169:0:18888:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.141@tcp lock: ffff9fe9c1523c00/0xd6c4b8f0586801b2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18888 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783135169.045195:0:18888:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9f6fe6a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:06a7653e-5f5a-4acc-ba93-0eff19f145f0:18888:1869752384463872:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1783135169.059742:0:18888:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135169.082813:0:18888:0:(client.c:2701:ptlrpc_set_wait()) set ffff9fe9c7b5f300 going to sleep for 11 seconds 00000100:00100000:0.0:1783135169.086377:0:18246:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384463872 00000100:00100000:0.0:1783135169.086401:0:18246:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384463872 00000100:00100000:0.0:1783135169.086461:0:18246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1783135169.086471:0:18246:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fff49850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:06a7653e-5f5a-4acc-ba93-0eff19f145f0+15:18888:x1869752384463872:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1783135169.086487:0:18246:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783135169.086505:0:18246:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fe9f68ac200/0xd6c4b8f0586801b9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xd6c4b8f0586801b2 expref: -99 pid: 18246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135169.086555:0:18246:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fe9f68ac200/0xd6c4b8f0586801b9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd6c4b8f0586801b2 expref: 16 pid: 18246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135169.086566:0:18246:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fe9f68ac200/0xd6c4b8f0586801b9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd6c4b8f0586801b2 expref: 16 pid: 18246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135169.086575:0:18246:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fe9f68ac200, rc 0) 00000100:00100000:0.0:1783135169.086650:0:18246:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fff49850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:06a7653e-5f5a-4acc-ba93-0eff19f145f0+16:18888:x1869752384463872:12345-0@lo:101:mount.lustre.0 Request processed in 180us (26916us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135169.086657:0:18246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1783135169.088918:0:18888:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9f6fe6a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:06a7653e-5f5a-4acc-ba93-0eff19f145f0:18888:1869752384463872:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1783135169.089186:0:18888:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.141@tcp lock: ffff9fe9c1523c00/0xd6c4b8f0586801b2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xd6c4b8f0586801b9 expref: -99 pid: 18888 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135169.089201:0:18888:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.141@tcp lock: ffff9fe9c1523c00/0xd6c4b8f0586801b2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xd6c4b8f0586801b9 expref: -99 pid: 18888 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1783135169.096886:0:18888:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00000040:00080000:2.0:1783135169.102109:0:18888:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1783135169.102620:0:18888:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].1, 224 off8416 00000040:00080000:2.0:1783135169.102684:0:18888:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].2, 120 off8536 00000040:00080000:2.0:1783135169.102720:0:18888:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].3, 168 off8704 00000040:00080000:2.0:1783135169.102785:0:18888:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].4, 224 off8928 00000040:00080000:2.0:1783135169.102827:0:18888:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].5, 224 off9152 00000040:00080000:2.0:1783135169.102875:0:18888:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].6, 120 off9272 00000040:00080000:2.0:1783135169.102913:0:18888:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].7, 168 off9440 00000040:00080000:2.0:1783135169.104172:0:18888:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].8, 224 off9664 00000040:00080000:2.0:1783135169.104269:0:18888:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].9, 224 off9888 00000040:00080000:2.0:1783135169.105204:0:18888:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].10, 120 off10008 00000040:00080000:2.0:1783135169.105246:0:18888:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].11, 224 off10232 00000040:00080000:2.0:1783135169.106460:0:18888:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].12, 224 off10456 00000040:00080000:2.0:1783135169.106525:0:18888:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].13, 88 off10544 00000040:00080000:2.0:1783135169.106563:0:18888:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].14, 128 off10672 00000040:00080000:2.0:1783135169.106616:0:18888:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].15, 144 off10816 00000040:00080000:2.0:1783135169.107044:0:18888:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].16, 160 off10976 00000040:00080000:2.0:1783135169.107080:0:18888:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].17, 224 off11200 00000040:00080000:2.0:1783135169.107145:0:18888:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].18, 224 off11424 00000040:00080000:2.0:1783135169.107182:0:18888:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].19, 80 off11504 00000040:00080000:2.0:1783135169.107217:0:18888:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].20, 224 off11728 00000040:00080000:2.0:1783135169.107305:0:18888:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].21, 224 off11952 00000040:00080000:2.0:1783135169.107345:0:18888:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].22, 88 off12040 00000040:00080000:2.0:1783135169.107382:0:18888:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].23, 128 off12168 00000040:00080000:2.0:1783135169.107428:0:18888:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].24, 144 off12312 00000040:00080000:2.0:1783135169.107463:0:18888:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].25, 128 off12440 00000040:00080000:2.0:1783135169.107494:0:18888:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].26, 224 off12664 00000040:00080000:2.0:1783135169.107539:0:18888:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].27, 224 off12888 00000040:00080000:2.0:1783135169.107574:0:18888:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].28, 80 off12968 00000040:00080000:2.0:1783135169.114006:0:18888:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].29, 224 off13192 00000040:00080000:2.0:1783135169.114177:0:18888:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].30, 224 off13416 00000040:00080000:2.0:1783135169.114219:0:18888:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].31, 88 off13504 00000040:00080000:2.0:1783135169.117333:0:18888:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].32, 128 off13632 00000040:00080000:2.0:1783135169.117483:0:18888:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].33, 144 off13776 00000040:00080000:2.0:1783135169.117570:0:18888:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].34, 128 off13904 00000040:00080000:2.0:1783135169.117625:0:18888:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].35, 224 off14128 00000040:00080000:2.0:1783135169.117679:0:18888:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].36, 224 off14352 00000040:00080000:2.0:1783135169.117718:0:18888:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].37, 80 off14432 00000040:00080000:2.0:1783135169.117750:0:18888:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].38, 224 off14656 00000040:00080000:2.0:1783135169.117817:0:18888:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].39, 224 off14880 00000040:00080000:2.0:1783135169.117853:0:18888:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].40, 120 off15000 00000040:00080000:2.0:1783135169.118177:0:18888:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].41, 224 off15224 00000040:00080000:2.0:1783135169.118186:0:18888:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 41 count 42 00000100:00100000:2.0:1783135169.120139:0:18888:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9f6fe6a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:06a7653e-5f5a-4acc-ba93-0eff19f145f0:18888:1869752384464000:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1783135169.120213:0:18888:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135169.120271:0:18888:0:(client.c:2701:ptlrpc_set_wait()) set ffff9fe9c7b5f300 going to sleep for 11 seconds 00000100:00100000:0.0:1783135169.120470:0:18245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384464000 00000100:00100000:0.0:1783135169.120478:0:18245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384464000 00000100:00100000:0.0:1783135169.120520:0:18245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1783135169.120527:0:18245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fff4a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:06a7653e-5f5a-4acc-ba93-0eff19f145f0+16:18888:x1869752384464000:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1783135169.120790:0:18245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fff4a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:06a7653e-5f5a-4acc-ba93-0eff19f145f0+16:18888:x1869752384464000:12345-0@lo:501:mount.lustre.0 Request processed in 262us (576us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135169.120798:0:18245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1783135169.121144:0:18888:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9f6fe6a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:06a7653e-5f5a-4acc-ba93-0eff19f145f0:18888:1869752384464000:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1783135169.121184:0:18888:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9f6fe6a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:06a7653e-5f5a-4acc-ba93-0eff19f145f0:18888:1869752384464128:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1783135169.121224:0:18888:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135169.121249:0:18888:0:(client.c:2701:ptlrpc_set_wait()) set ffff9fe9c7b5f300 going to sleep for 11 seconds 00000100:00100000:0.0:1783135169.121737:0:18247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384464128 00000100:00100000:0.0:1783135169.121743:0:18247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384464128 00000100:00100000:0.0:1783135169.121851:0:18247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1783135169.121860:0:18247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fff4a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:06a7653e-5f5a-4acc-ba93-0eff19f145f0+16:18888:x1869752384464128:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1783135169.123209:0:18247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fff4a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:06a7653e-5f5a-4acc-ba93-0eff19f145f0+16:18888:x1869752384464128:12345-0@lo:503:mount.lustre.0 Request processed in 1347us (1980us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135169.123220:0:18247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1783135169.132466:0:18888:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9f6fe6a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:06a7653e-5f5a-4acc-ba93-0eff19f145f0:18888:1869752384464128:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1783135169.133546:0:18888:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1783135169.133741:0:18888:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9fe8fc380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:06a7653e-5f5a-4acc-ba93-0eff19f145f0:18888:1869752384464256:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1783135169.133886:0:18888:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135169.134023:0:18888:0:(client.c:2701:ptlrpc_set_wait()) set ffff9fe9f89806c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783135169.134488:0:18246:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384464256 00000100:00100000:2.0:1783135169.134497:0:18246:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384464256 00000100:00100000:2.0:1783135169.134547:0:18246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1783135169.134556:0:18246:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fff48450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:06a7653e-5f5a-4acc-ba93-0eff19f145f0+16:18888:x1869752384464256:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1783135169.135085:0:18246:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fff48450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:06a7653e-5f5a-4acc-ba93-0eff19f145f0+16:18888:x1869752384464256:12345-0@lo:502:mount.lustre.0 Request processed in 529us (1197us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135169.135093:0:18246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1783135169.135892:0:18888:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9fe8fc380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:06a7653e-5f5a-4acc-ba93-0eff19f145f0:18888:1869752384464256:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1783135169.136901:0:18888:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].1, 224 off8416 00000040:00080000:0.0:1783135169.137095:0:18888:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].2, 120 off8536 00000040:00080000:0.0:1783135169.137153:0:18888:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].3, 168 off8704 00000040:00080000:0.0:1783135169.137205:0:18888:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].4, 224 off8928 00000040:00080000:0.0:1783135169.137241:0:18888:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].5, 224 off9152 00000040:00080000:0.0:1783135169.137892:0:18888:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].6, 120 off9272 00000040:00080000:0.0:1783135169.138054:0:18888:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].7, 168 off9440 00000040:00080000:0.0:1783135169.138091:0:18888:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].8, 224 off9664 00000040:00080000:0.0:1783135169.138133:0:18888:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].9, 224 off9888 00000040:00080000:0.0:1783135169.138163:0:18888:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].10, 120 off10008 00000040:00080000:0.0:1783135169.138199:0:18888:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].11, 224 off10232 00000040:00080000:0.0:1783135169.145703:0:18888:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].12, 224 off10456 00000040:00080000:0.0:1783135169.146815:0:18888:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].13, 88 off10544 00000040:00080000:0.0:1783135169.146860:0:18888:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].14, 128 off10672 00000040:00080000:0.0:1783135169.146941:0:18888:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].15, 144 off10816 00000040:00080000:0.0:1783135169.146980:0:18888:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].16, 160 off10976 00000040:00080000:0.0:1783135169.147016:0:18888:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].17, 224 off11200 00000040:00080000:0.0:1783135169.147067:0:18888:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].18, 224 off11424 00000040:00080000:0.0:1783135169.147130:0:18888:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].19, 80 off11504 00000040:00080000:0.0:1783135169.147165:0:18888:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].20, 224 off11728 00000040:00080000:0.0:1783135169.147211:0:18888:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].21, 224 off11952 00000040:00080000:0.0:1783135169.147245:0:18888:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].22, 88 off12040 00000040:00080000:0.0:1783135169.147314:0:18888:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].23, 128 off12168 00000040:00080000:0.0:1783135169.147364:0:18888:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].24, 144 off12312 00000040:00080000:0.0:1783135169.147402:0:18888:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].25, 128 off12440 00000040:00080000:0.0:1783135169.147437:0:18888:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].26, 224 off12664 00000040:00080000:0.0:1783135169.147488:0:18888:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].27, 224 off12888 00000040:00080000:0.0:1783135169.147528:0:18888:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].28, 80 off12968 00000040:00080000:0.0:1783135169.147576:0:18888:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].29, 224 off13192 00000040:00080000:0.0:1783135169.147626:0:18888:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].30, 224 off13416 00000040:00080000:0.0:1783135169.147662:0:18888:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].31, 88 off13504 00000040:00080000:0.0:1783135169.147696:0:18888:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].32, 128 off13632 00000040:00080000:0.0:1783135169.147732:0:18888:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].33, 144 off13776 00000040:00080000:0.0:1783135169.147782:0:18888:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].34, 128 off13904 00000040:00080000:0.0:1783135169.147834:0:18888:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].35, 224 off14128 00000040:00080000:0.0:1783135169.147877:0:18888:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].36, 224 off14352 00000040:00080000:0.0:1783135169.147907:0:18888:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].37, 80 off14432 00000040:00080000:0.0:1783135169.147936:0:18888:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].38, 224 off14656 00000040:00080000:0.0:1783135169.147989:0:18888:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].39, 224 off14880 00000040:00080000:0.0:1783135169.148023:0:18888:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].40, 120 off15000 00000100:00100000:0.0:1783135169.148070:0:18888:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9fe8fc380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:06a7653e-5f5a-4acc-ba93-0eff19f145f0:18888:1869752384464384:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1783135169.148148:0:18888:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135169.148199:0:18888:0:(client.c:2701:ptlrpc_set_wait()) set ffff9fe9f89806c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783135169.148423:0:18245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384464384 00000100:00100000:3.0:1783135169.148431:0:18245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384464384 00000100:00100000:3.0:1783135169.148479:0:18245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1783135169.148488:0:18245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fff4a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:06a7653e-5f5a-4acc-ba93-0eff19f145f0+16:18888:x1869752384464384:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1783135169.148743:0:18245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fff4a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:06a7653e-5f5a-4acc-ba93-0eff19f145f0+16:18888:x1869752384464384:12345-0@lo:502:mount.lustre.0 Request processed in 256us (594us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135169.148751:0:18245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1783135169.149816:0:18888:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9fe8fc380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:06a7653e-5f5a-4acc-ba93-0eff19f145f0:18888:1869752384464384:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1783135169.149948:0:18888:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].41, 224 off15224 00000040:00080000:2.0:1783135169.149962:0:18888:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:2.0:1783135169.152524:0:18911:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:2.0:1783135169.152541:0:18911:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff9fe9d0e80000) 00000020:00000080:2.0:1783135169.152573:0:18911:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type lwp with refcount 2 00000020:01000004:2.0:1783135169.152754:0:18911:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9fe9f8a5b800 from lustre-OST0000, refs=3 00000020:01000004:2.0:1783135169.152758:0:18911:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9fe9f8a5b800 from lustre-OST0000, refs=3 00000020:01000004:2.0:1783135169.152761:0:18911:0:(obd_mount.c:701:lustre_put_lsi()) put ffff9fe9f8a5b800 3 00010000:00080000:2.0:1783135169.152802:0:18911:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9fe9c979f800@lustre-MDT0000-lwp-OST0000: add connection 192.168.201.141@tcp at head 00010000:00010000:3.0:1783135169.166018:0:18911:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-4 is initialized 00000020:00000080:3.0:1783135169.166122:0:18911:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:3.0:1783135169.166165:0:18911:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1783135169.166181:0:18911:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0xd6c4b8f0586801c7 00000100:00080000:3.0:1783135169.166191:0:18911:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1783135169.166198:0:18911:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9fe9c979f800 using connection 192.168.201.141@tcp/0@lo 00000100:00100000:3.0:1783135169.166234:0:18911:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9fe9fe90f800 x1869752384464512/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1783135169.166315:0:3285:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9fe90f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3285:1869752384464512:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1783135169.166386:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1783135169.166439:0:18911:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1783135169.166676:0:18252:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384464512 00000100:00100000:0.0:1783135169.166683:0:18252:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384464512 00000100:00100000:0.0:1783135169.166719:0:18252:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1783135169.166726:0:18252:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fe90df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3285:x1869752384464512:12345-0@lo:38:llog_process_th.0 00010000:00080000:0.0:1783135169.166747:0:18252:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 451 last 0 00000020:00000080:0.0:1783135169.166796:0:18252:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0xd6c4b8f0586801ce 00000004:00100000:0.0:1783135169.166809:0:18252:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1783135169.166840:0:18252:0:(import.c:65:import_set_state_nolock()) ffff9fe8c5fcb800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1783135169.166888:0:18252:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fe90df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3285:x1869752384464512:12345-0@lo:38:llog_process_th.0 Request processed in 162us (502us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135169.166895:0:18252:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1783135169.167156:0:3285:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9fe9fe90f800 x1869752384464512/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1783135179 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783135169.167167:0:3285:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1783135169.167179:0:3285:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 3 00000100:00080000:0.0:1783135169.167184:0:3285:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1783135169.167188:0:3285:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1783135169.167191:0:3285:0:(import.c:65:import_set_state_nolock()) ffff9fe9c979f800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1783135169.167195:0:3285:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9fe90f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3285:1869752384464512:0@lo:38:llog_process_th.0 00000040:00080000:3.0:1783135169.168652:0:18911:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x10:0x0] index 42 count 42 00000020:01000000:3.0:1783135169.168704:0:18888:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:3.0:1783135169.168726:0:18888:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.201.141@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1783135169.168740:0:18888:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.141@tcp lock: ffff9fe9c1523c00/0xd6c4b8f0586801b2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xd6c4b8f0586801b9 expref: -99 pid: 18888 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135169.168750:0:18888:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.141@tcp lock: ffff9fe9c1523c00/0xd6c4b8f0586801b2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xd6c4b8f0586801b9 expref: -99 pid: 18888 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1783135169.168813:0:18888:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1783135169.168815:0:18888:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1783135169.168817:0:18888:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1783135169.168818:0:18888:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1783135169.168819:0:18888:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1783135169.168824:0:18888:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1783135169.168826:0:18888:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1783135169.168827:0:18888:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1783135169.168829:0:18888:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1783135169.168832:0:18888:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:3.0:1783135169.168834:0:18888:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1783135169.168835:0:18888:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1783135169.168836:0:18888:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1783135169.168837:0:18888:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1783135169.168838:0:18888:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1783135169.168839:0:18888:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1783135169.168839:0:18888:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1783135169.168840:0:18888:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1783135169.168841:0:18888:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1783135169.168862:0:18888:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:3.0:1783135169.168879:0:18888:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9fe90c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:06a7653e-5f5a-4acc-ba93-0eff19f145f0:18888:1869752384464640:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1783135169.168947:0:18888:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135169.168977:0:18888:0:(client.c:2701:ptlrpc_set_wait()) set ffff9fe9feff6000 going to sleep for 11 seconds 00000100:00080000:2.0:1783135169.169195:0:36:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1783135169.169201:0:36:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1783135169.169204:0:36:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1783135169.169207:0:36:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1783135169.169272:0:18246:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384464640 00000100:00100000:2.0:1783135169.169301:0:18246:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384464640 00000100:00100000:2.0:1783135169.169342:0:18246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1783135169.169351:0:18246:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9f5cea050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:06a7653e-5f5a-4acc-ba93-0eff19f145f0+16:18888:x1869752384464640:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1783135169.169376:0:18246:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:2.0:1783135169.169388:0:18246:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:2.0:1783135169.169689:0:3288:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1783135169.169700:0:3288:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9f6fe5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3288:1869752384464768:0@lo:400:kworker.0 00000100:00100000:2.0:1783135169.169735:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135169.169784:0:18253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384464768 00000100:00100000:2.0:1783135169.169788:0:18253:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384464768 00000100:00100000:2.0:1783135169.169814:0:18253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1783135169.169819:0:18253:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9f6fe4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3288:x1869752384464768:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783135169.169859:0:18253:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9f6fe4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3288:x1869752384464768:12345-0@lo:400:kworker.0 Request processed in 39us (124us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135169.169866:0:18253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1783135169.169916:0:3288:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9fe9f6fe5f80 x1869752384464768/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783135185 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783135169.169953:0:3288:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9f6fe5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3288:1869752384464768:0@lo:400:kworker.0 20000000:01000000:3.0:1783135169.237986:0:18246:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1783135169.238030:0:18246:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:2.0:1783135169.238227:0:18268:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1783135169.238233:0:18268:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1783135169.242116:0:18268:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9fe9c1523e00/0xd6c4b8f0586801d5 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18268 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135169.242165:0:18268:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9fe9c0030200/0xd6c4b8f058680142 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd6c4b8f05868013b expref: 16 pid: 18247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135169.242177:0:18268:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9fe9c1523e00/0xd6c4b8f0586801d5 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 18268 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135169.242930:0:18268:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9fe9c0030200/0xd6c4b8f058680142 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd6c4b8f05868013b expref: 16 pid: 18247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135169.242953:0:18268:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9fe9c0030200/0xd6c4b8f058680142 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd6c4b8f05868013b expref: 16 pid: 18247 timeout: 551 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783135169.242975:0:18268:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9fe90c380 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:18268:1869752384464896:0@lo:104: 00000100:00100000:3.0:1783135169.243067:0:18268:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135169.243150:0:18268:0:(client.c:2701:ptlrpc_set_wait()) set ffff9fe9c794e900 going to sleep for 11 seconds 00000100:00100000:2.0:1783135169.244801:0:18236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384464896 00000100:00100000:2.0:1783135169.244818:0:18236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384464896 00000100:00100000:2.0:1783135169.244887:0:18236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1783135169.244900:0:18236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fe90fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:06a7653e-5f5a-4acc-ba93-0eff19f145f0+3:18268:x1869752384464896:12345-0@lo:104: 00010000:00010000:2.0:1783135169.244921:0:18236:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.141@tcp lock: ffff9fe8c5551c00/0xd6c4b8f05868013b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xd6c4b8f058680142 expref: -99 pid: 18249 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135169.245031:0:18236:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1783135169.245038:0:18236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fe90fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:06a7653e-5f5a-4acc-ba93-0eff19f145f0+3:18268:x1869752384464896:12345-0@lo:104: Request processed in 142us (1972us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135169.245046:0:18236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1783135169.245160:0:18268:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9fe90c380 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:18268:1869752384464896:0@lo:104: 00010000:00010000:3.0:1783135169.245189:0:18268:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9fe9c1523e00/0xd6c4b8f0586801d5 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 18268 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135169.245464:0:18241:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783135169.245473:0:18241:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.141@tcp lock: ffff9fe8c5551c00/0xd6c4b8f05868013b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xd6c4b8f058680142 expref: -99 pid: 18249 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135169.245482:0:18241:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe8c5551c00 already unused, calling callback (ffffffffc1b40c20) 10000000:00010000:0.0:1783135169.245487:0:18241:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.141@tcp lock: ffff9fe8c5551c00/0xd6c4b8f05868013b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xd6c4b8f058680142 expref: -99 pid: 18249 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135169.245497:0:18241:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.141@tcp lock: ffff9fe8c5551c00/0xd6c4b8f05868013b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xd6c4b8f058680142 expref: -99 pid: 18249 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1783135169.245505:0:18241:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.141@tcp lock: ffff9fe8c5551c00/0xd6c4b8f05868013b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xd6c4b8f058680142 expref: -99 pid: 18249 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783135169.245511:0:18241:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1783135169.245559:0:18241:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.141@tcp lock: ffff9fe8c5551c00/0xd6c4b8f05868013b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd6c4b8f058680142 expref: -99 pid: 18249 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135169.245566:0:18241:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1783135169.245600:0:18241:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.141@tcp lock: ffff9fe8c5551c00/0xd6c4b8f05868013b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd6c4b8f058680142 expref: -99 pid: 18249 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135169.245608:0:18241:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.141@tcp lock: ffff9fe8c5551c00/0xd6c4b8f05868013b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd6c4b8f058680142 expref: -99 pid: 18249 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135169.245661:0:18241:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783135169.245663:0:18241:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783135169.245664:0:18241:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783135169.246157:0:3287:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1783135169.246182:0:3287:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9fe8ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:06a7653e-5f5a-4acc-ba93-0eff19f145f0:3287:1869752384465024:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1783135169.246720:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135169.246853:0:18238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384465024 00000100:00100000:0.0:1783135169.246862:0:18238:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384465024 00010000:00010000:0.0:1783135169.246902:0:18238:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9fe9c0030200/0xd6c4b8f058680142 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd6c4b8f05868013b expref: 17 pid: 18247 timeout: 551 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783135169.246943:0:18238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1783135169.246952:0:18238:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fe90c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:06a7653e-5f5a-4acc-ba93-0eff19f145f0+17:3287:x1869752384465024:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1783135169.246968:0:18238:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783135169.246974:0:18238:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9fe9c0030200/0xd6c4b8f058680142 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd6c4b8f05868013b expref: 17 pid: 18247 timeout: 551 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135169.246987:0:18238:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9fe9c0030200/0xd6c4b8f058680142 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd6c4b8f05868013b expref: 17 pid: 18247 timeout: 551 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135169.247009:0:18238:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fe9c0030200/0xd6c4b8f058680142 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd6c4b8f05868013b expref: 17 pid: 18247 timeout: 551 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135169.247041:0:18238:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9fe9c1523e00/0xd6c4b8f0586801d5 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 18268 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135169.247051:0:18238:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fe9c1523e00/0xd6c4b8f0586801d5 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 18268 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1783135169.247074:0:18238:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.008840171s 00010000:00010000:0.0:1783135169.247080:0:18238:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9fe9c1523e00/0xd6c4b8f0586801d5 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 18268 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135169.247104:0:18238:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9fe9c1523e00/0xd6c4b8f0586801d5 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 18268 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135169.247111:0:18238:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9fe9c1523e00/0xd6c4b8f0586801d5 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 18268 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135169.247117:0:18238:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9fe9c1523e00/0xd6c4b8f0586801d5 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 18268 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135169.247123:0:18238:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe9c1523e00 already unused, calling callback (ffffffffc1527ce0) 00010000:00010000:0.0:1783135169.247137:0:18238:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9fe9c1523e00/0xd6c4b8f0586801d5 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 18268 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135169.247146:0:18238:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9fe9c1523e00/0xd6c4b8f0586801d5 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 18268 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135169.247160:0:18238:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9fe9c1523e00/0xd6c4b8f0586801d5 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18268 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135169.247171:0:18238:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783135169.247548:0:18238:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fe90c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:06a7653e-5f5a-4acc-ba93-0eff19f145f0+16:3287:x1869752384465024:12345-0@lo:103:ldlm_bl.0 Request processed in 264us (497us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135169.247558:0:18238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1783135169.247734:0:3287:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9fe8ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:06a7653e-5f5a-4acc-ba93-0eff19f145f0:3287:1869752384465024:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1783135169.247769:0:18268:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9fe9c1523e00/0xd6c4b8f0586801d5 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18268 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135169.247778:0:18268:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9fe9c1523e00/0xd6c4b8f0586801d5 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18268 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135169.247785:0:18268:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fe9c1523e00/0xd6c4b8f0586801d5 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18268 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783135169.260148:0:18246:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9f5cea050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:06a7653e-5f5a-4acc-ba93-0eff19f145f0+15:18888:x1869752384464640:12345-0@lo:253:mount.lustre.0 Request processed in 90775us (91178us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135169.260167:0:18246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1783135169.260576:0:18888:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9fe90c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:06a7653e-5f5a-4acc-ba93-0eff19f145f0:18888:1869752384464640:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1783135169.260598:0:18888:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:0.0:1783135169.260601:0:18888:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1783135169.260603:0:18888:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1783135169.260605:0:18888:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1783135169.260606:0:18888:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1783135169.260607:0:18888:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1783135169.260624:0:18888:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1783135169.260626:0:18888:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1783135169.260628:0:18888:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1783135169.260630:0:18888:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1783135169.260665:0:18888:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:0.0:1783135169.268881:0:18888:0:(osd_index.c:2102:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:0.0:1783135169.274472:0:18888:0:(osd_index.c:2102:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:0.0:1783135169.274643:0:18888:0:(osd_index.c:2102:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:0.0:1783135169.274787:0:18888:0:(osd_index.c:2102:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:0.0:1783135169.274890:0:18888:0:(osd_index.c:2102:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:0.0:1783135169.275104:0:18888:0:(osd_index.c:2102:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:0.0:1783135169.279637:0:18888:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 3, last_transno is 12884901888 00002000:00080000:2.0:1783135169.414029:0:18888:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:2.0:1783135169.414043:0:18888:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:2.0:1783135169.414118:0:18888:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1783135169.414217:0:18888:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.141@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1783135169.414245:0:18888:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=48 00000080:00000004:2.0:1783135169.414340:0:18888:0:(super25.c:187:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00010000:00010000:0.0:1783135169.480104:0:18240:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783135170.500407:0:18241:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1783135170.708369:0:18249:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1783135170.708378:0:18249:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-mdtir-ffff9fe8c47e7000 from 10 10000000:01000000:3.0:1783135170.708385:0:18249:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1783135170.708441:0:18249:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.141@tcp lock: ffff9fe9c0030400/0xd6c4b8f0586801dc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18249 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135170.708453:0:18249:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.141@tcp lock: ffff9fe9c0030400/0xd6c4b8f0586801dc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18249 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135170.708466:0:18249:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.141@tcp lock: ffff9fe9c0030400/0xd6c4b8f0586801dc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18249 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783135170.708493:0:18249:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9fe90ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:06a7653e-5f5a-4acc-ba93-0eff19f145f0:18249:1869752384465152:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1783135170.708561:0:18249:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135170.708615:0:18249:0:(client.c:2701:ptlrpc_set_wait()) set ffff9fe9c794e600 going to sleep for 11 seconds 00000100:00100000:0.0:1783135170.710535:0:18247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384465152 00000100:00100000:0.0:1783135170.710548:0:18247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384465152 00000100:00100000:0.0:1783135170.710681:0:18247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1783135170.710691:0:18247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9f5ce8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:06a7653e-5f5a-4acc-ba93-0eff19f145f0+15:18249:x1869752384465152:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783135170.710709:0:18247:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783135170.710729:0:18247:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fe9f68ad800/0xd6c4b8f0586801e3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd6c4b8f0586801dc expref: -99 pid: 18247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135170.710758:0:18247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fe9f68ad800/0xd6c4b8f0586801e3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd6c4b8f0586801dc expref: 16 pid: 18247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135170.710770:0:18247:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fe9f68ad800/0xd6c4b8f0586801e3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd6c4b8f0586801dc expref: 16 pid: 18247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135170.710779:0:18247:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fe9f68ad800, rc 0) 00000100:00100000:0.0:1783135170.710848:0:18247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9f5ce8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:06a7653e-5f5a-4acc-ba93-0eff19f145f0+16:18249:x1869752384465152:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 159us (2286us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135170.710868:0:18247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1783135170.710931:0:18249:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9fe90ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:06a7653e-5f5a-4acc-ba93-0eff19f145f0:18249:1869752384465152:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783135170.710950:0:18249:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.141@tcp lock: ffff9fe9c0030400/0xd6c4b8f0586801dc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd6c4b8f0586801e3 expref: -99 pid: 18249 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135170.710959:0:18249:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.141@tcp lock: ffff9fe9c0030400/0xd6c4b8f0586801dc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd6c4b8f0586801e3 expref: -99 pid: 18249 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783135170.711024:0:18249:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9fe8fd880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:06a7653e-5f5a-4acc-ba93-0eff19f145f0:18249:1869752384465280:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1783135170.711058:0:18249:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135170.711094:0:18249:0:(client.c:2701:ptlrpc_set_wait()) set ffff9fe9e0293240 going to sleep for 11 seconds 00000100:00100000:1.0:1783135170.711157:0:18246:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384465280 00000100:00100000:1.0:1783135170.711162:0:18246:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384465280 00000100:00100000:1.0:1783135170.711194:0:18246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1783135170.711202:0:18246:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9f5ce9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:06a7653e-5f5a-4acc-ba93-0eff19f145f0+16:18249:x1869752384465280:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1783135170.711216:0:18246:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1783135170.711242:0:18246:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1783135170.711255:0:18246:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 10 00000100:00100000:1.0:1783135170.711378:0:18246:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9f5ce9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:06a7653e-5f5a-4acc-ba93-0eff19f145f0+16:18249:x1869752384465280:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 175us (317us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135170.711384:0:18246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1783135170.711697:0:18249:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9fe8fd880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:06a7653e-5f5a-4acc-ba93-0eff19f145f0:18249:1869752384465280:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1783135170.711748:0:18249:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.201.141@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1783135170.711755:0:18249:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.141@tcp lock: ffff9fe9c0030400/0xd6c4b8f0586801dc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd6c4b8f0586801e3 expref: -99 pid: 18249 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135170.711764:0:18249:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.141@tcp lock: ffff9fe9c0030400/0xd6c4b8f0586801dc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd6c4b8f0586801e3 expref: -99 pid: 18249 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135171.523432:0:18240:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783135172.547452:0:18241:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783135173.585980:0:18240:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1783135174.283794:0:8:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1783135174.283802:0:8:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1783135174.283805:0:8:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1783135174.283808:0:8:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1783135174.283861:0:3287:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe8c590d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:06a7653e-5f5a-4acc-ba93-0eff19f145f0:3287:1869752384465408:0@lo:400:kworker.0 00000100:00100000:1.0:1783135174.283940:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135174.284000:0:3289:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe8c590d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3289:1869752384465664:0@lo:400:kworker.0 00000100:00100000:1.0:1783135174.284030:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135174.284050:0:3289:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1783135174.284056:0:3289:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe8c590ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3289:1869752384465536:0@lo:400:kworker.0 00000100:00100000:1.0:1783135174.284077:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135174.284106:0:18254:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384465664 00000100:00100000:1.0:1783135174.284112:0:18254:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384465664 00000100:00100000:1.0:1783135174.284156:0:18254:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384465536 00000100:00100000:1.0:1783135174.284159:0:18254:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384465536 00000100:00100000:1.0:1783135174.284195:0:18254:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1783135174.284204:0:18254:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe8c590dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3289:x1869752384465664:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783135174.284255:0:18254:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe8c590dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3289:x1869752384465664:12345-0@lo:400:kworker.0 Request processed in 52us (223us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135174.284261:0:18254:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1783135174.284293:0:18254:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1783135174.284301:0:18254:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe8c590d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3289:x1869752384465536:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783135174.284328:0:18254:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe8c590d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3289:x1869752384465536:12345-0@lo:400:kworker.0 Request processed in 29us (250us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135174.284334:0:18254:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:1.0:1783135174.284361:0:18248:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1783135174.284386:0:3289:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9fe8c590ea00 x1869752384465536/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783135190 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783135174.284400:0:3289:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe8c590ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3289:1869752384465536:0@lo:400:kworker.0 00010000:00080000:1.0:1783135174.284410:0:3289:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9fe8c590d500 x1869752384465664/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783135190 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783135174.284419:0:3289:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe8c590d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3289:1869752384465664:0@lo:400:kworker.0 00000100:00100000:0.0:1783135174.286381:0:18245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384465408 00000100:00100000:0.0:1783135174.286392:0:18245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384465408 00000100:00100000:0.0:1783135174.286449:0:18245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1783135174.286466:0:18245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9c8e49050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:06a7653e-5f5a-4acc-ba93-0eff19f145f0+16:3287:x1869752384465408:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783135174.286544:0:18245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9c8e49050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:06a7653e-5f5a-4acc-ba93-0eff19f145f0+16:3287:x1869752384465408:12345-0@lo:400:kworker.0 Request processed in 80us (2604us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135174.286563:0:18245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1783135174.286623:0:3287:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe8c590d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:06a7653e-5f5a-4acc-ba93-0eff19f145f0:3287:1869752384465408:0@lo:400:kworker.0 00010000:00010000:0.0:1783135174.600259:0:18241:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1783135174.917259:0:18286:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1783135175.620499:0:18240:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783135176.649783:0:18241:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783135177.350017:0:3285:0:(client.c:2489:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1783135162/real 1783135162] req@ffff9fe9fe8fea00 x1869752384461056/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1783135177 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783135177.350051:0:3285:0:(client.c:2520:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9fe9fe8fea00 x1869752384461056/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1783135177 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783135177.350061:0:3285:0:(client.c:2489:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1783135162/real 1783135162] req@ffff9fe9fe8fdf80 x1869752384461184/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1783135177 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783135177.350072:0:3285:0:(client.c:2520:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9fe9fe8fdf80 x1869752384461184/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1783135177 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1783135177.350089:0:3285:0:(import.c:65:import_set_state_nolock()) ffff9fe9fdc3a800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1783135177.350122:0:3285:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1783135177.350126:0:3285:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9fe8fea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3285:1869752384461056:0@lo:8:kworker.0 00000100:00080000:2.0:1783135177.350132:0:3285:0:(import.c:65:import_set_state_nolock()) ffff9fe9f8a5c000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1783135177.350137:0:3285:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1783135177.350140:0:3285:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9fe8fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3285:1869752384461184:0@lo:8:kworker.0 00000100:00080000:0.0:1783135177.352251:0:8:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1783135177.352258:0:8:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1783135177.352261:0:8:0:(import.c:65:import_set_state_nolock()) ffff9fe9fdc3a800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1783135177.352269:0:8:0:(import.c:512:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 444 00000100:00080000:0.0:1783135177.352275:0:8:0:(import.c:591:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1783135177.352315:0:8:0:(import.c:626:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9fe9fdc3a800 using connection 192.168.201.141@tcp/0@lo 00000100:00100000:0.0:1783135177.352337:0:8:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9fe9fe8fce00 x1869752384465920/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1783135177.352365:0:8:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1783135177.352369:0:8:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1783135177.352371:0:8:0:(import.c:65:import_set_state_nolock()) ffff9fe9f8a5c000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1783135177.352374:0:8:0:(import.c:512:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 444 00000100:00080000:0.0:1783135177.352376:0:8:0:(import.c:591:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1783135177.352380:0:8:0:(import.c:626:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9fe9f8a5c000 using connection 192.168.201.141@tcp/0@lo 00000100:00100000:0.0:1783135177.352392:0:8:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9fe9fe8fdf80 x1869752384466048/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1783135177.352444:0:3287:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9fe8fea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3287:1869752384466176:0@lo:400:kworker.0 00000100:00100000:0.0:1783135177.352519:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135177.352583:0:3287:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1783135177.352589:0:3287:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9fe8fd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:06a7653e-5f5a-4acc-ba93-0eff19f145f0:3287:1869752384465792:0@lo:400:kworker.0 00000100:00100000:0.0:1783135177.352630:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135177.352695:0:3288:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9fe8ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3288:1869752384466304:0@lo:400:kworker.0 00000100:00100000:0.0:1783135177.352720:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135177.352756:0:18254:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384466176 00000100:00100000:0.0:1783135177.352762:0:18254:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384466176 00000100:00100000:0.0:1783135177.353021:0:18254:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384466304 00000100:00100000:0.0:1783135177.353025:0:18254:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384466304 00000100:00100000:0.0:1783135177.353059:0:18254:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1783135177.353077:0:18254:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fe8fc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3287:x1869752384466176:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783135177.353139:0:18254:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fe8fc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3287:x1869752384466176:12345-0@lo:400:kworker.0 Request processed in 71us (619us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135177.353146:0:18254:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1783135177.353164:0:18254:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1783135177.353171:0:18254:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fe8fc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3288:x1869752384466304:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783135177.353203:0:18254:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fe8fc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3288:x1869752384466304:12345-0@lo:400:kworker.0 Request processed in 33us (482us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135177.353209:0:18254:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1783135177.353228:0:18246:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384465792 00000100:00100000:0.0:1783135177.353231:0:18246:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384465792 00000100:00100000:0.0:1783135177.353254:0:18246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1783135177.353260:0:18246:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9c8e48850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:06a7653e-5f5a-4acc-ba93-0eff19f145f0+16:3287:x1869752384465792:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783135177.353305:0:18246:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9c8e48850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:06a7653e-5f5a-4acc-ba93-0eff19f145f0+16:3287:x1869752384465792:12345-0@lo:400:kworker.0 Request processed in 46us (675us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135177.353311:0:18246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00080000:0.0:1783135177.353341:0:18248:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1783135177.353369:0:3288:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9fe9fe8ff480 x1869752384466304/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783135193 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783135177.353380:0:3288:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9fe8ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3288:1869752384466304:0@lo:400:kworker.0 00000100:00100000:0.0:1783135177.353410:0:3285:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9fe8fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3285:1869752384465920:0@lo:8:kworker.0 00000100:00100000:0.0:1783135177.353439:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135177.353456:0:3285:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9fe8fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3285:1869752384466048:0@lo:8:kworker.0 00000100:00100000:0.0:1783135177.353480:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135177.353511:0:18890:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384465920 00000100:00100000:0.0:1783135177.353515:0:18890:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384465920 00000100:00100000:0.0:1783135177.353529:0:18890:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384466048 00000100:00100000:0.0:1783135177.353531:0:18890:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384466048 00000100:00100000:0.0:1783135177.353540:0:18890:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1783135177.353545:0:18890:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fe8ff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3285:x1869752384465920:12345-0@lo:8:kworker.0 00010000:00080000:0.0:1783135177.353567:0:18890:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 459 last 0 00000020:00000080:0.0:1783135177.353593:0:18890:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xd6c4b8f0586801ea 00002000:00100000:0.0:1783135177.353620:0:18890:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff9fe8c4519000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113653 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:0.0:1783135177.353625:0:18890:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:0.0:1783135177.353628:0:18890:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00000100:00100000:1.0:1783135177.354753:0:3287:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9fe8fd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:06a7653e-5f5a-4acc-ba93-0eff19f145f0:3287:1869752384465792:0@lo:400:kworker.0 00010000:00080000:1.0:1783135177.354770:0:3287:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9fe9fe8fea00 x1869752384466176/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783135193 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783135177.354780:0:3287:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9fe8fea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3287:1869752384466176:0@lo:400:kworker.0 00002000:00080000:1.0:1783135177.358369:0:18890:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1783135177.358419:0:18890:0:(import.c:65:import_set_state_nolock()) ffff9fea01d7e000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1783135177.358512:0:18890:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fe8ff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3285:x1869752384465920:12345-0@lo:8:kworker.0 Request processed in 4963us (5069us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135177.358526:0:18890:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1783135177.358558:0:18890:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1783135177.358564:0:18890:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fe8fdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3285:x1869752384466048:12345-0@lo:8:kworker.0 00010000:00020000:1.0:1783135177.358583:0:18890:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00010000:00080000:0.0:1783135177.359999:0:3285:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9fe9fe8fce00 x1869752384465920/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1783135197 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783135177.360016:0:3285:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1783135177.360028:0:3285:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 3 00000100:00080000:0.0:1783135177.360040:0:3285:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1783135177.360046:0:3285:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:0.0:1783135177.360049:0:3285:0:(import.c:65:import_set_state_nolock()) ffff9fe9fdc3a800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1783135177.360086:0:3285:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1783135177.360092:0:3285:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9fe8fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3285:1869752384465920:0@lo:8:kworker.0 00000004:00080000:0.0:1783135177.360167:0:18274:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1783135177.360453:0:18274:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 459756172546ns, next at 0ns, rc = 0 00000004:00080000:2.0:1783135177.360637:0:18275:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x240000400:0x22:0x0] 00000100:00100000:2.0:1783135177.360660:0:18275:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9f6fe5880 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:18275:1869752384466560:0@lo:5:osp-pre-0-0.0 00000100:00100000:2.0:1783135177.360721:0:18275:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135177.360744:0:18275:0:(client.c:2701:ptlrpc_set_wait()) set ffff9fe9cb3e9cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1783135177.360783:0:18889:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:2.0:1783135177.360789:0:18889:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:2.0:1783135177.361233:0:3288:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1783135177.361246:0:3288:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9f6fe5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1869752384466432:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1783135177.361275:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135177.361438:0:18889:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384466560 00000100:00100000:2.0:1783135177.361447:0:18889:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384466560 00000100:00100000:2.0:1783135177.361569:0:19201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1783135177.361580:0:19201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9f6fe7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:18275:x1869752384466560:12345-0@lo:5:osp-pre-0-0.0 00000100:00100000:0.0:1783135177.363562:0:18892:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384466432 00000100:00100000:0.0:1783135177.363572:0:18892:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384466432 00000100:00100000:0.0:1783135177.363630:0:18892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1783135177.363637:0:18892:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9f6fe5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3288:x1869752384466432:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1783135177.363669:0:18892:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1783135177.364070:0:18892:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9f6fe5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3288:x1869752384466432:12345-0@lo:13:osp-pre-0-0.0 Request processed in 432us (2793us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135177.364078:0:18892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:0.0:1783135177.364101:0:18248:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1783135177.364145:0:3288:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9fe9f6fe5f80 x1869752384466432/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783135193 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783135177.364165:0:3288:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9f6fe5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1869752384466432:0@lo:13:osp-pre-0-0.0 00002000:00080000:2.0:1783135177.373496:0:19201:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:2.0:1783135177.373511:0:19201:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 65 -> diff = -31 00002000:02000040:2.0:1783135177.373518:0:19201:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x240000400:35 to 0x240000400:65) 00000100:00100000:1.0:1783135177.382587:0:18890:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fe8fdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3285:x1869752384466048:12345-0@lo:8:kworker.0 Request processed in 24011us (29096us total) trans 0 rc -19/-19 00000100:00100000:1.0:1783135177.382602:0:18890:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:1.0:1783135177.382664:0:3285:0:(import.c:65:import_set_state_nolock()) ffff9fe9f8a5c000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1783135177.382670:0:3285:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1783135177.382675:0:3285:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9fe8fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3285:1869752384466048:0@lo:8:kworker.0 00002000:00010000:2.0:1783135177.418819:0:19201:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x41:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1783135177.418831:0:19201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000096a9cbbf/0xd6c4b8f0586801f1 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x41:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135177.418849:0:19201:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x41:0x0].0x0 since=459s v=(0 0) 00010000:00010000:2.0:1783135177.418854:0:19201:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x41:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783135177.418860:0:19201:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000096a9cbbf/0xd6c4b8f0586801f1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135177.418877:0:19201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000096a9cbbf/0xd6c4b8f0586801f1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135177.418888:0:19201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000096a9cbbf/0xd6c4b8f0586801f1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135177.418896:0:19201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000096a9cbbf/0xd6c4b8f0586801f1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135177.418921:0:19201:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1783135177.418935:0:18240:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783135177.418941:0:18240:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000096a9cbbf/0xd6c4b8f0586801f1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135177.418955:0:18240:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe9c1523800 already unused, calling callback (ffffffffc1527ce0) 00010000:00010000:2.0:1783135177.418960:0:18240:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000096a9cbbf/0xd6c4b8f0586801f1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135177.418968:0:18240:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000096a9cbbf/0xd6c4b8f0586801f1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135177.418984:0:18240:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000096a9cbbf/0xd6c4b8f0586801f1 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135177.418991:0:18240:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000096a9cbbf/0xd6c4b8f0586801f1 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135177.419009:0:18240:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783135177.419011:0:18240:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783135177.419012:0:18240:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1783135177.427858:0:19201:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x40:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1783135177.427872:0:19201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000555fd7b0/0xd6c4b8f0586801f8 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x40:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135177.427892:0:19201:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x40:0x0].0x0 since=459s v=(0 0) 00010000:00010000:2.0:1783135177.427896:0:19201:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x40:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783135177.427902:0:19201:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000555fd7b0/0xd6c4b8f0586801f8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135177.427917:0:19201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000555fd7b0/0xd6c4b8f0586801f8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135177.427935:0:19201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000555fd7b0/0xd6c4b8f0586801f8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135177.427942:0:19201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000555fd7b0/0xd6c4b8f0586801f8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135177.427962:0:19201:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1783135177.427974:0:18241:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783135177.427979:0:18241:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000555fd7b0/0xd6c4b8f0586801f8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135177.427986:0:18241:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe9c1522c00 already unused, calling callback (ffffffffc1527ce0) 00010000:00010000:2.0:1783135177.427990:0:18241:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000555fd7b0/0xd6c4b8f0586801f8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135177.427999:0:18241:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000555fd7b0/0xd6c4b8f0586801f8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135177.428014:0:18241:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000555fd7b0/0xd6c4b8f0586801f8 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135177.428020:0:18241:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000555fd7b0/0xd6c4b8f0586801f8 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135177.428038:0:18241:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783135177.428045:0:18241:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783135177.428047:0:18241:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1783135177.428880:0:19201:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1783135177.428887:0:19201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000681aab5e/0xd6c4b8f0586801ff lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135177.428898:0:19201:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3f:0x0].0x0 since=459s v=(0 0) 00010000:00010000:2.0:1783135177.428902:0:19201:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783135177.428906:0:19201:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000681aab5e/0xd6c4b8f0586801ff lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135177.428915:0:19201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000681aab5e/0xd6c4b8f0586801ff lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135177.428923:0:19201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000681aab5e/0xd6c4b8f0586801ff lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135177.428930:0:19201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000681aab5e/0xd6c4b8f0586801ff lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135177.428954:0:19201:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1783135177.429430:0:18240:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783135177.429437:0:18240:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000681aab5e/0xd6c4b8f0586801ff lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135177.429445:0:18240:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe9c1522000 already unused, calling callback (ffffffffc1527ce0) 00010000:00010000:0.0:1783135177.429448:0:18240:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000681aab5e/0xd6c4b8f0586801ff lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135177.429457:0:18240:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000681aab5e/0xd6c4b8f0586801ff lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135177.429474:0:18240:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000681aab5e/0xd6c4b8f0586801ff lrc: 1/0,0 mode: --/PW res: [0x240000400:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135177.429493:0:18240:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000681aab5e/0xd6c4b8f0586801ff lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135177.429511:0:18240:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783135177.429513:0:18240:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783135177.429515:0:18240:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1783135177.433680:0:19201:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1783135177.433694:0:19201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000096a9cbbf/0xd6c4b8f058680206 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135177.433712:0:19201:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3e:0x0].0x0 since=459s v=(0 0) 00010000:00010000:2.0:1783135177.433716:0:19201:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783135177.433722:0:19201:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000096a9cbbf/0xd6c4b8f058680206 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135177.433743:0:19201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000096a9cbbf/0xd6c4b8f058680206 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135177.433754:0:19201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000096a9cbbf/0xd6c4b8f058680206 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135177.433762:0:19201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000096a9cbbf/0xd6c4b8f058680206 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135177.433789:0:19201:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1783135177.434303:0:18241:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783135177.434311:0:18241:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000096a9cbbf/0xd6c4b8f058680206 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135177.434320:0:18241:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe9c1523800 already unused, calling callback (ffffffffc1527ce0) 00010000:00010000:0.0:1783135177.434324:0:18241:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000096a9cbbf/0xd6c4b8f058680206 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135177.434334:0:18241:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000096a9cbbf/0xd6c4b8f058680206 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135177.434350:0:18241:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000096a9cbbf/0xd6c4b8f058680206 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135177.434357:0:18241:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000096a9cbbf/0xd6c4b8f058680206 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135177.434372:0:18241:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783135177.434374:0:18241:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783135177.434375:0:18241:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1783135177.437159:0:19201:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1783135177.437183:0:19201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004f452ca1/0xd6c4b8f05868020d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135177.437199:0:19201:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3d:0x0].0x0 since=459s v=(0 0) 00010000:00010000:2.0:1783135177.437203:0:19201:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783135177.437210:0:19201:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004f452ca1/0xd6c4b8f05868020d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135177.437223:0:19201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004f452ca1/0xd6c4b8f05868020d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135177.438545:0:19201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004f452ca1/0xd6c4b8f05868020d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135177.438572:0:19201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004f452ca1/0xd6c4b8f05868020d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135177.438597:0:19201:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1783135177.439212:0:19201:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1783135177.439220:0:19201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000005738572/0xd6c4b8f058680214 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135177.439318:0:18240:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783135177.439326:0:18240:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004f452ca1/0xd6c4b8f05868020d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135177.439335:0:18240:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe9c1523e00 already unused, calling callback (ffffffffc1527ce0) 00010000:00010000:0.0:1783135177.439339:0:18240:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004f452ca1/0xd6c4b8f05868020d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135177.439349:0:18240:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004f452ca1/0xd6c4b8f05868020d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135177.439368:0:18240:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004f452ca1/0xd6c4b8f05868020d lrc: 1/0,0 mode: --/PW res: [0x240000400:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135177.439374:0:18240:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004f452ca1/0xd6c4b8f05868020d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135177.439392:0:18240:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783135177.439393:0:18240:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783135177.439395:0:18240:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783135177.441351:0:19201:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3c:0x0].0x0 since=459s v=(0 0) 00010000:00010000:2.0:1783135177.441357:0:19201:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783135177.441365:0:19201:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000005738572/0xd6c4b8f058680214 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135177.441384:0:19201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000005738572/0xd6c4b8f058680214 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135177.441396:0:19201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000005738572/0xd6c4b8f058680214 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135177.441404:0:19201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000005738572/0xd6c4b8f058680214 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135177.441427:0:19201:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783135177.441694:0:18241:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783135177.441702:0:18241:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000005738572/0xd6c4b8f058680214 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135177.441711:0:18241:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe9c1523000 already unused, calling callback (ffffffffc1527ce0) 00010000:00010000:3.0:1783135177.441716:0:18241:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000005738572/0xd6c4b8f058680214 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135177.441726:0:18241:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000005738572/0xd6c4b8f058680214 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135177.441746:0:18241:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000005738572/0xd6c4b8f058680214 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135177.441755:0:18241:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000005738572/0xd6c4b8f058680214 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135177.441779:0:18241:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783135177.441781:0:18241:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783135177.441783:0:18241:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1783135177.444106:0:19201:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1783135177.444128:0:19201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000095441e9c/0xd6c4b8f05868021b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135177.444146:0:19201:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3b:0x0].0x0 since=459s v=(0 0) 00010000:00010000:3.0:1783135177.444150:0:19201:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783135177.444156:0:19201:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000095441e9c/0xd6c4b8f05868021b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135177.444175:0:19201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000095441e9c/0xd6c4b8f05868021b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135177.444185:0:19201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000095441e9c/0xd6c4b8f05868021b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135177.444193:0:19201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000095441e9c/0xd6c4b8f05868021b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135177.444217:0:19201:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1783135177.444337:0:18240:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783135177.444345:0:18240:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000095441e9c/0xd6c4b8f05868021b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135177.444363:0:18240:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe9c0030c00 already unused, calling callback (ffffffffc1527ce0) 00010000:00010000:2.0:1783135177.444368:0:18240:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000095441e9c/0xd6c4b8f05868021b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135177.444378:0:18240:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000095441e9c/0xd6c4b8f05868021b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135177.444396:0:18240:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000095441e9c/0xd6c4b8f05868021b lrc: 1/0,0 mode: --/PW res: [0x240000400:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135177.444404:0:18240:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000095441e9c/0xd6c4b8f05868021b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135177.444428:0:18240:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783135177.444430:0:18240:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783135177.444433:0:18240:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1783135177.448398:0:19201:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1783135177.448411:0:19201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000555fd7b0/0xd6c4b8f058680222 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135177.448428:0:19201:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3a:0x0].0x0 since=459s v=(0 0) 00010000:00010000:2.0:1783135177.448433:0:19201:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783135177.448440:0:19201:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000555fd7b0/0xd6c4b8f058680222 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135177.448454:0:19201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000555fd7b0/0xd6c4b8f058680222 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135177.448471:0:19201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000555fd7b0/0xd6c4b8f058680222 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135177.448479:0:19201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000555fd7b0/0xd6c4b8f058680222 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135177.448502:0:19201:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1783135177.448939:0:19201:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x39:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1783135177.448945:0:19201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001d5b41a8/0xd6c4b8f058680229 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135177.448954:0:19201:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x39:0x0].0x0 since=459s v=(0 0) 00010000:00010000:2.0:1783135177.448957:0:19201:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x39:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783135177.448961:0:19201:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001d5b41a8/0xd6c4b8f058680229 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135177.448969:0:19201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001d5b41a8/0xd6c4b8f058680229 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135177.448976:0:19201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001d5b41a8/0xd6c4b8f058680229 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135177.448982:0:19201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001d5b41a8/0xd6c4b8f058680229 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135177.449009:0:19201:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1783135177.449022:0:18240:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1783135177.449028:0:18240:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000555fd7b0/0xd6c4b8f058680222 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135177.449036:0:18240:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe9c1522c00 already unused, calling callback (ffffffffc1527ce0) 00010000:00010000:2.0:1783135177.449041:0:18240:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000555fd7b0/0xd6c4b8f058680222 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135177.449049:0:18240:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000555fd7b0/0xd6c4b8f058680222 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135177.449067:0:18240:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000555fd7b0/0xd6c4b8f058680222 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135177.449075:0:18240:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000555fd7b0/0xd6c4b8f058680222 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135177.449094:0:18240:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783135177.449097:0:18240:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001d5b41a8/0xd6c4b8f058680229 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135177.449103:0:18240:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe9c1523a00 already unused, calling callback (ffffffffc1527ce0) 00010000:00010000:2.0:1783135177.449106:0:18240:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001d5b41a8/0xd6c4b8f058680229 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135177.449135:0:18240:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001d5b41a8/0xd6c4b8f058680229 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135177.449145:0:18240:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001d5b41a8/0xd6c4b8f058680229 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135177.449151:0:18240:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001d5b41a8/0xd6c4b8f058680229 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135177.449163:0:18240:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783135177.449164:0:18240:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783135177.449166:0:18240:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1783135177.449646:0:19201:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x38:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1783135177.449652:0:19201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a535065f/0xd6c4b8f058680230 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x38:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135177.449661:0:19201:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x38:0x0].0x0 since=459s v=(0 0) 00010000:00010000:2.0:1783135177.449663:0:19201:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x38:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783135177.449667:0:19201:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a535065f/0xd6c4b8f058680230 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135177.449678:0:19201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a535065f/0xd6c4b8f058680230 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135177.449686:0:19201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a535065f/0xd6c4b8f058680230 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135177.449699:0:19201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a535065f/0xd6c4b8f058680230 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135177.449712:0:19201:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1783135177.449721:0:18240:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783135177.449725:0:18240:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a535065f/0xd6c4b8f058680230 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135177.449731:0:18240:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe9c1523400 already unused, calling callback (ffffffffc1527ce0) 00010000:00010000:2.0:1783135177.449735:0:18240:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a535065f/0xd6c4b8f058680230 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135177.449743:0:18240:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a535065f/0xd6c4b8f058680230 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135177.449755:0:18240:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a535065f/0xd6c4b8f058680230 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135177.449763:0:18240:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a535065f/0xd6c4b8f058680230 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135177.449776:0:18240:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783135177.449777:0:18240:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783135177.449779:0:18240:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1783135177.450179:0:19201:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x37:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1783135177.450190:0:19201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f7cc9135/0xd6c4b8f058680237 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135177.450198:0:19201:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x37:0x0].0x0 since=459s v=(0 0) 00010000:00010000:2.0:1783135177.450201:0:19201:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x37:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783135177.450205:0:19201:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f7cc9135/0xd6c4b8f058680237 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135177.450213:0:19201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f7cc9135/0xd6c4b8f058680237 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135177.450220:0:19201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f7cc9135/0xd6c4b8f058680237 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135177.450226:0:19201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f7cc9135/0xd6c4b8f058680237 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135177.450239:0:19201:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1783135177.450247:0:18240:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783135177.450250:0:18240:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f7cc9135/0xd6c4b8f058680237 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135177.450256:0:18240:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe9c7829a00 already unused, calling callback (ffffffffc1527ce0) 00010000:00010000:2.0:1783135177.450259:0:18240:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f7cc9135/0xd6c4b8f058680237 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135177.450266:0:18240:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f7cc9135/0xd6c4b8f058680237 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135177.450301:0:18240:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f7cc9135/0xd6c4b8f058680237 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135177.450309:0:18240:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f7cc9135/0xd6c4b8f058680237 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135177.450323:0:18240:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783135177.450324:0:18240:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783135177.450326:0:18240:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1783135177.450680:0:19201:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x36:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1783135177.450686:0:19201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000eb172ed9/0xd6c4b8f05868023e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135177.450693:0:19201:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x36:0x0].0x0 since=459s v=(0 0) 00010000:00010000:2.0:1783135177.450696:0:19201:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x36:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783135177.450701:0:19201:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000eb172ed9/0xd6c4b8f05868023e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135177.450711:0:19201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000eb172ed9/0xd6c4b8f05868023e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135177.450720:0:19201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000eb172ed9/0xd6c4b8f05868023e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135177.450728:0:19201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000eb172ed9/0xd6c4b8f05868023e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135177.450751:0:19201:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1783135177.450759:0:18240:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783135177.450762:0:18240:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000eb172ed9/0xd6c4b8f05868023e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135177.450769:0:18240:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe9c7828800 already unused, calling callback (ffffffffc1527ce0) 00010000:00010000:2.0:1783135177.450772:0:18240:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000eb172ed9/0xd6c4b8f05868023e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135177.450779:0:18240:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000eb172ed9/0xd6c4b8f05868023e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135177.450790:0:18240:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000eb172ed9/0xd6c4b8f05868023e lrc: 1/0,0 mode: --/PW res: [0x240000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135177.450799:0:18240:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000eb172ed9/0xd6c4b8f05868023e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135177.450813:0:18240:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783135177.450815:0:18240:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783135177.450817:0:18240:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783135177.453780:0:18241:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1783135177.457733:0:19201:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x35:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1783135177.457749:0:19201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006747ba8e/0xd6c4b8f058680245 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x35:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135177.457767:0:19201:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x35:0x0].0x0 since=459s v=(0 0) 00010000:00010000:2.0:1783135177.457777:0:19201:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x35:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783135177.457783:0:19201:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006747ba8e/0xd6c4b8f058680245 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135177.457798:0:19201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006747ba8e/0xd6c4b8f058680245 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135177.457809:0:19201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006747ba8e/0xd6c4b8f058680245 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135177.457818:0:19201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006747ba8e/0xd6c4b8f058680245 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135177.457843:0:19201:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783135177.457870:0:18240:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783135177.457880:0:18240:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006747ba8e/0xd6c4b8f058680245 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135177.457889:0:18240:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe9c7829600 already unused, calling callback (ffffffffc1527ce0) 00010000:00010000:3.0:1783135177.457894:0:18240:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006747ba8e/0xd6c4b8f058680245 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135177.457904:0:18240:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006747ba8e/0xd6c4b8f058680245 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135177.457923:0:18240:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006747ba8e/0xd6c4b8f058680245 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135177.457931:0:18240:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006747ba8e/0xd6c4b8f058680245 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135177.457963:0:18240:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783135177.457966:0:18240:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783135177.457968:0:18240:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1783135177.458467:0:19201:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x34:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1783135177.458474:0:19201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007c6793cf/0xd6c4b8f05868024c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x34:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135177.458483:0:19201:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x34:0x0].0x0 since=459s v=(0 0) 00010000:00010000:2.0:1783135177.458486:0:19201:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x34:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783135177.458490:0:19201:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007c6793cf/0xd6c4b8f05868024c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135177.458500:0:19201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007c6793cf/0xd6c4b8f05868024c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135177.458510:0:19201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007c6793cf/0xd6c4b8f05868024c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135177.458523:0:19201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007c6793cf/0xd6c4b8f05868024c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135177.458542:0:19201:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783135177.458583:0:18241:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783135177.458591:0:18241:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007c6793cf/0xd6c4b8f05868024c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135177.458601:0:18241:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe9c7828e00 already unused, calling callback (ffffffffc1527ce0) 00010000:00010000:1.0:1783135177.458605:0:18241:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007c6793cf/0xd6c4b8f05868024c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135177.458622:0:18241:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007c6793cf/0xd6c4b8f05868024c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135177.458638:0:18241:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007c6793cf/0xd6c4b8f05868024c lrc: 1/0,0 mode: --/PW res: [0x240000400:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135177.458652:0:18241:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007c6793cf/0xd6c4b8f05868024c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135177.458672:0:18241:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783135177.458674:0:18241:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783135177.458676:0:18241:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1783135177.458937:0:19201:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x33:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1783135177.458943:0:19201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b06bbad6/0xd6c4b8f058680253 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135177.458951:0:19201:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x33:0x0].0x0 since=459s v=(0 0) 00010000:00010000:2.0:1783135177.458954:0:19201:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x33:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783135177.458958:0:19201:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b06bbad6/0xd6c4b8f058680253 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135177.458966:0:19201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b06bbad6/0xd6c4b8f058680253 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135177.458974:0:19201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b06bbad6/0xd6c4b8f058680253 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135177.458980:0:19201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b06bbad6/0xd6c4b8f058680253 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135177.459001:0:19201:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783135177.459142:0:18240:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783135177.459148:0:18240:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b06bbad6/0xd6c4b8f058680253 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135177.459157:0:18240:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe9c7828200 already unused, calling callback (ffffffffc1527ce0) 00010000:00010000:3.0:1783135177.459161:0:18240:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b06bbad6/0xd6c4b8f058680253 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135177.459170:0:18240:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b06bbad6/0xd6c4b8f058680253 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135177.459182:0:18240:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b06bbad6/0xd6c4b8f058680253 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135177.459190:0:18240:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b06bbad6/0xd6c4b8f058680253 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135177.459208:0:18240:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783135177.459210:0:18240:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783135177.459212:0:18240:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1783135177.469146:0:19201:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x32:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1783135177.469174:0:19201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cda93d77/0xd6c4b8f05868025a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135177.469210:0:19201:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x32:0x0].0x0 since=459s v=(0 0) 00010000:00010000:2.0:1783135177.469214:0:19201:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x32:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783135177.469221:0:19201:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cda93d77/0xd6c4b8f05868025a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135177.469489:0:19201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cda93d77/0xd6c4b8f05868025a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135177.469500:0:19201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cda93d77/0xd6c4b8f05868025a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135177.469509:0:19201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cda93d77/0xd6c4b8f05868025a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135177.469526:0:19201:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1783135177.470129:0:19201:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x31:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1783135177.470136:0:19201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c7eaa13a/0xd6c4b8f058680261 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135177.470144:0:19201:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x31:0x0].0x0 since=459s v=(0 0) 00010000:00010000:2.0:1783135177.470147:0:19201:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x31:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783135177.470151:0:19201:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c7eaa13a/0xd6c4b8f058680261 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135177.470160:0:19201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c7eaa13a/0xd6c4b8f058680261 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135177.470179:0:19201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c7eaa13a/0xd6c4b8f058680261 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135177.470186:0:19201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c7eaa13a/0xd6c4b8f058680261 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135177.470208:0:19201:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:2.0:1783135177.470987:0:19201:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x30:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1783135177.470994:0:19201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000365388e0/0xd6c4b8f058680268 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135177.471005:0:19201:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x30:0x0].0x0 since=459s v=(0 0) 00010000:00010000:2.0:1783135177.471008:0:19201:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x30:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783135177.471012:0:19201:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000365388e0/0xd6c4b8f058680268 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135177.471021:0:19201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000365388e0/0xd6c4b8f058680268 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135177.471030:0:19201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000365388e0/0xd6c4b8f058680268 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135177.471037:0:19201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000365388e0/0xd6c4b8f058680268 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135177.471055:0:19201:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:2.0:1783135177.473440:0:19201:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1783135177.473453:0:19201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c80b561a/0xd6c4b8f05868026f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135177.473473:0:19201:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2f:0x0].0x0 since=459s v=(0 0) 00010000:00010000:2.0:1783135177.473477:0:19201:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783135177.473483:0:19201:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c80b561a/0xd6c4b8f05868026f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135177.473498:0:19201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c80b561a/0xd6c4b8f05868026f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135177.473510:0:19201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c80b561a/0xd6c4b8f05868026f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135177.473518:0:19201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c80b561a/0xd6c4b8f05868026f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135177.473531:0:19201:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00002000:00010000:2.0:1783135177.473980:0:19201:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1783135177.473986:0:19201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000db3da5fe/0xd6c4b8f058680276 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135177.473994:0:19201:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2e:0x0].0x0 since=459s v=(0 0) 00010000:00010000:2.0:1783135177.474003:0:19201:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783135177.474007:0:19201:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000db3da5fe/0xd6c4b8f058680276 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135177.474016:0:19201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000db3da5fe/0xd6c4b8f058680276 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135177.474024:0:19201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000db3da5fe/0xd6c4b8f058680276 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135177.474031:0:19201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000db3da5fe/0xd6c4b8f058680276 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135177.474040:0:19201:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00010000:00010000:1.0:1783135177.474202:0:18241:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:1.0:1783135177.474210:0:18241:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cda93d77/0xd6c4b8f05868025a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135177.474219:0:18241:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe9c7829200 already unused, calling callback (ffffffffc1527ce0) 00010000:00010000:1.0:1783135177.474224:0:18241:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cda93d77/0xd6c4b8f05868025a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135177.474233:0:18241:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cda93d77/0xd6c4b8f05868025a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135177.474250:0:18241:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cda93d77/0xd6c4b8f05868025a lrc: 1/0,0 mode: --/PW res: [0x240000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135177.474257:0:18241:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cda93d77/0xd6c4b8f05868025a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135177.474277:0:18241:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1783135177.474297:0:18241:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c7eaa13a/0xd6c4b8f058680261 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135177.474310:0:18241:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe9c7828000 already unused, calling callback (ffffffffc1527ce0) 00010000:00010000:1.0:1783135177.474314:0:18241:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c7eaa13a/0xd6c4b8f058680261 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135177.474321:0:18241:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c7eaa13a/0xd6c4b8f058680261 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135177.474332:0:18241:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c7eaa13a/0xd6c4b8f058680261 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135177.474339:0:18241:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c7eaa13a/0xd6c4b8f058680261 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135177.474354:0:18241:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1783135177.474357:0:18241:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000365388e0/0xd6c4b8f058680268 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135177.474363:0:18241:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe9c7828c00 already unused, calling callback (ffffffffc1527ce0) 00010000:00010000:1.0:1783135177.474366:0:18241:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000365388e0/0xd6c4b8f058680268 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135177.474374:0:18241:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000365388e0/0xd6c4b8f058680268 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135177.474382:0:18241:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000365388e0/0xd6c4b8f058680268 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135177.474393:0:18241:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000365388e0/0xd6c4b8f058680268 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135177.474406:0:18241:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1783135177.474409:0:18241:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c80b561a/0xd6c4b8f05868026f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135177.474415:0:18241:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe9c7829800 already unused, calling callback (ffffffffc1527ce0) 00010000:00010000:1.0:1783135177.474418:0:18241:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c80b561a/0xd6c4b8f05868026f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135177.474425:0:18241:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c80b561a/0xd6c4b8f05868026f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135177.474434:0:18241:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c80b561a/0xd6c4b8f05868026f lrc: 1/0,0 mode: --/PW res: [0x240000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135177.474441:0:18241:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c80b561a/0xd6c4b8f05868026f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135177.474452:0:18241:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783135177.474455:0:18241:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000db3da5fe/0xd6c4b8f058680276 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135177.474461:0:18241:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe9c7828a00 already unused, calling callback (ffffffffc1527ce0) 00010000:00010000:1.0:1783135177.474470:0:18241:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000db3da5fe/0xd6c4b8f058680276 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135177.474477:0:18241:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000db3da5fe/0xd6c4b8f058680276 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135177.474487:0:18241:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000db3da5fe/0xd6c4b8f058680276 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135177.474494:0:18241:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000db3da5fe/0xd6c4b8f058680276 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135177.474504:0:18241:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783135177.474506:0:18241:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783135177.474507:0:18241:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783135177.474784:0:18240:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1783135177.475501:0:19201:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1783135177.475509:0:19201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000eb172ed9/0xd6c4b8f05868027d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135177.475520:0:19201:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2d:0x0].0x0 since=459s v=(0 0) 00010000:00010000:2.0:1783135177.475524:0:19201:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783135177.475528:0:19201:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000eb172ed9/0xd6c4b8f05868027d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135177.475538:0:19201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000eb172ed9/0xd6c4b8f05868027d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135177.475548:0:19201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000eb172ed9/0xd6c4b8f05868027d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135177.475564:0:19201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000eb172ed9/0xd6c4b8f05868027d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135177.475581:0:19201:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1783135177.475961:0:19201:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1783135177.475967:0:19201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f7cc9135/0xd6c4b8f058680284 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135177.475976:0:19201:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2c:0x0].0x0 since=459s v=(0 0) 00010000:00010000:2.0:1783135177.475979:0:19201:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783135177.475983:0:19201:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f7cc9135/0xd6c4b8f058680284 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135177.475991:0:19201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f7cc9135/0xd6c4b8f058680284 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135177.475999:0:19201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f7cc9135/0xd6c4b8f058680284 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135177.476006:0:19201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f7cc9135/0xd6c4b8f058680284 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135177.476026:0:19201:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1783135177.476064:0:18240:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1783135177.476070:0:18240:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000eb172ed9/0xd6c4b8f05868027d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135177.476078:0:18240:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe9c7828800 already unused, calling callback (ffffffffc1527ce0) 00010000:00010000:0.0:1783135177.476082:0:18240:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000eb172ed9/0xd6c4b8f05868027d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135177.476101:0:18240:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000eb172ed9/0xd6c4b8f05868027d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135177.476126:0:18240:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000eb172ed9/0xd6c4b8f05868027d lrc: 1/0,0 mode: --/PW res: [0x240000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135177.476134:0:18240:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000eb172ed9/0xd6c4b8f05868027d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135177.476150:0:18240:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783135177.476153:0:18240:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f7cc9135/0xd6c4b8f058680284 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135177.476160:0:18240:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe9c7829a00 already unused, calling callback (ffffffffc1527ce0) 00010000:00010000:0.0:1783135177.476163:0:18240:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f7cc9135/0xd6c4b8f058680284 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135177.476171:0:18240:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f7cc9135/0xd6c4b8f058680284 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135177.476181:0:18240:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f7cc9135/0xd6c4b8f058680284 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135177.476188:0:18240:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f7cc9135/0xd6c4b8f058680284 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135177.476211:0:18240:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783135177.476212:0:18240:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783135177.476214:0:18240:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783135177.478361:0:18241:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1783135177.478555:0:19201:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1783135177.478566:0:19201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b1cb05b0/0xd6c4b8f05868028b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135177.478587:0:19201:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2b:0x0].0x0 since=459s v=(0 0) 00010000:00010000:2.0:1783135177.478592:0:19201:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783135177.478598:0:19201:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b1cb05b0/0xd6c4b8f05868028b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135177.478609:0:19201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b1cb05b0/0xd6c4b8f05868028b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135177.478620:0:19201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b1cb05b0/0xd6c4b8f05868028b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135177.478628:0:19201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b1cb05b0/0xd6c4b8f05868028b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135177.478650:0:19201:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1783135177.478694:0:18240:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783135177.478701:0:18240:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b1cb05b0/0xd6c4b8f05868028b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135177.478710:0:18240:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe9c7829e00 already unused, calling callback (ffffffffc1527ce0) 00010000:00010000:0.0:1783135177.478714:0:18240:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b1cb05b0/0xd6c4b8f05868028b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135177.478723:0:18240:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b1cb05b0/0xd6c4b8f05868028b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135177.478737:0:18240:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b1cb05b0/0xd6c4b8f05868028b lrc: 1/0,0 mode: --/PW res: [0x240000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135177.478744:0:18240:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b1cb05b0/0xd6c4b8f05868028b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135177.478760:0:18240:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783135177.478762:0:18240:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783135177.478763:0:18240:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1783135177.479104:0:19201:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1783135177.479674:0:19201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001733b7a5/0xd6c4b8f058680292 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135177.479688:0:19201:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2a:0x0].0x0 since=459s v=(0 0) 00010000:00010000:2.0:1783135177.479691:0:19201:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783135177.479696:0:19201:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001733b7a5/0xd6c4b8f058680292 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135177.479705:0:19201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001733b7a5/0xd6c4b8f058680292 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135177.479724:0:19201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001733b7a5/0xd6c4b8f058680292 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135177.479730:0:19201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001733b7a5/0xd6c4b8f058680292 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135177.479750:0:19201:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783135177.479780:0:18241:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783135177.479787:0:18241:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001733b7a5/0xd6c4b8f058680292 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135177.479796:0:18241:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe9c7829c00 already unused, calling callback (ffffffffc1527ce0) 00010000:00010000:1.0:1783135177.479801:0:18241:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001733b7a5/0xd6c4b8f058680292 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135177.479810:0:18241:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001733b7a5/0xd6c4b8f058680292 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135177.479823:0:18241:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001733b7a5/0xd6c4b8f058680292 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135177.479839:0:18241:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001733b7a5/0xd6c4b8f058680292 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135177.479859:0:18241:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783135177.479862:0:18241:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783135177.479864:0:18241:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1783135177.485805:0:19201:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x29:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1783135177.485819:0:19201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bbd0d110/0xd6c4b8f058680299 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135177.485848:0:19201:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x29:0x0].0x0 since=459s v=(0 0) 00010000:00010000:3.0:1783135177.485854:0:19201:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x29:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783135177.485861:0:19201:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bbd0d110/0xd6c4b8f058680299 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135177.485877:0:19201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bbd0d110/0xd6c4b8f058680299 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135177.485888:0:19201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bbd0d110/0xd6c4b8f058680299 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135177.485896:0:19201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bbd0d110/0xd6c4b8f058680299 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135177.485922:0:19201:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1783135177.486471:0:19201:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x28:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1783135177.486477:0:19201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000095441e9c/0xd6c4b8f0586802a0 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x28:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135177.486486:0:19201:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x28:0x0].0x0 since=459s v=(0 0) 00010000:00010000:3.0:1783135177.486489:0:19201:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x28:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783135177.486494:0:19201:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000095441e9c/0xd6c4b8f0586802a0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135177.486503:0:19201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000095441e9c/0xd6c4b8f0586802a0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135177.486522:0:19201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000095441e9c/0xd6c4b8f0586802a0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135177.486530:0:19201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000095441e9c/0xd6c4b8f0586802a0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135177.486542:0:19201:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:3.0:1783135177.486885:0:19201:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x27:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1783135177.486891:0:19201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000027056a73/0xd6c4b8f0586802a7 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135177.486900:0:19201:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x27:0x0].0x0 since=459s v=(0 0) 00010000:00010000:3.0:1783135177.486903:0:19201:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x27:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783135177.486908:0:19201:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000027056a73/0xd6c4b8f0586802a7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135177.486917:0:19201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000027056a73/0xd6c4b8f0586802a7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135177.486924:0:19201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000027056a73/0xd6c4b8f0586802a7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135177.486932:0:19201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000027056a73/0xd6c4b8f0586802a7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135177.486951:0:19201:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:3.0:1783135177.487499:0:19201:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x26:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1783135177.487505:0:19201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000039f945ae/0xd6c4b8f0586802ae lrc: 3/0,1 mode: --/PW res: [0x240000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135177.487514:0:19201:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x26:0x0].0x0 since=459s v=(0 0) 00010000:00010000:3.0:1783135177.487517:0:19201:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x26:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783135177.487521:0:19201:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000039f945ae/0xd6c4b8f0586802ae lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135177.487552:0:19201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000039f945ae/0xd6c4b8f0586802ae lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135177.487559:0:19201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000039f945ae/0xd6c4b8f0586802ae lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135177.487565:0:19201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000039f945ae/0xd6c4b8f0586802ae lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135177.487713:0:19201:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00010000:00010000:1.0:1783135177.488251:0:18241:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1783135177.488259:0:18241:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bbd0d110/0xd6c4b8f058680299 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135177.488268:0:18241:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe9c0031400 already unused, calling callback (ffffffffc1527ce0) 00010000:00010000:1.0:1783135177.488272:0:18241:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bbd0d110/0xd6c4b8f058680299 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135177.488294:0:18241:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bbd0d110/0xd6c4b8f058680299 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135177.488312:0:18241:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bbd0d110/0xd6c4b8f058680299 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135177.488318:0:18241:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bbd0d110/0xd6c4b8f058680299 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135177.488337:0:18241:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1783135177.488340:0:18241:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000095441e9c/0xd6c4b8f0586802a0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135177.488353:0:18241:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe9c0030c00 already unused, calling callback (ffffffffc1527ce0) 00010000:00010000:1.0:1783135177.488356:0:18241:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000095441e9c/0xd6c4b8f0586802a0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135177.488362:0:18241:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000095441e9c/0xd6c4b8f0586802a0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135177.488371:0:18241:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000095441e9c/0xd6c4b8f0586802a0 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135177.488377:0:18241:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000095441e9c/0xd6c4b8f0586802a0 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135177.488389:0:18241:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1783135177.488392:0:18241:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000027056a73/0xd6c4b8f0586802a7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135177.488397:0:18241:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe9c0030200 already unused, calling callback (ffffffffc1527ce0) 00010000:00010000:1.0:1783135177.488400:0:18241:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000027056a73/0xd6c4b8f0586802a7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135177.488406:0:18241:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000027056a73/0xd6c4b8f0586802a7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135177.488415:0:18241:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000027056a73/0xd6c4b8f0586802a7 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135177.488429:0:18241:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000027056a73/0xd6c4b8f0586802a7 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135177.488439:0:18241:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783135177.488443:0:18241:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000039f945ae/0xd6c4b8f0586802ae lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135177.488448:0:18241:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe9c0031600 already unused, calling callback (ffffffffc1527ce0) 00010000:00010000:1.0:1783135177.488451:0:18241:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000039f945ae/0xd6c4b8f0586802ae lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135177.488458:0:18241:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000039f945ae/0xd6c4b8f0586802ae lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135177.488466:0:18241:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000039f945ae/0xd6c4b8f0586802ae lrc: 1/0,0 mode: --/PW res: [0x240000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135177.488474:0:18241:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000039f945ae/0xd6c4b8f0586802ae lrc: 0/0,0 mode: --/PW res: [0x240000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135177.488485:0:18241:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783135177.488486:0:18241:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783135177.488488:0:18241:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1783135177.491451:0:19201:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x25:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1783135177.491466:0:19201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001f613943/0xd6c4b8f0586802b5 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135177.491483:0:19201:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x25:0x0].0x0 since=459s v=(0 0) 00010000:00010000:3.0:1783135177.491494:0:19201:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x25:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783135177.491501:0:19201:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001f613943/0xd6c4b8f0586802b5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135177.491514:0:19201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001f613943/0xd6c4b8f0586802b5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135177.491525:0:19201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001f613943/0xd6c4b8f0586802b5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135177.491533:0:19201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001f613943/0xd6c4b8f0586802b5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135177.491550:0:19201:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1783135177.494261:0:19201:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x24:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1783135177.494273:0:19201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003d1ec7ff/0xd6c4b8f0586802bc lrc: 3/0,1 mode: --/PW res: [0x240000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135177.494308:0:19201:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x24:0x0].0x0 since=459s v=(0 0) 00010000:00010000:3.0:1783135177.494313:0:19201:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x24:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783135177.494319:0:19201:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003d1ec7ff/0xd6c4b8f0586802bc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135177.494333:0:19201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003d1ec7ff/0xd6c4b8f0586802bc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135177.494342:0:19201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003d1ec7ff/0xd6c4b8f0586802bc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135177.494356:0:19201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003d1ec7ff/0xd6c4b8f0586802bc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135177.494366:0:19201:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:3.0:1783135177.497572:0:19201:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x23:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1783135177.497586:0:19201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000027282274/0xd6c4b8f0586802c3 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135177.497602:0:19201:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x23:0x0].0x0 since=459s v=(0 0) 00010000:00010000:3.0:1783135177.500449:0:19201:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x23:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783135177.500463:0:19201:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000027282274/0xd6c4b8f0586802c3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135177.500485:0:19201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000027282274/0xd6c4b8f0586802c3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135177.500497:0:19201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000027282274/0xd6c4b8f0586802c3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135177.500504:0:19201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000027282274/0xd6c4b8f0586802c3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135177.501150:0:19201:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00080000:3.0:1783135177.504503:0:19201:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x240000400:34 00000100:00100000:3.0:1783135177.505421:0:19201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9f6fe7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:18275:x1869752384466560:12345-0@lo:5:osp-pre-0-0.0 Request processed in 143838us (144695us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135177.505447:0:19201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1783135177.511576:0:18275:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9f6fe5880 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:18275:1869752384466560:0@lo:5:osp-pre-0-0.0 00000004:00080000:2.0:1783135177.511595:0:18275:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x240000400:0x41:0x0] from OST, last_created [0x240000400:0x41:0x0]last_used is [0x240000400:0x22:0x0] 00000100:00100000:2.0:1783135177.511650:0:18275:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9f6fe5880 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:18275:1869752384466688:0@lo:5:osp-pre-0-0.0 00000100:00100000:2.0:1783135177.511706:0:18275:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135177.511750:0:18275:0:(client.c:2701:ptlrpc_set_wait()) set ffff9fe9cb3e9cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1783135177.511770:0:18889:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384466688 00000100:00100000:2.0:1783135177.511777:0:18889:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384466688 00000100:00100000:2.0:1783135177.511822:0:18889:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1783135177.511833:0:18889:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9f6fe6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:18275:x1869752384466688:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:2.0:1783135177.511879:0:18889:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 66 00010000:00010000:1.0:1783135177.512186:0:18241:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1783135177.512196:0:18241:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001f613943/0xd6c4b8f0586802b5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135177.514428:0:18241:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe9c0030000 already unused, calling callback (ffffffffc1527ce0) 00010000:00010000:1.0:1783135177.514441:0:18241:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001f613943/0xd6c4b8f0586802b5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135177.514456:0:18241:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001f613943/0xd6c4b8f0586802b5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135177.514477:0:18241:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001f613943/0xd6c4b8f0586802b5 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135177.514484:0:18241:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001f613943/0xd6c4b8f0586802b5 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135177.517925:0:18241:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1783135177.517941:0:18241:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003d1ec7ff/0xd6c4b8f0586802bc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135177.517956:0:18241:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe9c0030a00 already unused, calling callback (ffffffffc1527ce0) 00010000:00010000:1.0:1783135177.517962:0:18241:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003d1ec7ff/0xd6c4b8f0586802bc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135177.517973:0:18241:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003d1ec7ff/0xd6c4b8f0586802bc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135177.517993:0:18241:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003d1ec7ff/0xd6c4b8f0586802bc lrc: 1/0,0 mode: --/PW res: [0x240000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135177.518008:0:18241:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003d1ec7ff/0xd6c4b8f0586802bc lrc: 0/0,0 mode: --/PW res: [0x240000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135177.518027:0:18241:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783135177.518031:0:18241:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000027282274/0xd6c4b8f0586802c3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135177.518038:0:18241:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe9c148b200 already unused, calling callback (ffffffffc1527ce0) 00010000:00010000:1.0:1783135177.518041:0:18241:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000027282274/0xd6c4b8f0586802c3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135177.518049:0:18241:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000027282274/0xd6c4b8f0586802c3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135177.518059:0:18241:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000027282274/0xd6c4b8f0586802c3 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135177.518066:0:18241:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000027282274/0xd6c4b8f0586802c3 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135177.518077:0:18241:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783135177.518079:0:18241:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783135177.518080:0:18241:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783135177.519719:0:18240:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783135177.528823:0:18889:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9f6fe6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:18275:x1869752384466688:12345-0@lo:5:osp-pre-0-0.0 Request processed in 16985us (17111us total) trans 12884901889 rc 0/0 00000100:00100000:2.0:1783135177.528835:0:18889:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1783135177.532326:0:18275:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9f6fe5880 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:18275:1869752384466688:0@lo:5:osp-pre-0-0.0 00000004:00080000:0.0:1783135177.532346:0:18275:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x41:0x0]-[0x240000400:0x61:0x0] 00000004:00080000:0.0:1783135177.587931:0:5791:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00010000:00010000:2.0:1783135177.667958:0:18241:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1783135178.300665:0:19257:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg141-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1783135178.691387:0:18240:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783135179.715626:0:18241:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1783135180.040325:0:6602:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:3.0:1783135180.040357:0:6602:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 12884901889 is committed 00010000:00010000:0.0:1783135180.740453:0:18240:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783135181.767259:0:18241:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783135182.467880:0:3287:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1783135182.467903:0:3287:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9f6fe4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1869752384466816:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1783135182.467967:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1783135182.468180:0:8:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1783135182.468184:0:8:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1783135182.468188:0:8:0:(import.c:65:import_set_state_nolock()) ffff9fe9f8a5c000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1783135182.468194:0:8:0:(import.c:512:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 459 00000100:00080000:3.0:1783135182.468198:0:8:0:(import.c:591:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:3.0:1783135182.468205:0:8:0:(import.c:626:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9fe9f8a5c000 using connection 192.168.201.141@tcp/0@lo 00000100:00100000:3.0:1783135182.468225:0:8:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9fe9fe90d880 x1869752384467072/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1783135182.468330:0:3285:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9fe90d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3285:1869752384467072:0@lo:8:kworker.0 00000100:00100000:1.0:1783135182.468367:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135182.468441:0:3287:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9fe90d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:06a7653e-5f5a-4acc-ba93-0eff19f145f0:3287:1869752384466944:0@lo:400:kworker.0 00000100:00100000:2.0:1783135182.468471:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135182.468543:0:18247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384466944 00000100:00100000:1.0:1783135182.468550:0:18247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384466944 00000100:00100000:1.0:1783135182.468604:0:18247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1783135182.468613:0:18247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9c8e48c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:06a7653e-5f5a-4acc-ba93-0eff19f145f0+16:3287:x1869752384466944:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783135182.468666:0:18247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9c8e48c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:06a7653e-5f5a-4acc-ba93-0eff19f145f0+16:3287:x1869752384466944:12345-0@lo:400:kworker.0 Request processed in 54us (193us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135182.468673:0:18247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1783135182.468756:0:3287:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9fe90d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:06a7653e-5f5a-4acc-ba93-0eff19f145f0:3287:1869752384466944:0@lo:400:kworker.0 00000100:00100000:3.0:1783135182.468807:0:18890:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384467072 00000100:00100000:3.0:1783135182.468811:0:18890:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384467072 00000100:00100000:3.0:1783135182.468838:0:18890:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1783135182.468843:0:18890:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe8c590d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3285:x1869752384467072:12345-0@lo:8:kworker.0 00010000:00020000:3.0:1783135182.468860:0:18890:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1783135182.472450:0:18892:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384466816 00000100:00100000:0.0:1783135182.472465:0:18892:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384466816 00000100:00100000:0.0:1783135182.472533:0:18892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1783135182.472543:0:18892:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9f6fe7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3287:x1869752384466816:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1783135182.472585:0:18892:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1783135182.472669:0:18892:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9f6fe7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3287:x1869752384466816:12345-0@lo:13:osp-pre-0-0.0 Request processed in 128us (4701us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135182.472677:0:18892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1783135182.472705:0:3288:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9fe90e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3288:1869752384467200:0@lo:400:kworker.0 00000100:00100000:0.0:1783135182.472738:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135182.472763:0:3288:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1783135182.472769:0:3288:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9fe90f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3288:1869752384467328:0@lo:400:kworker.0 00000100:00100000:0.0:1783135182.472787:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1783135182.472809:0:18248:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1783135182.472825:0:18254:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384467200 00000100:00100000:0.0:1783135182.472828:0:18254:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384467200 00000100:00100000:0.0:1783135182.472851:0:18254:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384467328 00000100:00100000:0.0:1783135182.472854:0:18254:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384467328 00000100:00100000:0.0:1783135182.472872:0:18254:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1783135182.472877:0:18254:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fe8fce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3288:x1869752384467200:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783135182.472910:0:18254:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fe8fce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3288:x1869752384467200:12345-0@lo:400:kworker.0 Request processed in 33us (172us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135182.472915:0:18254:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1783135182.472939:0:18254:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1783135182.472944:0:18254:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fe8fed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3288:x1869752384467328:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783135182.472968:0:18254:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fe8fed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3288:x1869752384467328:12345-0@lo:400:kworker.0 Request processed in 24us (180us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135182.472974:0:18254:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00080000:0.0:1783135182.472991:0:18248:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1783135182.473015:0:3288:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9fe9fe90f100 x1869752384467328/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783135198 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783135182.473038:0:3288:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9fe90f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3288:1869752384467328:0@lo:400:kworker.0 00010000:00080000:0.0:1783135182.473050:0:3288:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9fe9fe90e300 x1869752384467200/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783135198 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783135182.473057:0:3288:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9fe90e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3288:1869752384467200:0@lo:400:kworker.0 00000100:00100000:0.0:1783135182.473086:0:3287:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 12884901889 gen 2 00000100:00100000:0.0:1783135182.473104:0:3287:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9f6fe4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1869752384466816:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1783135182.477378:0:18890:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe8c590d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3285:x1869752384467072:12345-0@lo:8:kworker.0 Request processed in 8523us (9000us total) trans 0 rc -19/-19 00000100:00100000:3.0:1783135182.477392:0:18890:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:0.0:1783135182.477921:0:3285:0:(import.c:65:import_set_state_nolock()) ffff9fe9f8a5c000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1783135182.477928:0:3285:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1783135182.477932:0:3285:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9fe90d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3285:1869752384467072:0@lo:8:kworker.0 00010000:00010000:0.0:1783135182.787464:0:18240:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783135183.819467:0:18241:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1783135184.132737:0:18286:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1783135184.835969:0:18240:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1783135185.506969:0:19560:0:(obd_mount.c:914:lmd_print()) mount data: 00000020:01000004:1.0:1783135185.506983:0:19560:0:(obd_mount.c:917:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:1.0:1783135185.507233:0:19560:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff9fea01d7a000 00000020:01000004:1.0:1783135185.507479:0:19560:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:1.0:1783135185.507495:0:19560:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:1.0:1783135185.507510:0:19560:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff9fe9d13819c0) 00000020:00000080:1.0:1783135185.507526:0:19560:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1783135185.536348:0:19560:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:2.0:1783135185.540841:0:19560:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:2.0:1783135185.548300:0:19560:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:2.0:1783135185.548545:0:19560:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:2.0:1783135185.548824:0:19560:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000003:0xb:0x0] (8/32) 00100000:10000000:2.0:1783135185.549547:0:19560:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-client under 403: rc = 0 00100000:10000000:2.0:1783135185.549752:0:19560:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-OST0001 under 403: rc = 0 00100000:10000000:2.0:1783135185.549841:0:19560:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled params under 403: rc = 0 00100000:10000000:2.0:1783135185.550551:0:19560:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000 under 770: rc = 0 00100000:10000000:3.0:1783135185.556020:0:19560:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000-OST0001 under 770: rc = 0 00100000:10000000:3.0:1783135185.556239:0:19560:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000 under 770: rc = 0 00100000:10000000:3.0:1783135185.556485:0:19560:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000-OST0001 under 770: rc = 0 00100000:10000000:3.0:1783135185.556685:0:19560:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000 under 770: rc = 0 00100000:10000000:3.0:1783135185.556876:0:19560:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000-OST0001 under 770: rc = 0 00000020:00000080:3.0:1783135185.557567:0:19560:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:3.0:1783135185.557592:0:19560:0:(osd_handler.c:1569:osd_obd_connect()) connect #0 00000020:00000080:3.0:1783135185.557613:0:19560:0:(genops.c:1406:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xd6c4b8f0586802d1 00000020:01000004:3.0:1783135185.557625:0:19560:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:3.0:1783135185.557654:0:19560:0:(obd_mount.c:394:lustre_start_mgc()) MGC192.168.201.141@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1783135185.557659:0:19560:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.201.141@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1783135185.557666:0:19560:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0001 00000020:01000004:3.0:1783135185.557693:0:19560:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:3.0:1783135185.557699:0:19560:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.141@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:3.0:1783135185.567752:0:19560:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.141@tcp ctxt 0 is initialized 00000020:01000004:3.0:1783135185.567812:0:19560:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.201.141@tcp, index=0001, flags=0x20002 00000020:01000004:3.0:1783135185.567818:0:19560:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1783135185.567821:0:19560:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1783135185.567822:0:19560:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1783135185.567824:0:19560:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1783135185.567826:0:19560:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1783135185.567827:0:19560:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1783135185.567829:0:19560:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1783135185.567831:0:19560:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1783135185.567833:0:19560:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1783135185.567838:0:19560:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020002 00000020:01000004:3.0:1783135185.567841:0:19560:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1783135185.567843:0:19560:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1783135185.567844:0:19560:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1783135185.567846:0:19560:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1783135185.567847:0:19560:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1783135185.567849:0:19560:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1783135185.567850:0:19560:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1783135185.567851:0:19560:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1783135185.567852:0:19560:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1783135185.567897:0:19560:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:3.0:1783135185.567929:0:19560:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9fe90d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:06a7653e-5f5a-4acc-ba93-0eff19f145f0:19560:1869752384467456:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1783135185.568120:0:19560:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135185.568264:0:19560:0:(client.c:2701:ptlrpc_set_wait()) set ffff9fe9cbbbcf00 going to sleep for 11 seconds 00000100:00100000:0.0:1783135185.568509:0:18245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384467456 00000100:00100000:0.0:1783135185.568519:0:18245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384467456 00000100:00100000:1.0:1783135185.568709:0:18245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1783135185.568723:0:18245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9c8e4a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:06a7653e-5f5a-4acc-ba93-0eff19f145f0+16:19560:x1869752384467456:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1783135185.568771:0:18245:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:1.0:1783135185.568775:0:18245:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0001 is running on 0@lo 20000000:01000000:1.0:1783135185.568781:0:18245:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:1.0:1783135185.579658:0:18245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9c8e4a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:06a7653e-5f5a-4acc-ba93-0eff19f145f0+16:19560:x1869752384467456:12345-0@lo:253:mount.lustre.0 Request processed in 10917us (11518us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135185.579683:0:18245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1783135185.579816:0:19560:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9fe90d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:06a7653e-5f5a-4acc-ba93-0eff19f145f0:19560:1869752384467456:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1783135185.579835:0:19560:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:3.0:1783135185.579858:0:19560:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1783135185.579860:0:19560:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1783135185.579862:0:19560:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1783135185.579863:0:19560:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1783135185.579864:0:19560:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1783135185.579865:0:19560:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1783135185.579867:0:19560:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1783135185.579870:0:19560:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1783135185.579871:0:19560:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1783135185.579923:0:19560:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9fea01d7a000 from lustre-OST0001 10000000:01000000:3.0:1783135185.579967:0:19560:0:(mgc_request.c:1945:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:3.0:1783135185.579980:0:19560:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:3.0:1783135185.582207:0:19560:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9fe9ca89cd40 local copy 00010000:00010000:3.0:1783135185.582234:0:19560:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.141@tcp lock: ffff9fe8c5550800/0xd6c4b8f058680062 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xd6c4b8f058680069 expref: -99 pid: 18234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783135185.582900:0:19560:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9fe90d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:06a7653e-5f5a-4acc-ba93-0eff19f145f0:19560:1869752384467584:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1783135185.584755:0:19560:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135185.584845:0:19560:0:(client.c:2701:ptlrpc_set_wait()) set ffff9fe9cbbbca80 going to sleep for 11 seconds 00000100:00100000:2.0:1783135185.584956:0:18246:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384467584 00000100:00100000:2.0:1783135185.584969:0:18246:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384467584 00000100:00100000:2.0:1783135185.585265:0:18246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1783135185.585312:0:18246:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9c8e4ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:06a7653e-5f5a-4acc-ba93-0eff19f145f0+16:19560:x1869752384467584:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1783135185.585987:0:18246:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9c8e4ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:06a7653e-5f5a-4acc-ba93-0eff19f145f0+16:19560:x1869752384467584:12345-0@lo:501:mount.lustre.0 Request processed in 709us (1239us total) trans 0 rc -2/-2 00000100:00100000:2.0:1783135185.586005:0:18246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1783135185.587200:0:19560:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9fe90d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:06a7653e-5f5a-4acc-ba93-0eff19f145f0:19560:1869752384467584:0@lo:501:mount.lustre.0 10000000:01000000:3.0:1783135185.587238:0:19560:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.201.141@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1783135185.587577:0:19560:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.201.141@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1783135185.587591:0:19560:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.141@tcp lock: ffff9fe8c5550800/0xd6c4b8f058680062 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xd6c4b8f058680069 expref: -99 pid: 18234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135185.587605:0:19560:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.141@tcp lock: ffff9fe8c5550800/0xd6c4b8f058680062 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xd6c4b8f058680069 expref: -99 pid: 18234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783135185.587652:0:19560:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9fea01d7a000 10000000:01000000:3.0:1783135185.587657:0:19560:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1783135185.587665:0:19560:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:3.0:1783135185.587677:0:19560:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1783135185.587684:0:19560:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:3.0:1783135185.587687:0:19560:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:3.0:1783135185.587739:0:19560:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.141@tcp lock: ffff9fe9c148b400/0xd6c4b8f0586802d8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135185.587748:0:19560:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.141@tcp lock: ffff9fe9c148b400/0xd6c4b8f0586802d8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135185.587761:0:19560:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.141@tcp lock: ffff9fe9c148b400/0xd6c4b8f0586802d8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783135185.587791:0:19560:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9fe90d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:06a7653e-5f5a-4acc-ba93-0eff19f145f0:19560:1869752384467712:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1783135185.587882:0:19560:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135185.588559:0:19560:0:(client.c:2701:ptlrpc_set_wait()) set ffff9fe9cbbbca80 going to sleep for 11 seconds 00000100:00100000:1.0:1783135185.588823:0:18245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384467712 00000100:00100000:1.0:1783135185.588835:0:18245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384467712 00000100:00100000:1.0:1783135185.588921:0:18245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1783135185.588933:0:18245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9c8e4a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:06a7653e-5f5a-4acc-ba93-0eff19f145f0+16:19560:x1869752384467712:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1783135185.588983:0:18245:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783135185.589006:0:18245:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fe8c5550a00/0xd6c4b8f0586802df lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xd6c4b8f0586802d8 expref: -99 pid: 18245 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135185.589050:0:18245:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fe8c5550a00/0xd6c4b8f0586802df lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd6c4b8f0586802d8 expref: 17 pid: 18245 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135185.589065:0:18245:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fe8c5550a00/0xd6c4b8f0586802df lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd6c4b8f0586802d8 expref: 17 pid: 18245 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135185.589076:0:18245:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fe8c5550a00, rc 0) 00000100:00100000:1.0:1783135185.589150:0:18245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9c8e4a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:06a7653e-5f5a-4acc-ba93-0eff19f145f0+17:19560:x1869752384467712:12345-0@lo:101:mount.lustre.0 Request processed in 219us (1268us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135185.589157:0:18245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1783135185.589350:0:19560:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9fe90d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:06a7653e-5f5a-4acc-ba93-0eff19f145f0:19560:1869752384467712:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1783135185.589373:0:19560:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.141@tcp lock: ffff9fe9c148b400/0xd6c4b8f0586802d8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xd6c4b8f0586802df expref: -99 pid: 19560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135185.589397:0:19560:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.141@tcp lock: ffff9fe9c148b400/0xd6c4b8f0586802d8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xd6c4b8f0586802df expref: -99 pid: 19560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1783135185.590805:0:19560:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 11 count 11 00000040:00080000:0.0:1783135185.597655:0:19560:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1783135185.599361:0:19560:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].1, 224 off8416 00000040:00080000:0.0:1783135185.599435:0:19560:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].2, 128 off8544 00000040:00080000:0.0:1783135185.599472:0:19560:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].3, 112 off8656 00000040:00080000:0.0:1783135185.599528:0:19560:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].4, 224 off8880 00000040:00080000:0.0:1783135185.599564:0:19560:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].5, 224 off9104 00000040:00080000:0.0:1783135185.599619:0:19560:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].6, 80 off9184 00000040:00080000:0.0:1783135185.599746:0:19560:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].7, 224 off9408 00000040:00080000:0.0:1783135185.599787:0:19560:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].8, 224 off9632 00000040:00080000:0.0:1783135185.599835:0:19560:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].9, 120 off9752 00000040:00080000:0.0:1783135185.599905:0:19560:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].10, 224 off9976 00000040:00080000:0.0:1783135185.599914:0:19560:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 10 count 11 00000100:00100000:0.0:1783135185.600039:0:19560:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9fe8fd500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:06a7653e-5f5a-4acc-ba93-0eff19f145f0:19560:1869752384467840:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1783135185.600108:0:19560:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135185.600151:0:19560:0:(client.c:2701:ptlrpc_set_wait()) set ffff9fe9e9b206c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783135185.600369:0:18245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384467840 00000100:00100000:1.0:1783135185.600385:0:18245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384467840 00000100:00100000:1.0:1783135185.600471:0:18245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1783135185.600483:0:18245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9c8e48450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:06a7653e-5f5a-4acc-ba93-0eff19f145f0+17:19560:x1869752384467840:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1783135185.601189:0:18245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9c8e48450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:06a7653e-5f5a-4acc-ba93-0eff19f145f0+17:19560:x1869752384467840:12345-0@lo:501:mount.lustre.0 Request processed in 705us (1078us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135185.601199:0:18245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1783135185.601826:0:19560:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9fe8fd500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:06a7653e-5f5a-4acc-ba93-0eff19f145f0:19560:1869752384467840:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1783135185.601883:0:19560:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9fe8fd500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:06a7653e-5f5a-4acc-ba93-0eff19f145f0:19560:1869752384467968:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1783135185.601958:0:19560:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135185.602060:0:19560:0:(client.c:2701:ptlrpc_set_wait()) set ffff9fe9e9b206c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783135185.606000:0:18246:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384467968 00000100:00100000:1.0:1783135185.606016:0:18246:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384467968 00000100:00100000:1.0:1783135185.606081:0:18246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1783135185.606091:0:18246:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9c8e4b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:06a7653e-5f5a-4acc-ba93-0eff19f145f0+17:19560:x1869752384467968:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1783135185.606603:0:18246:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9c8e4b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:06a7653e-5f5a-4acc-ba93-0eff19f145f0+17:19560:x1869752384467968:12345-0@lo:503:mount.lustre.0 Request processed in 512us (4642us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135185.606621:0:18246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1783135185.607404:0:19560:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9fe8fd500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:06a7653e-5f5a-4acc-ba93-0eff19f145f0:19560:1869752384467968:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1783135185.608319:0:19560:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1783135185.608403:0:19560:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9fe8fd500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:06a7653e-5f5a-4acc-ba93-0eff19f145f0:19560:1869752384468096:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1783135185.608472:0:19560:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135185.608511:0:19560:0:(client.c:2701:ptlrpc_set_wait()) set ffff9fe9e9b206c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783135185.608719:0:18247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384468096 00000100:00100000:3.0:1783135185.608734:0:18247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384468096 00000100:00100000:3.0:1783135185.608799:0:18247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1783135185.608811:0:18247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9c8e49c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:06a7653e-5f5a-4acc-ba93-0eff19f145f0+17:19560:x1869752384468096:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1783135185.609178:0:18247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9c8e49c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:06a7653e-5f5a-4acc-ba93-0eff19f145f0+17:19560:x1869752384468096:12345-0@lo:502:mount.lustre.0 Request processed in 369us (704us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135185.609188:0:18247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1783135185.609805:0:19560:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9fe8fd500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:06a7653e-5f5a-4acc-ba93-0eff19f145f0:19560:1869752384468096:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1783135185.610098:0:19560:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].1, 224 off8416 00000040:00080000:0.0:1783135185.610158:0:19560:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].2, 128 off8544 00000040:00080000:0.0:1783135185.610192:0:19560:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].3, 112 off8656 00000040:00080000:0.0:1783135185.610235:0:19560:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].4, 224 off8880 00000040:00080000:0.0:1783135185.610271:0:19560:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].5, 224 off9104 00000040:00080000:0.0:1783135185.611506:0:19560:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].6, 80 off9184 00000040:00080000:0.0:1783135185.611583:0:19560:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].7, 224 off9408 00000040:00080000:0.0:1783135185.611618:0:19560:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].8, 224 off9632 00000040:00080000:0.0:1783135185.611781:0:19560:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].9, 120 off9752 00000100:00100000:0.0:1783135185.611840:0:19560:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9fe8fd500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:06a7653e-5f5a-4acc-ba93-0eff19f145f0:19560:1869752384468224:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1783135185.611939:0:19560:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135185.612073:0:19560:0:(client.c:2701:ptlrpc_set_wait()) set ffff9fe9e9b206c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783135185.621550:0:18246:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384468224 00000100:00100000:1.0:1783135185.621566:0:18246:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384468224 00000100:00100000:1.0:1783135185.621698:0:18246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1783135185.621709:0:18246:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9c8e48050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:06a7653e-5f5a-4acc-ba93-0eff19f145f0+17:19560:x1869752384468224:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1783135185.621995:0:18246:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9c8e48050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:06a7653e-5f5a-4acc-ba93-0eff19f145f0+17:19560:x1869752384468224:12345-0@lo:502:mount.lustre.0 Request processed in 288us (10067us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135185.622003:0:18246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1783135185.622157:0:19560:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9fe8fd500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:06a7653e-5f5a-4acc-ba93-0eff19f145f0:19560:1869752384468224:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1783135185.622385:0:19560:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].10, 224 off9976 00000040:00080000:2.0:1783135185.622411:0:19560:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 10 count 11 00000020:01000000:0.0:1783135185.639351:0:19561:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1783135185.639369:0:19561:0:(obd_mount.c:952:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:0.0:1783135185.639379:0:19561:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783135185.639382:0:19561:0:(obd_config.c:1561:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:0.0:1783135185.639399:0:19561:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1783135185.639427:0:19561:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff9fe8c57c3380) 00000020:00000080:2.0:1783135185.639560:0:19561:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type obdfilter with refcount 2 00000020:00000080:2.0:1783135185.639572:0:19561:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1783135185.639679:0:19561:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9fea01d7a000 from lustre-OST0001, refs=2 00080000:01000000:2.0:1783135185.639689:0:19561:0:(osd_handler.c:1569:osd_obd_connect()) connect #1 00000020:00000080:2.0:1783135185.639697:0:19561:0:(genops.c:1406:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xd6c4b8f0586802ed 00010000:00010000:3.0:1783135185.648822:0:19561:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:00000004:3.0:1783135185.649607:0:19561:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 3, last_transno is 8589934601 00080000:10000000:3.0:1783135185.666668:0:19561:0:(osd_index.c:2102:osd_index_try()) lustre-OST0001: index object [0x200000003:0xc:0x0] (8/8/4) registered 00000020:00000080:3.0:1783135185.675455:0:19561:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:3.0:1783135185.675474:0:19561:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1783135185.675485:0:19561:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783135185.675488:0:19561:0:(obd_config.c:1561:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:3.0:1783135185.675503:0:19561:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1783135185.675509:0:19561:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783135185.675512:0:19561:0:(obd_config.c:1561:class_process_config()) marker 20 (0x1) lustre sys.timeout 00000020:00000080:3.0:1783135185.675516:0:19561:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1783135185.675518:0:19561:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1783135185.675522:0:19561:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1783135185.675525:0:19561:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783135185.675526:0:19561:0:(obd_config.c:1561:class_process_config()) marker 20 (0x2) lustre sys.timeout 00000020:01000000:3.0:1783135185.675529:0:19561:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1783135185.675532:0:19561:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783135185.675533:0:19561:0:(obd_config.c:1561:class_process_config()) marker 24 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1783135185.675538:0:19561:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000020:01000000:3.0:1783135185.675878:0:19561:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1783135185.675884:0:19561:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783135185.675887:0:19561:0:(obd_config.c:1561:class_process_config()) marker 24 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1783135185.675893:0:19561:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 11 count 11 00000020:01000000:3.0:1783135185.676036:0:19560:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-10 (rc=0) 10000000:01000000:3.0:1783135185.676071:0:19560:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.201.141@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:3.0:1783135185.676095:0:19560:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.141@tcp lock: ffff9fe9c148b400/0xd6c4b8f0586802d8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xd6c4b8f0586802df expref: -99 pid: 19560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135185.676111:0:19560:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.141@tcp lock: ffff9fe9c148b400/0xd6c4b8f0586802d8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xd6c4b8f0586802df expref: -99 pid: 19560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783135185.676121:0:19560:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff9fea01d7a000 from 1 10000000:01000000:3.0:1783135185.676126:0:19560:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1783135185.676184:0:19560:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.141@tcp lock: ffff9fe9c148b800/0xd6c4b8f0586802f4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135185.676195:0:19560:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.141@tcp lock: ffff9fe9c148b800/0xd6c4b8f0586802f4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135185.676209:0:19560:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.141@tcp lock: ffff9fe9c148b800/0xd6c4b8f0586802f4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783135185.676255:0:19560:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9fe90dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:06a7653e-5f5a-4acc-ba93-0eff19f145f0:19560:1869752384468352:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1783135185.676381:0:19560:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135185.676434:0:19560:0:(client.c:2701:ptlrpc_set_wait()) set ffff9fe9cbbbc600 going to sleep for 11 seconds 00000100:00100000:3.0:1783135185.677532:0:18245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384468352 00000100:00100000:3.0:1783135185.677546:0:18245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384468352 00000100:00100000:3.0:1783135185.677642:0:18245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1783135185.677655:0:18245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9c8e4b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:06a7653e-5f5a-4acc-ba93-0eff19f145f0+17:19560:x1869752384468352:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1783135185.677676:0:18245:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783135185.677696:0:18245:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fe9c148ba00/0xd6c4b8f0586802fb lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xd6c4b8f0586802f4 expref: -99 pid: 18245 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135185.677732:0:18245:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fe9c148ba00/0xd6c4b8f0586802fb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd6c4b8f0586802f4 expref: 18 pid: 18245 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135185.677745:0:18245:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fe9c148ba00/0xd6c4b8f0586802fb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd6c4b8f0586802f4 expref: 18 pid: 18245 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135185.677756:0:18245:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fe9c148ba00, rc 0) 00000100:00100000:3.0:1783135185.677843:0:18245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9c8e4b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:06a7653e-5f5a-4acc-ba93-0eff19f145f0+18:19560:x1869752384468352:12345-0@lo:101:mount.lustre.0 Request processed in 191us (1463us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135185.677851:0:18245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1783135185.677936:0:19560:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9fe90dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:06a7653e-5f5a-4acc-ba93-0eff19f145f0:19560:1869752384468352:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1783135185.677958:0:19560:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.141@tcp lock: ffff9fe9c148b800/0xd6c4b8f0586802f4 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd6c4b8f0586802fb expref: -99 pid: 19560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135185.677979:0:19560:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.141@tcp lock: ffff9fe9c148b800/0xd6c4b8f0586802f4 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xd6c4b8f0586802fb expref: -99 pid: 19560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1783135185.679092:0:19560:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 10 00000040:00080000:2.0:1783135185.679587:0:19560:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1783135185.679839:0:19560:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].1, 224 off8416 00000040:00080000:2.0:1783135185.679908:0:19560:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].2, 112 off8528 00000040:00080000:2.0:1783135185.679967:0:19560:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].3, 224 off8752 00000040:00080000:2.0:1783135185.680027:0:19560:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].4, 224 off8976 00000040:00080000:2.0:1783135185.680067:0:19560:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].5, 112 off9088 00000040:00080000:2.0:1783135185.680119:0:19560:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].6, 224 off9312 00000040:00080000:2.0:1783135185.680156:0:19560:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].7, 224 off9536 00000040:00080000:2.0:1783135185.680197:0:19560:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].8, 128 off9664 00000040:00080000:2.0:1783135185.680268:0:19560:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].9, 224 off9888 00000040:00080000:2.0:1783135185.680276:0:19560:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 9 count 10 00000100:00100000:2.0:1783135185.680402:0:19560:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9f6fe6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:06a7653e-5f5a-4acc-ba93-0eff19f145f0:19560:1869752384468480:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1783135185.680473:0:19560:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135185.680527:0:19560:0:(client.c:2701:ptlrpc_set_wait()) set ffff9fe9e0328780 going to sleep for 11 seconds 00000100:00100000:0.0:1783135185.680557:0:18246:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384468480 00000100:00100000:0.0:1783135185.680574:0:18246:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384468480 00000100:00100000:0.0:1783135185.680668:0:18246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1783135185.680679:0:18246:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9c8e4a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:06a7653e-5f5a-4acc-ba93-0eff19f145f0+18:19560:x1869752384468480:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1783135185.681240:0:18246:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9c8e4a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:06a7653e-5f5a-4acc-ba93-0eff19f145f0+18:19560:x1869752384468480:12345-0@lo:501:mount.lustre.0 Request processed in 561us (764us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135185.681248:0:18246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1783135185.682743:0:19560:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9f6fe6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:06a7653e-5f5a-4acc-ba93-0eff19f145f0:19560:1869752384468480:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1783135185.682804:0:19560:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9f6fe6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:06a7653e-5f5a-4acc-ba93-0eff19f145f0:19560:1869752384468608:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1783135185.682883:0:19560:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135185.682922:0:19560:0:(client.c:2701:ptlrpc_set_wait()) set ffff9fe9e0328780 going to sleep for 11 seconds 00000100:00100000:0.0:1783135185.683188:0:18247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384468608 00000100:00100000:0.0:1783135185.683217:0:18247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384468608 00000100:00100000:0.0:1783135185.684069:0:18247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1783135185.684087:0:18247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe8c6df7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:06a7653e-5f5a-4acc-ba93-0eff19f145f0+18:19560:x1869752384468608:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1783135185.684641:0:18247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe8c6df7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:06a7653e-5f5a-4acc-ba93-0eff19f145f0+18:19560:x1869752384468608:12345-0@lo:503:mount.lustre.0 Request processed in 557us (1755us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135185.684652:0:18247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1783135185.686456:0:19560:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9f6fe6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:06a7653e-5f5a-4acc-ba93-0eff19f145f0:19560:1869752384468608:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1783135185.687077:0:19560:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1783135185.687159:0:19560:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9f6fe6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:06a7653e-5f5a-4acc-ba93-0eff19f145f0:19560:1869752384468736:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1783135185.687233:0:19560:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135185.693126:0:18245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384468736 00000100:00100000:3.0:1783135185.693147:0:18245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384468736 00000100:00100000:3.0:1783135185.693237:0:18245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1783135185.693250:0:18245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe8c6df5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:06a7653e-5f5a-4acc-ba93-0eff19f145f0+18:19560:x1869752384468736:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1783135185.693884:0:18245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe8c6df5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:06a7653e-5f5a-4acc-ba93-0eff19f145f0+18:19560:x1869752384468736:12345-0@lo:502:mount.lustre.0 Request processed in 634us (6649us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135185.693895:0:18245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1783135185.696424:0:19560:0:(client.c:2701:ptlrpc_set_wait()) set ffff9fe9e0328780 going to sleep for 11 seconds 00000100:00100000:2.0:1783135185.696477:0:19560:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9f6fe6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:06a7653e-5f5a-4acc-ba93-0eff19f145f0:19560:1869752384468736:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1783135185.698085:0:19560:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].1, 224 off8416 00000040:00080000:2.0:1783135185.698170:0:19560:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].2, 112 off8528 00000040:00080000:2.0:1783135185.698220:0:19560:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].3, 224 off8752 00000040:00080000:2.0:1783135185.699609:0:19560:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].4, 224 off8976 00000040:00080000:2.0:1783135185.699657:0:19560:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].5, 112 off9088 00000040:00080000:2.0:1783135185.700588:0:19560:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].6, 224 off9312 00000040:00080000:2.0:1783135185.700634:0:19560:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].7, 224 off9536 00000040:00080000:2.0:1783135185.701398:0:19560:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].8, 128 off9664 00000100:00100000:2.0:1783135185.701461:0:19560:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9f6fe6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:06a7653e-5f5a-4acc-ba93-0eff19f145f0:19560:1869752384468864:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1783135185.701550:0:19560:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135185.701660:0:19560:0:(client.c:2701:ptlrpc_set_wait()) set ffff9fe9e0328780 going to sleep for 11 seconds 00000100:00100000:0.0:1783135185.708723:0:18245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384468864 00000100:00100000:0.0:1783135185.708740:0:18245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384468864 00000100:00100000:0.0:1783135185.708831:0:18245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1783135185.708842:0:18245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fe69c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:06a7653e-5f5a-4acc-ba93-0eff19f145f0+18:19560:x1869752384468864:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1783135185.709169:0:18245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fe69c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:06a7653e-5f5a-4acc-ba93-0eff19f145f0+18:19560:x1869752384468864:12345-0@lo:502:mount.lustre.0 Request processed in 327us (7620us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135185.709178:0:18245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1783135185.709454:0:19560:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9f6fe6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:06a7653e-5f5a-4acc-ba93-0eff19f145f0:19560:1869752384468864:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1783135185.709622:0:19560:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].9, 224 off9888 00000040:00080000:2.0:1783135185.709638:0:19560:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:2.0:1783135185.711252:0:19565:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1783135185.711267:0:19565:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783135185.711270:0:19565:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1783135185.711310:0:19565:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9fea01d7a000 00000020:00000080:2.0:1783135185.711314:0:19565:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1783135185.711323:0:19565:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1783135185.711326:0:19565:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783135185.711327:0:19565:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:2.0:1783135185.711330:0:19565:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1783135185.711334:0:19565:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783135185.711335:0:19565:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1783135185.711338:0:19565:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9fea01d7a000 00000020:00000080:2.0:1783135185.711340:0:19565:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1783135185.711395:0:19565:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1783135185.711399:0:19565:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783135185.711400:0:19565:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:2.0:1783135185.711403:0:19565:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1783135185.711415:0:19565:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783135185.711416:0:19565:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1783135185.711420:0:19565:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9fea01d7a000 00000020:00000080:2.0:1783135185.711422:0:19565:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1783135185.711461:0:19565:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1783135185.711465:0:19565:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783135185.711466:0:19565:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:2.0:1783135185.711469:0:19565:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0xe:0x0] index 10 count 10 00000020:01000000:1.0:1783135185.711841:0:19560:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:1.0:1783135185.711888:0:19560:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.201.141@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1783135185.711916:0:19560:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.141@tcp lock: ffff9fe9c148b800/0xd6c4b8f0586802f4 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd6c4b8f0586802fb expref: -99 pid: 19560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135185.711928:0:19560:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.141@tcp lock: ffff9fe9c148b800/0xd6c4b8f0586802f4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd6c4b8f0586802fb expref: -99 pid: 19560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783135185.712005:0:19560:0:(mgc_request.c:1945:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1783135185.712009:0:19560:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9fea01d7a000 10000000:01000000:1.0:1783135185.712012:0:19560:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9fea01d7a000 10000000:01000000:1.0:1783135185.712016:0:19560:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1783135185.712021:0:19560:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff9fea01d7a000 from 1 10000000:01000000:1.0:1783135185.712024:0:19560:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1783135185.712060:0:19560:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.141@tcp lock: ffff9fe8c5551400/0xd6c4b8f058680302 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135185.712068:0:19560:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.141@tcp lock: ffff9fe8c5551400/0xd6c4b8f058680302 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135185.712078:0:19560:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.141@tcp lock: ffff9fe8c5551400/0xd6c4b8f058680302 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783135185.712107:0:19560:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe8c590ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:06a7653e-5f5a-4acc-ba93-0eff19f145f0:19560:1869752384468992:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1783135185.712179:0:19560:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135185.712226:0:19560:0:(client.c:2701:ptlrpc_set_wait()) set ffff9fe9e2d06840 going to sleep for 11 seconds 00000100:00100000:3.0:1783135185.713137:0:18246:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384468992 00000100:00100000:3.0:1783135185.713148:0:18246:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384468992 00000100:00100000:3.0:1783135185.713191:0:18246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1783135185.713200:0:18246:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fe69c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:06a7653e-5f5a-4acc-ba93-0eff19f145f0+18:19560:x1869752384468992:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1783135185.713215:0:18246:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783135185.713230:0:18246:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fe9c148ac00/0xd6c4b8f058680309 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xd6c4b8f058680302 expref: -99 pid: 18246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135185.713257:0:18246:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fe9c148ac00/0xd6c4b8f058680309 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd6c4b8f058680302 expref: 19 pid: 18246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135185.713268:0:18246:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fe9c148ac00/0xd6c4b8f058680309 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd6c4b8f058680302 expref: 19 pid: 18246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135185.713293:0:18246:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fe9c148ac00, rc 0) 00000100:00100000:3.0:1783135185.713360:0:18246:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fe69c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:06a7653e-5f5a-4acc-ba93-0eff19f145f0+19:19560:x1869752384468992:12345-0@lo:101:mount.lustre.0 Request processed in 160us (1180us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135185.713367:0:18246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1783135185.713426:0:19560:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe8c590ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:06a7653e-5f5a-4acc-ba93-0eff19f145f0:19560:1869752384468992:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1783135185.713450:0:19560:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.141@tcp lock: ffff9fe8c5551400/0xd6c4b8f058680302 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xd6c4b8f058680309 expref: -99 pid: 19560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135185.713459:0:19560:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.141@tcp lock: ffff9fe8c5551400/0xd6c4b8f058680302 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xd6c4b8f058680309 expref: -99 pid: 19560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1783135185.714082:0:19560:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00000040:00080000:3.0:1783135185.714437:0:19560:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1783135185.714674:0:19560:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].1, 224 off8416 00000040:00080000:3.0:1783135185.714719:0:19560:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].2, 120 off8536 00000040:00080000:3.0:1783135185.714753:0:19560:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].3, 168 off8704 00000040:00080000:3.0:1783135185.714800:0:19560:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].4, 224 off8928 00000040:00080000:3.0:1783135185.714838:0:19560:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].5, 224 off9152 00000040:00080000:3.0:1783135185.714885:0:19560:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].6, 120 off9272 00000040:00080000:3.0:1783135185.714920:0:19560:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].7, 168 off9440 00000040:00080000:3.0:1783135185.714952:0:19560:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].8, 224 off9664 00000040:00080000:3.0:1783135185.715013:0:19560:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].9, 224 off9888 00000040:00080000:3.0:1783135185.715049:0:19560:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].10, 120 off10008 00000040:00080000:3.0:1783135185.715083:0:19560:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].11, 224 off10232 00000040:00080000:3.0:1783135185.715128:0:19560:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].12, 224 off10456 00000040:00080000:3.0:1783135185.715180:0:19560:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].13, 88 off10544 00000040:00080000:3.0:1783135185.715215:0:19560:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].14, 128 off10672 00000040:00080000:3.0:1783135185.715263:0:19560:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].15, 144 off10816 00000040:00080000:3.0:1783135185.715330:0:19560:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].16, 160 off10976 00000040:00080000:3.0:1783135185.715365:0:19560:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].17, 224 off11200 00000040:00080000:3.0:1783135185.715419:0:19560:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].18, 224 off11424 00000040:00080000:3.0:1783135185.715455:0:19560:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].19, 80 off11504 00000040:00080000:3.0:1783135185.715486:0:19560:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].20, 224 off11728 00000040:00080000:3.0:1783135185.715534:0:19560:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].21, 224 off11952 00000040:00080000:3.0:1783135185.715570:0:19560:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].22, 88 off12040 00000040:00080000:3.0:1783135185.715606:0:19560:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].23, 128 off12168 00000040:00080000:3.0:1783135185.715658:0:19560:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].24, 144 off12312 00000040:00080000:3.0:1783135185.715707:0:19560:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].25, 128 off12440 00000040:00080000:3.0:1783135185.715744:0:19560:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].26, 224 off12664 00000040:00080000:3.0:1783135185.715795:0:19560:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].27, 224 off12888 00000040:00080000:3.0:1783135185.715831:0:19560:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].28, 80 off12968 00000040:00080000:3.0:1783135185.715882:0:19560:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].29, 224 off13192 00000040:00080000:3.0:1783135185.715928:0:19560:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].30, 224 off13416 00000040:00080000:3.0:1783135185.715963:0:19560:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].31, 88 off13504 00000040:00080000:3.0:1783135185.722566:0:19560:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].32, 128 off13632 00000040:00080000:3.0:1783135185.722617:0:19560:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].33, 144 off13776 00000040:00080000:3.0:1783135185.722780:0:19560:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].34, 128 off13904 00000040:00080000:3.0:1783135185.722823:0:19560:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].35, 224 off14128 00000040:00080000:3.0:1783135185.722878:0:19560:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].36, 224 off14352 00000040:00080000:3.0:1783135185.722916:0:19560:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].37, 80 off14432 00000040:00080000:3.0:1783135185.722954:0:19560:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].38, 224 off14656 00000040:00080000:3.0:1783135185.723022:0:19560:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].39, 224 off14880 00000040:00080000:3.0:1783135185.723058:0:19560:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].40, 120 off15000 00000040:00080000:3.0:1783135185.723157:0:19560:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].41, 224 off15224 00000040:00080000:3.0:1783135185.723164:0:19560:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 41 count 42 00000100:00100000:3.0:1783135185.723307:0:19560:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9fe90dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:06a7653e-5f5a-4acc-ba93-0eff19f145f0:19560:1869752384469120:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1783135185.724580:0:19560:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135185.724631:0:18247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384469120 00000100:00100000:3.0:1783135185.724638:0:18247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384469120 00000100:00100000:3.0:1783135185.725469:0:18247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1783135185.725483:0:18247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fe69ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:06a7653e-5f5a-4acc-ba93-0eff19f145f0+19:19560:x1869752384469120:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1783135185.725978:0:18247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fe69ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:06a7653e-5f5a-4acc-ba93-0eff19f145f0+19:19560:x1869752384469120:12345-0@lo:501:mount.lustre.0 Request processed in 488us (1389us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135185.725987:0:18247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1783135185.726053:0:19560:0:(client.c:2701:ptlrpc_set_wait()) set ffff9fe9cbbbce40 going to sleep for 11 seconds 00000100:00100000:3.0:1783135185.726077:0:19560:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9fe90dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:06a7653e-5f5a-4acc-ba93-0eff19f145f0:19560:1869752384469120:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1783135185.726777:0:19560:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9fe90dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:06a7653e-5f5a-4acc-ba93-0eff19f145f0:19560:1869752384469248:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1783135185.726828:0:19560:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135185.726859:0:18245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384469248 00000100:00100000:3.0:1783135185.726865:0:18245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384469248 00000100:00100000:3.0:1783135185.726893:0:18245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1783135185.726899:0:18245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fe69fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:06a7653e-5f5a-4acc-ba93-0eff19f145f0+19:19560:x1869752384469248:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1783135185.727133:0:18245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fe69fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:06a7653e-5f5a-4acc-ba93-0eff19f145f0+19:19560:x1869752384469248:12345-0@lo:503:mount.lustre.0 Request processed in 233us (305us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135185.727140:0:18245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1783135185.727180:0:19560:0:(client.c:2701:ptlrpc_set_wait()) set ffff9fe9cbbbce40 going to sleep for 11 seconds 00000100:00100000:3.0:1783135185.727194:0:19560:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9fe90dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:06a7653e-5f5a-4acc-ba93-0eff19f145f0:19560:1869752384469248:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1783135185.731411:0:19560:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1783135185.731501:0:19560:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9fe90dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:06a7653e-5f5a-4acc-ba93-0eff19f145f0:19560:1869752384469376:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1783135185.731583:0:19560:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135185.731624:0:18246:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384469376 00000100:00100000:3.0:1783135185.731630:0:18246:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384469376 00000100:00100000:3.0:1783135185.732491:0:18246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1783135185.732504:0:18246:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fe69d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:06a7653e-5f5a-4acc-ba93-0eff19f145f0+19:19560:x1869752384469376:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1783135185.732890:0:18246:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fe69d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:06a7653e-5f5a-4acc-ba93-0eff19f145f0+19:19560:x1869752384469376:12345-0@lo:502:mount.lustre.0 Request processed in 388us (1305us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135185.732898:0:18246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1783135185.732957:0:19560:0:(client.c:2701:ptlrpc_set_wait()) set ffff9fe9cbbbce40 going to sleep for 11 seconds 00000100:00100000:3.0:1783135185.732990:0:19560:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9fe90dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:06a7653e-5f5a-4acc-ba93-0eff19f145f0:19560:1869752384469376:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1783135185.735458:0:19560:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].1, 224 off8416 00000040:00080000:3.0:1783135185.735548:0:19560:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].2, 120 off8536 00000040:00080000:3.0:1783135185.735598:0:19560:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].3, 168 off8704 00000040:00080000:3.0:1783135185.735650:0:19560:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].4, 224 off8928 00000040:00080000:3.0:1783135185.736218:0:19560:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].5, 224 off9152 00000040:00080000:3.0:1783135185.736275:0:19560:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].6, 120 off9272 00000040:00080000:3.0:1783135185.736339:0:19560:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].7, 168 off9440 00000040:00080000:3.0:1783135185.736659:0:19560:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].8, 224 off9664 00000040:00080000:3.0:1783135185.736786:0:19560:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].9, 224 off9888 00000040:00080000:3.0:1783135185.736822:0:19560:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].10, 120 off10008 00000040:00080000:3.0:1783135185.736852:0:19560:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].11, 224 off10232 00000040:00080000:3.0:1783135185.736896:0:19560:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].12, 224 off10456 00000040:00080000:3.0:1783135185.736931:0:19560:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].13, 88 off10544 00000040:00080000:3.0:1783135185.736965:0:19560:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].14, 128 off10672 00000040:00080000:3.0:1783135185.737029:0:19560:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].15, 144 off10816 00000040:00080000:3.0:1783135185.737065:0:19560:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].16, 160 off10976 00000040:00080000:3.0:1783135185.737135:0:19560:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].17, 224 off11200 00000040:00080000:3.0:1783135185.737187:0:19560:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].18, 224 off11424 00000040:00080000:3.0:1783135185.737223:0:19560:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].19, 80 off11504 00000040:00080000:3.0:1783135185.737257:0:19560:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].20, 224 off11728 00000040:00080000:3.0:1783135185.737329:0:19560:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].21, 224 off11952 00000040:00080000:3.0:1783135185.737935:0:19560:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].22, 88 off12040 00000040:00080000:3.0:1783135185.737977:0:19560:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].23, 128 off12168 00000040:00080000:3.0:1783135185.738026:0:19560:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].24, 144 off12312 00000040:00080000:3.0:1783135185.738058:0:19560:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].25, 128 off12440 00000040:00080000:3.0:1783135185.738091:0:19560:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].26, 224 off12664 00000040:00080000:3.0:1783135185.738134:0:19560:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].27, 224 off12888 00000040:00080000:3.0:1783135185.738169:0:19560:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].28, 80 off12968 00000040:00080000:3.0:1783135185.738203:0:19560:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].29, 224 off13192 00000040:00080000:3.0:1783135185.738254:0:19560:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].30, 224 off13416 00000040:00080000:3.0:1783135185.738311:0:19560:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].31, 88 off13504 00000040:00080000:3.0:1783135185.738470:0:19560:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].32, 128 off13632 00000040:00080000:3.0:1783135185.738524:0:19560:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].33, 144 off13776 00000040:00080000:3.0:1783135185.738574:0:19560:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].34, 128 off13904 00000040:00080000:3.0:1783135185.738612:0:19560:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].35, 224 off14128 00000040:00080000:3.0:1783135185.738739:0:19560:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].36, 224 off14352 00000040:00080000:3.0:1783135185.738782:0:19560:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].37, 80 off14432 00000040:00080000:3.0:1783135185.738817:0:19560:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].38, 224 off14656 00000040:00080000:3.0:1783135185.738864:0:19560:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].39, 224 off14880 00000040:00080000:3.0:1783135185.738901:0:19560:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].40, 120 off15000 00000100:00100000:3.0:1783135185.738953:0:19560:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9fe90dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:06a7653e-5f5a-4acc-ba93-0eff19f145f0:19560:1869752384469504:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1783135185.739241:0:19560:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135185.739334:0:19560:0:(client.c:2701:ptlrpc_set_wait()) set ffff9fe9cbbbce40 going to sleep for 11 seconds 00000100:00100000:2.0:1783135185.743596:0:18247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384469504 00000100:00100000:2.0:1783135185.743612:0:18247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384469504 00000100:00100000:2.0:1783135185.743747:0:18247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1783135185.743759:0:18247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fe69dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:06a7653e-5f5a-4acc-ba93-0eff19f145f0+19:19560:x1869752384469504:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1783135185.744088:0:18247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fe69dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:06a7653e-5f5a-4acc-ba93-0eff19f145f0+19:19560:x1869752384469504:12345-0@lo:502:mount.lustre.0 Request processed in 331us (4848us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135185.744097:0:18247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1783135185.744791:0:19560:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9fe90dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:06a7653e-5f5a-4acc-ba93-0eff19f145f0:19560:1869752384469504:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1783135185.744910:0:19560:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].41, 224 off15224 00000040:00080000:3.0:1783135185.744925:0:19560:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:3.0:1783135185.747416:0:19570:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:3.0:1783135185.747433:0:19570:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff9fe8c5628000) 00000020:00000080:3.0:1783135185.747457:0:19570:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type lwp with refcount 2 00000020:01000004:3.0:1783135185.747642:0:19570:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9fea01d7a000 from lustre-OST0001, refs=3 00000020:01000004:3.0:1783135185.747646:0:19570:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9fea01d7a000 from lustre-OST0001, refs=3 00000020:01000004:3.0:1783135185.747649:0:19570:0:(obd_mount.c:701:lustre_put_lsi()) put ffff9fea01d7a000 3 00010000:00080000:3.0:1783135185.747789:0:19570:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9fe8c59ca800@lustre-MDT0000-lwp-OST0001: add connection 192.168.201.141@tcp at head 00010000:00010000:3.0:1783135185.753681:0:19570:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-5 is initialized 00000020:00000080:3.0:1783135185.753792:0:19570:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:3.0:1783135185.753835:0:19570:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1783135185.753851:0:19570:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0xd6c4b8f058680317 00000100:00080000:3.0:1783135185.753867:0:19570:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1783135185.753875:0:19570:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9fe8c59ca800 using connection 192.168.201.141@tcp/0@lo 00000100:00100000:3.0:1783135185.753921:0:19570:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9fe9fe90dc00 x1869752384469632/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1783135185.753956:0:19570:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000040:00080000:3.0:1783135185.754198:0:19570:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x10:0x0] index 42 count 42 00000100:00100000:0.0:1783135185.754241:0:3285:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9fe90dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3285:1869752384469632:0@lo:38:llog_process_th.0 00000100:00080000:3.0:1783135185.754341:0:8:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00100000:0.0:1783135185.754344:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1783135185.754345:0:8:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1783135185.754348:0:8:0:(import.c:65:import_set_state_nolock()) ffff9fe9f8a5c000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1783135185.754352:0:8:0:(import.c:512:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 464 00000100:00080000:3.0:1783135185.754355:0:8:0:(import.c:591:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1783135185.754359:0:8:0:(import.c:626:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9fe9f8a5c000 using connection 192.168.201.141@tcp/0@lo 00000100:00100000:3.0:1783135185.754371:0:8:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9fe9fe90ed80 x1869752384469888/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1783135185.754384:0:3285:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9fe90ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3285:1869752384469888:0@lo:8:kworker.0 00000100:00100000:0.0:1783135185.754409:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135185.754420:0:3286:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9fe90e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1869752384469760:0@lo:400:kworker.0 00000100:00100000:0.0:1783135185.754441:0:18254:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384469632 00000100:00100000:3.0:1783135185.754447:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135185.754448:0:18254:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384469632 00000100:00100000:3.0:1783135185.754466:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1783135185.754471:0:3286:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9fe90ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3286:1869752384470016:0@lo:400:kworker.0 00000100:00100000:0.0:1783135185.754479:0:18254:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1783135185.754486:0:18254:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fe8fd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3285:x1869752384469632:12345-0@lo:38:llog_process_th.0 00000100:00100000:3.0:1783135185.754493:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:0.0:1783135185.754511:0:18254:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 468 last 0 00000100:00100000:3.0:1783135185.754519:0:3288:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9fe90c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3288:1869752384470144:0@lo:400:kworker.0 00000100:00100000:3.0:1783135185.754538:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00000080:0.0:1783135185.754545:0:18254:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0xd6c4b8f05868031e 00000004:00100000:0.0:1783135185.754564:0:18254:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00100000:3.0:1783135185.754566:0:19201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384469888 00000100:00100000:3.0:1783135185.754569:0:19201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384469888 00000100:00100000:3.0:1783135185.754584:0:19201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384469760 00000100:00100000:3.0:1783135185.754586:0:19201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384469760 00000100:00080000:0.0:1783135185.754595:0:18254:0:(import.c:65:import_set_state_nolock()) ffff9fe8c451c800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1783135185.754617:0:19201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1783135185.754623:0:19201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fe90f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3286:x1869752384469760:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783135185.754643:0:18254:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fe8fd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3285:x1869752384469632:12345-0@lo:38:llog_process_th.0 Request processed in 156us (299us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135185.754655:0:19201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fe90f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3286:x1869752384469760:12345-0@lo:400:kworker.0 Request processed in 33us (208us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135185.754657:0:18254:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1783135185.754661:0:19201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1783135185.754669:0:18254:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384470016 00000100:00100000:3.0:1783135185.754670:0:19201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1783135185.754672:0:18254:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384470016 00000100:00100000:3.0:1783135185.754674:0:19201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fe8fc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3285:x1869752384469888:12345-0@lo:8:kworker.0 00000100:00100000:0.0:1783135185.754686:0:18254:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384470144 00000100:00100000:0.0:1783135185.754688:0:18254:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384470144 00000100:00100000:0.0:1783135185.754702:0:18254:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1783135185.754706:0:18254:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fe90d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3286:x1869752384470016:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783135185.754709:0:19201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fe8fc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3285:x1869752384469888:12345-0@lo:8:kworker.0 Request processed in 34us (300us total) trans 0 rc -11/-11 00000100:00100000:3.0:1783135185.754715:0:19201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1783135185.754732:0:18254:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fe90d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3286:x1869752384470016:12345-0@lo:400:kworker.0 Request processed in 25us (237us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135185.754734:0:18252:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:0.0:1783135185.754738:0:18254:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1783135185.754741:0:18252:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:0.0:1783135185.754747:0:18254:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1783135185.754753:0:18254:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fe90d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3288:x1869752384470144:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1783135185.754756:0:18248:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1783135185.754761:0:18248:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1783135185.754781:0:18254:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fe90d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3288:x1869752384470144:12345-0@lo:400:kworker.0 Request processed in 28us (241us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135185.754787:0:18254:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1783135185.754824:0:3285:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00010000:00080000:3.0:1783135185.754829:0:3288:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9fe9fe90c000 x1869752384470144/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783135201 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1783135185.754831:0:3285:0:(import.c:65:import_set_state_nolock()) ffff9fe9f8a5c000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1783135185.754835:0:3285:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1783135185.754838:0:3285:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9fe90ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3285:1869752384469888:0@lo:8:kworker.0 00000100:00100000:3.0:1783135185.754839:0:3288:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9fe90c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3288:1869752384470144:0@lo:400:kworker.0 00010000:00080000:0.0:1783135185.754849:0:3285:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9fe9fe90dc00 x1869752384469632/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1783135195 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783135185.754857:0:3285:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00010000:00080000:3.0:1783135185.754860:0:3286:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9fe9fe90ce00 x1869752384470016/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783135201 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1783135185.754862:0:3285:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 3 00000100:00100000:3.0:1783135185.754867:0:3286:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9fe90ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3286:1869752384470016:0@lo:400:kworker.0 00000100:00080000:0.0:1783135185.754868:0:3285:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1783135185.754872:0:3285:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00100000:3.0:1783135185.754877:0:3286:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9fe90e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1869752384469760:0@lo:400:kworker.0 00000100:00080000:0.0:1783135185.754879:0:3285:0:(import.c:65:import_set_state_nolock()) ffff9fe8c59ca800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1783135185.754884:0:3285:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9fe90dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3285:1869752384469632:0@lo:38:llog_process_th.0 00000020:01000000:2.0:1783135185.755035:0:19560:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:2.0:1783135185.755083:0:19560:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.201.141@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1783135185.755105:0:19560:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.141@tcp lock: ffff9fe8c5551400/0xd6c4b8f058680302 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xd6c4b8f058680309 expref: -99 pid: 19560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135185.755118:0:19560:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.141@tcp lock: ffff9fe8c5551400/0xd6c4b8f058680302 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xd6c4b8f058680309 expref: -99 pid: 19560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1783135185.755178:0:19560:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1783135185.755180:0:19560:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1783135185.755181:0:19560:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1783135185.755182:0:19560:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1783135185.755183:0:19560:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1783135185.755185:0:19560:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1783135185.755186:0:19560:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1783135185.755188:0:19560:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1783135185.755189:0:19560:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1783135185.755197:0:19560:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020002 00000020:01000004:2.0:1783135185.755200:0:19560:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1783135185.755201:0:19560:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1783135185.755201:0:19560:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1783135185.755202:0:19560:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1783135185.755203:0:19560:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1783135185.755204:0:19560:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1783135185.755204:0:19560:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1783135185.755205:0:19560:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1783135185.755206:0:19560:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1783135185.755221:0:19560:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1783135185.755232:0:19560:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9f6fe6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:06a7653e-5f5a-4acc-ba93-0eff19f145f0:19560:1869752384470272:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1783135185.755269:0:19560:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135185.755303:0:19560:0:(client.c:2701:ptlrpc_set_wait()) set ffff9fe9e0328900 going to sleep for 11 seconds 00000100:00100000:3.0:1783135185.756551:0:18245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384470272 00000100:00100000:3.0:1783135185.756563:0:18245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384470272 00000100:00100000:3.0:1783135185.756626:0:18245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1783135185.756635:0:18245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fe69c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:06a7653e-5f5a-4acc-ba93-0eff19f145f0+19:19560:x1869752384470272:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1783135185.756727:0:18245:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:3.0:1783135185.756744:0:18245:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00010000:00010000:1.0:1783135185.859522:0:18241:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 20000000:01000000:2.0:1783135185.881365:0:18245:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1783135185.884417:0:18245:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:0.0:1783135185.884505:0:18268:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1783135185.884512:0:18268:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1783135185.884539:0:18268:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9fe9f68ac800/0xd6c4b8f058680325 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18268 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135185.884564:0:18268:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9fe9f68ad800/0xd6c4b8f0586801e3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd6c4b8f0586801dc expref: 19 pid: 18247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135185.884574:0:18268:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9fe9f68ac800/0xd6c4b8f058680325 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 18268 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135185.884617:0:18268:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9fe9f68ad800/0xd6c4b8f0586801e3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd6c4b8f0586801dc expref: 19 pid: 18247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135185.884636:0:18268:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9fe9f68ad800/0xd6c4b8f0586801e3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd6c4b8f0586801dc expref: 19 pid: 18247 timeout: 568 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783135185.884653:0:18268:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9fe8fe300 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:18268:1869752384470400:0@lo:104: 00000100:00100000:0.0:1783135185.884726:0:18268:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135185.884832:0:18268:0:(client.c:2701:ptlrpc_set_wait()) set ffff9fe9ca2f3240 going to sleep for 11 seconds 00000100:00100000:2.0:1783135185.888992:0:18235:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384470400 00000100:00100000:2.0:1783135185.889015:0:18235:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384470400 00000100:00100000:2.0:1783135185.889145:0:18235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1783135185.889159:0:18235:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fe8ff100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:06a7653e-5f5a-4acc-ba93-0eff19f145f0+3:18268:x1869752384470400:12345-0@lo:104: 00010000:00010000:2.0:1783135185.889185:0:18235:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.141@tcp lock: ffff9fe9c0030400/0xd6c4b8f0586801dc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xd6c4b8f0586801e3 expref: -99 pid: 18249 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135185.889350:0:18235:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1783135185.889356:0:18235:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fe8ff100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:06a7653e-5f5a-4acc-ba93-0eff19f145f0+3:18268:x1869752384470400:12345-0@lo:104: Request processed in 202us (4630us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135185.889364:0:18235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1783135185.889452:0:18268:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9fe8fe300 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:18268:1869752384470400:0@lo:104: 00010000:00010000:0.0:1783135185.889489:0:18268:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9fe9f68ac800/0xd6c4b8f058680325 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 18268 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135185.892231:0:18240:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783135185.892248:0:18240:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.141@tcp lock: ffff9fe9c0030400/0xd6c4b8f0586801dc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xd6c4b8f0586801e3 expref: -99 pid: 18249 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135185.892260:0:18240:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe9c0030400 already unused, calling callback (ffffffffc1b40c20) 10000000:00010000:1.0:1783135185.892264:0:18240:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.141@tcp lock: ffff9fe9c0030400/0xd6c4b8f0586801dc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xd6c4b8f0586801e3 expref: -99 pid: 18249 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135185.892274:0:18240:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.141@tcp lock: ffff9fe9c0030400/0xd6c4b8f0586801dc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xd6c4b8f0586801e3 expref: -99 pid: 18249 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783135185.892311:0:18240:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.141@tcp lock: ffff9fe9c0030400/0xd6c4b8f0586801dc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xd6c4b8f0586801e3 expref: -99 pid: 18249 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783135185.892317:0:18240:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1783135185.892448:0:18240:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.141@tcp lock: ffff9fe9c0030400/0xd6c4b8f0586801dc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd6c4b8f0586801e3 expref: -99 pid: 18249 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135185.892455:0:18240:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1783135185.892477:0:18240:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.141@tcp lock: ffff9fe9c0030400/0xd6c4b8f0586801dc lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd6c4b8f0586801e3 expref: -99 pid: 18249 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135185.892485:0:18240:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.141@tcp lock: ffff9fe9c0030400/0xd6c4b8f0586801dc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd6c4b8f0586801e3 expref: -99 pid: 18249 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135185.892530:0:18240:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783135185.892532:0:18240:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783135185.892534:0:18240:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783135185.893885:0:3289:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe8c590ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:06a7653e-5f5a-4acc-ba93-0eff19f145f0:3289:1869752384470528:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1783135185.893962:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135185.894120:0:18238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384470528 00000100:00100000:0.0:1783135185.894128:0:18238:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384470528 00010000:00010000:0.0:1783135185.894162:0:18238:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9fe9f68ad800/0xd6c4b8f0586801e3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd6c4b8f0586801dc expref: 20 pid: 18247 timeout: 568 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783135185.894220:0:18238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1783135185.894231:0:18238:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fe90e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:06a7653e-5f5a-4acc-ba93-0eff19f145f0+20:3289:x1869752384470528:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1783135185.894246:0:18238:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783135185.894252:0:18238:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9fe9f68ad800/0xd6c4b8f0586801e3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd6c4b8f0586801dc expref: 20 pid: 18247 timeout: 568 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135185.894264:0:18238:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9fe9f68ad800/0xd6c4b8f0586801e3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd6c4b8f0586801dc expref: 20 pid: 18247 timeout: 568 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135185.894496:0:18238:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fe9f68ad800/0xd6c4b8f0586801e3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd6c4b8f0586801dc expref: 20 pid: 18247 timeout: 568 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135185.894514:0:18238:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9fe9f68ac800/0xd6c4b8f058680325 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 18268 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135185.894524:0:18238:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fe9f68ac800/0xd6c4b8f058680325 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 18268 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1783135185.894543:0:18238:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.010031876s 00010000:00010000:0.0:1783135185.894549:0:18238:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9fe9f68ac800/0xd6c4b8f058680325 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 18268 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135185.894557:0:18238:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9fe9f68ac800/0xd6c4b8f058680325 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 18268 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135185.894565:0:18238:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9fe9f68ac800/0xd6c4b8f058680325 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 18268 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135185.894572:0:18238:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9fe9f68ac800/0xd6c4b8f058680325 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 18268 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135185.894590:0:18238:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe9f68ac800 already unused, calling callback (ffffffffc1527ce0) 00010000:00010000:0.0:1783135185.894596:0:18238:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9fe9f68ac800/0xd6c4b8f058680325 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 18268 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135185.894605:0:18238:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9fe9f68ac800/0xd6c4b8f058680325 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 18268 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135185.894624:0:18238:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9fe9f68ac800/0xd6c4b8f058680325 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18268 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135185.894636:0:18238:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783135185.894700:0:18238:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fe90e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:06a7653e-5f5a-4acc-ba93-0eff19f145f0+19:3289:x1869752384470528:12345-0@lo:103:ldlm_bl.0 Request processed in 471us (737us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135185.894709:0:18238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:0.0:1783135185.894742:0:18268:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9fe9f68ac800/0xd6c4b8f058680325 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18268 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135185.894750:0:18268:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9fe9f68ac800/0xd6c4b8f058680325 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18268 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135185.894757:0:18268:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fe9f68ac800/0xd6c4b8f058680325 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18268 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783135185.895054:0:3289:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe8c590ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:06a7653e-5f5a-4acc-ba93-0eff19f145f0:3289:1869752384470528:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1783135185.905904:0:18245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fe69c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:06a7653e-5f5a-4acc-ba93-0eff19f145f0+18:19560:x1869752384470272:12345-0@lo:253:mount.lustre.0 Request processed in 149257us (150620us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135185.905944:0:18245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1783135185.906036:0:19560:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9f6fe6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:06a7653e-5f5a-4acc-ba93-0eff19f145f0:19560:1869752384470272:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1783135185.906055:0:19560:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:2.0:1783135185.906058:0:19560:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1783135185.906060:0:19560:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1783135185.906062:0:19560:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1783135185.906069:0:19560:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1783135185.906070:0:19560:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1783135185.906072:0:19560:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1783135185.906073:0:19560:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1783135185.906075:0:19560:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1783135185.906077:0:19560:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1783135185.906094:0:19560:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:2.0:1783135185.906609:0:19560:0:(osd_index.c:2102:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:2.0:1783135185.906784:0:19560:0:(osd_index.c:2102:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:2.0:1783135185.907158:0:19560:0:(osd_index.c:2102:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:2.0:1783135185.909639:0:19560:0:(osd_index.c:2102:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:3.0:1783135185.910128:0:19560:0:(osd_index.c:2102:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:3.0:1783135185.910534:0:19560:0:(osd_index.c:2102:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:3.0:1783135185.912505:0:19560:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 3, last_transno is 12884901888 00002000:00080000:2.0:1783135185.968694:0:19560:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:2.0:1783135185.968704:0:19560:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:2.0:1783135185.968742:0:19560:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1783135185.968810:0:19560:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.141@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1783135185.968823:0:19560:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=49 00000080:00000004:2.0:1783135185.968857:0:19560:0:(super25.c:187:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00010000:00010000:1.0:1783135186.884587:0:18241:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1783135187.269434:0:18249:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1783135187.269443:0:18249:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-mdtir-ffff9fe8c47e7000 from 11 10000000:01000000:3.0:1783135187.269448:0:18249:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1783135187.269512:0:18249:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.141@tcp lock: ffff9fe9c148b600/0xd6c4b8f05868032c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18249 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135187.269526:0:18249:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.141@tcp lock: ffff9fe9c148b600/0xd6c4b8f05868032c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18249 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135187.269538:0:18249:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.141@tcp lock: ffff9fe9c148b600/0xd6c4b8f05868032c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18249 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783135187.269566:0:18249:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9fe90ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:06a7653e-5f5a-4acc-ba93-0eff19f145f0:18249:1869752384470656:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1783135187.269640:0:18249:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135187.269744:0:18249:0:(client.c:2701:ptlrpc_set_wait()) set ffff9fe9e2f2b3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783135187.273456:0:18247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384470656 00000100:00100000:1.0:1783135187.273467:0:18247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384470656 00000100:00100000:1.0:1783135187.273561:0:18247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1783135187.273571:0:18247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fe69f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:06a7653e-5f5a-4acc-ba93-0eff19f145f0+18:18249:x1869752384470656:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783135187.273588:0:18247:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783135187.273608:0:18247:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fe8c5550400/0xd6c4b8f058680333 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd6c4b8f05868032c expref: -99 pid: 18247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135187.273640:0:18247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fe8c5550400/0xd6c4b8f058680333 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd6c4b8f05868032c expref: 19 pid: 18247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135187.273652:0:18247:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fe8c5550400/0xd6c4b8f058680333 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd6c4b8f05868032c expref: 19 pid: 18247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135187.273664:0:18247:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fe8c5550400, rc 0) 00000100:00100000:1.0:1783135187.273759:0:18247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fe69f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:06a7653e-5f5a-4acc-ba93-0eff19f145f0+19:18249:x1869752384470656:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 189us (4119us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135187.273766:0:18247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1783135187.273862:0:18249:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9fe90ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:06a7653e-5f5a-4acc-ba93-0eff19f145f0:18249:1869752384470656:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783135187.273882:0:18249:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.141@tcp lock: ffff9fe9c148b600/0xd6c4b8f05868032c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd6c4b8f058680333 expref: -99 pid: 18249 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135187.273892:0:18249:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.141@tcp lock: ffff9fe9c148b600/0xd6c4b8f05868032c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd6c4b8f058680333 expref: -99 pid: 18249 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783135187.273994:0:18249:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9fe8fe300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:06a7653e-5f5a-4acc-ba93-0eff19f145f0:18249:1869752384470784:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1783135187.274038:0:18249:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135187.278400:0:18249:0:(client.c:2701:ptlrpc_set_wait()) set ffff9fe9ca2f3cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1783135187.280550:0:18246:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384470784 00000100:00100000:3.0:1783135187.280563:0:18246:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384470784 00000100:00100000:3.0:1783135187.280608:0:18246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1783135187.280617:0:18246:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fe69e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:06a7653e-5f5a-4acc-ba93-0eff19f145f0+19:18249:x1869752384470784:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1783135187.280644:0:18246:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1783135187.280665:0:18246:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1783135187.280668:0:18246:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 11 00000100:00100000:3.0:1783135187.280780:0:18246:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fe69e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:06a7653e-5f5a-4acc-ba93-0eff19f145f0+19:18249:x1869752384470784:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 163us (6740us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135187.280795:0:18246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1783135187.281397:0:18249:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9fe8fe300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:06a7653e-5f5a-4acc-ba93-0eff19f145f0:18249:1869752384470784:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1783135187.281461:0:18249:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.201.141@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1783135187.281470:0:18249:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.141@tcp lock: ffff9fe9c148b600/0xd6c4b8f05868032c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd6c4b8f058680333 expref: -99 pid: 18249 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135187.281481:0:18249:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.141@tcp lock: ffff9fe9c148b600/0xd6c4b8f05868032c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd6c4b8f058680333 expref: -99 pid: 18249 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783135187.590661:0:3287:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1783135187.590679:0:3287:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9f6fe6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1869752384470912:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1783135187.590737:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135187.590787:0:18892:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384470912 00000100:00100000:2.0:1783135187.590796:0:18892:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384470912 00000100:00080000:1.0:1783135187.590927:0:18248:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1783135187.590967:0:18892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1783135187.590978:0:18892:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe8c590d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3287:x1869752384470912:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1783135187.591017:0:18892:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1783135187.591145:0:3287:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9f6fe6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1869752384470912:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1783135187.591242:0:18892:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe8c590d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3287:x1869752384470912:12345-0@lo:13:osp-pre-0-0.0 Request processed in 100us (338us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135187.591251:0:18892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:3.0:1783135187.911731:0:18240:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783135188.938236:0:18241:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783135189.956720:0:18240:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783135190.980798:0:18241:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1783135191.176125:0:8:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1783135191.176134:0:8:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1783135191.176138:0:8:0:(import.c:65:import_set_state_nolock()) ffff9fe9f8a5c000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1783135191.176154:0:8:0:(import.c:626:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9fe9f8a5c000 using connection 192.168.201.141@tcp/0@lo 00000100:00100000:0.0:1783135191.176179:0:8:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9fe9fe8fca80 x1869752384471296/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1783135191.176266:0:3286:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9fe8fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3286:1869752384471552:0@lo:400:kworker.0 00000100:00100000:0.0:1783135191.176381:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135191.176448:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1783135191.176455:0:3286:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9fe8fe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:06a7653e-5f5a-4acc-ba93-0eff19f145f0:3286:1869752384471040:0@lo:400:kworker.0 00000100:00100000:0.0:1783135191.176485:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135191.176509:0:3286:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9fe8fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3286:1869752384471680:0@lo:400:kworker.0 00000100:00100000:0.0:1783135191.176530:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135191.179039:0:18254:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384471552 00000100:00100000:0.0:1783135191.179050:0:18254:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384471552 00000100:00100000:0.0:1783135191.179111:0:18254:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384471680 00000100:00100000:0.0:1783135191.179115:0:18254:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384471680 00000100:00100000:0.0:1783135191.179142:0:18254:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1783135191.179153:0:18254:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fe8fea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3286:x1869752384471552:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783135191.179222:0:18254:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fe8fea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3286:x1869752384471552:12345-0@lo:400:kworker.0 Request processed in 71us (2841us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135191.179229:0:18254:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1783135191.179244:0:18254:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1783135191.179250:0:18254:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fe8fd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3286:x1869752384471680:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783135191.179277:0:18254:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fe8fd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3286:x1869752384471680:12345-0@lo:400:kworker.0 Request processed in 27us (2745us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135191.179303:0:18254:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1783135191.179323:0:18246:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384471040 00000100:00100000:0.0:1783135191.179326:0:18246:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384471040 00000100:00100000:0.0:1783135191.179349:0:18246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1783135191.179355:0:18246:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fe69cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:06a7653e-5f5a-4acc-ba93-0eff19f145f0+19:3286:x1869752384471040:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783135191.179382:0:18246:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fe69cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:06a7653e-5f5a-4acc-ba93-0eff19f145f0+19:3286:x1869752384471040:12345-0@lo:400:kworker.0 Request processed in 27us (2897us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135191.179387:0:18246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00080000:0.0:1783135191.179415:0:18248:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783135191.179517:0:3286:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9fe8fe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:06a7653e-5f5a-4acc-ba93-0eff19f145f0:3286:1869752384471040:0@lo:400:kworker.0 00000100:00100000:1.0:1783135191.179710:0:3285:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9fe8fca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3285:1869752384471296:0@lo:8:kworker.0 00000100:00100000:1.0:1783135191.180645:0:3285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135191.180701:0:3289:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9fe8ffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3289:1869752384471424:0@lo:400:kworker.0 00000100:00100000:1.0:1783135191.181628:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135191.181681:0:3289:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1783135191.181692:0:3289:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9fe8ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1869752384471168:0@lo:400:kworker.0 00000100:00100000:1.0:1783135191.181823:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135191.181884:0:19201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384471296 00000100:00100000:1.0:1783135191.181892:0:19201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384471296 00000100:00100000:1.0:1783135191.181924:0:19201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384471168 00000100:00100000:1.0:1783135191.181927:0:19201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384471168 00000100:00100000:1.0:1783135191.181964:0:19201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1783135191.181973:0:19201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe8c590ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3289:x1869752384471168:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783135191.182028:0:19201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe8c590ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3289:x1869752384471168:12345-0@lo:400:kworker.0 Request processed in 56us (284us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135191.182037:0:19201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1783135191.182055:0:19201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1783135191.182059:0:19201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe8c590fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3285:x1869752384471296:12345-0@lo:8:kworker.0 00010000:00080000:1.0:1783135191.182087:0:19201:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 473 last 0 00000020:00000080:1.0:1783135191.182116:0:19201:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xd6c4b8f05868033a 00002000:00100000:1.0:1783135191.182130:0:19201:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff9fe9efd84800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113653 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:1.0:1783135191.182134:0:19201:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:1.0:1783135191.182137:0:19201:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00010000:00080000:0.0:1783135191.184139:0:3286:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fe9fe8fdf80 x1869752384471680/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783135207 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783135191.184177:0:3286:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9fe8fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3286:1869752384471680:0@lo:400:kworker.0 00010000:00080000:0.0:1783135191.184247:0:3286:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fe9fe8fd500 x1869752384471552/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783135207 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783135191.184257:0:3286:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9fe8fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3286:1869752384471552:0@lo:400:kworker.0 00000100:00080000:0.0:1783135191.185377:0:18248:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00080000:1.0:1783135191.185694:0:19201:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1783135191.185737:0:19201:0:(import.c:65:import_set_state_nolock()) ffff9fe9efd84000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1783135191.186021:0:19201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe8c590fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3285:x1869752384471296:12345-0@lo:8:kworker.0 Request processed in 3958us (5376us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135191.186033:0:19201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1783135191.186094:0:3289:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9fe8ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1869752384471168:0@lo:400:kworker.0 00000100:00100000:2.0:1783135191.187466:0:18254:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384471424 00000100:00100000:2.0:1783135191.187479:0:18254:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384471424 00000100:00100000:2.0:1783135191.187538:0:18254:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1783135191.187548:0:18254:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe8c590c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3289:x1869752384471424:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783135191.187639:0:18254:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe8c590c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3289:x1869752384471424:12345-0@lo:400:kworker.0 Request processed in 92us (6894us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135191.187652:0:18254:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:2.0:1783135191.187761:0:3289:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fe9fe8ffb80 x1869752384471424/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783135207 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783135191.187775:0:3289:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9fe8ffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3289:1869752384471424:0@lo:400:kworker.0 00010000:00080000:0.0:1783135191.193817:0:3285:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fe9fe8fca80 x1869752384471296/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1783135216 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1783135191.193849:0:3285:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 3 00000100:00080000:0.0:1783135191.193860:0:3285:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1783135191.193868:0:3285:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:0.0:1783135191.193884:0:3285:0:(import.c:65:import_set_state_nolock()) ffff9fe9f8a5c000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1783135191.193909:0:3285:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1783135191.193917:0:3285:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9fe8fca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3285:1869752384471296:0@lo:8:kworker.0 00000004:00080000:1.0:1783135191.195196:0:18277:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x280000400:0x22:0x0] 00000100:00100000:1.0:1783135191.195226:0:18277:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe8c590e680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:18277:1869752384471936:0@lo:5:osp-pre-1-0.0 00000100:00100000:1.0:1783135191.195309:0:18277:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135191.195340:0:18277:0:(client.c:2701:ptlrpc_set_wait()) set ffff9fe9e9b20f00 going to sleep for 11 seconds 00000100:00100000:1.0:1783135191.195359:0:3288:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe8c590c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1869752384471808:0@lo:13:osp-pre-1-0.0 00000004:00080000:3.0:1783135191.195370:0:18276:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000100:00100000:1.0:1783135191.195387:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135191.195423:0:18891:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384471936 00000100:00100000:1.0:1783135191.195431:0:18891:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384471936 00000100:00100000:1.0:1783135191.195490:0:18891:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1783135191.195499:0:18891:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe8c590ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:18277:x1869752384471936:12345-0@lo:5:osp-pre-1-0.0 00000004:00080000:3.0:1783135191.197132:0:18276:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 473592850164ns, next at 0ns, rc = 0 00000100:00100000:3.0:1783135191.197194:0:18894:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384471808 00000100:00100000:3.0:1783135191.197203:0:18894:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384471808 00000100:00100000:3.0:1783135191.197730:0:18894:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1783135191.197739:0:18894:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe8c590df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3288:x1869752384471808:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1783135191.198299:0:18894:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1783135191.198402:0:18894:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe8c590df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3288:x1869752384471808:12345-0@lo:13:osp-pre-1-0.0 Request processed in 663us (3012us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135191.198410:0:18894:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1783135191.198498:0:3288:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fe8c590c000 x1869752384471808/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783135207 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783135191.198522:0:3288:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe8c590c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1869752384471808:0@lo:13:osp-pre-1-0.0 00000100:00080000:0.0:1783135191.200890:0:18248:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00080000:1.0:1783135191.210835:0:18891:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:1.0:1783135191.210849:0:18891:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 65 -> diff = -31 00002000:02000040:1.0:1783135191.210857:0:18891:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000400:35 to 0x280000400:65) 00002000:00010000:1.0:1783135191.240738:0:18891:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x41:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1783135191.240749:0:18891:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005e9c636d/0xd6c4b8f058680341 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x41:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135191.240766:0:18891:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x41:0x0].0x0 since=473s v=(0 0) 00010000:00010000:1.0:1783135191.240770:0:18891:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x41:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783135191.240777:0:18891:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005e9c636d/0xd6c4b8f058680341 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135191.240793:0:18891:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005e9c636d/0xd6c4b8f058680341 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135191.240811:0:18891:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005e9c636d/0xd6c4b8f058680341 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135191.240819:0:18891:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005e9c636d/0xd6c4b8f058680341 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135191.240845:0:18891:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783135191.240970:0:18240:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783135191.240978:0:18240:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005e9c636d/0xd6c4b8f058680341 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135191.240987:0:18240:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe8c5551c00 already unused, calling callback (ffffffffc1527ce0) 00010000:00010000:3.0:1783135191.240991:0:18240:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005e9c636d/0xd6c4b8f058680341 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135191.241000:0:18240:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005e9c636d/0xd6c4b8f058680341 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135191.241030:0:18240:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005e9c636d/0xd6c4b8f058680341 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135191.241039:0:18240:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005e9c636d/0xd6c4b8f058680341 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135191.241055:0:18240:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783135191.241057:0:18240:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783135191.241059:0:18240:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1783135191.241274:0:18891:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x40:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1783135191.241308:0:18891:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007530f934/0xd6c4b8f058680348 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x40:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135191.241317:0:18891:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x40:0x0].0x0 since=473s v=(0 0) 00010000:00010000:1.0:1783135191.241321:0:18891:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x40:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783135191.241325:0:18891:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007530f934/0xd6c4b8f058680348 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135191.241334:0:18891:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007530f934/0xd6c4b8f058680348 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135191.241343:0:18891:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007530f934/0xd6c4b8f058680348 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135191.241351:0:18891:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007530f934/0xd6c4b8f058680348 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135191.241380:0:18891:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1783135191.241732:0:18891:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1783135191.241737:0:18891:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008683403b/0xd6c4b8f05868034f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135191.241744:0:18891:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3f:0x0].0x0 since=473s v=(0 0) 00010000:00010000:1.0:1783135191.241747:0:18891:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783135191.241750:0:18891:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008683403b/0xd6c4b8f05868034f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135191.241758:0:18891:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008683403b/0xd6c4b8f05868034f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135191.241764:0:18891:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008683403b/0xd6c4b8f05868034f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135191.241772:0:18891:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008683403b/0xd6c4b8f05868034f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135191.241786:0:18891:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1783135191.241796:0:18240:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1783135191.241800:0:18240:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007530f934/0xd6c4b8f058680348 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135191.241807:0:18240:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe8c5551000 already unused, calling callback (ffffffffc1527ce0) 00010000:00010000:1.0:1783135191.241816:0:18240:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007530f934/0xd6c4b8f058680348 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135191.241825:0:18240:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007530f934/0xd6c4b8f058680348 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135191.241837:0:18240:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007530f934/0xd6c4b8f058680348 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135191.241845:0:18240:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007530f934/0xd6c4b8f058680348 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135191.241858:0:18240:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783135191.241861:0:18240:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008683403b/0xd6c4b8f05868034f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135191.241867:0:18240:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe8c5551a00 already unused, calling callback (ffffffffc1527ce0) 00010000:00010000:1.0:1783135191.241871:0:18240:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008683403b/0xd6c4b8f05868034f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135191.241889:0:18240:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008683403b/0xd6c4b8f05868034f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135191.241899:0:18240:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008683403b/0xd6c4b8f05868034f lrc: 1/0,0 mode: --/PW res: [0x280000400:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135191.241906:0:18240:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008683403b/0xd6c4b8f05868034f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135191.241923:0:18240:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783135191.241925:0:18240:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783135191.241926:0:18240:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1783135191.242316:0:18891:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1783135191.242322:0:18891:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000031b7e9f0/0xd6c4b8f058680356 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135191.242330:0:18891:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3e:0x0].0x0 since=473s v=(0 0) 00010000:00010000:1.0:1783135191.242332:0:18891:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783135191.242336:0:18891:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000031b7e9f0/0xd6c4b8f058680356 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135191.242345:0:18891:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000031b7e9f0/0xd6c4b8f058680356 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135191.242352:0:18891:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000031b7e9f0/0xd6c4b8f058680356 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135191.242358:0:18891:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000031b7e9f0/0xd6c4b8f058680356 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135191.242371:0:18891:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783135191.242377:0:18240:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783135191.242380:0:18240:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000031b7e9f0/0xd6c4b8f058680356 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135191.242395:0:18240:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe8c5550e00 already unused, calling callback (ffffffffc1527ce0) 00010000:00010000:1.0:1783135191.242398:0:18240:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000031b7e9f0/0xd6c4b8f058680356 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135191.242406:0:18240:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000031b7e9f0/0xd6c4b8f058680356 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135191.242416:0:18240:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000031b7e9f0/0xd6c4b8f058680356 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135191.242425:0:18240:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000031b7e9f0/0xd6c4b8f058680356 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135191.242438:0:18240:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783135191.242439:0:18240:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783135191.242441:0:18240:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1783135191.242798:0:18891:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1783135191.242804:0:18891:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f9bb2333/0xd6c4b8f05868035d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135191.242813:0:18891:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3d:0x0].0x0 since=473s v=(0 0) 00010000:00010000:1.0:1783135191.242816:0:18891:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783135191.242821:0:18891:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f9bb2333/0xd6c4b8f05868035d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135191.242830:0:18891:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f9bb2333/0xd6c4b8f05868035d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135191.242844:0:18891:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f9bb2333/0xd6c4b8f05868035d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135191.242851:0:18891:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f9bb2333/0xd6c4b8f05868035d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135191.242862:0:18891:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783135191.242869:0:18240:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783135191.244047:0:18241:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783135191.246645:0:18240:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f9bb2333/0xd6c4b8f05868035d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135191.246671:0:18240:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe8c5551800 already unused, calling callback (ffffffffc1527ce0) 00010000:00010000:1.0:1783135191.246678:0:18240:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f9bb2333/0xd6c4b8f05868035d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135191.246691:0:18240:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f9bb2333/0xd6c4b8f05868035d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135191.246715:0:18240:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f9bb2333/0xd6c4b8f05868035d lrc: 1/0,0 mode: --/PW res: [0x280000400:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135191.246723:0:18240:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f9bb2333/0xd6c4b8f05868035d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135191.246759:0:18240:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783135191.246768:0:18240:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783135191.246771:0:18240:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1783135191.247525:0:18891:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1783135191.248436:0:18891:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007a6c42c4/0xd6c4b8f058680364 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135191.248453:0:18891:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3c:0x0].0x0 since=473s v=(0 0) 00010000:00010000:1.0:1783135191.248457:0:18891:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783135191.248465:0:18891:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007a6c42c4/0xd6c4b8f058680364 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135191.248477:0:18891:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007a6c42c4/0xd6c4b8f058680364 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135191.248488:0:18891:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007a6c42c4/0xd6c4b8f058680364 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135191.248495:0:18891:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007a6c42c4/0xd6c4b8f058680364 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135191.248515:0:18891:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783135191.248528:0:18241:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783135191.248603:0:18241:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007a6c42c4/0xd6c4b8f058680364 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135191.248611:0:18241:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe9c0030400 already unused, calling callback (ffffffffc1527ce0) 00010000:00010000:1.0:1783135191.248615:0:18241:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007a6c42c4/0xd6c4b8f058680364 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135191.248636:0:18241:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007a6c42c4/0xd6c4b8f058680364 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135191.248652:0:18241:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007a6c42c4/0xd6c4b8f058680364 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135191.248659:0:18241:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007a6c42c4/0xd6c4b8f058680364 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135191.248675:0:18241:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783135191.248677:0:18241:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783135191.248678:0:18241:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1783135191.249276:0:18891:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1783135191.249320:0:18891:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003d1ec7ff/0xd6c4b8f05868036b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135191.249330:0:18891:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3b:0x0].0x0 since=473s v=(0 0) 00010000:00010000:1.0:1783135191.249334:0:18891:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783135191.249338:0:18891:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003d1ec7ff/0xd6c4b8f05868036b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135191.249349:0:18891:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003d1ec7ff/0xd6c4b8f05868036b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135191.249357:0:18891:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003d1ec7ff/0xd6c4b8f05868036b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135191.249369:0:18891:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003d1ec7ff/0xd6c4b8f05868036b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135191.249386:0:18891:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783135191.249396:0:18240:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783135191.249401:0:18240:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003d1ec7ff/0xd6c4b8f05868036b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135191.249409:0:18240:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe9c0030a00 already unused, calling callback (ffffffffc1527ce0) 00010000:00010000:1.0:1783135191.249413:0:18240:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003d1ec7ff/0xd6c4b8f05868036b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135191.249422:0:18240:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003d1ec7ff/0xd6c4b8f05868036b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135191.249434:0:18240:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003d1ec7ff/0xd6c4b8f05868036b lrc: 1/0,0 mode: --/PW res: [0x280000400:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135191.249442:0:18240:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003d1ec7ff/0xd6c4b8f05868036b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135191.249456:0:18240:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783135191.249458:0:18240:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783135191.249459:0:18240:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1783135191.251350:0:18891:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1783135191.251367:0:18891:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001f613943/0xd6c4b8f058680372 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135191.251381:0:18891:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3a:0x0].0x0 since=473s v=(0 0) 00010000:00010000:1.0:1783135191.251385:0:18891:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783135191.251390:0:18891:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001f613943/0xd6c4b8f058680372 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135191.251403:0:18891:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001f613943/0xd6c4b8f058680372 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135191.251413:0:18891:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001f613943/0xd6c4b8f058680372 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135191.251421:0:18891:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001f613943/0xd6c4b8f058680372 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135191.251438:0:18891:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783135191.251450:0:18241:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783135191.251455:0:18241:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001f613943/0xd6c4b8f058680372 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135191.251463:0:18241:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe9c0030000 already unused, calling callback (ffffffffc1527ce0) 00010000:00010000:1.0:1783135191.251467:0:18241:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001f613943/0xd6c4b8f058680372 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135191.251476:0:18241:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001f613943/0xd6c4b8f058680372 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135191.251499:0:18241:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001f613943/0xd6c4b8f058680372 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135191.251507:0:18241:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001f613943/0xd6c4b8f058680372 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135191.251524:0:18241:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783135191.251525:0:18241:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783135191.251527:0:18241:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1783135191.252486:0:18891:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x39:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1783135191.252495:0:18891:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000039f945ae/0xd6c4b8f058680379 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135191.252507:0:18891:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x39:0x0].0x0 since=473s v=(0 0) 00010000:00010000:1.0:1783135191.252510:0:18891:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x39:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783135191.252515:0:18891:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000039f945ae/0xd6c4b8f058680379 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135191.252525:0:18891:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000039f945ae/0xd6c4b8f058680379 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135191.252747:0:18891:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000039f945ae/0xd6c4b8f058680379 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135191.252756:0:18891:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000039f945ae/0xd6c4b8f058680379 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135191.252796:0:18891:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783135191.252810:0:18240:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783135191.252815:0:18240:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000039f945ae/0xd6c4b8f058680379 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135191.252823:0:18240:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe9c0031600 already unused, calling callback (ffffffffc1527ce0) 00010000:00010000:1.0:1783135191.252827:0:18240:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000039f945ae/0xd6c4b8f058680379 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135191.252835:0:18240:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000039f945ae/0xd6c4b8f058680379 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135191.252850:0:18240:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000039f945ae/0xd6c4b8f058680379 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135191.252858:0:18240:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000039f945ae/0xd6c4b8f058680379 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135191.252884:0:18240:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783135191.252887:0:18240:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783135191.252888:0:18240:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1783135191.253334:0:18891:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x38:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1783135191.253340:0:18891:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000027056a73/0xd6c4b8f058680380 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x38:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135191.253349:0:18891:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x38:0x0].0x0 since=473s v=(0 0) 00010000:00010000:1.0:1783135191.253357:0:18891:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x38:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783135191.253362:0:18891:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000027056a73/0xd6c4b8f058680380 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135191.253371:0:18891:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000027056a73/0xd6c4b8f058680380 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135191.253379:0:18891:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000027056a73/0xd6c4b8f058680380 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135191.253386:0:18891:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000027056a73/0xd6c4b8f058680380 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135191.253396:0:18891:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783135191.253403:0:18241:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783135191.253407:0:18241:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000027056a73/0xd6c4b8f058680380 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135191.253413:0:18241:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe9c0030200 already unused, calling callback (ffffffffc1527ce0) 00010000:00010000:1.0:1783135191.253416:0:18241:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000027056a73/0xd6c4b8f058680380 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135191.253422:0:18241:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000027056a73/0xd6c4b8f058680380 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135191.253432:0:18241:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000027056a73/0xd6c4b8f058680380 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135191.253448:0:18241:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000027056a73/0xd6c4b8f058680380 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135191.253461:0:18241:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783135191.253462:0:18241:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783135191.253464:0:18241:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1783135191.254964:0:18891:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x37:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1783135191.254974:0:18891:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000095441e9c/0xd6c4b8f058680387 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135191.254990:0:18891:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x37:0x0].0x0 since=473s v=(0 0) 00010000:00010000:1.0:1783135191.254994:0:18891:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x37:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783135191.255000:0:18891:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000095441e9c/0xd6c4b8f058680387 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135191.255012:0:18891:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000095441e9c/0xd6c4b8f058680387 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135191.255023:0:18891:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000095441e9c/0xd6c4b8f058680387 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135191.255031:0:18891:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000095441e9c/0xd6c4b8f058680387 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135191.255052:0:18891:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783135191.255066:0:18240:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783135191.255078:0:18240:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000095441e9c/0xd6c4b8f058680387 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135191.255086:0:18240:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe9c0030c00 already unused, calling callback (ffffffffc1527ce0) 00010000:00010000:1.0:1783135191.255090:0:18240:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000095441e9c/0xd6c4b8f058680387 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135191.255098:0:18240:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000095441e9c/0xd6c4b8f058680387 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135191.255114:0:18240:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000095441e9c/0xd6c4b8f058680387 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135191.255123:0:18240:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000095441e9c/0xd6c4b8f058680387 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135191.255146:0:18240:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783135191.255149:0:18240:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783135191.255150:0:18240:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1783135191.256275:0:18891:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x36:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1783135191.256306:0:18891:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bbd0d110/0xd6c4b8f05868038e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135191.256321:0:18891:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x36:0x0].0x0 since=473s v=(0 0) 00010000:00010000:1.0:1783135191.256324:0:18891:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x36:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783135191.256330:0:18891:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bbd0d110/0xd6c4b8f05868038e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135191.256352:0:18891:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bbd0d110/0xd6c4b8f05868038e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135191.256361:0:18891:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bbd0d110/0xd6c4b8f05868038e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135191.256368:0:18891:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000bbd0d110/0xd6c4b8f05868038e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135191.256383:0:18891:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783135191.256394:0:18241:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783135191.256399:0:18241:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000bbd0d110/0xd6c4b8f05868038e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135191.256406:0:18241:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe9c0031400 already unused, calling callback (ffffffffc1527ce0) 00010000:00010000:1.0:1783135191.256409:0:18241:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000bbd0d110/0xd6c4b8f05868038e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135191.256416:0:18241:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000bbd0d110/0xd6c4b8f05868038e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135191.256428:0:18241:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000bbd0d110/0xd6c4b8f05868038e lrc: 1/0,0 mode: --/PW res: [0x280000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135191.256435:0:18241:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bbd0d110/0xd6c4b8f05868038e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135191.256456:0:18241:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783135191.256457:0:18241:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783135191.256459:0:18241:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1783135191.257055:0:18891:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x35:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1783135191.257062:0:18891:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f09dd1ad/0xd6c4b8f058680395 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x35:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135191.257072:0:18891:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x35:0x0].0x0 since=473s v=(0 0) 00010000:00010000:1.0:1783135191.257074:0:18891:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x35:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783135191.257079:0:18891:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f09dd1ad/0xd6c4b8f058680395 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135191.257087:0:18891:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f09dd1ad/0xd6c4b8f058680395 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135191.257095:0:18891:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f09dd1ad/0xd6c4b8f058680395 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135191.257102:0:18891:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f09dd1ad/0xd6c4b8f058680395 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135191.257116:0:18891:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783135191.257124:0:18240:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783135191.257128:0:18240:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f09dd1ad/0xd6c4b8f058680395 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135191.257144:0:18240:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe9fe43f200 already unused, calling callback (ffffffffc1527ce0) 00010000:00010000:1.0:1783135191.257148:0:18240:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f09dd1ad/0xd6c4b8f058680395 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135191.257156:0:18240:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f09dd1ad/0xd6c4b8f058680395 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135191.257166:0:18240:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f09dd1ad/0xd6c4b8f058680395 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135191.257172:0:18240:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f09dd1ad/0xd6c4b8f058680395 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135191.257184:0:18240:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783135191.257186:0:18240:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783135191.257187:0:18240:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1783135191.258068:0:18891:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x34:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1783135191.258077:0:18891:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d97a7bc7/0xd6c4b8f05868039c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x34:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135191.258087:0:18891:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x34:0x0].0x0 since=473s v=(0 0) 00010000:00010000:1.0:1783135191.258090:0:18891:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x34:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783135191.258094:0:18891:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d97a7bc7/0xd6c4b8f05868039c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135191.258103:0:18891:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d97a7bc7/0xd6c4b8f05868039c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135191.258115:0:18891:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d97a7bc7/0xd6c4b8f05868039c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135191.258122:0:18891:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d97a7bc7/0xd6c4b8f05868039c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135191.258137:0:18891:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783135191.258148:0:18241:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783135191.258152:0:18241:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d97a7bc7/0xd6c4b8f05868039c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135191.258158:0:18241:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe9fe43e800 already unused, calling callback (ffffffffc1527ce0) 00010000:00010000:1.0:1783135191.258161:0:18241:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d97a7bc7/0xd6c4b8f05868039c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135191.258169:0:18241:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d97a7bc7/0xd6c4b8f05868039c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135191.258182:0:18241:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d97a7bc7/0xd6c4b8f05868039c lrc: 1/0,0 mode: --/PW res: [0x280000400:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135191.258190:0:18241:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d97a7bc7/0xd6c4b8f05868039c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135191.258203:0:18241:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783135191.258211:0:18241:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783135191.258213:0:18241:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1783135191.258944:0:18891:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x33:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1783135191.258951:0:18891:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ced82e6e/0xd6c4b8f0586803a3 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135191.258961:0:18891:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x33:0x0].0x0 since=473s v=(0 0) 00010000:00010000:1.0:1783135191.258964:0:18891:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x33:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783135191.258969:0:18891:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ced82e6e/0xd6c4b8f0586803a3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135191.258979:0:18891:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ced82e6e/0xd6c4b8f0586803a3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135191.258987:0:18891:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ced82e6e/0xd6c4b8f0586803a3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135191.258994:0:18891:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ced82e6e/0xd6c4b8f0586803a3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135191.259009:0:18891:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783135191.259020:0:18240:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783135191.259024:0:18240:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ced82e6e/0xd6c4b8f0586803a3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135191.259031:0:18240:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe9fe43fc00 already unused, calling callback (ffffffffc1527ce0) 00010000:00010000:1.0:1783135191.259035:0:18240:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ced82e6e/0xd6c4b8f0586803a3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135191.259056:0:18240:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ced82e6e/0xd6c4b8f0586803a3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135191.259069:0:18240:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ced82e6e/0xd6c4b8f0586803a3 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135191.259077:0:18240:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ced82e6e/0xd6c4b8f0586803a3 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135191.259092:0:18240:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783135191.259093:0:18240:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783135191.259095:0:18240:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1783135191.260724:0:18891:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x32:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1783135191.260737:0:18891:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fa78a885/0xd6c4b8f0586803aa lrc: 3/0,1 mode: --/PW res: [0x280000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135191.260766:0:18891:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x32:0x0].0x0 since=473s v=(0 0) 00010000:00010000:1.0:1783135191.260771:0:18891:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x32:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783135191.260779:0:18891:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fa78a885/0xd6c4b8f0586803aa lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135191.261231:0:18891:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fa78a885/0xd6c4b8f0586803aa lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135191.261244:0:18891:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fa78a885/0xd6c4b8f0586803aa lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135191.261259:0:18891:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fa78a885/0xd6c4b8f0586803aa lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135191.261302:0:18891:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783135191.261316:0:18241:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783135191.261321:0:18241:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fa78a885/0xd6c4b8f0586803aa lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135191.261328:0:18241:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe9fe43e600 already unused, calling callback (ffffffffc1527ce0) 00010000:00010000:1.0:1783135191.261332:0:18241:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fa78a885/0xd6c4b8f0586803aa lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135191.261342:0:18241:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fa78a885/0xd6c4b8f0586803aa lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135191.261356:0:18241:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fa78a885/0xd6c4b8f0586803aa lrc: 1/0,0 mode: --/PW res: [0x280000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135191.261364:0:18241:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fa78a885/0xd6c4b8f0586803aa lrc: 0/0,0 mode: --/PW res: [0x280000400:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135191.261383:0:18241:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783135191.261385:0:18241:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783135191.261386:0:18241:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1783135191.263143:0:18891:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x31:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1783135191.263163:0:18891:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001fa94d8b/0xd6c4b8f0586803b1 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135191.263178:0:18891:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x31:0x0].0x0 since=473s v=(0 0) 00010000:00010000:1.0:1783135191.263183:0:18891:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x31:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783135191.263189:0:18891:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001fa94d8b/0xd6c4b8f0586803b1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135191.263203:0:18891:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001fa94d8b/0xd6c4b8f0586803b1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135191.263213:0:18891:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001fa94d8b/0xd6c4b8f0586803b1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135191.263221:0:18891:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001fa94d8b/0xd6c4b8f0586803b1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135191.263244:0:18891:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1783135191.263963:0:18891:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x30:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1783135191.263970:0:18891:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c791f1a1/0xd6c4b8f0586803b8 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135191.263980:0:18891:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x30:0x0].0x0 since=473s v=(0 0) 00010000:00010000:1.0:1783135191.263982:0:18891:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x30:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783135191.263987:0:18891:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c791f1a1/0xd6c4b8f0586803b8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135191.263996:0:18891:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c791f1a1/0xd6c4b8f0586803b8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135191.264009:0:18891:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c791f1a1/0xd6c4b8f0586803b8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135191.264016:0:18891:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c791f1a1/0xd6c4b8f0586803b8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135191.264031:0:18891:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1783135191.264043:0:18241:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1783135191.264048:0:18241:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001fa94d8b/0xd6c4b8f0586803b1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135191.264055:0:18241:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe9fe43f000 already unused, calling callback (ffffffffc1527ce0) 00010000:00010000:1.0:1783135191.264060:0:18241:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001fa94d8b/0xd6c4b8f0586803b1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135191.264069:0:18241:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001fa94d8b/0xd6c4b8f0586803b1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135191.264086:0:18241:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001fa94d8b/0xd6c4b8f0586803b1 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135191.264093:0:18241:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001fa94d8b/0xd6c4b8f0586803b1 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135191.264109:0:18241:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783135191.264116:0:18241:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c791f1a1/0xd6c4b8f0586803b8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135191.264123:0:18241:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe9fe43f400 already unused, calling callback (ffffffffc1527ce0) 00010000:00010000:1.0:1783135191.264126:0:18241:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c791f1a1/0xd6c4b8f0586803b8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135191.264134:0:18241:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c791f1a1/0xd6c4b8f0586803b8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135191.264143:0:18241:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c791f1a1/0xd6c4b8f0586803b8 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135191.264150:0:18241:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c791f1a1/0xd6c4b8f0586803b8 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135191.264160:0:18241:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783135191.264162:0:18241:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783135191.264163:0:18241:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1783135191.265230:0:18891:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1783135191.265243:0:18891:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000040bebb14/0xd6c4b8f0586803bf lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135191.265258:0:18891:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2f:0x0].0x0 since=473s v=(0 0) 00010000:00010000:1.0:1783135191.265262:0:18891:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783135191.265267:0:18891:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000040bebb14/0xd6c4b8f0586803bf lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135191.265322:0:18891:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000040bebb14/0xd6c4b8f0586803bf lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135191.265331:0:18891:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000040bebb14/0xd6c4b8f0586803bf lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135191.265338:0:18891:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000040bebb14/0xd6c4b8f0586803bf lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135191.265353:0:18891:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1783135191.266405:0:18891:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1783135191.266414:0:18891:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009979a75f/0xd6c4b8f0586803c6 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135191.266426:0:18891:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2e:0x0].0x0 since=473s v=(0 0) 00010000:00010000:1.0:1783135191.266429:0:18891:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783135191.266433:0:18891:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009979a75f/0xd6c4b8f0586803c6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135191.266443:0:18891:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009979a75f/0xd6c4b8f0586803c6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135191.266452:0:18891:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009979a75f/0xd6c4b8f0586803c6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135191.266468:0:18891:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009979a75f/0xd6c4b8f0586803c6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135191.266477:0:18891:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1783135191.266900:0:18241:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1783135191.266908:0:18241:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000040bebb14/0xd6c4b8f0586803bf lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135191.266916:0:18241:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe9fe43fe00 already unused, calling callback (ffffffffc1527ce0) 00010000:00010000:0.0:1783135191.266921:0:18241:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000040bebb14/0xd6c4b8f0586803bf lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135191.266934:0:18241:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000040bebb14/0xd6c4b8f0586803bf lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135191.266957:0:18241:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000040bebb14/0xd6c4b8f0586803bf lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135191.266976:0:18241:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000040bebb14/0xd6c4b8f0586803bf lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135191.266997:0:18241:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783135191.267000:0:18241:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009979a75f/0xd6c4b8f0586803c6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135191.267007:0:18241:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe9fe43f600 already unused, calling callback (ffffffffc1527ce0) 00010000:00010000:0.0:1783135191.267010:0:18241:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009979a75f/0xd6c4b8f0586803c6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135191.267017:0:18241:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009979a75f/0xd6c4b8f0586803c6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135191.267026:0:18241:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009979a75f/0xd6c4b8f0586803c6 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135191.267033:0:18241:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009979a75f/0xd6c4b8f0586803c6 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135191.267046:0:18241:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783135191.267048:0:18241:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783135191.267049:0:18241:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1783135191.267513:0:18891:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1783135191.267520:0:18891:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f09dd1ad/0xd6c4b8f0586803cd lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135191.267904:0:18891:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2d:0x0].0x0 since=473s v=(0 0) 00010000:00010000:1.0:1783135191.267908:0:18891:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783135191.267914:0:18891:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f09dd1ad/0xd6c4b8f0586803cd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135191.267926:0:18891:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f09dd1ad/0xd6c4b8f0586803cd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135191.267935:0:18891:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f09dd1ad/0xd6c4b8f0586803cd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135191.267942:0:18891:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f09dd1ad/0xd6c4b8f0586803cd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135191.267959:0:18891:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1783135191.268257:0:18241:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783135191.268264:0:18241:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f09dd1ad/0xd6c4b8f0586803cd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135191.268293:0:18241:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe9fe43f200 already unused, calling callback (ffffffffc1527ce0) 00010000:00010000:0.0:1783135191.268297:0:18241:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f09dd1ad/0xd6c4b8f0586803cd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135191.268305:0:18241:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f09dd1ad/0xd6c4b8f0586803cd lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135191.268319:0:18241:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f09dd1ad/0xd6c4b8f0586803cd lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135191.268326:0:18241:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f09dd1ad/0xd6c4b8f0586803cd lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135191.268341:0:18241:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783135191.268343:0:18241:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783135191.268344:0:18241:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1783135191.268373:0:18891:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1783135191.268379:0:18891:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001afe611e/0xd6c4b8f0586803d4 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135191.268392:0:18891:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2c:0x0].0x0 since=473s v=(0 0) 00010000:00010000:1.0:1783135191.268395:0:18891:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783135191.268399:0:18891:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001afe611e/0xd6c4b8f0586803d4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135191.268409:0:18891:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001afe611e/0xd6c4b8f0586803d4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135191.268417:0:18891:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001afe611e/0xd6c4b8f0586803d4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135191.268424:0:18891:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001afe611e/0xd6c4b8f0586803d4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135191.268441:0:18891:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1783135191.269211:0:18891:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1783135191.269219:0:18891:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e6e89c8f/0xd6c4b8f0586803db lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135191.269229:0:18891:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=473s v=(0 0) 00010000:00010000:1.0:1783135191.269233:0:18891:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783135191.269238:0:18891:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e6e89c8f/0xd6c4b8f0586803db lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135191.269247:0:18891:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e6e89c8f/0xd6c4b8f0586803db lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135191.269265:0:18891:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e6e89c8f/0xd6c4b8f0586803db lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135191.269272:0:18891:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e6e89c8f/0xd6c4b8f0586803db lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135191.269299:0:18891:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1783135191.271133:0:18241:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1783135191.271144:0:18241:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001afe611e/0xd6c4b8f0586803d4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135191.271157:0:18241:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe9fe43e200 already unused, calling callback (ffffffffc1527ce0) 00010000:00010000:0.0:1783135191.271162:0:18241:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001afe611e/0xd6c4b8f0586803d4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135191.271172:0:18241:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001afe611e/0xd6c4b8f0586803d4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135191.271196:0:18241:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001afe611e/0xd6c4b8f0586803d4 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135191.271203:0:18241:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001afe611e/0xd6c4b8f0586803d4 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1783135191.271216:0:18891:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1783135191.271219:0:18241:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783135191.271222:0:18241:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e6e89c8f/0xd6c4b8f0586803db lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135191.271223:0:18891:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e08b3987/0xd6c4b8f0586803e2 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135191.271229:0:18241:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe9fe43ec00 already unused, calling callback (ffffffffc1527ce0) 00010000:00010000:0.0:1783135191.271232:0:18241:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e6e89c8f/0xd6c4b8f0586803db lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135191.271235:0:18891:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2a:0x0].0x0 since=473s v=(0 0) 00010000:00010000:1.0:1783135191.271239:0:18891:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783135191.271239:0:18241:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e6e89c8f/0xd6c4b8f0586803db lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135191.271244:0:18891:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e08b3987/0xd6c4b8f0586803e2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135191.271247:0:18241:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e6e89c8f/0xd6c4b8f0586803db lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135191.271253:0:18241:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e6e89c8f/0xd6c4b8f0586803db lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135191.271256:0:18891:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e08b3987/0xd6c4b8f0586803e2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135191.271264:0:18241:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783135191.271265:0:18891:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e08b3987/0xd6c4b8f0586803e2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135191.271266:0:18241:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783135191.271271:0:18241:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783135191.271273:0:18891:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e08b3987/0xd6c4b8f0586803e2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135191.271313:0:18891:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:0.0:1783135191.271382:0:5791:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00010000:00010000:0.0:1783135191.271406:0:18241:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783135191.271410:0:18241:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e08b3987/0xd6c4b8f0586803e2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135191.271417:0:18241:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe9fe43e400 already unused, calling callback (ffffffffc1527ce0) 00010000:00010000:0.0:1783135191.271420:0:18241:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e08b3987/0xd6c4b8f0586803e2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135191.271427:0:18241:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e08b3987/0xd6c4b8f0586803e2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135191.271437:0:18241:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e08b3987/0xd6c4b8f0586803e2 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135191.271443:0:18241:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e08b3987/0xd6c4b8f0586803e2 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135191.271455:0:18241:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783135191.271457:0:18241:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783135191.271458:0:18241:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1783135191.273023:0:18891:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x29:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1783135191.273035:0:18891:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000000b836c3/0xd6c4b8f0586803e9 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135191.273050:0:18891:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x29:0x0].0x0 since=473s v=(0 0) 00010000:00010000:1.0:1783135191.273054:0:18891:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x29:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783135191.273060:0:18891:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000000b836c3/0xd6c4b8f0586803e9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135191.273072:0:18891:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000000b836c3/0xd6c4b8f0586803e9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135191.273081:0:18891:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000000b836c3/0xd6c4b8f0586803e9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135191.273089:0:18891:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000000b836c3/0xd6c4b8f0586803e9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135191.273111:0:18891:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1783135191.273610:0:18240:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783135191.273619:0:18240:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000000b836c3/0xd6c4b8f0586803e9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135191.273630:0:18240:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe9fe43e000 already unused, calling callback (ffffffffc1527ce0) 00010000:00010000:2.0:1783135191.273635:0:18240:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000000b836c3/0xd6c4b8f0586803e9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135191.273645:0:18240:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000000b836c3/0xd6c4b8f0586803e9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135191.273668:0:18240:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000000b836c3/0xd6c4b8f0586803e9 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135191.273682:0:18240:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000000b836c3/0xd6c4b8f0586803e9 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1783135191.273696:0:18891:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x28:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1783135191.273703:0:18240:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783135191.273705:0:18891:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000df406bb1/0xd6c4b8f0586803f0 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x28:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135191.273706:0:18240:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783135191.273709:0:18240:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783135191.273719:0:18891:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x28:0x0].0x0 since=473s v=(0 0) 00010000:00010000:1.0:1783135191.273729:0:18891:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x28:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783135191.273734:0:18891:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000df406bb1/0xd6c4b8f0586803f0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135191.274158:0:18891:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000df406bb1/0xd6c4b8f0586803f0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135191.274167:0:18891:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000df406bb1/0xd6c4b8f0586803f0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135191.274174:0:18891:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000df406bb1/0xd6c4b8f0586803f0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135191.274194:0:18891:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1783135191.274453:0:18241:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783135191.274461:0:18241:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000df406bb1/0xd6c4b8f0586803f0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135191.274468:0:18241:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe9fe43f800 already unused, calling callback (ffffffffc1527ce0) 00010000:00010000:0.0:1783135191.274472:0:18241:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000df406bb1/0xd6c4b8f0586803f0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135191.274487:0:18241:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000df406bb1/0xd6c4b8f0586803f0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135191.274500:0:18241:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000df406bb1/0xd6c4b8f0586803f0 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135191.274507:0:18241:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000df406bb1/0xd6c4b8f0586803f0 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135191.274529:0:18241:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783135191.274530:0:18241:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783135191.274532:0:18241:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1783135191.274693:0:18891:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x27:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1783135191.274698:0:18891:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000757d0a52/0xd6c4b8f0586803f7 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135191.274707:0:18891:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x27:0x0].0x0 since=473s v=(0 0) 00010000:00010000:1.0:1783135191.274710:0:18891:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x27:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783135191.274715:0:18891:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000757d0a52/0xd6c4b8f0586803f7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135191.274724:0:18891:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000757d0a52/0xd6c4b8f0586803f7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135191.274732:0:18891:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000757d0a52/0xd6c4b8f0586803f7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135191.274757:0:18891:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000757d0a52/0xd6c4b8f0586803f7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135191.274775:0:18891:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1783135191.274844:0:18241:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783135191.274848:0:18241:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000757d0a52/0xd6c4b8f0586803f7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135191.274856:0:18241:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe9fe43ea00 already unused, calling callback (ffffffffc1527ce0) 00010000:00010000:0.0:1783135191.274859:0:18241:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000757d0a52/0xd6c4b8f0586803f7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135191.274867:0:18241:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000757d0a52/0xd6c4b8f0586803f7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135191.274898:0:18241:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000757d0a52/0xd6c4b8f0586803f7 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135191.274921:0:18241:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000757d0a52/0xd6c4b8f0586803f7 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135191.274936:0:18241:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783135191.274937:0:18241:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783135191.274939:0:18241:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1783135191.275189:0:18891:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x26:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1783135191.275196:0:18891:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a7a79ae1/0xd6c4b8f0586803fe lrc: 3/0,1 mode: --/PW res: [0x280000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135191.275204:0:18891:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x26:0x0].0x0 since=473s v=(0 0) 00010000:00010000:1.0:1783135191.275207:0:18891:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x26:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783135191.275211:0:18891:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a7a79ae1/0xd6c4b8f0586803fe lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135191.275220:0:18891:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a7a79ae1/0xd6c4b8f0586803fe lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135191.275228:0:18891:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a7a79ae1/0xd6c4b8f0586803fe lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135191.275235:0:18891:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a7a79ae1/0xd6c4b8f0586803fe lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135191.275256:0:18891:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1783135191.275651:0:18891:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x25:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1783135191.275656:0:18891:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000083f2968d/0xd6c4b8f058680405 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135191.275670:0:18891:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x25:0x0].0x0 since=473s v=(0 0) 00010000:00010000:1.0:1783135191.275673:0:18891:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x25:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783135191.275677:0:18891:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000083f2968d/0xd6c4b8f058680405 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135191.275685:0:18891:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000083f2968d/0xd6c4b8f058680405 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135191.275693:0:18891:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000083f2968d/0xd6c4b8f058680405 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135191.275695:0:18241:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783135191.275700:0:18241:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a7a79ae1/0xd6c4b8f0586803fe lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135191.275701:0:18891:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000083f2968d/0xd6c4b8f058680405 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135191.275709:0:18241:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe9fe43ee00 already unused, calling callback (ffffffffc1527ce0) 00010000:00010000:1.0:1783135191.275710:0:18891:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1783135191.275712:0:18241:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a7a79ae1/0xd6c4b8f0586803fe lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135191.275720:0:18241:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a7a79ae1/0xd6c4b8f0586803fe lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135191.275731:0:18241:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a7a79ae1/0xd6c4b8f0586803fe lrc: 1/0,0 mode: --/PW res: [0x280000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135191.275739:0:18241:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a7a79ae1/0xd6c4b8f0586803fe lrc: 0/0,0 mode: --/PW res: [0x280000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135191.275754:0:18241:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783135191.275758:0:18241:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000083f2968d/0xd6c4b8f058680405 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135191.275840:0:18241:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe9fe43fa00 already unused, calling callback (ffffffffc1527ce0) 00010000:00010000:0.0:1783135191.275844:0:18241:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000083f2968d/0xd6c4b8f058680405 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135191.275852:0:18241:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000083f2968d/0xd6c4b8f058680405 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135191.275863:0:18241:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000083f2968d/0xd6c4b8f058680405 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135191.275870:0:18241:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000083f2968d/0xd6c4b8f058680405 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135191.275894:0:18241:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783135191.276067:0:18241:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783135191.276069:0:18241:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783135191.277953:0:18240:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1783135191.279314:0:18891:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x24:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1783135191.279330:0:18891:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d6a83bdc/0xd6c4b8f05868040c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135191.279351:0:18891:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x24:0x0].0x0 since=473s v=(0 0) 00010000:00010000:0.0:1783135191.279356:0:18891:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x24:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783135191.279362:0:18891:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d6a83bdc/0xd6c4b8f05868040c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135191.279380:0:18891:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d6a83bdc/0xd6c4b8f05868040c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135191.279401:0:18891:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d6a83bdc/0xd6c4b8f05868040c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135191.279409:0:18891:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d6a83bdc/0xd6c4b8f05868040c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135191.279433:0:18891:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1783135191.279916:0:18891:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x23:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1783135191.279923:0:18891:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fd8fb796/0xd6c4b8f058680413 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135191.279932:0:18891:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x23:0x0].0x0 since=473s v=(0 0) 00010000:00010000:0.0:1783135191.279936:0:18891:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x23:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783135191.279940:0:18891:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fd8fb796/0xd6c4b8f058680413 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135191.279947:0:18241:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783135191.279948:0:18891:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fd8fb796/0xd6c4b8f058680413 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135191.279954:0:18241:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d6a83bdc/0xd6c4b8f05868040c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135191.279956:0:18891:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fd8fb796/0xd6c4b8f058680413 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135191.279963:0:18241:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe9f68ad800 already unused, calling callback (ffffffffc1527ce0) 00010000:00010000:0.0:1783135191.279964:0:18891:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fd8fb796/0xd6c4b8f058680413 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135191.279968:0:18241:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d6a83bdc/0xd6c4b8f05868040c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135191.279977:0:18241:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d6a83bdc/0xd6c4b8f05868040c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135191.279984:0:18891:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783135191.280003:0:18241:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d6a83bdc/0xd6c4b8f05868040c lrc: 1/0,0 mode: --/PW res: [0x280000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135191.280011:0:18241:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d6a83bdc/0xd6c4b8f05868040c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135191.280029:0:18241:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783135191.280033:0:18241:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fd8fb796/0xd6c4b8f058680413 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135191.280040:0:18241:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe9f68adc00 already unused, calling callback (ffffffffc1527ce0) 00010000:00010000:1.0:1783135191.280043:0:18241:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fd8fb796/0xd6c4b8f058680413 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135191.280050:0:18241:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fd8fb796/0xd6c4b8f058680413 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135191.280060:0:18241:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fd8fb796/0xd6c4b8f058680413 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135191.280067:0:18241:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fd8fb796/0xd6c4b8f058680413 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135191.280078:0:18241:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783135191.280080:0:18241:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783135191.280087:0:18241:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783135191.280132:0:18240:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:1.0:1783135191.280684:0:18891:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x280000400:34 00000100:00100000:0.0:1783135191.283816:0:18891:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe8c590ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:18277:x1869752384471936:12345-0@lo:5:osp-pre-1-0.0 Request processed in 88307us (88497us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135191.283832:0:18891:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1783135191.287825:0:18277:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe8c590e680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:18277:1869752384471936:0@lo:5:osp-pre-1-0.0 00000004:00080000:3.0:1783135191.287844:0:18277:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x280000400:0x41:0x0] from OST, last_created [0x280000400:0x41:0x0]last_used is [0x280000400:0x22:0x0] 00000100:00100000:3.0:1783135191.287910:0:18277:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9fe90c000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:18277:1869752384472064:0@lo:5:osp-pre-1-0.0 00000100:00100000:3.0:1783135191.287973:0:18277:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135191.288005:0:19201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384472064 00000100:00100000:1.0:1783135191.288012:0:19201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384472064 00000100:00100000:3.0:1783135191.288033:0:18277:0:(client.c:2701:ptlrpc_set_wait()) set ffff9fe9c9d15780 going to sleep for 11 seconds 00000100:00100000:1.0:1783135191.288058:0:19201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1783135191.288072:0:19201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fe90e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:18277:x1869752384472064:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:1.0:1783135191.288117:0:19201:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 66 00000100:00100000:1.0:1783135191.299431:0:19201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fe90e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:18277:x1869752384472064:12345-0@lo:5:osp-pre-1-0.0 Request processed in 11357us (11450us total) trans 12884901889 rc 0/0 00000100:00100000:1.0:1783135191.299446:0:19201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1783135191.304998:0:18277:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9fe90c000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:18277:1869752384472064:0@lo:5:osp-pre-1-0.0 00000004:00080000:2.0:1783135191.305017:0:18277:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x41:0x0]-[0x280000400:0x61:0x0] 00010000:00010000:3.0:1783135192.006122:0:18241:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783135192.717268:0:3289:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9f6fe6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1869752384472192:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1783135192.717464:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135192.717601:0:18894:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384472192 00000100:00100000:1.0:1783135192.717609:0:18894:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384472192 00000100:00100000:1.0:1783135192.717660:0:18894:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1783135192.717668:0:18894:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fe90f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3289:x1869752384472192:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1783135192.717706:0:18894:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1783135192.721012:0:18894:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fe90f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3289:x1869752384472192:12345-0@lo:13:osp-pre-0-0.0 Request processed in 3333us (3537us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135192.721027:0:18894:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1783135192.721162:0:3289:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9f6fe6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1869752384472192:0@lo:13:osp-pre-0-0.0 00000001:02000400:3.0:1783135193.012988:0:19917:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg141-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1783135193.027459:0:18240:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783135194.051461:0:18241:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1783135194.371792:0:18286:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1783135195.012964:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:2.0:1783135195.018800:0:18245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752374019456 00000100:00100000:2.0:1783135195.018825:0:18245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752374019456 00000100:00100000:3.0:1783135195.025010:0:18245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 76 00000100:00100000:3.0:1783135195.025039:0:18245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fe69f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:2366:x1869752374019456:12345-192.168.201.41@tcp:250:mount.lustre.0 00010000:00080000:3.0:1783135195.025230:0:18245:0:(ldlm_lib.c:1432:target_handle_connect()) MGS: connection from aff003e6-38dd-4a94-ba97-2d703b4bd555@192.168.201.41@tcp t0 exp 0000000000000000 cur 477 last 0 00000020:00000080:3.0:1783135195.026911:0:18245:0:(genops.c:1406:class_connect()) connect: client aff003e6-38dd-4a94-ba97-2d703b4bd555, cookie 0xd6c4b8f05868041a 00000100:00080000:3.0:1783135195.027084:0:18245:0:(import.c:65:import_set_state_nolock()) ffff9fe9c8d79000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1783135195.027167:0:18245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fe69f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aff003e6-38dd-4a94-ba97-2d703b4bd555+5:2366:x1869752374019456:12345-192.168.201.41@tcp:250:mount.lustre.0 Request processed in 2128us (14212us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135195.027178:0:18245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 76 00000100:00100000:3.0:1783135195.044771:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:0.0:1783135195.045038:0:18247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752374019584 00000100:00100000:0.0:1783135195.045050:0:18247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752374019584 00000100:00100000:0.0:1783135195.045123:0:18247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 77 00000100:00100000:0.0:1783135195.045134:0:18247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fe69d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aff003e6-38dd-4a94-ba97-2d703b4bd555+5:16733:x1869752374019584:12345-192.168.201.41@tcp:101:mount.lustre.0 00010000:00010000:0.0:1783135195.045152:0:18247:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783135195.045170:0:18247:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fe9f68ada00/0xd6c4b8f058680421 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x4428da03f5eb77eb expref: -99 pid: 18247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135195.045202:0:18247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fe9f68ada00/0xd6c4b8f058680421 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb77eb expref: 6 pid: 18247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135195.045215:0:18247:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fe9f68ada00/0xd6c4b8f058680421 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb77eb expref: 6 pid: 18247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135195.045225:0:18247:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fe9f68ada00, rc 0) 00000100:00100000:0.0:1783135195.045341:0:18247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fe69d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aff003e6-38dd-4a94-ba97-2d703b4bd555+6:16733:x1869752374019584:12345-192.168.201.41@tcp:101:mount.lustre.0 Request processed in 208us (578us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135195.045349:0:18247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 77 00000100:00100000:2.0:1783135195.071599:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00010000:00010000:1.0:1783135195.077138:0:18240:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783135195.079241:0:18245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752374019712 00000100:00100000:3.0:1783135195.079258:0:18245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752374019712 00000100:00100000:2.0:1783135195.080015:0:18245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 78 00000100:00100000:2.0:1783135195.080027:0:18245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fe69e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aff003e6-38dd-4a94-ba97-2d703b4bd555+6:16733:x1869752374019712:12345-192.168.201.41@tcp:501:mount.lustre.0 00000100:00100000:2.0:1783135195.080386:0:18245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fe69e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aff003e6-38dd-4a94-ba97-2d703b4bd555+6:16733:x1869752374019712:12345-192.168.201.41@tcp:501:mount.lustre.0 Request processed in 360us (8794us total) trans 0 rc -2/-2 00000100:00100000:2.0:1783135195.080395:0:18245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 78 00000100:00100000:1.0:1783135195.084785:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:0.0:1783135195.087819:0:18247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752374019840 00000100:00100000:0.0:1783135195.087836:0:18247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752374019840 00000100:00100000:0.0:1783135195.087914:0:18247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 79 00000100:00100000:0.0:1783135195.087926:0:18247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fe69d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aff003e6-38dd-4a94-ba97-2d703b4bd555+6:16733:x1869752374019840:12345-192.168.201.41@tcp:101:mount.lustre.0 00010000:00010000:0.0:1783135195.087960:0:18247:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783135195.087980:0:18247:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fe9f68ac800/0xd6c4b8f058680428 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x4428da03f5eb77f2 expref: -99 pid: 18247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135195.088013:0:18247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fe9f68ac800/0xd6c4b8f058680428 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb77f2 expref: 7 pid: 18247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135195.088025:0:18247:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fe9f68ac800/0xd6c4b8f058680428 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb77f2 expref: 7 pid: 18247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135195.088034:0:18247:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fe9f68ac800, rc 0) 00000100:00100000:0.0:1783135195.088122:0:18247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fe69d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aff003e6-38dd-4a94-ba97-2d703b4bd555+7:16733:x1869752374019840:12345-192.168.201.41@tcp:101:mount.lustre.0 Request processed in 199us (3350us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135195.088129:0:18247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 79 00000100:00100000:1.0:1783135195.091509:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:0.0:1783135195.091627:0:18247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752374019968 00000100:00100000:0.0:1783135195.091641:0:18247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752374019968 00000100:00100000:0.0:1783135195.091800:0:18247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 80 00000100:00100000:0.0:1783135195.091822:0:18247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fe69f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aff003e6-38dd-4a94-ba97-2d703b4bd555+7:16733:x1869752374019968:12345-192.168.201.41@tcp:501:mount.lustre.0 00000100:00100000:0.0:1783135195.092667:0:18247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fe69f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aff003e6-38dd-4a94-ba97-2d703b4bd555+8:16733:x1869752374019968:12345-192.168.201.41@tcp:501:mount.lustre.0 Request processed in 837us (1162us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135195.092678:0:18247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 80 00000100:00100000:3.0:1783135195.096383:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:0.0:1783135195.096753:0:18246:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752374020096 00000100:00100000:0.0:1783135195.096768:0:18246:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752374020096 00000100:00100000:0.0:1783135195.096923:0:18246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 81 00000100:00100000:0.0:1783135195.096937:0:18246:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fff54850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aff003e6-38dd-4a94-ba97-2d703b4bd555+8:16733:x1869752374020096:12345-192.168.201.41@tcp:503:mount.lustre.0 00000100:00100000:0.0:1783135195.098671:0:18246:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fff54850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aff003e6-38dd-4a94-ba97-2d703b4bd555+8:16733:x1869752374020096:12345-192.168.201.41@tcp:503:mount.lustre.0 Request processed in 1724us (2299us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135195.098700:0:18246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 81 00000100:00100000:1.0:1783135195.102630:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:2.0:1783135195.102747:0:18245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752374020224 00000100:00100000:2.0:1783135195.102761:0:18245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752374020224 00000100:00100000:2.0:1783135195.102848:0:18245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 82 00000100:00100000:2.0:1783135195.102861:0:18245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fff57050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aff003e6-38dd-4a94-ba97-2d703b4bd555+8:16752:x1869752374020224:12345-192.168.201.41@tcp:502:llog_process_th.0 00000100:00100000:2.0:1783135195.103409:0:18245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fff57050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aff003e6-38dd-4a94-ba97-2d703b4bd555+8:16752:x1869752374020224:12345-192.168.201.41@tcp:502:llog_process_th.0 Request processed in 547us (792us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135195.103418:0:18245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 82 00000100:00100000:1.0:1783135195.128800:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:0.0:1783135195.128936:0:18246:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752374020352 00000100:00100000:0.0:1783135195.128952:0:18246:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752374020352 00000100:00100000:0.0:1783135195.129096:0:18246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 83 00000100:00100000:0.0:1783135195.129110:0:18246:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fff57c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aff003e6-38dd-4a94-ba97-2d703b4bd555+8:16752:x1869752374020352:12345-192.168.201.41@tcp:502:llog_process_th.0 00000100:00100000:0.0:1783135195.129547:0:18246:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fff57c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aff003e6-38dd-4a94-ba97-2d703b4bd555+8:16752:x1869752374020352:12345-192.168.201.41@tcp:502:llog_process_th.0 Request processed in 438us (759us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135195.129556:0:18246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 83 00000100:00100000:3.0:1783135195.139965:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:1.0:1783135195.140346:0:18247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752374020480 00000100:00100000:1.0:1783135195.140360:0:18247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752374020480 00000100:00100000:1.0:1783135195.140444:0:18247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 84 00000100:00100000:1.0:1783135195.140458:0:18247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fff55c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aff003e6-38dd-4a94-ba97-2d703b4bd555+8:16733:x1869752374020480:12345-192.168.201.41@tcp:101:mount.lustre.0 00010000:00010000:1.0:1783135195.140504:0:18247:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783135195.140527:0:18247:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fe9fe43fa00/0xd6c4b8f05868042f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x4428da03f5eb781c expref: -99 pid: 18247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135195.140568:0:18247:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fe9fe43fa00/0xd6c4b8f05868042f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb781c expref: 9 pid: 18247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135195.140581:0:18247:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fe9fe43fa00/0xd6c4b8f05868042f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb781c expref: 9 pid: 18247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135195.140593:0:18247:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fe9fe43fa00, rc 0) 00000100:00100000:1.0:1783135195.140689:0:18247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fff55c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aff003e6-38dd-4a94-ba97-2d703b4bd555+9:16733:x1869752374020480:12345-192.168.201.41@tcp:101:mount.lustre.0 Request processed in 233us (739us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135195.140699:0:18247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 84 00000100:00100000:1.0:1783135195.144939:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:0.0:1783135195.146463:0:18246:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752374020608 00000100:00100000:0.0:1783135195.146485:0:18246:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752374020608 00000100:00100000:0.0:1783135195.146627:0:18246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 85 00000100:00100000:0.0:1783135195.146642:0:18246:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fff56c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aff003e6-38dd-4a94-ba97-2d703b4bd555+9:16733:x1869752374020608:12345-192.168.201.41@tcp:256:mount.lustre.0 20000000:01000000:0.0:1783135195.146684:0:18246:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:0.0:1783135195.146719:0:18246:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1783135195.146723:0:18246:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1783135195.146726:0:18246:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1783135195.146728:0:18246:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 11 00000100:00100000:0.0:1783135195.148858:0:18246:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fff56c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aff003e6-38dd-4a94-ba97-2d703b4bd555+9:16733:x1869752374020608:12345-192.168.201.41@tcp:256:mount.lustre.0 Request processed in 2203us (3917us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135195.148878:0:18246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 85 00000100:00100000:3.0:1783135195.152146:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:2.0:1783135195.152356:0:18245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752374020736 00000100:00100000:2.0:1783135195.152370:0:18245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752374020736 00000100:00100000:2.0:1783135195.152455:0:18245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 86 00000100:00100000:2.0:1783135195.152469:0:18245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fff57450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aff003e6-38dd-4a94-ba97-2d703b4bd555+9:16733:x1869752374020736:12345-192.168.201.41@tcp:101:mount.lustre.0 00010000:00010000:2.0:1783135195.152499:0:18245:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783135195.152523:0:18245:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fe9c7828c00/0xd6c4b8f058680436 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x4428da03f5eb7823 expref: -99 pid: 18245 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135195.152587:0:18245:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fe9c7828c00/0xd6c4b8f058680436 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb7823 expref: 10 pid: 18245 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135195.152601:0:18245:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fe9c7828c00/0xd6c4b8f058680436 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb7823 expref: 10 pid: 18245 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135195.152609:0:18245:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fe9c7828c00, rc 0) 00000100:00100000:2.0:1783135195.152678:0:18245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fff57450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aff003e6-38dd-4a94-ba97-2d703b4bd555+10:16733:x1869752374020736:12345-192.168.201.41@tcp:101:mount.lustre.0 Request processed in 211us (553us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135195.152686:0:18245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 86 00000100:00100000:1.0:1783135195.155214:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:0.0:1783135195.155688:0:18246:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752374020864 00000100:00100000:0.0:1783135195.155702:0:18246:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752374020864 00000100:00100000:0.0:1783135195.155823:0:18246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 87 00000100:00100000:0.0:1783135195.155899:0:18246:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fff54050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aff003e6-38dd-4a94-ba97-2d703b4bd555+10:16733:x1869752374020864:12345-192.168.201.41@tcp:501:mount.lustre.0 00000100:00100000:0.0:1783135195.156534:0:18246:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fff54050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aff003e6-38dd-4a94-ba97-2d703b4bd555+10:16733:x1869752374020864:12345-192.168.201.41@tcp:501:mount.lustre.0 Request processed in 638us (1330us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135195.156554:0:18246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 87 00000100:00100000:3.0:1783135195.158555:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:1.0:1783135195.158678:0:18247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752374020992 00000100:00100000:1.0:1783135195.158691:0:18247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752374020992 00000100:00100000:1.0:1783135195.158765:0:18247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 88 00000100:00100000:1.0:1783135195.158776:0:18247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fff55050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aff003e6-38dd-4a94-ba97-2d703b4bd555+10:16733:x1869752374020992:12345-192.168.201.41@tcp:503:mount.lustre.0 00000100:00100000:1.0:1783135195.159586:0:18247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fff55050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aff003e6-38dd-4a94-ba97-2d703b4bd555+10:16733:x1869752374020992:12345-192.168.201.41@tcp:503:mount.lustre.0 Request processed in 806us (1041us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135195.159598:0:18247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 88 00000100:00100000:3.0:1783135195.162354:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:0.0:1783135195.162460:0:18246:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752374021120 00000100:00100000:0.0:1783135195.162471:0:18246:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752374021120 00000100:00100000:0.0:1783135195.162532:0:18246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 89 00000100:00100000:0.0:1783135195.162547:0:18246:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fff57850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aff003e6-38dd-4a94-ba97-2d703b4bd555+10:16756:x1869752374021120:12345-192.168.201.41@tcp:502:llog_process_th.0 00000100:00100000:0.0:1783135195.163319:0:18246:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fff57850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aff003e6-38dd-4a94-ba97-2d703b4bd555+10:16756:x1869752374021120:12345-192.168.201.41@tcp:502:llog_process_th.0 Request processed in 770us (973us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135195.163328:0:18246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 89 00000100:00100000:3.0:1783135195.166382:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:0.0:1783135195.167946:0:18247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752374021248 00000100:00100000:0.0:1783135195.167962:0:18247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752374021248 00000100:00100000:0.0:1783135195.168066:0:18247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 90 00000100:00100000:0.0:1783135195.168089:0:18247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fff55850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aff003e6-38dd-4a94-ba97-2d703b4bd555+10:16756:x1869752374021248:12345-192.168.201.41@tcp:502:llog_process_th.0 00000100:00100000:0.0:1783135195.168504:0:18247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fff55850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aff003e6-38dd-4a94-ba97-2d703b4bd555+10:16756:x1869752374021248:12345-192.168.201.41@tcp:502:llog_process_th.0 Request processed in 416us (2147us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135195.168513:0:18247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 90 00000100:00100000:3.0:1783135195.183683:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:0.0:1783135195.185330:0:18252:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752374021376 00000100:00100000:0.0:1783135195.185350:0:18252:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752374021376 00000100:00100000:0.0:1783135195.185432:0:18252:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 4 00000100:00100000:0.0:1783135195.185443:0:18252:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fe90d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2366:x1869752374021376:12345-192.168.201.41@tcp:38:mount.lustre.0 00010000:00080000:1.0:1783135195.185567:0:18252:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from be37dafa-e6ef-4275-9c00-a4e42a1df10b@192.168.201.41@tcp t0 exp 0000000000000000 cur 477 last 0 00000020:00000080:1.0:1783135195.185638:0:18252:0:(genops.c:1406:class_connect()) connect: client be37dafa-e6ef-4275-9c00-a4e42a1df10b, cookie 0xd6c4b8f05868043d 00000004:00100000:1.0:1783135195.185700:0:18252:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000001:00000004:1.0:1783135195.185727:0:18252:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 3, last_transno is 12884901888 00000100:00080000:1.0:1783135195.240346:0:18252:0:(import.c:65:import_set_state_nolock()) ffff9fe9efd86000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1783135195.240480:0:18252:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fe90d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:be37dafa-e6ef-4275-9c00-a4e42a1df10b+6:2366:x1869752374021376:12345-192.168.201.41@tcp:38:mount.lustre.0 Request processed in 55035us (56813us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135195.240494:0:18252:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 4 00000100:00100000:3.0:1783135195.244015:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:3.0:1783135195.244073:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:2.0:1783135195.244379:0:18254:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752374021632 00000100:00100000:2.0:1783135195.244393:0:18254:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752374021632 00000100:00100000:2.0:1783135195.244490:0:18254:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752374021504 00000100:00100000:2.0:1783135195.244493:0:18254:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752374021504 00000100:00100000:2.0:1783135195.244523:0:18254:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 5 00000100:00100000:2.0:1783135195.244535:0:18254:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fe90ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:be37dafa-e6ef-4275-9c00-a4e42a1df10b+7:16733:x1869752374021632:12345-192.168.201.41@tcp:41:mount.lustre.0 00000004:00000024:2.0:1783135195.244599:0:18254:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1783135195.244710:0:18254:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fe90ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:be37dafa-e6ef-4275-9c00-a4e42a1df10b+7:16733:x1869752374021632:12345-192.168.201.41@tcp:41:mount.lustre.0 Request processed in 176us (710us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135195.244719:0:18254:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 5 00000100:00100000:2.0:1783135195.244743:0:18254:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 6 00000100:00100000:2.0:1783135195.244750:0:18254:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fe90c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:be37dafa-e6ef-4275-9c00-a4e42a1df10b+6:0:x1869752374021504:12345-192.168.201.41@tcp:41:mount.lustre.0 00000004:00000024:2.0:1783135195.244762:0:18254:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1783135195.244786:0:18254:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fe90c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:be37dafa-e6ef-4275-9c00-a4e42a1df10b+6:0:x1869752374021504:12345-192.168.201.41@tcp:41:mount.lustre.0 Request processed in 37us (712us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135195.244826:0:18254:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 6 00000100:00080000:3.0:1783135195.245412:0:18248:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1783135195.249165:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:2.0:1783135195.249568:0:18254:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752374021760 00000100:00100000:2.0:1783135195.249583:0:18254:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752374021760 00000100:00100000:2.0:1783135195.249721:0:18254:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 7 00000100:00100000:2.0:1783135195.249734:0:18254:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fe90f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:be37dafa-e6ef-4275-9c00-a4e42a1df10b+6:16733:x1869752374021760:12345-192.168.201.41@tcp:40:mount.lustre.0 00000100:00100000:2.0:1783135195.249884:0:18254:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fe90f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:be37dafa-e6ef-4275-9c00-a4e42a1df10b+6:16733:x1869752374021760:12345-192.168.201.41@tcp:40:mount.lustre.0 Request processed in 153us (742us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135195.249893:0:18254:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 7 00000100:00100000:3.0:1783135195.252538:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:3.0:1783135195.252606:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:3.0:1783135195.252640:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:3.0:1783135195.252679:0:18890:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752374021888 00000100:00100000:3.0:1783135195.252690:0:18890:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752374021888 00000100:00100000:3.0:1783135195.252739:0:18890:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752374022016 00000100:00100000:3.0:1783135195.252743:0:18890:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752374022016 00000100:00100000:3.0:1783135195.252790:0:18890:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 9 00000100:00100000:3.0:1783135195.252800:0:18890:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fe90ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2366:x1869752374021888:12345-192.168.201.41@tcp:8:mount.lustre.0 00010000:00080000:3.0:1783135195.252862:0:18890:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0000: connection from be37dafa-e6ef-4275-9c00-a4e42a1df10b@192.168.201.41@tcp t0 exp 0000000000000000 cur 477 last 0 00000020:00000080:3.0:1783135195.252903:0:18890:0:(genops.c:1406:class_connect()) connect: client be37dafa-e6ef-4275-9c00-a4e42a1df10b, cookie 0xd6c4b8f058680444 00002000:00100000:3.0:1783135195.252919:0:18890:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli be37dafa-e6ef-4275-9c00-a4e42a1df10b/ffff9fe9c8d7f000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113653 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1783135195.252955:0:18890:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:3.0:1783135195.253441:0:18890:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1783135195.253489:0:18890:0:(import.c:65:import_set_state_nolock()) ffff9fe9c8d7d800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1783135195.253599:0:18890:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fe90ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:be37dafa-e6ef-4275-9c00-a4e42a1df10b+6:2366:x1869752374021888:12345-192.168.201.41@tcp:8:mount.lustre.0 Request processed in 796us (989us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135195.253611:0:18890:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 9 00000100:00100000:3.0:1783135195.253639:0:18890:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 10 00000100:00100000:3.0:1783135195.253645:0:18890:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fe90dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2366:x1869752374022016:12345-192.168.201.41@tcp:8:mount.lustre.0 00010000:00080000:3.0:1783135195.253668:0:18890:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0001: connection from be37dafa-e6ef-4275-9c00-a4e42a1df10b@192.168.201.41@tcp t0 exp 0000000000000000 cur 477 last 0 00000020:00000080:3.0:1783135195.253691:0:18890:0:(genops.c:1406:class_connect()) connect: client be37dafa-e6ef-4275-9c00-a4e42a1df10b, cookie 0xd6c4b8f05868044b 00002000:00100000:3.0:1783135195.253700:0:18890:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli be37dafa-e6ef-4275-9c00-a4e42a1df10b/ffff9fe9c8d7e000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113653 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1783135195.253719:0:18890:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:3.0:1783135195.253888:0:18890:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1783135195.253906:0:18890:0:(import.c:65:import_set_state_nolock()) ffff9fe9c8d7a000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1783135195.253933:0:18890:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fe90dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:be37dafa-e6ef-4275-9c00-a4e42a1df10b+6:2366:x1869752374022016:12345-192.168.201.41@tcp:8:mount.lustre.0 Request processed in 286us (1291us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135195.253940:0:18890:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 10 00000100:00100000:0.0:1783135195.254618:0:18255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752374022144 00000100:00100000:0.0:1783135195.254632:0:18255:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752374022144 00000100:00100000:0.0:1783135195.254723:0:18255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 0 00000100:00100000:0.0:1783135195.254735:0:18255:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fe90ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:be37dafa-e6ef-4275-9c00-a4e42a1df10b+6:16733:x1869752374022144:12345-192.168.201.41@tcp:33:mount.lustre.0 00000004:00080000:2.0:1783135195.260887:0:18255:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 6032us 00000004:00200000:3.0:1783135195.301146:0:18255:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000100:00100000:3.0:1783135195.303884:0:18255:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fe90ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:be37dafa-e6ef-4275-9c00-a4e42a1df10b+6:16733:x1869752374022144:12345-192.168.201.41@tcp:33:mount.lustre.0 Request processed in 49136us (51346us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135195.303918:0:18255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 0 00000001:00100000:2.0:1783135195.308385:0:6602:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of be37dafa-e6ef-4275-9c00-a4e42a1df10b 00000100:00100000:3.0:1783135195.539588:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:1.0:1783135195.540327:0:19572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752374022272 00000100:00100000:1.0:1783135195.540341:0:19572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752374022272 00000100:00100000:1.0:1783135195.540449:0:19572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 8 00000100:00100000:1.0:1783135195.540463:0:19572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fe90ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:be37dafa-e6ef-4275-9c00-a4e42a1df10b+6:16777:x1869752374022272:12345-192.168.201.41@tcp:101:mkdir.0 00010000:00010000:1.0:1783135195.540494:0:19572:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783135195.540532:0:19572:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43ea00/0xd6c4b8f058680452 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4428da03f5eb784d expref: -99 pid: 19572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135195.540638:0:19572:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43f800/0xd6c4b8f058680459 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 19572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135195.540659:0:19572:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43f800/0xd6c4b8f058680459 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135195.540676:0:19572:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43f800/0xd6c4b8f058680459 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19572 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783135195.541276:0:19572:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:1.0:1783135195.541308:0:19572:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 4 stripe count 1 MDT count 1 00000004:00010000:1.0:1783135195.541447:0:19572:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43f800/0xd6c4b8f058680459 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135195.541488:0:19572:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43ea00/0xd6c4b8f058680452 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb784d expref: 8 pid: 19572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135195.541524:0:19572:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43f800/0xd6c4b8f058680459 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb784d expref: 7 pid: 19572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135195.541536:0:19572:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fe9c9dd3100) 00010000:00010000:1.0:1783135195.541539:0:19572:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1783135195.541544:0:19572:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fe9fe43f800, rc 0) 00000100:00100000:1.0:1783135195.541640:0:19572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fe90ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:be37dafa-e6ef-4275-9c00-a4e42a1df10b+7:16777:x1869752374022272:12345-192.168.201.41@tcp:101:mkdir.0 Request processed in 1179us (2075us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135195.541649:0:19572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 8 00010000:00010000:3.0:1783135196.102514:0:18241:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783135196.299168:0:3286:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9fec14a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:06a7653e-5f5a-4acc-ba93-0eff19f145f0:3286:1869752384472320:0@lo:400:kworker.0 00000100:00100000:3.0:1783135196.299307:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135196.299361:0:3286:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9fec14700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3286:1869752384472832:0@lo:400:kworker.0 00000100:00100000:3.0:1783135196.299390:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135196.299421:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1783135196.299427:0:3286:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9fec16a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1869752384472448:0@lo:400:kworker.0 00000100:00100000:3.0:1783135196.299451:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135196.299468:0:3286:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9fec17480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3286:1869752384472960:0@lo:400:kworker.0 00000100:00100000:3.0:1783135196.299519:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135196.299553:0:3288:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9fec14380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1869752384472576:0@lo:400:kworker.0 00000100:00100000:3.0:1783135196.299576:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135196.299594:0:3288:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1783135196.299599:0:3288:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9fec16680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3288:1869752384472704:0@lo:400:kworker.0 00000100:00100000:3.0:1783135196.299620:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135196.299655:0:18246:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384472320 00000100:00100000:3.0:1783135196.299664:0:18246:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384472320 00000100:00100000:3.0:1783135196.299720:0:18246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1783135196.299746:0:18246:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fff56850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:06a7653e-5f5a-4acc-ba93-0eff19f145f0+19:3286:x1869752384472320:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783135196.299816:0:18246:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fff56850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:06a7653e-5f5a-4acc-ba93-0eff19f145f0+19:3286:x1869752384472320:12345-0@lo:400:kworker.0 Request processed in 86us (539us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135196.299824:0:18246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1783135196.299863:0:18890:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384472448 00000100:00100000:3.0:1783135196.299874:0:18890:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384472448 00000100:00100000:3.0:1783135196.299913:0:18890:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384472576 00000100:00100000:3.0:1783135196.299916:0:18890:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384472576 00000100:00100000:3.0:1783135196.299937:0:18890:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1783135196.299943:0:18890:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fec14e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3286:x1869752384472448:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783135196.299978:0:18890:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fec14e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3286:x1869752384472448:12345-0@lo:400:kworker.0 Request processed in 35us (525us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135196.299984:0:18890:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1783135196.299995:0:18890:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1783135196.300001:0:18890:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fec16d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3288:x1869752384472576:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783135196.300031:0:18890:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fec16d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3288:x1869752384472576:12345-0@lo:400:kworker.0 Request processed in 31us (453us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135196.300037:0:18890:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1783135196.300055:0:18254:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384472832 00000100:00100000:3.0:1783135196.300059:0:18254:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384472832 00000100:00100000:3.0:1783135196.300085:0:18254:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384472960 00000100:00100000:3.0:1783135196.300087:0:18254:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384472960 00000100:00100000:3.0:1783135196.300101:0:18254:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384472704 00000100:00100000:3.0:1783135196.300103:0:18254:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384472704 00000100:00100000:3.0:1783135196.300114:0:18254:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1783135196.300120:0:18254:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fec15f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3286:x1869752384472832:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783135196.300148:0:18254:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fec15f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3286:x1869752384472832:12345-0@lo:400:kworker.0 Request processed in 29us (758us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135196.300154:0:18254:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1783135196.300164:0:18254:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1783135196.300169:0:18254:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fec15c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3286:x1869752384472960:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783135196.300190:0:18254:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fec15c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3286:x1869752384472960:12345-0@lo:400:kworker.0 Request processed in 22us (671us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135196.300205:0:18254:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1783135196.300216:0:18254:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1783135196.300221:0:18254:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fec15500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3288:x1869752384472704:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783135196.300248:0:18254:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fec15500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3288:x1869752384472704:12345-0@lo:400:kworker.0 Request processed in 26us (626us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135196.300253:0:18254:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1783135196.300326:0:3286:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9fec16a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1869752384472448:0@lo:400:kworker.0 00000100:00100000:3.0:1783135196.300338:0:3286:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9fec17480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3286:1869752384472960:0@lo:400:kworker.0 00000100:00100000:3.0:1783135196.300345:0:3286:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9fec14a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:06a7653e-5f5a-4acc-ba93-0eff19f145f0:3286:1869752384472320:0@lo:400:kworker.0 00000100:00100000:3.0:1783135196.300354:0:3286:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9fec14700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3286:1869752384472832:0@lo:400:kworker.0 00000100:00080000:3.0:1783135196.300383:0:18248:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1783135196.300388:0:18248:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1783135196.300390:0:18248:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1783135196.300411:0:3288:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9fec16680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3288:1869752384472704:0@lo:400:kworker.0 00000100:00100000:3.0:1783135196.300419:0:3288:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9fec14380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1869752384472576:0@lo:400:kworker.0 00000100:00100000:1.0:1783135196.304174:0:3288:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe8c590f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1869752384473088:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1783135196.304269:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135196.304437:0:18894:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384473088 00000100:00100000:1.0:1783135196.304446:0:18894:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384473088 00000100:00100000:1.0:1783135196.304505:0:18894:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1783135196.304515:0:18894:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe8c590c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3288:x1869752384473088:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1783135196.304544:0:18894:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1783135196.304598:0:18894:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe8c590c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3288:x1869752384473088:12345-0@lo:13:osp-pre-1-0.0 Request processed in 84us (328us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135196.304606:0:18894:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1783135196.304665:0:3288:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe8c590f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1869752384473088:0@lo:13:osp-pre-1-0.0 00000001:00080000:3.0:1783135196.447380:0:7470:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 12884901889 is committed 00000001:00100000:3.0:1783135196.447448:0:7470:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00100000:3.0:1783135196.447459:0:7470:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of be37dafa-e6ef-4275-9c00-a4e42a1df10b 00010000:00010000:1.0:1783135197.124207:0:18240:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783135197.576862:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:3.0:1783135197.576969:0:18254:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752374022400 00000100:00100000:3.0:1783135197.576983:0:18254:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752374022400 00000100:00100000:3.0:1783135197.577098:0:18254:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 9 00000100:00100000:3.0:1783135197.577112:0:18254:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9f6fe4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:be37dafa-e6ef-4275-9c00-a4e42a1df10b+7:16829:x1869752374022400:12345-192.168.201.41@tcp:41:lfs.0 00000004:00000024:3.0:1783135197.577178:0:18254:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1783135197.577353:0:18254:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9f6fe4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:be37dafa-e6ef-4275-9c00-a4e42a1df10b+7:16829:x1869752374022400:12345-192.168.201.41@tcp:41:lfs.0 Request processed in 244us (507us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135197.577362:0:18254:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 9 00000100:00080000:0.0:1783135197.577864:0:18248:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1783135197.594847:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:1.0:1783135197.607096:0:18894:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752374022528 00000100:00100000:1.0:1783135197.607117:0:18894:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752374022528 00000100:00100000:1.0:1783135197.607477:0:18894:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 6 00000100:00100000:1.0:1783135197.607492:0:18894:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fec14380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:be37dafa-e6ef-4275-9c00-a4e42a1df10b+5:16829:x1869752374022528:12345-192.168.201.41@tcp:13:lfs.0 00002000:00000024:1.0:1783135197.607568:0:18894:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1783135197.607724:0:18894:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fec14380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:be37dafa-e6ef-4275-9c00-a4e42a1df10b+5:16829:x1869752374022528:12345-192.168.201.41@tcp:13:lfs.0 Request processed in 235us (12893us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135197.607733:0:18894:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 6 00000100:00080000:0.0:1783135197.608193:0:18248:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1783135197.611849:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:1.0:1783135197.612388:0:18894:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752374022656 00000100:00100000:1.0:1783135197.612402:0:18894:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752374022656 00000100:00100000:1.0:1783135197.612497:0:18894:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 7 00000100:00100000:1.0:1783135197.612510:0:18894:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9f6fe5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:be37dafa-e6ef-4275-9c00-a4e42a1df10b+5:16829:x1869752374022656:12345-192.168.201.41@tcp:13:lfs.0 00002000:00000024:1.0:1783135197.612564:0:18894:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00080000:0.0:1783135197.612852:0:18248:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1783135197.612957:0:18894:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9f6fe5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:be37dafa-e6ef-4275-9c00-a4e42a1df10b+5:16829:x1869752374022656:12345-192.168.201.41@tcp:13:lfs.0 Request processed in 448us (1122us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135197.612967:0:18894:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 7 00000100:00100000:1.0:1783135197.829081:0:3288:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1783135197.829114:0:3288:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9f6fe5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1869752384473216:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1783135197.829210:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135197.829378:0:18892:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384473216 00000100:00100000:3.0:1783135197.829388:0:18892:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384473216 00000100:00100000:3.0:1783135197.829448:0:18892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1783135197.829459:0:18892:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe8c590f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3288:x1869752384473216:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1783135197.829489:0:18892:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1783135197.829548:0:18892:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe8c590f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3288:x1869752384473216:12345-0@lo:13:osp-pre-0-0.0 Request processed in 90us (338us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135197.829555:0:18892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1783135197.829647:0:3288:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9f6fe5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1869752384473216:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1783135197.832916:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:2.0:1783135197.833030:0:18245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752374022784 00000100:00100000:2.0:1783135197.833043:0:18245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752374022784 00000100:00100000:2.0:1783135197.833112:0:18245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 92 00000100:00100000:2.0:1783135197.833124:0:18245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fff56050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aff003e6-38dd-4a94-ba97-2d703b4bd555+10:16861:x1869752374022784:12345-192.168.201.41@tcp:101:mount.lustre.0 00010000:00010000:2.0:1783135197.833146:0:18245:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783135197.833168:0:18245:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fe9c7829c00/0xd6c4b8f058680460 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x4428da03f5eb7854 expref: -99 pid: 18245 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135197.833205:0:18245:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fe9c7829c00/0xd6c4b8f058680460 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb7854 expref: 11 pid: 18245 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135197.833218:0:18245:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fe9c7829c00/0xd6c4b8f058680460 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb7854 expref: 11 pid: 18245 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135197.833240:0:18245:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fe9c7829c00, rc 0) 00000100:00100000:2.0:1783135197.833346:0:18245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fff56050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aff003e6-38dd-4a94-ba97-2d703b4bd555+11:16861:x1869752374022784:12345-192.168.201.41@tcp:101:mount.lustre.0 Request processed in 223us (441us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135197.833354:0:18245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 92 00000100:00100000:3.0:1783135197.838965:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:0.0:1783135197.839624:0:18247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752374022912 00000100:00100000:0.0:1783135197.839637:0:18247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752374022912 00000100:00100000:0.0:1783135197.839715:0:18247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 93 00000100:00100000:0.0:1783135197.839729:0:18247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fff54450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aff003e6-38dd-4a94-ba97-2d703b4bd555+11:16861:x1869752374022912:12345-192.168.201.41@tcp:501:mount.lustre.0 00000100:00100000:0.0:1783135197.840175:0:18247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fff54450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aff003e6-38dd-4a94-ba97-2d703b4bd555+11:16861:x1869752374022912:12345-192.168.201.41@tcp:501:mount.lustre.0 Request processed in 448us (1222us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135197.840184:0:18247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 93 00000100:00100000:3.0:1783135197.845393:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:2.0:1783135197.845546:0:18245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752374023040 00000100:00100000:2.0:1783135197.845559:0:18245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752374023040 00000100:00100000:2.0:1783135197.845630:0:18245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 94 00000100:00100000:2.0:1783135197.845642:0:18245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fff56450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aff003e6-38dd-4a94-ba97-2d703b4bd555+11:16861:x1869752374023040:12345-192.168.201.41@tcp:503:mount.lustre.0 00000100:00100000:2.0:1783135197.846259:0:18245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fff56450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aff003e6-38dd-4a94-ba97-2d703b4bd555+11:16861:x1869752374023040:12345-192.168.201.41@tcp:503:mount.lustre.0 Request processed in 616us (879us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135197.846270:0:18245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 94 00000100:00100000:1.0:1783135197.854269:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:0.0:1783135197.854443:0:18247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752374023168 00000100:00100000:0.0:1783135197.854455:0:18247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752374023168 00000100:00100000:0.0:1783135197.854535:0:18247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 95 00000100:00100000:0.0:1783135197.854547:0:18247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fff55450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aff003e6-38dd-4a94-ba97-2d703b4bd555+11:16868:x1869752374023168:12345-192.168.201.41@tcp:502:llog_process_th.0 00000100:00100000:0.0:1783135197.855568:0:18247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fff55450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aff003e6-38dd-4a94-ba97-2d703b4bd555+11:16868:x1869752374023168:12345-192.168.201.41@tcp:502:llog_process_th.0 Request processed in 1017us (1310us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135197.855582:0:18247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 95 00000100:00100000:3.0:1783135197.869622:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:2.0:1783135197.870981:0:18245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752374023296 00000100:00100000:2.0:1783135197.870996:0:18245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752374023296 00000100:00100000:2.0:1783135197.871090:0:18245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 96 00000100:00100000:2.0:1783135197.871102:0:18245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fff54c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aff003e6-38dd-4a94-ba97-2d703b4bd555+11:16868:x1869752374023296:12345-192.168.201.41@tcp:502:llog_process_th.0 00000100:00100000:2.0:1783135197.871528:0:18245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fff54c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aff003e6-38dd-4a94-ba97-2d703b4bd555+11:16868:x1869752374023296:12345-192.168.201.41@tcp:502:llog_process_th.0 Request processed in 426us (1918us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135197.871538:0:18245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 96 00000100:00100000:2.0:1783135197.877205:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:3.0:1783135197.877390:0:18246:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752374023424 00000100:00100000:3.0:1783135197.877403:0:18246:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752374023424 00000100:00100000:3.0:1783135197.877537:0:18246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 97 00000100:00100000:3.0:1783135197.877548:0:18246:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fff49450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aff003e6-38dd-4a94-ba97-2d703b4bd555+11:16861:x1869752374023424:12345-192.168.201.41@tcp:101:mount.lustre.0 00010000:00010000:3.0:1783135197.877571:0:18246:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783135197.877594:0:18246:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fea02166c00/0xd6c4b8f058680467 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x4428da03f5eb787e expref: -99 pid: 18246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135197.877636:0:18246:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fea02166c00/0xd6c4b8f058680467 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb787e expref: 12 pid: 18246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135197.877649:0:18246:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fea02166c00/0xd6c4b8f058680467 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb787e expref: 12 pid: 18246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135197.877682:0:18246:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fea02166c00, rc 0) 00000100:00100000:3.0:1783135197.877783:0:18246:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fff49450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aff003e6-38dd-4a94-ba97-2d703b4bd555+12:16861:x1869752374023424:12345-192.168.201.41@tcp:101:mount.lustre.0 Request processed in 232us (586us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135197.877791:0:18246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 97 00000100:00100000:1.0:1783135197.885542:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:2.0:1783135197.885682:0:18245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752374023552 00000100:00100000:2.0:1783135197.885695:0:18245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752374023552 00000100:00100000:2.0:1783135197.885776:0:18245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 98 00000100:00100000:2.0:1783135197.885788:0:18245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fff48c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aff003e6-38dd-4a94-ba97-2d703b4bd555+12:16861:x1869752374023552:12345-192.168.201.41@tcp:256:mount.lustre.0 20000000:01000000:2.0:1783135197.885825:0:18245:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:2.0:1783135197.885864:0:18245:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1783135197.885869:0:18245:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1783135197.885872:0:18245:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1783135197.885875:0:18245:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 11 00000100:00100000:2.0:1783135197.887939:0:18245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fff48c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aff003e6-38dd-4a94-ba97-2d703b4bd555+12:16861:x1869752374023552:12345-192.168.201.41@tcp:256:mount.lustre.0 Request processed in 2141us (2400us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135197.887954:0:18245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 98 00000100:00100000:3.0:1783135197.890691:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:0.0:1783135197.890861:0:18246:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752374023680 00000100:00100000:0.0:1783135197.890872:0:18246:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752374023680 00000100:00100000:0.0:1783135197.890929:0:18246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 99 00000100:00100000:0.0:1783135197.890938:0:18246:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fff48850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aff003e6-38dd-4a94-ba97-2d703b4bd555+12:16861:x1869752374023680:12345-192.168.201.41@tcp:101:mount.lustre.0 00010000:00010000:0.0:1783135197.890957:0:18246:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783135197.890976:0:18246:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fe9f68ad800/0xd6c4b8f05868046e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x4428da03f5eb7885 expref: -99 pid: 18246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135197.891007:0:18246:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fe9f68ad800/0xd6c4b8f05868046e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb7885 expref: 13 pid: 18246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135197.891049:0:18246:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fe9f68ad800/0xd6c4b8f05868046e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb7885 expref: 13 pid: 18246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135197.891062:0:18246:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fe9f68ad800, rc 0) 00000100:00100000:0.0:1783135197.891141:0:18246:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fff48850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aff003e6-38dd-4a94-ba97-2d703b4bd555+13:16861:x1869752374023680:12345-192.168.201.41@tcp:101:mount.lustre.0 Request processed in 203us (462us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135197.891149:0:18246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 99 00000100:00100000:1.0:1783135197.892652:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:2.0:1783135197.892721:0:18245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752374023808 00000100:00100000:2.0:1783135197.892733:0:18245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752374023808 00000100:00100000:2.0:1783135197.892801:0:18245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 100 00000100:00100000:2.0:1783135197.892812:0:18245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fff4b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aff003e6-38dd-4a94-ba97-2d703b4bd555+13:16861:x1869752374023808:12345-192.168.201.41@tcp:501:mount.lustre.0 00000100:00100000:2.0:1783135197.893228:0:18245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fff4b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aff003e6-38dd-4a94-ba97-2d703b4bd555+13:16861:x1869752374023808:12345-192.168.201.41@tcp:501:mount.lustre.0 Request processed in 417us (580us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135197.893237:0:18245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 100 00000100:00100000:1.0:1783135197.894931:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:3.0:1783135197.895082:0:18247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752374023936 00000100:00100000:3.0:1783135197.895094:0:18247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752374023936 00000100:00100000:3.0:1783135197.895206:0:18247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 101 00000100:00100000:3.0:1783135197.895217:0:18247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fff4bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aff003e6-38dd-4a94-ba97-2d703b4bd555+13:16861:x1869752374023936:12345-192.168.201.41@tcp:503:mount.lustre.0 00000100:00100000:2.0:1783135197.895893:0:18247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fff4bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aff003e6-38dd-4a94-ba97-2d703b4bd555+13:16861:x1869752374023936:12345-192.168.201.41@tcp:503:mount.lustre.0 Request processed in 675us (969us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135197.895904:0:18247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 101 00000100:00100000:3.0:1783135197.898565:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:2.0:1783135197.898916:0:18245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752374024064 00000100:00100000:2.0:1783135197.898927:0:18245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752374024064 00000100:00100000:2.0:1783135197.898993:0:18245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 102 00000100:00100000:2.0:1783135197.899004:0:18245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fff49c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aff003e6-38dd-4a94-ba97-2d703b4bd555+13:16873:x1869752374024064:12345-192.168.201.41@tcp:502:llog_process_th.0 00000100:00100000:2.0:1783135197.899416:0:18245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fff49c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aff003e6-38dd-4a94-ba97-2d703b4bd555+13:16873:x1869752374024064:12345-192.168.201.41@tcp:502:llog_process_th.0 Request processed in 412us (863us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135197.899425:0:18245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 102 00000100:00100000:1.0:1783135197.902187:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:2.0:1783135197.902410:0:18247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752374024192 00000100:00100000:2.0:1783135197.902423:0:18247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752374024192 00000100:00100000:2.0:1783135197.902555:0:18247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 103 00000100:00100000:2.0:1783135197.902589:0:18247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fff4ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aff003e6-38dd-4a94-ba97-2d703b4bd555+13:16873:x1869752374024192:12345-192.168.201.41@tcp:502:llog_process_th.0 00000100:00100000:2.0:1783135197.902948:0:18247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fff4ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aff003e6-38dd-4a94-ba97-2d703b4bd555+13:16873:x1869752374024192:12345-192.168.201.41@tcp:502:llog_process_th.0 Request processed in 362us (776us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135197.902958:0:18247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 103 00000100:00100000:1.0:1783135197.921331:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:1.0:1783135197.921375:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:1.0:1783135197.921413:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:1.0:1783135197.921452:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:1.0:1783135197.921491:0:18891:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752374024960 00000100:00100000:2.0:1783135197.921802:0:18252:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752374024320 00000100:00100000:2.0:1783135197.921813:0:18252:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752374024320 00000100:00100000:2.0:1783135197.921857:0:18252:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752374024704 00000100:00100000:2.0:1783135197.921860:0:18252:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752374024704 00000100:00100000:2.0:1783135197.921900:0:18252:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 17 00000100:00100000:2.0:1783135197.921911:0:18252:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe8c590ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:be37dafa-e6ef-4275-9c00-a4e42a1df10b+7:2367:x1869752374024704:12345-192.168.201.41@tcp:400:kworker.0 00000100:00100000:2.0:1783135197.922015:0:18252:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe8c590ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:be37dafa-e6ef-4275-9c00-a4e42a1df10b+7:2367:x1869752374024704:12345-192.168.201.41@tcp:400:kworker.0 Request processed in 105us (638us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135197.922023:0:18252:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 17 00000100:00100000:2.0:1783135197.922045:0:18252:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 10 00000100:00100000:2.0:1783135197.922050:0:18252:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe8c590f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2366:x1869752374024320:12345-192.168.201.41@tcp:38:mount.lustre.0 00010000:00080000:2.0:1783135197.922090:0:18252:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from c20ee9e6-2328-4d1d-a817-651c3e3a5c78@192.168.201.41@tcp t0 exp 0000000000000000 cur 480 last 0 00000020:00000080:2.0:1783135197.922130:0:18252:0:(genops.c:1406:class_connect()) connect: client c20ee9e6-2328-4d1d-a817-651c3e3a5c78, cookie 0xd6c4b8f058680475 00000004:00100000:2.0:1783135197.922169:0:18252:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:2.0:1783135197.922352:0:18252:0:(import.c:65:import_set_state_nolock()) ffff9fe8c5da7800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1783135197.922389:0:18252:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe8c590f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c20ee9e6-2328-4d1d-a817-651c3e3a5c78+6:2366:x1869752374024320:12345-192.168.201.41@tcp:38:mount.lustre.0 Request processed in 337us (1114us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135197.922397:0:18252:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 10 00000100:00100000:1.0:1783135197.922810:0:18891:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752374024960 00000100:00100000:1.0:1783135197.922859:0:18891:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752374024832 00000100:00100000:1.0:1783135197.922862:0:18891:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752374024832 00000100:00100000:1.0:1783135197.922886:0:18891:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 4 00000100:00100000:1.0:1783135197.922895:0:18891:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe8c590f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:be37dafa-e6ef-4275-9c00-a4e42a1df10b+5:2367:x1869752374024960:12345-192.168.201.41@tcp:400:kworker.0 00000100:00100000:1.0:1783135197.922930:0:18891:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe8c590f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:be37dafa-e6ef-4275-9c00-a4e42a1df10b+5:2367:x1869752374024960:12345-192.168.201.41@tcp:400:kworker.0 Request processed in 37us (1516us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135197.922937:0:18891:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 4 00000100:00100000:1.0:1783135197.922953:0:18891:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 5 00000100:00100000:1.0:1783135197.922958:0:18891:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe8c590e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:be37dafa-e6ef-4275-9c00-a4e42a1df10b+5:2367:x1869752374024832:12345-192.168.201.41@tcp:400:kworker.0 00000100:00100000:1.0:1783135197.922981:0:18891:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe8c590e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:be37dafa-e6ef-4275-9c00-a4e42a1df10b+5:2367:x1869752374024832:12345-192.168.201.41@tcp:400:kworker.0 Request processed in 24us (1529us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135197.922987:0:18891:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 5 00000100:00100000:0.0:1783135197.927580:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:2.0:1783135197.927772:0:18252:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752374024448 00000100:00100000:2.0:1783135197.927789:0:18252:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752374024448 00000100:00100000:2.0:1783135197.927884:0:18252:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 11 00000100:00100000:2.0:1783135197.927914:0:18252:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fe8fca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c20ee9e6-2328-4d1d-a817-651c3e3a5c78+6:0:x1869752374024448:12345-192.168.201.41@tcp:41:mount.lustre.0 00000004:00000024:2.0:1783135197.927976:0:18252:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1783135197.928071:0:18252:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fe8fca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c20ee9e6-2328-4d1d-a817-651c3e3a5c78+6:0:x1869752374024448:12345-192.168.201.41@tcp:41:mount.lustre.0 Request processed in 158us (508us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135197.928080:0:18252:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 11 00000100:00080000:0.0:1783135197.928331:0:18248:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1783135197.930710:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:2.0:1783135197.931230:0:18254:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752374024576 00000100:00100000:2.0:1783135197.931242:0:18254:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752374024576 00000100:00100000:2.0:1783135197.931405:0:18254:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 12 00000100:00100000:2.0:1783135197.931417:0:18254:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe8c590e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c20ee9e6-2328-4d1d-a817-651c3e3a5c78+6:16861:x1869752374024576:12345-192.168.201.41@tcp:41:mount.lustre.0 00000004:00000024:2.0:1783135197.931459:0:18254:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1783135197.931562:0:18254:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe8c590e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c20ee9e6-2328-4d1d-a817-651c3e3a5c78+6:16861:x1869752374024576:12345-192.168.201.41@tcp:41:mount.lustre.0 Request processed in 146us (863us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135197.931571:0:18254:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 12 00000100:00100000:1.0:1783135197.936187:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:2.0:1783135197.936365:0:18252:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752374025088 00000100:00100000:2.0:1783135197.936377:0:18252:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752374025088 00000100:00100000:2.0:1783135197.936448:0:18252:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 13 00000100:00100000:2.0:1783135197.936459:0:18252:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe8c590c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c20ee9e6-2328-4d1d-a817-651c3e3a5c78+6:16861:x1869752374025088:12345-192.168.201.41@tcp:40:mount.lustre.0 00000100:00100000:2.0:1783135197.936576:0:18252:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe8c590c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c20ee9e6-2328-4d1d-a817-651c3e3a5c78+6:16861:x1869752374025088:12345-192.168.201.41@tcp:40:mount.lustre.0 Request processed in 118us (404us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135197.936584:0:18252:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 13 00000100:00100000:0.0:1783135197.939523:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:0.0:1783135197.939570:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:1.0:1783135197.939723:0:18891:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752374025216 00000100:00100000:1.0:1783135197.939734:0:18891:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752374025216 00000100:00100000:1.0:1783135197.939789:0:18891:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752374025344 00000100:00100000:1.0:1783135197.939792:0:18891:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752374025344 00000100:00100000:1.0:1783135197.939823:0:18891:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 11 00000100:00100000:1.0:1783135197.939834:0:18891:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fe8fd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2366:x1869752374025216:12345-192.168.201.41@tcp:8:mount.lustre.0 00000100:00100000:3.0:1783135197.939869:0:19201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 12 00000100:00100000:3.0:1783135197.939876:0:19201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fe8fdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2366:x1869752374025344:12345-192.168.201.41@tcp:8:mount.lustre.0 00010000:00080000:1.0:1783135197.939879:0:18891:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0000: connection from c20ee9e6-2328-4d1d-a817-651c3e3a5c78@192.168.201.41@tcp t0 exp 0000000000000000 cur 480 last 0 00010000:00080000:3.0:1783135197.939892:0:19201:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0001: connection from c20ee9e6-2328-4d1d-a817-651c3e3a5c78@192.168.201.41@tcp t0 exp 0000000000000000 cur 480 last 0 00000020:00000080:3.0:1783135197.939920:0:19201:0:(genops.c:1406:class_connect()) connect: client c20ee9e6-2328-4d1d-a817-651c3e3a5c78, cookie 0xd6c4b8f058680483 00000020:00000080:1.0:1783135197.939920:0:18891:0:(genops.c:1406:class_connect()) connect: client c20ee9e6-2328-4d1d-a817-651c3e3a5c78, cookie 0xd6c4b8f05868047c 00002000:00100000:1.0:1783135197.940048:0:18891:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli c20ee9e6-2328-4d1d-a817-651c3e3a5c78/ffff9fe9efd80000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113653 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1783135197.940063:0:18891:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:1.0:1783135197.940421:0:18891:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1783135197.940458:0:18891:0:(import.c:65:import_set_state_nolock()) ffff9fe9efd85000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1783135197.940557:0:18891:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fe8fd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c20ee9e6-2328-4d1d-a817-651c3e3a5c78+6:2366:x1869752374025216:12345-192.168.201.41@tcp:8:mount.lustre.0 Request processed in 723us (1059us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135197.940565:0:18891:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 11 00000100:00100000:1.0:1783135197.943416:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00002000:00100000:0.0:1783135197.943545:0:19201:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli c20ee9e6-2328-4d1d-a817-651c3e3a5c78/ffff9fe9c8d7e800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113653 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1783135197.943565:0:19201:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1783135197.943874:0:19201:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1783135197.943922:0:19201:0:(import.c:65:import_set_state_nolock()) ffff9fe8c451b800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1783135197.944017:0:19201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fe8fdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c20ee9e6-2328-4d1d-a817-651c3e3a5c78+6:2366:x1869752374025344:12345-192.168.201.41@tcp:8:mount.lustre.0 Request processed in 4137us (4444us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135197.944030:0:19201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 12 00000100:00100000:2.0:1783135197.945239:0:18256:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752374025472 00000100:00100000:2.0:1783135197.945253:0:18256:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752374025472 00000100:00100000:2.0:1783135197.945377:0:18256:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 1 00000100:00100000:2.0:1783135197.945389:0:18256:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe8c590ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c20ee9e6-2328-4d1d-a817-651c3e3a5c78+6:16861:x1869752374025472:12345-192.168.201.41@tcp:33:mount.lustre.0 00000004:00200000:2.0:1783135197.945779:0:18256:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000100:00100000:2.0:1783135197.945962:0:18256:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe8c590ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c20ee9e6-2328-4d1d-a817-651c3e3a5c78+6:16861:x1869752374025472:12345-192.168.201.41@tcp:33:mount.lustre.0 Request processed in 574us (2560us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135197.945971:0:18256:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 1 00000100:00100000:1.0:1783135198.091984:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:3.0:1783135198.092270:0:19572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752374025600 00000100:00100000:3.0:1783135198.092315:0:19572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752374025600 00000100:00100000:3.0:1783135198.092403:0:19572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 14 00000100:00100000:3.0:1783135198.092414:0:19572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe8c6dfc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c20ee9e6-2328-4d1d-a817-651c3e3a5c78+6:16894:x1869752374025600:12345-192.168.201.41@tcp:101:mkdir.0 00010000:00010000:3.0:1783135198.092442:0:19572:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783135198.092474:0:19572:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fea02166400/0xd6c4b8f05868048a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4428da03f5eb78af expref: -99 pid: 19572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135198.092565:0:19572:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fea02166200/0xd6c4b8f058680491 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 19572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135198.092605:0:19572:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fea02166200/0xd6c4b8f058680491 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135198.092622:0:19572:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fea02166200/0xd6c4b8f058680491 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19572 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783135198.093164:0:19572:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:3.0:1783135198.093169:0:19572:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 4 stripe count 1 MDT count 1 00000004:00010000:3.0:1783135198.093266:0:19572:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fea02166200/0xd6c4b8f058680491 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135198.093326:0:19572:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fea02166400/0xd6c4b8f05868048a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb78af expref: 8 pid: 19572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135198.093347:0:19572:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fea02166200/0xd6c4b8f058680491 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb78af expref: 7 pid: 19572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135198.093359:0:19572:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fe9c9dd3100) 00010000:00010000:3.0:1783135198.093362:0:19572:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1783135198.093366:0:19572:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fea02166200, rc 0) 00000100:00100000:3.0:1783135198.093500:0:19572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe8c6dfc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c20ee9e6-2328-4d1d-a817-651c3e3a5c78+7:16894:x1869752374025600:12345-192.168.201.41@tcp:101:mkdir.0 Request processed in 1088us (1532us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135198.093509:0:19572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 14 00010000:00010000:3.0:1783135198.148153:0:18241:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783135199.172565:0:18240:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783135200.195933:0:18241:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1783135200.472939:0:6602:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of c20ee9e6-2328-4d1d-a817-651c3e3a5c78 00000001:00100000:3.0:1783135200.481675:0:5791:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of be37dafa-e6ef-4275-9c00-a4e42a1df10b 00000001:00100000:3.0:1783135200.481703:0:5791:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of c20ee9e6-2328-4d1d-a817-651c3e3a5c78 00000001:02000400:3.0:1783135201.062140:0:20123:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:1.0:1783135201.222572:0:18240:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783135201.411765:0:3286:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe8c6dfed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:06a7653e-5f5a-4acc-ba93-0eff19f145f0:3286:1869752384473344:0@lo:400:kworker.0 00000100:00100000:0.0:1783135201.411868:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135201.411935:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1783135201.411942:0:3286:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe8c6dfdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1869752384473472:0@lo:400:kworker.0 00000100:00100000:0.0:1783135201.411975:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135201.412011:0:3289:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9fec16680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1869752384473728:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1783135201.412061:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135201.412174:0:18889:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384473472 00000100:00100000:1.0:1783135201.412183:0:18889:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384473472 00000100:00100000:1.0:1783135201.412256:0:18889:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1783135201.412266:0:18889:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fe8fe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3286:x1869752384473472:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783135201.412368:0:18889:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fe8fe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3286:x1869752384473472:12345-0@lo:400:kworker.0 Request processed in 103us (391us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135201.412377:0:18889:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1783135201.412407:0:18246:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384473344 00000100:00100000:1.0:1783135201.412410:0:18246:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384473344 00000100:00100000:1.0:1783135201.412439:0:18246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1783135201.412447:0:18246:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fff4b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:06a7653e-5f5a-4acc-ba93-0eff19f145f0+19:3286:x1869752384473344:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783135201.412477:0:18246:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fff4b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:06a7653e-5f5a-4acc-ba93-0eff19f145f0+19:3286:x1869752384473344:12345-0@lo:400:kworker.0 Request processed in 31us (610us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135201.412483:0:18246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00080000:1.0:1783135201.412564:0:18248:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1783135201.412578:0:18892:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384473728 00000100:00100000:1.0:1783135201.412582:0:18892:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384473728 00000100:00100000:1.0:1783135201.412615:0:18892:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1783135201.412621:0:18892:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fe8ffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3289:x1869752384473728:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1783135201.412653:0:18892:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1783135201.412798:0:3288:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe8c6dfce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1869752384473600:0@lo:400:kworker.0 00000100:00100000:2.0:1783135201.412833:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135201.412858:0:3288:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe8c6dfc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3288:1869752384474112:0@lo:400:kworker.0 00000100:00100000:2.0:1783135201.412890:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135201.412967:0:18891:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384473600 00000100:00100000:2.0:1783135201.412971:0:18891:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384473600 00000100:00100000:2.0:1783135201.413000:0:18891:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1783135201.413007:0:18891:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9f6fe5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3288:x1869752384473600:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783135201.413043:0:18891:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9f6fe5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3288:x1869752384473600:12345-0@lo:400:kworker.0 Request processed in 36us (208us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135201.413049:0:18891:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1783135201.413070:0:18252:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384474112 00000100:00100000:2.0:1783135201.413073:0:18252:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384474112 00000100:00100000:2.0:1783135201.413102:0:18252:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1783135201.413108:0:18252:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9f6fe6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3288:x1869752384474112:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783135201.413139:0:18252:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9f6fe6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3288:x1869752384474112:12345-0@lo:400:kworker.0 Request processed in 31us (248us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135201.413145:0:18252:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1783135201.413371:0:3288:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 12884901889 gen 2 00000100:00100000:2.0:1783135201.413393:0:3288:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe8c6dfce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1869752384473600:0@lo:400:kworker.0 00000100:00100000:2.0:1783135201.413406:0:3288:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe8c6dfc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3288:1869752384474112:0@lo:400:kworker.0 00000100:00100000:2.0:1783135201.413598:0:3287:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe8c6dff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3287:1869752384473984:0@lo:400:kworker.0 00000100:00100000:2.0:1783135201.413657:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135201.413682:0:3287:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1783135201.413688:0:3287:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe8c6dff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3287:1869752384473856:0@lo:400:kworker.0 00000100:00100000:2.0:1783135201.413726:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135201.413754:0:18254:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384473984 00000100:00100000:2.0:1783135201.413758:0:18254:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384473984 00000100:00100000:2.0:1783135201.413783:0:18254:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384473856 00000100:00100000:2.0:1783135201.413786:0:18254:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384473856 00000100:00100000:2.0:1783135201.413802:0:18254:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1783135201.413808:0:18254:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9f6fe5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3287:x1869752384473984:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783135201.413848:0:18254:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9f6fe5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3287:x1869752384473984:12345-0@lo:400:kworker.0 Request processed in 39us (190us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135201.413854:0:18254:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1783135201.413865:0:18254:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1783135201.413870:0:18254:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9f6fe6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3287:x1869752384473856:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783135201.413893:0:18254:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9f6fe6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3287:x1869752384473856:12345-0@lo:400:kworker.0 Request processed in 23us (166us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135201.413898:0:18254:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1783135201.413920:0:3287:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe8c6dff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3287:1869752384473856:0@lo:400:kworker.0 00000100:00100000:2.0:1783135201.413928:0:3287:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe8c6dff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3287:1869752384473984:0@lo:400:kworker.0 00000100:00080000:2.0:1783135201.414025:0:18248:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1783135201.414029:0:18248:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1783135201.414435:0:3286:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe8c6dfdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1869752384473472:0@lo:400:kworker.0 00000100:00100000:2.0:1783135201.414447:0:3286:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe8c6dfed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:06a7653e-5f5a-4acc-ba93-0eff19f145f0:3286:1869752384473344:0@lo:400:kworker.0 00000100:00100000:1.0:1783135201.423169:0:18892:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fe8ffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3289:x1869752384473728:12345-0@lo:13:osp-pre-1-0.0 Request processed in 10533us (11091us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135201.423187:0:18892:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1783135201.423352:0:3289:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9fec16680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1869752384473728:0@lo:13:osp-pre-1-0.0 00000001:00100000:3.0:1783135201.443168:0:7470:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of c20ee9e6-2328-4d1d-a817-651c3e3a5c78 00010000:00010000:3.0:1783135202.246844:0:18241:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783135202.953936:0:3289:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9fe90c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1869752384474240:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1783135202.954048:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135202.954147:0:18894:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384474240 00000100:00100000:2.0:1783135202.954157:0:18894:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384474240 00000100:00100000:2.0:1783135202.954219:0:18894:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1783135202.954229:0:18894:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fe9fb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3289:x1869752384474240:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1783135202.954276:0:18894:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1783135202.954375:0:18894:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fe9fb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3289:x1869752384474240:12345-0@lo:13:osp-pre-0-0.0 Request processed in 146us (327us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135202.954383:0:18894:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1783135202.954459:0:3289:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9fe90c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1869752384474240:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1783135203.109612:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:1.0:1783135203.109655:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:1.0:1783135203.109747:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:1.0:1783135203.109776:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:1.0:1783135203.109795:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:1.0:1783135203.109815:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:1.0:1783135203.109841:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:1.0:1783135203.109875:0:18254:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752374025856 00000100:00100000:1.0:1783135203.109886:0:18254:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752374025856 00000100:00100000:1.0:1783135203.109965:0:18254:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752374026240 00000100:00100000:1.0:1783135203.109969:0:18254:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752374026240 00000100:00100000:1.0:1783135203.109996:0:18254:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 21 00000100:00100000:1.0:1783135203.110009:0:18254:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe8c6dfc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:be37dafa-e6ef-4275-9c00-a4e42a1df10b+6:2370:x1869752374025856:12345-192.168.201.41@tcp:400:kworker.0 00000100:00100000:1.0:1783135203.110181:0:18254:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe8c6dfc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:be37dafa-e6ef-4275-9c00-a4e42a1df10b+6:2370:x1869752374025856:12345-192.168.201.41@tcp:400:kworker.0 Request processed in 175us (585us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135203.110191:0:18254:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 21 00000100:00100000:1.0:1783135203.110212:0:18254:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 22 00000100:00100000:1.0:1783135203.110218:0:18254:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe8c6dfd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c20ee9e6-2328-4d1d-a817-651c3e3a5c78+6:2370:x1869752374026240:12345-192.168.201.41@tcp:400:kworker.0 00000100:00100000:1.0:1783135203.110246:0:18254:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe8c6dfd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c20ee9e6-2328-4d1d-a817-651c3e3a5c78+6:2370:x1869752374026240:12345-192.168.201.41@tcp:400:kworker.0 Request processed in 28us (429us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135203.110253:0:18254:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 22 00000100:00100000:1.0:1783135203.110273:0:18889:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752374026112 00000100:00100000:1.0:1783135203.110276:0:18889:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752374026112 00000100:00100000:1.0:1783135203.110320:0:18889:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752374026368 00000100:00100000:1.0:1783135203.110334:0:18889:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752374026368 00000100:00100000:1.0:1783135203.110350:0:18889:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752374025984 00000100:00100000:1.0:1783135203.110353:0:18889:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752374025984 00000100:00100000:1.0:1783135203.110365:0:18889:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752374026496 00000100:00100000:1.0:1783135203.110367:0:18889:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752374026496 00000100:00100000:1.0:1783135203.110382:0:18889:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 8 00000100:00100000:1.0:1783135203.110388:0:18889:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe8c6dffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:be37dafa-e6ef-4275-9c00-a4e42a1df10b+5:2370:x1869752374026112:12345-192.168.201.41@tcp:400:kworker.0 00000100:00100000:1.0:1783135203.110416:0:18889:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe8c6dffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:be37dafa-e6ef-4275-9c00-a4e42a1df10b+5:2370:x1869752374026112:12345-192.168.201.41@tcp:400:kworker.0 Request processed in 28us (760us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135203.110423:0:18889:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 8 00000100:00100000:1.0:1783135203.110434:0:18889:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 9 00000100:00100000:1.0:1783135203.110439:0:18889:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe8c6dfea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c20ee9e6-2328-4d1d-a817-651c3e3a5c78+5:2370:x1869752374026368:12345-192.168.201.41@tcp:400:kworker.0 00000100:00100000:1.0:1783135203.110463:0:18889:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe8c6dfea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c20ee9e6-2328-4d1d-a817-651c3e3a5c78+5:2370:x1869752374026368:12345-192.168.201.41@tcp:400:kworker.0 Request processed in 23us (715us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135203.110469:0:18889:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 9 00000100:00100000:1.0:1783135203.110479:0:18889:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 10 00000100:00100000:1.0:1783135203.110485:0:18889:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe8c6dfe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:be37dafa-e6ef-4275-9c00-a4e42a1df10b+5:2370:x1869752374025984:12345-192.168.201.41@tcp:400:kworker.0 00000100:00100000:1.0:1783135203.110508:0:18889:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe8c6dfe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:be37dafa-e6ef-4275-9c00-a4e42a1df10b+5:2370:x1869752374025984:12345-192.168.201.41@tcp:400:kworker.0 Request processed in 23us (712us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135203.110514:0:18889:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 10 00000100:00100000:1.0:1783135203.110524:0:18889:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 11 00000100:00100000:1.0:1783135203.110530:0:18889:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe8c6dfca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c20ee9e6-2328-4d1d-a817-651c3e3a5c78+5:2370:x1869752374026496:12345-192.168.201.41@tcp:400:kworker.0 00000100:00100000:1.0:1783135203.110552:0:18889:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe8c6dfca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c20ee9e6-2328-4d1d-a817-651c3e3a5c78+5:2370:x1869752374026496:12345-192.168.201.41@tcp:400:kworker.0 Request processed in 22us (710us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135203.110558:0:18889:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 11 00000100:00100000:1.0:1783135203.110603:0:18247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752374025728 00000100:00100000:1.0:1783135203.110606:0:18247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752374025728 00000100:00100000:1.0:1783135203.110634:0:18247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 105 00000100:00100000:1.0:1783135203.110640:0:18247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fff48050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aff003e6-38dd-4a94-ba97-2d703b4bd555+13:2370:x1869752374025728:12345-192.168.201.41@tcp:400:kworker.0 00000100:00100000:1.0:1783135203.110676:0:18247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fff48050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aff003e6-38dd-4a94-ba97-2d703b4bd555+13:2370:x1869752374025728:12345-192.168.201.41@tcp:400:kworker.0 Request processed in 26us (890us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135203.110684:0:18247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 105 00000100:00080000:1.0:1783135203.110730:0:18248:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1783135203.110735:0:18248:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1783135203.110737:0:18248:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1783135203.267440:0:18240:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783135204.293702:0:18241:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1783135204.613878:0:18286:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000020:00000080:2.0:1783135204.648975:0:20270:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffd8fab6dd0 20000000:00000080:2.0:1783135204.648998:0:20270:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9fe8c5f20400 uarg=0000000000000000 20000000:01000000:2.0:1783135204.649038:0:20270:0:(mgs_llog.c:6177:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:2.0:1783135204.649044:0:20270:0:(mgs_llog.c:4638:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:2.0:1783135204.649050:0:20270:0:(mgs_llog.c:1376:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:2.0:1783135204.652519:0:20271:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 10 20000000:00000400:3.0:1783135204.652703:0:20270:0:(mgs_llog.c:1447:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:3.0:1783135204.675063:0:20270:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1783135204.675189:0:20270:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9fe9c7828800/0xd6c4b8f058680498 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135204.675214:0:20270:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9fe9f68ace00/0xd6c4b8f05868015e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd6c4b8f058680157 expref: 18 pid: 18247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135204.675221:0:20270:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9fe9f68ad000/0xd6c4b8f0586801ab lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd6c4b8f0586801a4 expref: 18 pid: 18247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135204.675228:0:20270:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9fe9c148ba00/0xd6c4b8f0586802fb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd6c4b8f0586802f4 expref: 18 pid: 18245 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135204.675237:0:20270:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9fe9c7828c00/0xd6c4b8f058680436 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb7823 expref: 12 pid: 18245 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135204.675259:0:20270:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9fe9f68ad800/0xd6c4b8f05868046e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb7885 expref: 12 pid: 18246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135204.675267:0:20270:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9fe9c7828800/0xd6c4b8f058680498 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 20270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135204.675335:0:20270:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9fe9f68ad800/0xd6c4b8f05868046e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb7885 expref: 12 pid: 18246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135204.675353:0:20270:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9fe9f68ad800/0xd6c4b8f05868046e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb7885 expref: 12 pid: 18246 timeout: 587 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783135204.675374:0:20270:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9fe9f9180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20270:1869752384474368:192.168.201.41@tcp:104: 00010000:00010000:2.0:1783135204.675492:0:20270:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9fe9c7828c00/0xd6c4b8f058680436 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb7823 expref: 12 pid: 18245 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135204.675500:0:20270:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9fe9c7828c00/0xd6c4b8f058680436 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb7823 expref: 12 pid: 18245 timeout: 587 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783135204.675509:0:20270:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9fe9f9f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20270:1869752384474496:192.168.201.41@tcp:104: 00010000:00010000:2.0:1783135204.675537:0:20270:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9fe9c148ba00/0xd6c4b8f0586802fb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd6c4b8f0586802f4 expref: 18 pid: 18245 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135204.675545:0:20270:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9fe9c148ba00/0xd6c4b8f0586802fb lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd6c4b8f0586802f4 expref: 18 pid: 18245 timeout: 587 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783135204.675555:0:20270:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9fe9faa00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20270:1869752384474624:0@lo:104: 00000100:00100000:2.0:1783135204.675595:0:20270:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135204.675657:0:18235:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384474624 00000100:00100000:2.0:1783135204.675666:0:18235:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384474624 00000100:00100000:2.0:1783135204.675722:0:18235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1783135204.675732:0:18235:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fe9fa300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:06a7653e-5f5a-4acc-ba93-0eff19f145f0+3:20270:x1869752384474624:12345-0@lo:104: 00010000:00010000:2.0:1783135204.675746:0:18235:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.141@tcp lock: ffff9fe9c148b800/0xd6c4b8f0586802f4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xd6c4b8f0586802fb expref: -99 pid: 19560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135204.675795:0:18235:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1783135204.675801:0:18235:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fe9fa300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:06a7653e-5f5a-4acc-ba93-0eff19f145f0+3:20270:x1869752384474624:12345-0@lo:104: Request processed in 71us (207us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135204.675809:0:18235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:1.0:1783135204.675823:0:18240:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783135204.675832:0:18240:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.141@tcp lock: ffff9fe9c148b800/0xd6c4b8f0586802f4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xd6c4b8f0586802fb expref: -99 pid: 19560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135204.675841:0:18240:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe9c148b800 already unused, calling callback (ffffffffc1b40c20) 10000000:00010000:1.0:1783135204.675845:0:18240:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.141@tcp lock: ffff9fe9c148b800/0xd6c4b8f0586802f4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xd6c4b8f0586802fb expref: -99 pid: 19560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135204.675851:0:20270:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9fe9f68ad000/0xd6c4b8f0586801ab lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd6c4b8f0586801a4 expref: 18 pid: 18247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135204.675858:0:18240:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.141@tcp lock: ffff9fe9c148b800/0xd6c4b8f0586802f4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xd6c4b8f0586802fb expref: -99 pid: 19560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135204.675864:0:20270:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9fe9f68ad000/0xd6c4b8f0586801ab lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd6c4b8f0586801a4 expref: 18 pid: 18247 timeout: 587 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783135204.675871:0:18240:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.141@tcp lock: ffff9fe9c148b800/0xd6c4b8f0586802f4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xd6c4b8f0586802fb expref: -99 pid: 19560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783135204.675880:0:20270:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9fe9f8a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20270:1869752384474752:0@lo:104: 10000000:01000000:1.0:1783135204.675882:0:18240:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00000100:00100000:2.0:1783135204.675913:0:20270:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1783135204.675916:0:18240:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.141@tcp lock: ffff9fe9c148b800/0xd6c4b8f0586802f4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd6c4b8f0586802fb expref: -99 pid: 19560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783135204.675938:0:18235:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384474752 00010000:00010000:1.0:1783135204.675941:0:18240:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1783135204.675943:0:18235:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384474752 00000100:00100000:2.0:1783135204.675967:0:18235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00010000:00010000:1.0:1783135204.675968:0:18240:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.141@tcp lock: ffff9fe9c148b800/0xd6c4b8f0586802f4 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd6c4b8f0586802fb expref: -99 pid: 19560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783135204.675978:0:18235:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fe9f8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:06a7653e-5f5a-4acc-ba93-0eff19f145f0+3:20270:x1869752384474752:12345-0@lo:104: 00010000:00010000:1.0:1783135204.675980:0:18240:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.141@tcp lock: ffff9fe9c148b800/0xd6c4b8f0586802f4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd6c4b8f0586802fb expref: -99 pid: 19560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135204.675993:0:18235:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.141@tcp lock: ffff9fe8c5550c00/0xd6c4b8f0586801a4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xd6c4b8f0586801ab expref: -99 pid: 18888 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135204.676000:0:18240:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783135204.676003:0:18240:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783135204.676006:0:18240:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783135204.676027:0:3286:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe8c6dff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:06a7653e-5f5a-4acc-ba93-0eff19f145f0:3286:1869752384474880:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1783135204.676034:0:18235:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1783135204.676041:0:18235:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fe9f8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:06a7653e-5f5a-4acc-ba93-0eff19f145f0+3:20270:x1869752384474752:12345-0@lo:104: Request processed in 66us (127us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135204.676058:0:18235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1783135204.676063:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1783135204.676093:0:20270:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9fe9f68ace00/0xd6c4b8f05868015e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd6c4b8f058680157 expref: 18 pid: 18247 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135204.676100:0:18241:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783135204.676103:0:20270:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9fe9f68ace00/0xd6c4b8f05868015e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd6c4b8f058680157 expref: 18 pid: 18247 timeout: 587 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135204.676107:0:18241:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.141@tcp lock: ffff9fe8c5550c00/0xd6c4b8f0586801a4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xd6c4b8f0586801ab expref: -99 pid: 18888 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783135204.676119:0:20270:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9fe9f8700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20270:1869752384475008:0@lo:104: 00010000:00010000:1.0:1783135204.676119:0:18241:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe8c5550c00 already unused, calling callback (ffffffffc1b40c20) 10000000:00010000:1.0:1783135204.676125:0:18241:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.141@tcp lock: ffff9fe8c5550c00/0xd6c4b8f0586801a4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xd6c4b8f0586801ab expref: -99 pid: 18888 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135204.676134:0:18241:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.141@tcp lock: ffff9fe8c5550c00/0xd6c4b8f0586801a4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xd6c4b8f0586801ab expref: -99 pid: 18888 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783135204.676142:0:18241:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.141@tcp lock: ffff9fe8c5550c00/0xd6c4b8f0586801a4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xd6c4b8f0586801ab expref: -99 pid: 18888 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783135204.676148:0:18241:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00000100:00100000:2.0:1783135204.676154:0:20270:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1783135204.676171:0:18241:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.141@tcp lock: ffff9fe8c5550c00/0xd6c4b8f0586801a4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd6c4b8f0586801ab expref: -99 pid: 18888 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783135204.676185:0:18235:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00010000:00010000:1.0:1783135204.676192:0:18241:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1783135204.676199:0:18235:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384475008 00000100:00100000:2.0:1783135204.676203:0:18235:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384475008 00010000:00010000:1.0:1783135204.676206:0:18241:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.141@tcp lock: ffff9fe8c5550c00/0xd6c4b8f0586801a4 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd6c4b8f0586801ab expref: -99 pid: 18888 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135204.676215:0:18241:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.141@tcp lock: ffff9fe8c5550c00/0xd6c4b8f0586801a4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd6c4b8f0586801ab expref: -99 pid: 18888 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783135204.676223:0:18235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1783135204.676230:0:18235:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9f40f5050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:06a7653e-5f5a-4acc-ba93-0eff19f145f0+3:20270:x1869752384475008:12345-0@lo:104: 00010000:00010000:1.0:1783135204.676230:0:18241:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783135204.676235:0:18241:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783135204.676239:0:18241:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783135204.676241:0:18235:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.141@tcp lock: ffff9fe8c5551200/0xd6c4b8f058680157 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xd6c4b8f05868015e expref: -99 pid: 18249 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783135204.676254:0:18238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384474880 00000100:00100000:1.0:1783135204.676259:0:18238:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384474880 00010000:00010000:2.0:1783135204.676275:0:18235:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1783135204.676310:0:18235:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9f40f5050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:06a7653e-5f5a-4acc-ba93-0eff19f145f0+3:20270:x1869752384475008:12345-0@lo:104: Request processed in 81us (158us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135204.676319:0:18235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:1.0:1783135204.676352:0:18238:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9fe9c148ba00/0xd6c4b8f0586802fb lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd6c4b8f0586802f4 expref: 19 pid: 18245 timeout: 587 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783135204.676383:0:18238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1783135204.676391:0:18238:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe8c6dfe300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:06a7653e-5f5a-4acc-ba93-0eff19f145f0+19:3286:x1869752384474880:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1783135204.676401:0:18238:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1783135204.676403:0:20270:0:(client.c:2701:ptlrpc_set_wait()) set ffff9fe9cbbbc900 going to sleep for 11 seconds 00010000:00010000:1.0:1783135204.676408:0:18238:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9fe9c148ba00/0xd6c4b8f0586802fb lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd6c4b8f0586802f4 expref: 19 pid: 18245 timeout: 587 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135204.676421:0:18238:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9fe9c148ba00/0xd6c4b8f0586802fb lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd6c4b8f0586802f4 expref: 19 pid: 18245 timeout: 587 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783135204.676430:0:20270:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9fe9faa00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20270:1869752384474624:0@lo:104: 00010000:00010000:1.0:1783135204.676435:0:18238:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fe9c148ba00/0xd6c4b8f0586802fb lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd6c4b8f0586802f4 expref: 19 pid: 18245 timeout: 587 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783135204.676442:0:20270:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9fe9f8a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20270:1869752384474752:0@lo:104: 00010000:00010000:1.0:1783135204.676451:0:18238:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783135204.676452:0:20270:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9fe9f8700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20270:1869752384475008:0@lo:104: 00000100:00100000:1.0:1783135204.676481:0:18238:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe8c6dfe300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:06a7653e-5f5a-4acc-ba93-0eff19f145f0+18:3286:x1869752384474880:12345-0@lo:103:ldlm_bl.0 Request processed in 91us (420us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135204.676495:0:18238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1783135204.676520:0:3287:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe8c6dfd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:06a7653e-5f5a-4acc-ba93-0eff19f145f0:3287:1869752384475136:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1783135204.676546:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135204.676593:0:3286:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe8c6dff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:06a7653e-5f5a-4acc-ba93-0eff19f145f0:3286:1869752384474880:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1783135204.676607:0:18240:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783135204.676611:0:18240:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.141@tcp lock: ffff9fe8c5551200/0xd6c4b8f058680157 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xd6c4b8f05868015e expref: -99 pid: 18249 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135204.676619:0:18240:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe8c5551200 already unused, calling callback (ffffffffc1b40c20) 10000000:00010000:1.0:1783135204.676622:0:18240:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.141@tcp lock: ffff9fe8c5551200/0xd6c4b8f058680157 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xd6c4b8f05868015e expref: -99 pid: 18249 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135204.676629:0:18240:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.141@tcp lock: ffff9fe8c5551200/0xd6c4b8f058680157 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xd6c4b8f05868015e expref: -99 pid: 18249 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783135204.676636:0:18240:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.141@tcp lock: ffff9fe8c5551200/0xd6c4b8f058680157 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xd6c4b8f05868015e expref: -99 pid: 18249 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783135204.676657:0:18240:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1783135204.676674:0:18240:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.141@tcp lock: ffff9fe8c5551200/0xd6c4b8f058680157 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd6c4b8f05868015e expref: -99 pid: 18249 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135204.676681:0:18240:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1783135204.676694:0:18240:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.141@tcp lock: ffff9fe8c5551200/0xd6c4b8f058680157 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd6c4b8f05868015e expref: -99 pid: 18249 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135204.676702:0:18240:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.141@tcp lock: ffff9fe8c5551200/0xd6c4b8f058680157 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd6c4b8f05868015e expref: -99 pid: 18249 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135204.676724:0:18240:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783135204.676726:0:18240:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783135204.676728:0:18240:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783135204.676737:0:3288:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe8c6dff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:06a7653e-5f5a-4acc-ba93-0eff19f145f0:3288:1869752384475264:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1783135204.676762:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135204.676794:0:18238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384475136 00000100:00100000:1.0:1783135204.676798:0:18238:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384475136 00010000:00010000:1.0:1783135204.676814:0:18238:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9fe9f68ad000/0xd6c4b8f0586801ab lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd6c4b8f0586801a4 expref: 18 pid: 18247 timeout: 587 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783135204.676821:0:18239:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384475264 00000100:00100000:2.0:1783135204.676828:0:18239:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384475264 00000100:00100000:1.0:1783135204.676837:0:18238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1783135204.676846:0:18238:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe8c6dfd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:06a7653e-5f5a-4acc-ba93-0eff19f145f0+19:3287:x1869752384475136:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1783135204.676855:0:18238:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783135204.676858:0:18239:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9fe9f68ace00/0xd6c4b8f05868015e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd6c4b8f058680157 expref: 19 pid: 18247 timeout: 587 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135204.676862:0:18238:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9fe9f68ad000/0xd6c4b8f0586801ab lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd6c4b8f0586801a4 expref: 19 pid: 18247 timeout: 587 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135204.676878:0:18238:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9fe9f68ad000/0xd6c4b8f0586801ab lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd6c4b8f0586801a4 expref: 19 pid: 18247 timeout: 587 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783135204.676884:0:18239:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00010000:00010000:1.0:1783135204.676890:0:18238:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fe9f68ad000/0xd6c4b8f0586801ab lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd6c4b8f0586801a4 expref: 19 pid: 18247 timeout: 587 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783135204.676893:0:18239:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00010000:00010000:1.0:1783135204.676902:0:18238:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783135204.676929:0:18238:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe8c6dfd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:06a7653e-5f5a-4acc-ba93-0eff19f145f0+18:3287:x1869752384475136:12345-0@lo:103:ldlm_bl.0 Request processed in 85us (382us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135204.676936:0:18238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1783135204.676951:0:18238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1783135204.676958:0:18238:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9f643d450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:06a7653e-5f5a-4acc-ba93-0eff19f145f0+17:3288:x1869752384475264:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1783135204.676971:0:18238:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783135204.676976:0:18238:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9fe9f68ace00/0xd6c4b8f05868015e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd6c4b8f058680157 expref: 17 pid: 18247 timeout: 587 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135204.676984:0:18238:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9fe9f68ace00/0xd6c4b8f05868015e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd6c4b8f058680157 expref: 17 pid: 18247 timeout: 587 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135204.676994:0:18238:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fe9f68ace00/0xd6c4b8f05868015e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd6c4b8f058680157 expref: 17 pid: 18247 timeout: 587 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135204.677002:0:18238:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783135204.677034:0:18238:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9f643d450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:06a7653e-5f5a-4acc-ba93-0eff19f145f0+16:3288:x1869752384475264:12345-0@lo:103:ldlm_bl.0 Request processed in 77us (271us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135204.677040:0:18238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1783135204.677082:0:3287:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe8c6dfd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:06a7653e-5f5a-4acc-ba93-0eff19f145f0:3287:1869752384475136:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1783135204.677143:0:3288:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe8c6dff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:06a7653e-5f5a-4acc-ba93-0eff19f145f0:3288:1869752384475264:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1783135204.680450:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:1.0:1783135204.680485:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:1.0:1783135204.680520:0:18237:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752374026752 00000100:00100000:1.0:1783135204.680529:0:18237:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752374026752 00010000:00010000:1.0:1783135204.680561:0:18237:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9fe9c7828c00/0xd6c4b8f058680436 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb7823 expref: 13 pid: 18245 timeout: 587 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783135204.680594:0:18237:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752374026624 00000100:00100000:1.0:1783135204.680597:0:18237:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752374026624 00010000:00010000:1.0:1783135204.680608:0:18237:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9fe9f68ad800/0xd6c4b8f05868046e lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb7885 expref: 14 pid: 18246 timeout: 587 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783135204.680654:0:18237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 7 00000100:00100000:1.0:1783135204.680663:0:18237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe8c6dfd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:aff003e6-38dd-4a94-ba97-2d703b4bd555+14:2369:x1869752374026752:12345-192.168.201.41@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1783135204.680696:0:18237:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783135204.680702:0:18237:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9fe9c7828c00/0xd6c4b8f058680436 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb7823 expref: 14 pid: 18245 timeout: 587 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135204.680712:0:18237:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9fe9c7828c00/0xd6c4b8f058680436 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb7823 expref: 14 pid: 18245 timeout: 587 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135204.680730:0:18237:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783135204.680785:0:18237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe8c6dfd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:aff003e6-38dd-4a94-ba97-2d703b4bd555+14:2369:x1869752374026752:12345-192.168.201.41@tcp:103:ldlm_bl.0 Request processed in 122us (344us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135204.680793:0:18237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 7 00000100:00100000:1.0:1783135204.680809:0:18237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 8 00000100:00100000:1.0:1783135204.680814:0:18237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe8c6dfe300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:aff003e6-38dd-4a94-ba97-2d703b4bd555+13:2369:x1869752374026624:12345-192.168.201.41@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1783135204.680822:0:18237:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783135204.680826:0:18237:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9fe9f68ad800/0xd6c4b8f05868046e lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb7885 expref: 13 pid: 18246 timeout: 587 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135204.680835:0:18237:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9fe9f68ad800/0xd6c4b8f05868046e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb7885 expref: 13 pid: 18246 timeout: 587 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135204.680846:0:18237:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9fe9c7828800/0xd6c4b8f058680498 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 20270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135204.680855:0:18237:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fe9c7828800/0xd6c4b8f058680498 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 20270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135204.680869:0:18237:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9fe9c7828800/0xd6c4b8f058680498 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 20270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135204.680886:0:18237:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9fe9c7828800/0xd6c4b8f058680498 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 20270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135204.680892:0:18237:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9fe9c7828800/0xd6c4b8f058680498 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 20270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135204.680899:0:18237:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9fe9c7828800/0xd6c4b8f058680498 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 20270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135204.680905:0:18237:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe9c7828800 already unused, calling callback (ffffffffc1527ce0) 00010000:00010000:1.0:1783135204.680909:0:18237:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9fe9c7828800/0xd6c4b8f058680498 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 20270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135204.680918:0:18237:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9fe9c7828800/0xd6c4b8f058680498 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 20270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135204.680927:0:18237:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9fe9c7828800/0xd6c4b8f058680498 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135204.680937:0:18237:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783135204.680956:0:18237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe8c6dfe300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:aff003e6-38dd-4a94-ba97-2d703b4bd555+13:2369:x1869752374026624:12345-192.168.201.41@tcp:103:ldlm_bl.0 Request processed in 141us (470us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135204.680963:0:18237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 8 00010000:00010000:2.0:1783135204.681297:0:20270:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fe9f68ad800/0xd6c4b8f05868046e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb7885 expref: 12 pid: 18246 timeout: 587 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783135204.681313:0:20270:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9fe9f9180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20270:1869752384474368:192.168.201.41@tcp:104: 00010000:00010000:2.0:1783135204.681326:0:20270:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fe9c7828c00/0xd6c4b8f058680436 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb7823 expref: 11 pid: 18245 timeout: 587 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783135204.681336:0:20270:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9fe9f9f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20270:1869752384474496:192.168.201.41@tcp:104: 00010000:00010000:2.0:1783135204.681363:0:20270:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9fe9c7828800/0xd6c4b8f058680498 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135204.681372:0:20270:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9fe9c7828800/0xd6c4b8f058680498 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135204.681378:0:20270:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9fe9c7828800/0xd6c4b8f058680498 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135204.681383:0:20270:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fe9c7828800/0xd6c4b8f058680498 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135205.316552:0:18241:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783135206.075023:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:2.0:1783135206.081123:0:18254:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752374026880 00000100:00100000:2.0:1783135206.081138:0:18254:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752374026880 00000100:00100000:2.0:1783135206.081241:0:18254:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 15 00000100:00100000:2.0:1783135206.081253:0:18254:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe8c6dfd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:be37dafa-e6ef-4275-9c00-a4e42a1df10b+6:17356:x1869752374026880:12345-192.168.201.41@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1783135206.081303:0:18254:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783135206.081325:0:18254:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828800/0xd6c4b8f05868049f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4428da03f5eb78b6 expref: -99 pid: 18254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135206.081385:0:18254:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828c00/0xd6c4b8f0586804a6 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 18254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135206.081400:0:18254:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828c00/0xd6c4b8f0586804a6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135206.081416:0:18254:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828c00/0xd6c4b8f0586804a6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 18254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135206.081431:0:18254:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829a00/0xd6c4b8f0586804ad lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 18254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135206.081438:0:18254:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829a00/0xd6c4b8f0586804ad lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135206.081444:0:18254:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829a00/0xd6c4b8f0586804ad lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135206.081901:0:18254:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829e00/0xd6c4b8f0586804b4 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 18254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135206.081911:0:18254:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829e00/0xd6c4b8f0586804b4 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135206.081919:0:18254:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829e00/0xd6c4b8f0586804b4 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18254 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783135206.082003:0:18254:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 6656 00000004:00200000:2.0:1783135206.082013:0:18254:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:2.0:1783135206.082105:0:18254:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829e00/0xd6c4b8f0586804b4 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135206.082117:0:18254:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828c00/0xd6c4b8f0586804a6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135206.082124:0:18254:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828c00/0xd6c4b8f0586804a6 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 18254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135206.082131:0:18254:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828c00/0xd6c4b8f0586804a6 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135206.082136:0:18254:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe9c7828c00 already unused, calling callback (ffffffffc1f634f0) 00010000:00010000:2.0:1783135206.082141:0:18254:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828c00/0xd6c4b8f0586804a6 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135206.082148:0:18254:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828c00/0xd6c4b8f0586804a6 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 18254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135206.082159:0:18254:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fe9c9dd3100) 00010000:00010000:2.0:1783135206.082162:0:18254:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783135206.082166:0:18254:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828c00/0xd6c4b8f0586804a6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135206.082173:0:18254:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828c00/0xd6c4b8f0586804a6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135206.082185:0:18254:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829a00/0xd6c4b8f0586804ad lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135206.082191:0:18254:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829a00/0xd6c4b8f0586804ad lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 18254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135206.082206:0:18254:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829a00/0xd6c4b8f0586804ad lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135206.082212:0:18254:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe9c7829a00 already unused, calling callback (ffffffffc1f634f0) 00010000:00010000:2.0:1783135206.082216:0:18254:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829a00/0xd6c4b8f0586804ad lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135206.082237:0:18254:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829a00/0xd6c4b8f0586804ad lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 18254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135206.082245:0:18254:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff9fe9c9bb4b00) 00010000:00010000:2.0:1783135206.082248:0:18254:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783135206.082250:0:18254:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829a00/0xd6c4b8f0586804ad lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135206.082256:0:18254:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829a00/0xd6c4b8f0586804ad lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135206.082343:0:18254:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828800/0xd6c4b8f05868049f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb78b6 expref: 8 pid: 18254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135206.082358:0:18254:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829e00/0xd6c4b8f0586804b4 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb78b6 expref: 7 pid: 18254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135206.082366:0:18254:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9fe9c9bb4300) 00010000:00010000:2.0:1783135206.082368:0:18254:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1783135206.082370:0:18254:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fe9c7829e00, rc 0) 00000100:00100000:2.0:1783135206.082436:0:18254:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe8c6dfd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:be37dafa-e6ef-4275-9c00-a4e42a1df10b+7:17356:x1869752374026880:12345-192.168.201.41@tcp:101:lhsmtool_posix.0 Request processed in 1186us (7429us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135206.082453:0:18254:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 15 00000100:00080000:1.0:1783135206.083233:0:18248:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1783135206.093411:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:2.0:1783135206.093815:0:18252:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752374027136 00000100:00100000:2.0:1783135206.093824:0:18252:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752374027136 00000100:00100000:2.0:1783135206.093881:0:18252:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 16 00000100:00100000:2.0:1783135206.093892:0:18252:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe8c6dfdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:be37dafa-e6ef-4275-9c00-a4e42a1df10b+7:17356:x1869752374027136:12345-192.168.201.41@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1783135206.093910:0:18252:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783135206.093930:0:18252:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828800/0xd6c4b8f0586804bb lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4428da03f5eb78bd expref: -99 pid: 18252 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135206.094016:0:18252:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829a00/0xd6c4b8f0586804c2 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 18252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135206.094030:0:18252:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829a00/0xd6c4b8f0586804c2 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135206.094041:0:18252:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829a00/0xd6c4b8f0586804c2 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135206.094055:0:18252:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828c00/0xd6c4b8f0586804c9 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 18252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135206.094061:0:18252:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828c00/0xd6c4b8f0586804c9 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135206.094067:0:18252:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828c00/0xd6c4b8f0586804c9 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135206.095645:0:18252:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fea02166000/0xd6c4b8f0586804d0 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 18252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135206.095673:0:18252:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fea02166000/0xd6c4b8f0586804d0 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135206.095685:0:18252:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fea02166000/0xd6c4b8f0586804d0 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18252 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783135206.095700:0:18252:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 6656 00010000:00010000:3.0:1783135206.096021:0:18252:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829a00/0xd6c4b8f0586804c2 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135206.096030:0:18252:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829a00/0xd6c4b8f0586804c2 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 18252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135206.096037:0:18252:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829a00/0xd6c4b8f0586804c2 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 18252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135206.096044:0:18252:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe9c7829a00 already unused, calling callback (ffffffffc1f634f0) 00010000:00010000:3.0:1783135206.096049:0:18252:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829a00/0xd6c4b8f0586804c2 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 18252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135206.096058:0:18252:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829a00/0xd6c4b8f0586804c2 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 18252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135206.096073:0:18252:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9fe9c9bb4300) 00010000:00010000:3.0:1783135206.096082:0:18252:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783135206.096087:0:18252:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829a00/0xd6c4b8f0586804c2 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 18252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135206.096094:0:18252:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829a00/0xd6c4b8f0586804c2 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 18252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135206.096112:0:18252:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828c00/0xd6c4b8f0586804c9 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135206.096118:0:18252:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828c00/0xd6c4b8f0586804c9 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 18252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135206.096124:0:18252:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828c00/0xd6c4b8f0586804c9 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135206.096130:0:18252:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe9c7828c00 already unused, calling callback (ffffffffc1f634f0) 00010000:00010000:3.0:1783135206.096133:0:18252:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828c00/0xd6c4b8f0586804c9 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135206.096138:0:18252:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828c00/0xd6c4b8f0586804c9 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 18252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135206.096145:0:18252:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff9fe9c9bb4b00) 00010000:00010000:3.0:1783135206.096147:0:18252:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783135206.096150:0:18252:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828c00/0xd6c4b8f0586804c9 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135206.096155:0:18252:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828c00/0xd6c4b8f0586804c9 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135206.096771:0:18252:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828800/0xd6c4b8f0586804bb lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb78bd expref: 10 pid: 18252 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135206.096805:0:18252:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fea02166000/0xd6c4b8f0586804d0 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb78bd expref: 9 pid: 18252 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135206.096813:0:18252:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9fe9c33d0b00) 00010000:00010000:3.0:1783135206.096815:0:18252:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783135206.096818:0:18252:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fea02166000, rc 0) 00000100:00100000:3.0:1783135206.096918:0:18252:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe8c6dfdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:be37dafa-e6ef-4275-9c00-a4e42a1df10b+9:17356:x1869752374027136:12345-192.168.201.41@tcp:101:lhsmtool_posix.0 Request processed in 3026us (3516us total) trans 12884901889 rc 0/0 00000100:00100000:3.0:1783135206.096929:0:18252:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 16 00000100:00100000:1.0:1783135206.104440:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:2.0:1783135206.108341:0:18254:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752374027264 00000100:00100000:2.0:1783135206.108357:0:18254:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752374027264 00000100:00100000:2.0:1783135206.108435:0:18254:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 17 00000100:00100000:2.0:1783135206.108463:0:18254:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe8c6dff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:be37dafa-e6ef-4275-9c00-a4e42a1df10b+9:17356:x1869752374027264:12345-192.168.201.41@tcp:59:lhsmtool_posix.0 00000100:00100000:2.0:1783135206.108589:0:18254:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe8c6dff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:be37dafa-e6ef-4275-9c00-a4e42a1df10b+9:17356:x1869752374027264:12345-192.168.201.41@tcp:59:lhsmtool_posix.0 Request processed in 129us (4165us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135206.108597:0:18254:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 17 00000100:00100000:1.0:1783135206.165251:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:2.0:1783135206.165506:0:19572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752374027392 00000100:00100000:2.0:1783135206.165520:0:19572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752374027392 00000100:00100000:2.0:1783135206.165600:0:19572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 18 00000100:00100000:2.0:1783135206.165645:0:19572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe8c6dfed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:be37dafa-e6ef-4275-9c00-a4e42a1df10b+9:17362:x1869752374027392:12345-192.168.201.41@tcp:101:lfs.0 00010000:00010000:2.0:1783135206.165672:0:19572:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783135206.165699:0:19572:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829200/0xd6c4b8f0586804de lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4428da03f5eb78c4 expref: -99 pid: 19572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135206.165787:0:19572:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828000/0xd6c4b8f0586804e5 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 19572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135206.165804:0:19572:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828000/0xd6c4b8f0586804e5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 19572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135206.165817:0:19572:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828000/0xd6c4b8f0586804e5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 19572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135206.165833:0:19572:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829800/0xd6c4b8f0586804ec lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135206.165841:0:19572:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829800/0xd6c4b8f0586804ec lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135206.165848:0:19572:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829800/0xd6c4b8f0586804ec lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135206.166198:0:19572:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828000/0xd6c4b8f0586804e5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 19572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135206.166209:0:19572:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828000/0xd6c4b8f0586804e5 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 19572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135206.166217:0:19572:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828000/0xd6c4b8f0586804e5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 19572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135206.166224:0:19572:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe9c7828000 already unused, calling callback (ffffffffc1f634f0) 00010000:00010000:2.0:1783135206.166229:0:19572:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828000/0xd6c4b8f0586804e5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 19572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135206.166237:0:19572:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828000/0xd6c4b8f0586804e5 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 19572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135206.166255:0:19572:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fe9c9dd3100) 00010000:00010000:2.0:1783135206.166259:0:19572:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783135206.166265:0:19572:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828000/0xd6c4b8f0586804e5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 19572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135206.166272:0:19572:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828000/0xd6c4b8f0586804e5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 19572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135206.166331:0:19572:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829800/0xd6c4b8f0586804ec lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135206.166338:0:19572:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829800/0xd6c4b8f0586804ec lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 19572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135206.166344:0:19572:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829800/0xd6c4b8f0586804ec lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135206.166356:0:19572:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe9c7829800 already unused, calling callback (ffffffffc1f634f0) 00010000:00010000:2.0:1783135206.166359:0:19572:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829800/0xd6c4b8f0586804ec lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135206.166365:0:19572:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829800/0xd6c4b8f0586804ec lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 19572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135206.166374:0:19572:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff9fe9c9bb4d00) 00010000:00010000:2.0:1783135206.166377:0:19572:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783135206.166380:0:19572:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829800/0xd6c4b8f0586804ec lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135206.166386:0:19572:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829800/0xd6c4b8f0586804ec lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135206.166430:0:19572:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829200/0xd6c4b8f0586804de lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb78c4 expref: 10 pid: 19572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135206.166441:0:19572:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fe9c9dd3100) 00010000:00010000:2.0:1783135206.166444:0:19572:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783135206.166447:0:19572:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829200/0xd6c4b8f0586804de lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb78c4 expref: 10 pid: 19572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135206.166456:0:19572:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fe9c7829200, rc 0) 00000100:00100000:2.0:1783135206.166545:0:19572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe8c6dfed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:be37dafa-e6ef-4275-9c00-a4e42a1df10b+9:17362:x1869752374027392:12345-192.168.201.41@tcp:101:lfs.0 Request processed in 935us (1309us total) trans 0 rc 301/301 00000100:00100000:2.0:1783135206.166553:0:19572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 18 00000100:00100000:1.0:1783135206.176663:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:3.0:1783135206.176812:0:18261:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752374027520 00000100:00100000:3.0:1783135206.176826:0:18261:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752374027520 00000100:00100000:3.0:1783135206.176899:0:18261:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 0 00000100:00100000:3.0:1783135206.176911:0:18261:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe8c6dfdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:be37dafa-e6ef-4275-9c00-a4e42a1df10b+9:17362:x1869752374027520:12345-192.168.201.41@tcp:700:lfs.0 00000100:00100000:3.0:1783135206.177041:0:18261:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe8c6dfdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:be37dafa-e6ef-4275-9c00-a4e42a1df10b+9:17362:x1869752374027520:12345-192.168.201.41@tcp:700:lfs.0 Request processed in 125us (395us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135206.177050:0:18261:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 0 00000100:00100000:1.0:1783135206.180525:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:3.0:1783135206.180716:0:18253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752374027776 00000100:00100000:3.0:1783135206.180729:0:18253:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752374027776 00000100:00100000:3.0:1783135206.180864:0:18253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 19 00000100:00100000:3.0:1783135206.180879:0:18253:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe8c6dff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:be37dafa-e6ef-4275-9c00-a4e42a1df10b+9:17362:x1869752374027776:12345-192.168.201.41@tcp:36:lfs.0 00010000:00010000:3.0:1783135206.180990:0:18253:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783135206.181032:0:18253:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43f800/0xd6c4b8f058680459 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb784d expref: 9 pid: 19572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135206.181072:0:18253:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fe9c9dd3100) 00010000:00010000:3.0:1783135206.181100:0:18253:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1783135206.181755:0:18253:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fea02166400/0xd6c4b8f0586804f3 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 18253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135206.181776:0:18253:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fea02166200/0xd6c4b8f058680491 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb78af expref: 5 pid: 19572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135206.181787:0:18253:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fea02166400/0xd6c4b8f0586804f3 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135206.181833:0:18253:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9fea02166200/0xd6c4b8f058680491 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb78af expref: 5 pid: 19572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135206.181850:0:18253:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9fea02166200/0xd6c4b8f058680491 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb78af expref: 5 pid: 19572 timeout: 588 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783135206.181867:0:18253:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9fec14700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:18253:1869752384475392:192.168.201.41@tcp:104: 00000100:00100000:3.0:1783135206.182015:0:18253:0:(client.c:2701:ptlrpc_set_wait()) set ffff9fe9c339dd80 going to sleep for 11 seconds 00000100:00100000:3.0:1783135206.185081:0:18253:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9fec14700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:18253:1869752384475392:192.168.201.41@tcp:104: 00010000:00010000:3.0:1783135206.185126:0:18253:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9fea02166400/0xd6c4b8f0586804f3 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18253 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783135206.186994:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:2.0:1783135206.187195:0:18237:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752374027904 00000100:00100000:2.0:1783135206.187232:0:18237:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752374027904 00010000:00010000:2.0:1783135206.187358:0:18237:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fea02166200/0xd6c4b8f058680491 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb78af expref: 6 pid: 19572 timeout: 588 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783135206.187423:0:18237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 9 00000100:00100000:2.0:1783135206.187435:0:18237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe8c6dff480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c20ee9e6-2328-4d1d-a817-651c3e3a5c78+6:2370:x1869752374027904:12345-192.168.201.41@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783135206.187459:0:18237:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783135206.187469:0:18237:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9fea02166200/0xd6c4b8f058680491 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb78af expref: 6 pid: 19572 timeout: 588 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135206.187487:0:18237:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9fea02166200/0xd6c4b8f058680491 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb78af expref: 6 pid: 19572 timeout: 588 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135206.187520:0:18237:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fea02166200/0xd6c4b8f058680491 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb78af expref: 6 pid: 19572 timeout: 588 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135206.187541:0:18237:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fe9c9dd3100) 00010000:00010000:2.0:1783135206.187548:0:18237:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9fea02166400/0xd6c4b8f0586804f3 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135206.187559:0:18237:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fea02166400/0xd6c4b8f0586804f3 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 18253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135206.187569:0:18237:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fea02166400/0xd6c4b8f0586804f3 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 18253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135206.187604:0:18237:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783135206.187693:0:18237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe8c6dff480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c20ee9e6-2328-4d1d-a817-651c3e3a5c78+5:2370:x1869752374027904:12345-192.168.201.41@tcp:103:ldlm_bl.0 Request processed in 259us (712us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135206.187713:0:18237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 9 00010000:00010000:3.0:1783135206.187946:0:18253:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9fea02166400/0xd6c4b8f0586804f3 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135206.187956:0:18253:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fea02166400/0xd6c4b8f0586804f3 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135206.187988:0:18253:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fea02167800/0xd6c4b8f0586804fa lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 18253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135206.188012:0:18253:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fea02167800/0xd6c4b8f0586804fa lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135206.188022:0:18253:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fea02167800/0xd6c4b8f0586804fa lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18253 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783135206.189950:0:18253:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 512 00010000:00010000:3.0:1783135206.189973:0:18253:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fea02166400/0xd6c4b8f0586804f3 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135206.189984:0:18253:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fea02166400/0xd6c4b8f0586804f3 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 18253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135206.189993:0:18253:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fea02166400/0xd6c4b8f0586804f3 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135206.190000:0:18253:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fea02166400 already unused, calling callback (ffffffffc1f634f0) 00010000:00010000:3.0:1783135206.190005:0:18253:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fea02166400/0xd6c4b8f0586804f3 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135206.190015:0:18253:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fea02166400/0xd6c4b8f0586804f3 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 18253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135206.190036:0:18253:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fe9c9dd3100) 00010000:00010000:3.0:1783135206.190040:0:18253:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783135206.190045:0:18253:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fea02166400/0xd6c4b8f0586804f3 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135206.190051:0:18253:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fea02166400/0xd6c4b8f0586804f3 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18253 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1783135206.190099:0:18253:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000003d5658dc reply state 00000000cfda0526 transno 12884901890 ns: mdt-lustre-MDT0000_UUID lock: ffff9fea02167800/0xd6c4b8f0586804fa lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18253 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783135206.190110:0:18253:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1783135206.190224:0:18253:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe8c6dff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:be37dafa-e6ef-4275-9c00-a4e42a1df10b+10:17362:x1869752374027776:12345-192.168.201.41@tcp:36:lfs.0 Request processed in 9344us (9712us total) trans 12884901890 rc 0/0 00000100:00100000:3.0:1783135206.190235:0:18253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 19 00000100:00080000:1.0:1783135206.190953:0:18248:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1783135206.193898:0:3273:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9fea02167800/0xd6c4b8f0586804fa lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135206.193930:0:3273:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fea02167800/0xd6c4b8f0586804fa lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 18253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135206.193938:0:3273:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fea02167800/0xd6c4b8f0586804fa lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135206.193946:0:3273:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fea02167800 already unused, calling callback (ffffffffc1f634f0) 00010000:00010000:3.0:1783135206.193952:0:3273:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fea02167800/0xd6c4b8f0586804fa lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135206.193962:0:3273:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fea02167800/0xd6c4b8f0586804fa lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 18253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135206.193986:0:3273:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff9fe9c33d0300) 00010000:00010000:3.0:1783135206.193989:0:3273:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783135206.193995:0:3273:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fea02167800/0xd6c4b8f0586804fa lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135206.194002:0:3273:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fea02167800/0xd6c4b8f0586804fa lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18253 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783135206.264870:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:2.0:1783135206.265010:0:18245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752374028032 00000100:00100000:2.0:1783135206.265025:0:18245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752374028032 00000100:00100000:2.0:1783135206.265096:0:18245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 106 00000100:00100000:2.0:1783135206.265108:0:18245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fff49050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aff003e6-38dd-4a94-ba97-2d703b4bd555+11:16748:x1869752374028032:12345-192.168.201.41@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783135206.265132:0:18245:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783135206.265158:0:18245:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fe9c7829800/0xd6c4b8f058680501 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x4428da03f5eb78cb expref: -99 pid: 18245 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135206.265198:0:18245:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fe9c7829800/0xd6c4b8f058680501 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb78cb expref: 12 pid: 18245 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135206.265212:0:18245:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fe9c7829800/0xd6c4b8f058680501 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb78cb expref: 12 pid: 18245 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135206.265223:0:18245:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fe9c7829800, rc 0) 00000100:00100000:2.0:1783135206.265339:0:18245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fff49050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aff003e6-38dd-4a94-ba97-2d703b4bd555+12:16748:x1869752374028032:12345-192.168.201.41@tcp:101:ll_cfg_requeue.0 Request processed in 232us (485us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135206.265347:0:18245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 106 10000000:01000000:1.0:1783135206.275407:0:18249:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1783135206.275419:0:18249:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff9fea01d7a000 from 10 10000000:01000000:1.0:1783135206.275426:0:18249:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1783135206.275496:0:18249:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.141@tcp lock: ffff9fe9fe43e000/0xd6c4b8f058680508 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18249 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135206.275510:0:18249:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.141@tcp lock: ffff9fe9fe43e000/0xd6c4b8f058680508 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18249 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135206.275523:0:18249:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.141@tcp lock: ffff9fe9fe43e000/0xd6c4b8f058680508 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18249 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783135206.275557:0:18249:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe8c6dfc380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:06a7653e-5f5a-4acc-ba93-0eff19f145f0:18249:1869752384475520:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1783135206.275692:0:18249:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135206.275789:0:18249:0:(client.c:2701:ptlrpc_set_wait()) set ffff9fe9e9b20600 going to sleep for 11 seconds 00000100:00100000:2.0:1783135206.276050:0:18246:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384475520 00000100:00100000:2.0:1783135206.276063:0:18246:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384475520 00000100:00100000:2.0:1783135206.276136:0:18246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1783135206.276148:0:18246:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fff4b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:06a7653e-5f5a-4acc-ba93-0eff19f145f0+16:18249:x1869752384475520:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783135206.276168:0:18246:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783135206.276187:0:18246:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fe9c7828000/0xd6c4b8f05868050f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xd6c4b8f058680508 expref: -99 pid: 18246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135206.276240:0:18246:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fe9c7828000/0xd6c4b8f05868050f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd6c4b8f058680508 expref: 17 pid: 18246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135206.276253:0:18246:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fe9c7828000/0xd6c4b8f05868050f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd6c4b8f058680508 expref: 17 pid: 18246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135206.276263:0:18246:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fe9c7828000, rc 0) 00000100:00100000:2.0:1783135206.276346:0:18246:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fff4b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:06a7653e-5f5a-4acc-ba93-0eff19f145f0+17:18249:x1869752384475520:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 199us (654us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135206.276354:0:18246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1783135206.276588:0:18249:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe8c6dfc380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:06a7653e-5f5a-4acc-ba93-0eff19f145f0:18249:1869752384475520:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783135206.276607:0:18249:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.141@tcp lock: ffff9fe9fe43e000/0xd6c4b8f058680508 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd6c4b8f05868050f expref: -99 pid: 18249 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135206.276636:0:18249:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.141@tcp lock: ffff9fe9fe43e000/0xd6c4b8f058680508 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd6c4b8f05868050f expref: -99 pid: 18249 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783135206.276705:0:18249:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe8c6dfc380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:06a7653e-5f5a-4acc-ba93-0eff19f145f0:18249:1869752384475648:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783135206.276738:0:18249:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135206.276782:0:18249:0:(client.c:2701:ptlrpc_set_wait()) set ffff9fe9e9b20600 going to sleep for 11 seconds 00000100:00100000:2.0:1783135206.279878:0:18247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384475648 00000100:00100000:2.0:1783135206.279901:0:18247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384475648 00000100:00100000:2.0:1783135206.280003:0:18247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1783135206.280015:0:18247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fff49850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:06a7653e-5f5a-4acc-ba93-0eff19f145f0+17:18249:x1869752384475648:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783135206.280819:0:18247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fff49850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:06a7653e-5f5a-4acc-ba93-0eff19f145f0+17:18249:x1869752384475648:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 802us (4075us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135206.280831:0:18247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1783135206.282499:0:18249:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe8c6dfc380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:06a7653e-5f5a-4acc-ba93-0eff19f145f0:18249:1869752384475648:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783135206.282596:0:18249:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9fec14700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:06a7653e-5f5a-4acc-ba93-0eff19f145f0:18249:1869752384475776:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783135206.282713:0:18249:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135206.282760:0:18249:0:(client.c:2701:ptlrpc_set_wait()) set ffff9fe9c339dd80 going to sleep for 11 seconds 00000100:00100000:0.0:1783135206.282879:0:18245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384475776 00000100:00100000:0.0:1783135206.282888:0:18245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384475776 00000100:00100000:0.0:1783135206.282964:0:18245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1783135206.282975:0:18245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fff4a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:06a7653e-5f5a-4acc-ba93-0eff19f145f0+17:18249:x1869752384475776:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783135206.283238:0:18245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fff4a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:06a7653e-5f5a-4acc-ba93-0eff19f145f0+17:18249:x1869752384475776:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 264us (524us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135206.283246:0:18245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1783135206.283851:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:1.0:1783135206.283934:0:18247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752374028160 00000100:00100000:1.0:1783135206.283941:0:18247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752374028160 00000100:00100000:1.0:1783135206.283985:0:18247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 110 00000100:00100000:1.0:1783135206.283993:0:18247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fff4a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aff003e6-38dd-4a94-ba97-2d703b4bd555+12:16748:x1869752374028160:12345-192.168.201.41@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783135206.284366:0:18247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fff4a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aff003e6-38dd-4a94-ba97-2d703b4bd555+12:16748:x1869752374028160:12345-192.168.201.41@tcp:501:ll_cfg_requeue.0 Request processed in 372us (516us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135206.284375:0:18247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 110 00000100:00100000:3.0:1783135206.286364:0:18249:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9fec14700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:06a7653e-5f5a-4acc-ba93-0eff19f145f0:18249:1869752384475776:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783135206.287829:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:2.0:1783135206.288060:0:18246:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752374028288 00000100:00100000:2.0:1783135206.288072:0:18246:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752374028288 00000100:00100000:2.0:1783135206.288136:0:18246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 111 00000100:00100000:2.0:1783135206.288147:0:18246:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fff48450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aff003e6-38dd-4a94-ba97-2d703b4bd555+12:16748:x1869752374028288:12345-192.168.201.41@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783135206.288466:0:18246:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fff48450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aff003e6-38dd-4a94-ba97-2d703b4bd555+12:16748:x1869752374028288:12345-192.168.201.41@tcp:503:ll_cfg_requeue.0 Request processed in 318us (644us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135206.288476:0:18246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 111 00000040:00080000:3.0:1783135206.292387:0:20284:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:0.0:1783135206.294143:0:18249:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:0.0:1783135206.294192:0:18249:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.201.141@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1783135206.294209:0:18249:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.141@tcp lock: ffff9fe9fe43e000/0xd6c4b8f058680508 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd6c4b8f05868050f expref: -99 pid: 18249 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135206.294224:0:18249:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.141@tcp lock: ffff9fe9fe43e000/0xd6c4b8f058680508 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd6c4b8f05868050f expref: -99 pid: 18249 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783135206.294239:0:18249:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1783135206.294243:0:18249:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff9fe9f8a5b800 from 10 10000000:01000000:0.0:1783135206.294247:0:18249:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1783135206.294349:0:18249:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.141@tcp lock: ffff9fe9f68adc00/0xd6c4b8f058680516 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18249 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135206.294360:0:18249:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.141@tcp lock: ffff9fe9f68adc00/0xd6c4b8f058680516 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18249 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135206.294373:0:18249:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.141@tcp lock: ffff9fe9f68adc00/0xd6c4b8f058680516 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18249 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783135206.294429:0:18249:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9fe8ff800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:06a7653e-5f5a-4acc-ba93-0eff19f145f0:18249:1869752384475904:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1783135206.294521:0:18249:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135206.294571:0:18249:0:(client.c:2701:ptlrpc_set_wait()) set ffff9fe9f42c3840 going to sleep for 11 seconds 00000100:00100000:3.0:1783135206.294749:0:18245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384475904 00000100:00100000:3.0:1783135206.294759:0:18245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384475904 00000100:00100000:3.0:1783135206.294815:0:18245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1783135206.294826:0:18245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fff4a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:06a7653e-5f5a-4acc-ba93-0eff19f145f0+17:18249:x1869752384475904:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783135206.294845:0:18245:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783135206.294860:0:18245:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fea02167800/0xd6c4b8f05868051d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xd6c4b8f058680516 expref: -99 pid: 18245 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135206.294892:0:18245:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fea02167800/0xd6c4b8f05868051d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd6c4b8f058680516 expref: 18 pid: 18245 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135206.294904:0:18245:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fea02167800/0xd6c4b8f05868051d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd6c4b8f058680516 expref: 18 pid: 18245 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135206.294914:0:18245:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fea02167800, rc 0) 00000100:00100000:3.0:1783135206.294959:0:18245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fff4a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:06a7653e-5f5a-4acc-ba93-0eff19f145f0+18:18249:x1869752384475904:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 134us (438us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135206.294967:0:18245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1783135206.295118:0:18249:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9fe8ff800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:06a7653e-5f5a-4acc-ba93-0eff19f145f0:18249:1869752384475904:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783135206.295137:0:18249:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.141@tcp lock: ffff9fe9f68adc00/0xd6c4b8f058680516 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd6c4b8f05868051d expref: -99 pid: 18249 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135206.295147:0:18249:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.141@tcp lock: ffff9fe9f68adc00/0xd6c4b8f058680516 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xd6c4b8f05868051d expref: -99 pid: 18249 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783135206.295206:0:18249:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9fe8ff800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:06a7653e-5f5a-4acc-ba93-0eff19f145f0:18249:1869752384476032:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783135206.295234:0:18249:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135206.295263:0:18249:0:(client.c:2701:ptlrpc_set_wait()) set ffff9fe9f42c3840 going to sleep for 11 seconds 00000100:00100000:1.0:1783135206.295827:0:18246:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384476032 00000100:00100000:1.0:1783135206.295835:0:18246:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384476032 00000100:00100000:1.0:1783135206.295875:0:18246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1783135206.295883:0:18246:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9f5cea050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:06a7653e-5f5a-4acc-ba93-0eff19f145f0+18:18249:x1869752384476032:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783135206.296313:0:18246:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9f5cea050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:06a7653e-5f5a-4acc-ba93-0eff19f145f0+18:18249:x1869752384476032:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 430us (1077us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135206.296321:0:18246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1783135206.296819:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:1.0:1783135206.297071:0:18246:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752374028416 00000100:00100000:1.0:1783135206.297078:0:18246:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752374028416 00000100:00100000:1.0:1783135206.297105:0:18246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 114 00000100:00100000:1.0:1783135206.297111:0:18246:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9f5ce8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aff003e6-38dd-4a94-ba97-2d703b4bd555+12:16748:x1869752374028416:12345-192.168.201.41@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783135206.297124:0:18246:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783135206.297143:0:18246:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fe9fe43fe00/0xd6c4b8f058680524 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x4428da03f5eb78d2 expref: -99 pid: 18246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135206.297172:0:18246:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fe9fe43fe00/0xd6c4b8f058680524 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb78d2 expref: 13 pid: 18246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135206.297195:0:18246:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fe9fe43fe00/0xd6c4b8f058680524 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb78d2 expref: 13 pid: 18246 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135206.297206:0:18246:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fe9fe43fe00, rc 0) 00000100:00100000:1.0:1783135206.297267:0:18246:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9f5ce8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aff003e6-38dd-4a94-ba97-2d703b4bd555+13:16748:x1869752374028416:12345-192.168.201.41@tcp:101:ll_cfg_requeue.0 Request processed in 155us (451us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135206.297274:0:18246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 114 00000100:00100000:0.0:1783135206.297761:0:18249:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9fe8ff800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:06a7653e-5f5a-4acc-ba93-0eff19f145f0:18249:1869752384476032:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783135206.297828:0:18249:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9fe8ff800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:06a7653e-5f5a-4acc-ba93-0eff19f145f0:18249:1869752384476160:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783135206.297891:0:18249:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135206.297939:0:18249:0:(client.c:2701:ptlrpc_set_wait()) set ffff9fe9f42c3840 going to sleep for 11 seconds 00000100:00100000:1.0:1783135206.298243:0:18246:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384476160 00000100:00100000:1.0:1783135206.298249:0:18246:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384476160 00000100:00100000:1.0:1783135206.298322:0:18246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:1.0:1783135206.298330:0:18246:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9f5ce9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:06a7653e-5f5a-4acc-ba93-0eff19f145f0+18:18249:x1869752384476160:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783135206.298581:0:18246:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9f5ce9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:06a7653e-5f5a-4acc-ba93-0eff19f145f0+18:18249:x1869752384476160:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 251us (688us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135206.298590:0:18246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:2.0:1783135206.298646:0:18249:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9fe8ff800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:06a7653e-5f5a-4acc-ba93-0eff19f145f0:18249:1869752384476160:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783135206.306565:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:1.0:1783135206.308390:0:18246:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752374028544 00000100:00100000:1.0:1783135206.308407:0:18246:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752374028544 00000100:00100000:1.0:1783135206.308479:0:18246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 116 00000100:00100000:1.0:1783135206.308488:0:18246:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9c8e49050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aff003e6-38dd-4a94-ba97-2d703b4bd555+13:16748:x1869752374028544:12345-192.168.201.41@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783135206.309031:0:18246:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9c8e49050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aff003e6-38dd-4a94-ba97-2d703b4bd555+13:16748:x1869752374028544:12345-192.168.201.41@tcp:501:ll_cfg_requeue.0 Request processed in 541us (2477us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135206.309055:0:18246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 116 00000040:00080000:2.0:1783135206.312427:0:20285:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:1.0:1783135206.313062:0:18249:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:1.0:1783135206.313102:0:18249:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.201.141@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1783135206.313119:0:18249:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.141@tcp lock: ffff9fe9f68adc00/0xd6c4b8f058680516 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd6c4b8f05868051d expref: -99 pid: 18249 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135206.313159:0:18249:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.141@tcp lock: ffff9fe9f68adc00/0xd6c4b8f058680516 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd6c4b8f05868051d expref: -99 pid: 18249 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783135206.313174:0:18249:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1783135206.313178:0:18249:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff9fe8c47e7000 from 10 10000000:01000000:1.0:1783135206.313181:0:18249:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1783135206.313233:0:18249:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.141@tcp lock: ffff9fe9fe43f800/0xd6c4b8f05868052b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18249 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135206.313243:0:18249:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.141@tcp lock: ffff9fe9fe43f800/0xd6c4b8f05868052b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18249 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135206.313257:0:18249:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.141@tcp lock: ffff9fe9fe43f800/0xd6c4b8f05868052b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18249 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783135206.313329:0:18249:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe8c6dfce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:06a7653e-5f5a-4acc-ba93-0eff19f145f0:18249:1869752384476288:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1783135206.313423:0:18249:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135206.313483:0:18249:0:(client.c:2701:ptlrpc_set_wait()) set ffff9fe9e9b209c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783135206.313865:0:18245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384476288 00000100:00100000:2.0:1783135206.313874:0:18245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384476288 00000100:00100000:2.0:1783135206.313945:0:18245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:2.0:1783135206.313957:0:18245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9c8e48850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:06a7653e-5f5a-4acc-ba93-0eff19f145f0+18:18249:x1869752384476288:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783135206.313973:0:18245:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783135206.313991:0:18245:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fe9c7828600/0xd6c4b8f058680532 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xd6c4b8f05868052b expref: -99 pid: 18245 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135206.314023:0:18245:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fe9c7828600/0xd6c4b8f058680532 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd6c4b8f05868052b expref: 19 pid: 18245 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135206.314196:0:18245:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fe9c7828600/0xd6c4b8f058680532 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd6c4b8f05868052b expref: 19 pid: 18245 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135206.314208:0:18245:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fe9c7828600, rc 0) 00000100:00100000:2.0:1783135206.314277:0:18245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9c8e48850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:06a7653e-5f5a-4acc-ba93-0eff19f145f0+19:18249:x1869752384476288:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 321us (854us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135206.314302:0:18245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:2.0:1783135206.314371:0:18249:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe8c6dfce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:06a7653e-5f5a-4acc-ba93-0eff19f145f0:18249:1869752384476288:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783135206.314391:0:18249:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.141@tcp lock: ffff9fe9fe43f800/0xd6c4b8f05868052b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd6c4b8f058680532 expref: -99 pid: 18249 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135206.314402:0:18249:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.141@tcp lock: ffff9fe9fe43f800/0xd6c4b8f05868052b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xd6c4b8f058680532 expref: -99 pid: 18249 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783135206.314477:0:18249:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9fe9f9f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:06a7653e-5f5a-4acc-ba93-0eff19f145f0:18249:1869752384476416:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783135206.314523:0:18249:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135206.314542:0:18249:0:(client.c:2701:ptlrpc_set_wait()) set ffff9fe9c9d15540 going to sleep for 11 seconds 00000100:00100000:1.0:1783135206.314733:0:18246:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384476416 00000100:00100000:1.0:1783135206.314738:0:18246:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384476416 00000100:00100000:1.0:1783135206.314778:0:18246:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:1.0:1783135206.314787:0:18246:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9c8e48c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:06a7653e-5f5a-4acc-ba93-0eff19f145f0+19:18249:x1869752384476416:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783135206.315793:0:18246:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9c8e48c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:06a7653e-5f5a-4acc-ba93-0eff19f145f0+19:18249:x1869752384476416:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 1003us (1265us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135206.315803:0:18246:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:2.0:1783135206.315948:0:18249:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9fe9f9f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:06a7653e-5f5a-4acc-ba93-0eff19f145f0:18249:1869752384476416:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783135206.316004:0:18249:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9fe9f9f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:06a7653e-5f5a-4acc-ba93-0eff19f145f0:18249:1869752384476544:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783135206.316076:0:18249:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135206.316117:0:18249:0:(client.c:2701:ptlrpc_set_wait()) set ffff9fe9c9d15540 going to sleep for 11 seconds 00000100:00100000:2.0:1783135206.316136:0:18245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384476544 00000100:00100000:2.0:1783135206.316141:0:18245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384476544 00000100:00100000:2.0:1783135206.316170:0:18245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:2.0:1783135206.316178:0:18245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9c8e4a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:06a7653e-5f5a-4acc-ba93-0eff19f145f0+19:18249:x1869752384476544:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783135206.316373:0:18245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9c8e4a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:06a7653e-5f5a-4acc-ba93-0eff19f145f0+19:18249:x1869752384476544:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 195us (296us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135206.316380:0:18245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:2.0:1783135206.316412:0:18249:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9fe9f9f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:06a7653e-5f5a-4acc-ba93-0eff19f145f0:18249:1869752384476544:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1783135206.317879:0:20286:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000100:00100000:0.0:1783135206.318737:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000020:01000000:1.0:1783135206.320590:0:18249:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:1.0:1783135206.320658:0:18249:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.201.141@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1783135206.320675:0:18249:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.141@tcp lock: ffff9fe9fe43f800/0xd6c4b8f05868052b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd6c4b8f058680532 expref: -99 pid: 18249 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135206.320712:0:18249:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.141@tcp lock: ffff9fe9fe43f800/0xd6c4b8f05868052b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd6c4b8f058680532 expref: -99 pid: 18249 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783135206.321373:0:19572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752374028672 00000100:00100000:2.0:1783135206.321388:0:19572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752374028672 00000100:00100000:2.0:1783135206.321475:0:19572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 20 00000100:00100000:2.0:1783135206.321488:0:19572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fe8ff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:be37dafa-e6ef-4275-9c00-a4e42a1df10b+9:17370:x1869752374028672:12345-192.168.201.41@tcp:101:lctl.0 00010000:00010000:2.0:1783135206.321525:0:19572:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783135206.321557:0:19572:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828400/0xd6c4b8f058680539 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4428da03f5eb78d9 expref: -99 pid: 19572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135206.321665:0:19572:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829400/0xd6c4b8f058680540 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 19572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135206.321695:0:19572:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829400/0xd6c4b8f058680540 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135206.321711:0:19572:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829400/0xd6c4b8f058680540 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19572 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783135206.321795:0:19572:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:2.0:1783135206.321799:0:19572:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 5 stripe count 1 MDT count 1 00000004:00010000:2.0:1783135206.321846:0:19572:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829400/0xd6c4b8f058680540 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135206.321875:0:19572:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828400/0xd6c4b8f058680539 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb78d9 expref: 11 pid: 19572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135206.321898:0:19572:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829400/0xd6c4b8f058680540 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb78d9 expref: 10 pid: 19572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135206.322140:0:19572:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fe9c9bb4100) 00010000:00010000:2.0:1783135206.322144:0:19572:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1783135206.322148:0:19572:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fe9c7829400, rc 0) 00000100:00100000:2.0:1783135206.322469:0:19572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fe8ff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:be37dafa-e6ef-4275-9c00-a4e42a1df10b+10:17370:x1869752374028672:12345-192.168.201.41@tcp:101:lctl.0 Request processed in 981us (3737us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135206.322478:0:19572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 20 00000100:00100000:0.0:1783135206.322654:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:2.0:1783135206.330697:0:18245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752374028800 00000100:00100000:2.0:1783135206.330717:0:18245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752374028800 00000100:00100000:2.0:1783135206.330819:0:18245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 120 00000100:00100000:2.0:1783135206.330832:0:18245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9c8e4a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aff003e6-38dd-4a94-ba97-2d703b4bd555+13:16748:x1869752374028800:12345-192.168.201.41@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783135206.331562:0:18245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9c8e4a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aff003e6-38dd-4a94-ba97-2d703b4bd555+13:16748:x1869752374028800:12345-192.168.201.41@tcp:503:ll_cfg_requeue.0 Request processed in 728us (8905us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135206.331584:0:18245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 120 00010000:00010000:1.0:1783135206.341322:0:18240:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783135206.349308:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:3.0:1783135206.349402:0:18254:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752374028928 00000100:00100000:3.0:1783135206.349434:0:18254:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752374028928 00000100:00100000:3.0:1783135206.349566:0:18254:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 21 00000100:00100000:3.0:1783135206.349808:0:18254:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe8c6dfce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c20ee9e6-2328-4d1d-a817-651c3e3a5c78+5:17372:x1869752374028928:12345-192.168.201.41@tcp:101:lfs.0 00010000:00010000:3.0:1783135206.349844:0:18254:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783135206.349877:0:18254:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fea02166400/0xd6c4b8f058680547 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4428da03f5eb78e0 expref: -99 pid: 18254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135206.349983:0:18254:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fea02166800/0xd6c4b8f05868054e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 18254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135206.350002:0:18254:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fea02166800/0xd6c4b8f05868054e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135206.350018:0:18254:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fea02166800/0xd6c4b8f05868054e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18254 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783135206.350130:0:18254:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:3.0:1783135206.350134:0:18254:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 5 stripe count 1 MDT count 1 00000004:00010000:3.0:1783135206.350171:0:18254:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fea02166800/0xd6c4b8f05868054e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135206.350204:0:18254:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fea02166400/0xd6c4b8f058680547 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb78e0 expref: 7 pid: 18254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135206.350228:0:18254:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fea02166800/0xd6c4b8f05868054e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb78e0 expref: 6 pid: 18254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135206.350238:0:18254:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fe9c9bb4100) 00010000:00010000:3.0:1783135206.350242:0:18254:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1783135206.350246:0:18254:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fea02166800, rc 0) 00000100:00100000:3.0:1783135206.350432:0:18254:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe8c6dfce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c20ee9e6-2328-4d1d-a817-651c3e3a5c78+6:17372:x1869752374028928:12345-192.168.201.41@tcp:101:lfs.0 Request processed in 854us (1149us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135206.350440:0:18254:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 21 00000100:00100000:0.0:1783135206.355167:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:3.0:1783135206.363701:0:18252:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752374029056 00000100:00100000:3.0:1783135206.363723:0:18252:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752374029056 00000100:00100000:2.0:1783135206.364596:0:18252:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 22 00000100:00100000:2.0:1783135206.364621:0:18252:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fe8ff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c20ee9e6-2328-4d1d-a817-651c3e3a5c78+6:17372:x1869752374029056:12345-192.168.201.41@tcp:101:lfs.0 00010000:00010000:2.0:1783135206.364727:0:18252:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783135206.364759:0:18252:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828400/0xd6c4b8f058680555 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4428da03f5eb78e7 expref: -99 pid: 18252 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135206.364860:0:18252:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829000/0xd6c4b8f05868055c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 18252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135206.364878:0:18252:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829000/0xd6c4b8f05868055c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135206.364892:0:18252:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829000/0xd6c4b8f05868055c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 18252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135206.364910:0:18252:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828a00/0xd6c4b8f058680563 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 18252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135206.364917:0:18252:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828a00/0xd6c4b8f058680563 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135206.364924:0:18252:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828a00/0xd6c4b8f058680563 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135206.365061:0:18252:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829200/0xd6c4b8f05868056a lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 18252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135206.365070:0:18252:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829200/0xd6c4b8f05868056a lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135206.365102:0:18252:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829200/0xd6c4b8f05868056a lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18252 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783135206.365158:0:18252:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 512 00000004:00200000:2.0:1783135206.365163:0:18252:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1783135206.365197:0:18252:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829200/0xd6c4b8f05868056a lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135206.365212:0:18252:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829000/0xd6c4b8f05868055c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135206.365219:0:18252:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829000/0xd6c4b8f05868055c lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 18252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135206.365227:0:18252:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829000/0xd6c4b8f05868055c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135206.365234:0:18252:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe9c7829000 already unused, calling callback (ffffffffc1f634f0) 00010000:00010000:2.0:1783135206.365240:0:18252:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829000/0xd6c4b8f05868055c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135206.365249:0:18252:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829000/0xd6c4b8f05868055c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 18252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135206.365263:0:18252:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fe9c9bb4100) 00010000:00010000:2.0:1783135206.365267:0:18252:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783135206.365272:0:18252:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829000/0xd6c4b8f05868055c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135206.365316:0:18252:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829000/0xd6c4b8f05868055c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135206.365346:0:18252:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828a00/0xd6c4b8f058680563 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135206.365352:0:18252:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828a00/0xd6c4b8f058680563 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 18252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135206.365358:0:18252:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828a00/0xd6c4b8f058680563 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135206.365364:0:18252:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe9c7828a00 already unused, calling callback (ffffffffc1f634f0) 00010000:00010000:2.0:1783135206.365368:0:18252:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828a00/0xd6c4b8f058680563 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135206.365374:0:18252:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828a00/0xd6c4b8f058680563 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 18252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135206.365383:0:18252:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff9fe9c9bb4600) 00010000:00010000:2.0:1783135206.365385:0:18252:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783135206.365388:0:18252:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828a00/0xd6c4b8f058680563 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135206.365394:0:18252:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828a00/0xd6c4b8f058680563 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135206.365436:0:18252:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828400/0xd6c4b8f058680555 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb78e7 expref: 8 pid: 18252 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135206.365451:0:18252:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829200/0xd6c4b8f05868056a lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb78e7 expref: 7 pid: 18252 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135206.365470:0:18252:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9fe9c9bb4400) 00010000:00010000:2.0:1783135206.365473:0:18252:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1783135206.365476:0:18252:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fe9c7829200, rc 0) 00000100:00100000:2.0:1783135206.365571:0:18252:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fe8ff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c20ee9e6-2328-4d1d-a817-651c3e3a5c78+7:17372:x1869752374029056:12345-192.168.201.41@tcp:101:lfs.0 Request processed in 962us (10416us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135206.365579:0:18252:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 22 00000100:00100000:0.0:1783135206.376563:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:1.0:1783135206.376969:0:18253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752374029312 00000100:00100000:1.0:1783135206.376991:0:18253:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752374029312 00000100:00100000:1.0:1783135206.377124:0:18253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 23 00000100:00100000:1.0:1783135206.377143:0:18253:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fe7d2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c20ee9e6-2328-4d1d-a817-651c3e3a5c78+7:17372:x1869752374029312:12345-192.168.201.41@tcp:101:lfs.0 00010000:00010000:1.0:1783135206.377188:0:18253:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783135206.377234:0:18253:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43f600/0xd6c4b8f058680571 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4428da03f5eb78ee expref: -99 pid: 18253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783135206.378056:0:18253:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 512 00010000:00010000:1.0:1783135206.378223:0:18253:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43f600/0xd6c4b8f058680571 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb78ee expref: 9 pid: 18253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135206.378243:0:18253:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fe9c9bb4100) 00010000:00010000:1.0:1783135206.378246:0:18253:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1783135206.378251:0:18253:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43f600/0xd6c4b8f058680571 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb78ee expref: 9 pid: 18253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135206.378271:0:18253:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fe9fe43f600, rc 0) 00000100:00100000:1.0:1783135206.378854:0:18253:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fe7d2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c20ee9e6-2328-4d1d-a817-651c3e3a5c78+8:17372:x1869752374029312:12345-192.168.201.41@tcp:101:lfs.0 Request processed in 1712us (2306us total) trans 12884901891 rc 301/301 00000100:00100000:1.0:1783135206.378865:0:18253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 23 00000100:00100000:2.0:1783135206.385865:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:1.0:1783135206.388738:0:18252:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752374029568 00000100:00100000:1.0:1783135206.388770:0:18252:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752374029568 00000100:00100000:1.0:1783135206.388862:0:18252:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 24 00000100:00100000:1.0:1783135206.388875:0:18252:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fe9f9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c20ee9e6-2328-4d1d-a817-651c3e3a5c78+8:17372:x1869752374029568:12345-192.168.201.41@tcp:36:lfs.0 00010000:00010000:1.0:1783135206.388954:0:18252:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783135206.388991:0:18252:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829200/0xd6c4b8f05868056a lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb78e7 expref: 8 pid: 18252 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135206.389016:0:18252:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9fe9c9bb4400) 00010000:00010000:1.0:1783135206.389033:0:18252:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1783135206.389082:0:18252:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43e200/0xd6c4b8f05868057f lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 18252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135206.389097:0:18252:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43e200/0xd6c4b8f05868057f lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135206.389108:0:18252:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43e200/0xd6c4b8f05868057f lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18252 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1783135206.389441:0:18252:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000003422af33 reply state 000000007cfbf196 transno 12884901892 ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43e200/0xd6c4b8f05868057f lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18252 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783135206.389454:0:18252:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1783135206.389471:0:18252:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 512 00000100:00100000:1.0:1783135206.389586:0:18252:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fe9f9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c20ee9e6-2328-4d1d-a817-651c3e3a5c78+9:17372:x1869752374029568:12345-192.168.201.41@tcp:36:lfs.0 Request processed in 713us (3734us total) trans 12884901892 rc 0/0 00000100:00100000:1.0:1783135206.389595:0:18252:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 24 00010000:00010000:3.0:1783135206.393962:0:3272:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43e200/0xd6c4b8f05868057f lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135206.393984:0:3272:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43e200/0xd6c4b8f05868057f lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 18252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135206.393993:0:3272:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43e200/0xd6c4b8f05868057f lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135206.394000:0:3272:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe9fe43e200 already unused, calling callback (ffffffffc1f634f0) 00010000:00010000:3.0:1783135206.394006:0:3272:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43e200/0xd6c4b8f05868057f lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135206.394015:0:3272:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43e200/0xd6c4b8f05868057f lrc: 4/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 18252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135206.394038:0:3272:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9fe9c9dd3600) 00010000:00010000:3.0:1783135206.394041:0:3272:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:3.0:1783135206.394046:0:3272:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43e200/0xd6c4b8f05868057f lrc: 2/0,0 mode: --/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135206.394053:0:3272:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43e200/0xd6c4b8f05868057f lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18252 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783135206.394168:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:2.0:1783135206.394256:0:18256:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752374029824 00000100:00100000:2.0:1783135206.394268:0:18256:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752374029824 00000100:00100000:2.0:1783135206.394358:0:18256:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 2 00000100:00100000:2.0:1783135206.394368:0:18256:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe8c6dfc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c20ee9e6-2328-4d1d-a817-651c3e3a5c78+8:17372:x1869752374029824:12345-192.168.201.41@tcp:35:lfs.0 00000100:00100000:2.0:1783135206.394714:0:18256:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe8c6dfc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c20ee9e6-2328-4d1d-a817-651c3e3a5c78+9:17372:x1869752374029824:12345-192.168.201.41@tcp:35:lfs.0 Request processed in 345us (550us total) trans 12884901893 rc 0/0 00000100:00100000:2.0:1783135206.394723:0:18256:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 2 00000100:00100000:0.0:1783135206.401275:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:3.0:1783135206.401471:0:18254:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752374030080 00000100:00100000:3.0:1783135206.401485:0:18254:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752374030080 00000100:00100000:3.0:1783135206.401561:0:18254:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 25 00000100:00100000:3.0:1783135206.401592:0:18254:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fe7d3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c20ee9e6-2328-4d1d-a817-651c3e3a5c78+9:17372:x1869752374030080:12345-192.168.201.41@tcp:101:lfs.0 00010000:00010000:3.0:1783135206.401636:0:18254:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783135206.401663:0:18254:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fea02166400/0xd6c4b8f058680586 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4428da03f5eb78f5 expref: -99 pid: 18254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135206.401777:0:18254:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fea02167400/0xd6c4b8f05868058d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 18254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135206.401798:0:18254:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fea02167400/0xd6c4b8f05868058d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135206.401812:0:18254:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fea02167400/0xd6c4b8f05868058d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 18254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135206.401830:0:18254:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fea02166600/0xd6c4b8f058680594 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 18254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135206.401838:0:18254:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fea02166600/0xd6c4b8f058680594 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135206.401845:0:18254:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fea02166600/0xd6c4b8f058680594 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18254 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783135206.402015:0:18254:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 512 00010000:00010000:3.0:1783135206.402395:0:18254:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fea02167400/0xd6c4b8f05868058d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135206.402405:0:18254:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fea02167400/0xd6c4b8f05868058d lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 18254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135206.402414:0:18254:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fea02167400/0xd6c4b8f05868058d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135206.402433:0:18254:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fea02167400 already unused, calling callback (ffffffffc1f634f0) 00010000:00010000:3.0:1783135206.402438:0:18254:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fea02167400/0xd6c4b8f05868058d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135206.402447:0:18254:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fea02167400/0xd6c4b8f05868058d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 18254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135206.402463:0:18254:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fe9c9bb4100) 00010000:00010000:3.0:1783135206.402467:0:18254:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783135206.402473:0:18254:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fea02167400/0xd6c4b8f05868058d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135206.402480:0:18254:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fea02167400/0xd6c4b8f05868058d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135206.402497:0:18254:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fea02166600/0xd6c4b8f058680594 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135206.402504:0:18254:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fea02166600/0xd6c4b8f058680594 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 18254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135206.402510:0:18254:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fea02166600/0xd6c4b8f058680594 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135206.402515:0:18254:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fea02166600 already unused, calling callback (ffffffffc1f634f0) 00010000:00010000:3.0:1783135206.402518:0:18254:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fea02166600/0xd6c4b8f058680594 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135206.402524:0:18254:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fea02166600/0xd6c4b8f058680594 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 18254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135206.402541:0:18254:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff9fe9c33d0300) 00010000:00010000:3.0:1783135206.402543:0:18254:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783135206.402546:0:18254:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fea02166600/0xd6c4b8f058680594 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135206.402552:0:18254:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fea02166600/0xd6c4b8f058680594 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135206.402604:0:18254:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fea02166400/0xd6c4b8f058680586 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb78f5 expref: 11 pid: 18254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135206.402625:0:18254:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fe9c9bb4100) 00010000:00010000:3.0:1783135206.402628:0:18254:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1783135206.402632:0:18254:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fea02166400/0xd6c4b8f058680586 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb78f5 expref: 11 pid: 18254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135206.402643:0:18254:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fea02166400, rc 0) 00000100:00100000:3.0:1783135206.402837:0:18254:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fe7d3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c20ee9e6-2328-4d1d-a817-651c3e3a5c78+10:17372:x1869752374030080:12345-192.168.201.41@tcp:101:lfs.0 Request processed in 1246us (1579us total) trans 12884901894 rc 301/301 00000100:00100000:3.0:1783135206.402846:0:18254:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 25 00000100:00100000:1.0:1783135206.410202:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:2.0:1783135206.414073:0:18252:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752374030208 00000100:00100000:2.0:1783135206.414096:0:18252:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752374030208 00000100:00100000:2.0:1783135206.414261:0:18252:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 26 00000100:00100000:2.0:1783135206.414274:0:18252:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fea00bcce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c20ee9e6-2328-4d1d-a817-651c3e3a5c78+10:17372:x1869752374030208:12345-192.168.201.41@tcp:101:lfs.0 00010000:00010000:2.0:1783135206.414326:0:18252:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783135206.414357:0:18252:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828400/0xd6c4b8f0586805a2 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4428da03f5eb78fc expref: -99 pid: 18252 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135206.414480:0:18252:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828a00/0xd6c4b8f0586805a9 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 18252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135206.414498:0:18252:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828a00/0xd6c4b8f0586805a9 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135206.414527:0:18252:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828a00/0xd6c4b8f0586805a9 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18252 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783135206.414595:0:18252:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 512 00000004:00200000:2.0:1783135206.414624:0:18252:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1783135206.414659:0:18252:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828a00/0xd6c4b8f0586805a9 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135206.414690:0:18252:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828400/0xd6c4b8f0586805a2 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb78fc expref: 12 pid: 18252 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135206.414715:0:18252:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828a00/0xd6c4b8f0586805a9 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb78fc expref: 11 pid: 18252 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135206.414725:0:18252:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9fe9c9bb4600) 00010000:00010000:2.0:1783135206.414728:0:18252:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1783135206.414732:0:18252:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fe9c7828a00, rc 0) 00000100:00100000:2.0:1783135206.415012:0:18252:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fea00bcce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c20ee9e6-2328-4d1d-a817-651c3e3a5c78+11:17372:x1869752374030208:12345-192.168.201.41@tcp:101:lfs.0 Request processed in 740us (4827us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135206.415020:0:18252:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 26 00000100:00100000:1.0:1783135206.418816:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:3.0:1783135206.419349:0:18256:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752374030336 00000100:00100000:3.0:1783135206.419363:0:18256:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752374030336 00000100:00100000:3.0:1783135206.419422:0:18256:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 3 00000100:00100000:3.0:1783135206.419433:0:18256:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fea00bcc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c20ee9e6-2328-4d1d-a817-651c3e3a5c78+11:17372:x1869752374030336:12345-192.168.201.41@tcp:37:lfs.0 00000100:00100000:3.0:1783135206.427704:0:18256:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fea00bcc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c20ee9e6-2328-4d1d-a817-651c3e3a5c78+11:17372:x1869752374030336:12345-192.168.201.41@tcp:37:lfs.0 Request processed in 8253us (8883us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135206.427722:0:18256:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 3 00000100:00100000:1.0:1783135206.437136:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:0.0:1783135206.438142:0:18255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752374030592 00000100:00100000:0.0:1783135206.438181:0:18255:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752374030592 00000100:00100000:0.0:1783135206.438271:0:18255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 4 00000100:00100000:0.0:1783135206.438298:0:18255:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9ca846c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c20ee9e6-2328-4d1d-a817-651c3e3a5c78+11:17372:x1869752374030592:12345-192.168.201.41@tcp:35:lfs.0 00000100:00100000:0.0:1783135206.439187:0:18255:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9ca846c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c20ee9e6-2328-4d1d-a817-651c3e3a5c78+12:17372:x1869752374030592:12345-192.168.201.41@tcp:35:lfs.0 Request processed in 900us (2063us total) trans 12884901895 rc 0/0 00000100:00100000:0.0:1783135206.439199:0:18255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 4 00000100:00100000:1.0:1783135206.505528:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:3.0:1783135206.506068:0:18253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752374030720 00000100:00100000:3.0:1783135206.506080:0:18253:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752374030720 00000100:00100000:3.0:1783135206.506226:0:18253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 27 00000100:00100000:3.0:1783135206.506240:0:18253:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fea00bcd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:be37dafa-e6ef-4275-9c00-a4e42a1df10b+10:17379:x1869752374030720:12345-192.168.201.41@tcp:101:bash.0 00010000:00010000:3.0:1783135206.506269:0:18253:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783135206.506352:0:18253:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fea02166400/0xd6c4b8f0586805b0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4428da03f5eb7903 expref: -99 pid: 18253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135206.506445:0:18253:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fea02166600/0xd6c4b8f0586805b7 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 18253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135206.506463:0:18253:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fea02166600/0xd6c4b8f0586805b7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135206.506478:0:18253:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fea02166600/0xd6c4b8f0586805b7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 18253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135206.506498:0:18253:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fea02167400/0xd6c4b8f0586805be lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 18253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135206.506506:0:18253:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fea02167400/0xd6c4b8f0586805be lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135206.506514:0:18253:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fea02167400/0xd6c4b8f0586805be lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135206.506693:0:18253:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fea02167a00/0xd6c4b8f0586805c5 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 18253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135206.506702:0:18253:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fea02167a00/0xd6c4b8f0586805c5 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135206.506733:0:18253:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fea02167a00/0xd6c4b8f0586805c5 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18253 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783135206.506791:0:18253:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 512 00000004:00200000:3.0:1783135206.506794:0:18253:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1783135206.506844:0:18253:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fea02167a00/0xd6c4b8f0586805c5 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135206.506857:0:18253:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fea02166600/0xd6c4b8f0586805b7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135206.506863:0:18253:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fea02166600/0xd6c4b8f0586805b7 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 18253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135206.506871:0:18253:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fea02166600/0xd6c4b8f0586805b7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135206.506877:0:18253:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fea02166600 already unused, calling callback (ffffffffc1f634f0) 00010000:00010000:3.0:1783135206.506881:0:18253:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fea02166600/0xd6c4b8f0586805b7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135206.506890:0:18253:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fea02166600/0xd6c4b8f0586805b7 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 18253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135206.507632:0:18253:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fe9c9bb4100) 00010000:00010000:3.0:1783135206.507638:0:18253:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783135206.507647:0:18253:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fea02166600/0xd6c4b8f0586805b7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135206.507656:0:18253:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fea02166600/0xd6c4b8f0586805b7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135206.507691:0:18253:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fea02167400/0xd6c4b8f0586805be lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135206.507699:0:18253:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fea02167400/0xd6c4b8f0586805be lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 18253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135206.507706:0:18253:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fea02167400/0xd6c4b8f0586805be lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135206.507711:0:18253:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fea02167400 already unused, calling callback (ffffffffc1f634f0) 00010000:00010000:3.0:1783135206.507715:0:18253:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fea02167400/0xd6c4b8f0586805be lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135206.507722:0:18253:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fea02167400/0xd6c4b8f0586805be lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 18253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135206.507734:0:18253:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff9fe9c33d0300) 00010000:00010000:3.0:1783135206.507736:0:18253:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783135206.507739:0:18253:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fea02167400/0xd6c4b8f0586805be lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135206.507745:0:18253:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fea02167400/0xd6c4b8f0586805be lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135206.507805:0:18253:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fea02166400/0xd6c4b8f0586805b0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb7903 expref: 12 pid: 18253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135206.507823:0:18253:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fea02167a00/0xd6c4b8f0586805c5 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb7903 expref: 11 pid: 18253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135206.507842:0:18253:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9fe9c9bb4600) 00010000:00010000:3.0:1783135206.507844:0:18253:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1783135206.507847:0:18253:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fea02167a00, rc 0) 00000100:00100000:3.0:1783135206.508139:0:18253:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fea00bcd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:be37dafa-e6ef-4275-9c00-a4e42a1df10b+11:17379:x1869752374030720:12345-192.168.201.41@tcp:101:bash.0 Request processed in 1901us (2625us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135206.508149:0:18253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 27 00000100:00100000:2.0:1783135206.511897:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:1.0:1783135206.512117:0:19572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752374030976 00000100:00100000:1.0:1783135206.512129:0:19572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752374030976 00000100:00100000:1.0:1783135206.512271:0:19572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 28 00000100:00100000:1.0:1783135206.512311:0:19572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fe9f9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:be37dafa-e6ef-4275-9c00-a4e42a1df10b+11:17379:x1869752374030976:12345-192.168.201.41@tcp:101:bash.0 00010000:00010000:1.0:1783135206.512339:0:19572:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783135206.512367:0:19572:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43f400/0xd6c4b8f0586805cc lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4428da03f5eb790a expref: -99 pid: 19572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135206.512544:0:19572:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43f000/0xd6c4b8f0586805d3 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 19572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135206.512563:0:19572:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828a00/0xd6c4b8f0586805a9 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb78fc expref: 11 pid: 18252 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135206.512573:0:19572:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43f000/0xd6c4b8f0586805d3 lrc: 4/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 19572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135206.513726:0:19572:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828a00/0xd6c4b8f0586805a9 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb78fc expref: 11 pid: 18252 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135206.513757:0:19572:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828a00/0xd6c4b8f0586805a9 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb78fc expref: 11 pid: 18252 timeout: 588 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783135206.513987:0:19572:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fea00bcd880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:19572:1869752384476672:192.168.201.41@tcp:104: 00000100:00100000:1.0:1783135206.514345:0:19572:0:(client.c:2701:ptlrpc_set_wait()) set ffff9fe9e9b20b40 going to sleep for 11 seconds 00000100:00100000:2.0:1783135206.517753:0:19572:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fea00bcd880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:19572:1869752384476672:192.168.201.41@tcp:104: 00010000:00010000:2.0:1783135206.517796:0:19572:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43f000/0xd6c4b8f0586805d3 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 19572 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783135206.521971:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:1.0:1783135206.522402:0:18238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752374031104 00000100:00100000:1.0:1783135206.522434:0:18238:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752374031104 00010000:00010000:1.0:1783135206.522485:0:18238:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828a00/0xd6c4b8f0586805a9 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb78fc expref: 12 pid: 18252 timeout: 588 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783135206.522573:0:18238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 10 00000100:00100000:1.0:1783135206.522585:0:18238:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fe9f8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c20ee9e6-2328-4d1d-a817-651c3e3a5c78+12:2369:x1869752374031104:12345-192.168.201.41@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1783135206.522623:0:18238:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783135206.522639:0:18238:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828a00/0xd6c4b8f0586805a9 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb78fc expref: 12 pid: 18252 timeout: 588 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135206.522656:0:18238:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828a00/0xd6c4b8f0586805a9 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb78fc expref: 12 pid: 18252 timeout: 588 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135206.522685:0:18238:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828a00/0xd6c4b8f0586805a9 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb78fc expref: 12 pid: 18252 timeout: 588 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135206.522709:0:18238:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9fe9c9bb4600) 00010000:00010000:1.0:1783135206.522716:0:18238:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43f000/0xd6c4b8f0586805d3 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 19572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135206.522730:0:18238:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43f000/0xd6c4b8f0586805d3 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 19572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135206.522740:0:18238:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43f000/0xd6c4b8f0586805d3 lrc: 4/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 19572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135206.522787:0:18238:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783135206.522866:0:18238:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fe9f8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c20ee9e6-2328-4d1d-a817-651c3e3a5c78+11:2369:x1869752374031104:12345-192.168.201.41@tcp:103:ldlm_bl.0 Request processed in 282us (909us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135206.522884:0:18238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 10 00010000:00010000:3.0:1783135206.523276:0:19572:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43f000/0xd6c4b8f0586805d3 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135206.523307:0:19572:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43f000/0xd6c4b8f0586805d3 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135206.523339:0:19572:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fea02166400/0xd6c4b8f0586805da lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135206.523350:0:19572:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fea02166400/0xd6c4b8f0586805da lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135206.523358:0:19572:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fea02166400/0xd6c4b8f0586805da lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135206.524788:0:19572:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fea02167400/0xd6c4b8f0586805e1 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135206.524809:0:19572:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fea02167400/0xd6c4b8f0586805e1 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135206.524822:0:19572:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fea02167400/0xd6c4b8f0586805e1 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19572 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783135206.524854:0:19572:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:3.0:1783135206.524898:0:19572:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43f000/0xd6c4b8f0586805d3 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135206.525669:0:19572:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43f000/0xd6c4b8f0586805d3 lrc: 2/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 19572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135206.525677:0:19572:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43f000/0xd6c4b8f0586805d3 lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 19572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135206.525684:0:19572:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe9fe43f000 already unused, calling callback (ffffffffc1f634f0) 00010000:00010000:3.0:1783135206.525689:0:19572:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43f000/0xd6c4b8f0586805d3 lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 19572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135206.525698:0:19572:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43f000/0xd6c4b8f0586805d3 lrc: 4/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 19572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135206.525720:0:19572:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9fe9c9bb4600) 00010000:00010000:3.0:1783135206.525724:0:19572:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783135206.525729:0:19572:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43f000/0xd6c4b8f0586805d3 lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 19572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135206.525736:0:19572:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43f000/0xd6c4b8f0586805d3 lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 19572 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1783135206.525758:0:19572:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000c2a88e37 reply state 00000000cba71731 transno 12884901896 ns: mdt-lustre-MDT0000_UUID lock: ffff9fea02166400/0xd6c4b8f0586805da lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19572 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783135206.525771:0:19572:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1783135206.525843:0:19572:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43f400/0xd6c4b8f0586805cc lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb790a expref: 14 pid: 19572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135206.525888:0:19572:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fea02167400/0xd6c4b8f0586805e1 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb790a expref: 13 pid: 19572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135206.525899:0:19572:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9fe9c33d0800) 00010000:00010000:3.0:1783135206.527241:0:19572:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:3.0:1783135206.527249:0:19572:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fea02167400, rc 0) 00000100:00100000:0.0:1783135206.527557:0:19572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fe9f9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:be37dafa-e6ef-4275-9c00-a4e42a1df10b+14:17379:x1869752374030976:12345-192.168.201.41@tcp:101:bash.0 Request processed in 15268us (15666us total) trans 12884901896 rc 0/0 00000100:00100000:0.0:1783135206.527570:0:19572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 28 00000100:00100000:3.0:1783135206.532599:0:3288:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1783135206.532647:0:3288:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9fec14700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1869752384476800:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1783135206.532737:0:3288:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135206.532804:0:18894:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384476800 00000100:00100000:3.0:1783135206.532814:0:18894:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384476800 00000100:00100000:3.0:1783135206.532888:0:18894:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1783135206.532899:0:18894:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fec14a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3288:x1869752384476800:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1783135206.532952:0:18894:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1783135206.533442:0:18894:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fec14a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3288:x1869752384476800:12345-0@lo:13:osp-pre-1-0.0 Request processed in 542us (702us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135206.533452:0:18894:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1783135206.533551:0:3288:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9fec14700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3288:1869752384476800:0@lo:13:osp-pre-1-0.0 00000100:00080000:0.0:1783135206.533673:0:18248:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1783135206.534645:0:3273:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9fea02166400/0xd6c4b8f0586805da lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135206.534662:0:3273:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fea02166400/0xd6c4b8f0586805da lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 19572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135206.534671:0:3273:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fea02166400/0xd6c4b8f0586805da lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135206.534679:0:3273:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fea02166400 already unused, calling callback (ffffffffc1f634f0) 00010000:00010000:3.0:1783135206.534703:0:3273:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fea02166400/0xd6c4b8f0586805da lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135206.534713:0:3273:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fea02166400/0xd6c4b8f0586805da lrc: 4/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 19572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135206.534735:0:3273:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0xb42112bc (ffff9fe9c33d0300) 00010000:00010000:3.0:1783135206.534739:0:3273:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783135206.534745:0:3273:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fea02166400/0xd6c4b8f0586805da lrc: 2/0,0 mode: --/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135206.534753:0:3273:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fea02166400/0xd6c4b8f0586805da lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19572 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783135206.546110:0:3289:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9fe7d0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3289:1869752384477312:0@lo:400:kworker.0 00000100:00100000:0.0:1783135206.546211:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135206.546275:0:3289:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1783135206.546309:0:3289:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9fe7d2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3289:1869752384477184:0@lo:400:kworker.0 00000100:00100000:0.0:1783135206.546337:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135206.546381:0:18253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384477312 00000100:00100000:0.0:1783135206.546390:0:18253:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384477312 00000100:00080000:0.0:1783135206.546425:0:18248:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783135206.546476:0:18252:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384477184 00000100:00100000:0.0:1783135206.546480:0:18252:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384477184 00000100:00100000:0.0:1783135206.546514:0:18252:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1783135206.546524:0:18252:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fe7d1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3289:x1869752384477312:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783135206.546591:0:18252:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fe7d1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3289:x1869752384477312:12345-0@lo:400:kworker.0 Request processed in 67us (379us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135206.546600:0:18252:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1783135206.546659:0:18252:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1783135206.546666:0:18252:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fe7d0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3289:x1869752384477184:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783135206.546698:0:18252:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fe7d0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3289:x1869752384477184:12345-0@lo:400:kworker.0 Request processed in 33us (361us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135206.546706:0:18252:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00080000:0.0:1783135206.546720:0:18248:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783135206.546754:0:3289:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9fe7d2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3289:1869752384477184:0@lo:400:kworker.0 00000100:00100000:0.0:1783135206.546907:0:3289:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9fe7d0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3289:1869752384477312:0@lo:400:kworker.0 00000100:00100000:1.0:1783135206.547236:0:3286:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9fe7d3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1869752384476928:0@lo:400:kworker.0 00000100:00100000:1.0:1783135206.547296:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135206.547323:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1783135206.547329:0:3286:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9fe7d0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3286:1869752384477056:0@lo:400:kworker.0 00000100:00100000:1.0:1783135206.547350:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135206.547379:0:18252:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384477056 00000100:00100000:1.0:1783135206.547383:0:18252:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384477056 00000100:00100000:1.0:1783135206.547411:0:18252:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1783135206.547418:0:18252:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fea00bcd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3286:x1869752384477056:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783135206.547452:0:18252:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fea00bcd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3286:x1869752384477056:12345-0@lo:400:kworker.0 Request processed in 35us (101us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135206.547459:0:18252:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1783135206.547483:0:3286:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9fe7d0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3286:1869752384477056:0@lo:400:kworker.0 00000100:00100000:0.0:1783135206.547545:0:18889:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384476928 00000100:00100000:0.0:1783135206.547548:0:18889:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384476928 00000100:00100000:0.0:1783135206.547591:0:18889:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1783135206.547598:0:18889:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fea00bcdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3286:x1869752384476928:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1783135206.547699:0:18248:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1783135206.547752:0:18889:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fea00bcdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3286:x1869752384476928:12345-0@lo:400:kworker.0 Request processed in 154us (454us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135206.547845:0:3286:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9fe7d3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1869752384476928:0@lo:400:kworker.0 00000100:00100000:0.0:1783135206.547876:0:18889:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1783135206.549016:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:1.0:1783135206.549371:0:19572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752374031232 00000100:00100000:1.0:1783135206.549382:0:19572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752374031232 00000100:00100000:1.0:1783135206.549436:0:18252:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 29 00000100:00100000:1.0:1783135206.549445:0:18252:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fe9f8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:be37dafa-e6ef-4275-9c00-a4e42a1df10b+13:17379:x1869752374031232:12345-192.168.201.41@tcp:101:bash.0 00010000:00010000:1.0:1783135206.549472:0:18252:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783135206.549496:0:18252:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43e600/0xd6c4b8f0586805ef lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4428da03f5eb7911 expref: -99 pid: 18252 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135206.549580:0:18252:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43fc00/0xd6c4b8f0586805f6 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 18252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135206.549631:0:18252:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43fc00/0xd6c4b8f0586805f6 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135206.549646:0:18252:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43fc00/0xd6c4b8f0586805f6 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18252 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783135206.549700:0:18252:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00000004:00200000:1.0:1783135206.549706:0:18252:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1783135206.549732:0:18252:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43fc00/0xd6c4b8f0586805f6 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135206.549744:0:18252:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43fc00/0xd6c4b8f0586805f6 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135206.549782:0:18252:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43e600/0xd6c4b8f0586805ef lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb7911 expref: 15 pid: 18252 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135206.549804:0:18252:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43fc00/0xd6c4b8f0586805f6 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb7911 expref: 14 pid: 18252 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135206.549814:0:18252:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9fe9c33d0800) 00010000:00010000:1.0:1783135206.549817:0:18252:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1783135206.549821:0:18252:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fe9fe43fc00, rc 0) 00000100:00100000:1.0:1783135206.549883:0:18252:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fe9f8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:be37dafa-e6ef-4275-9c00-a4e42a1df10b+14:17379:x1869752374031232:12345-192.168.201.41@tcp:101:bash.0 Request processed in 439us (875us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135206.549890:0:18252:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 29 00000100:00100000:2.0:1783135206.558454:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:3.0:1783135206.558559:0:18256:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752374031488 00000100:00100000:3.0:1783135206.558576:0:18256:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752374031488 00000100:00100000:3.0:1783135206.558683:0:18256:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 5 00000100:00100000:3.0:1783135206.558698:0:18256:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fe9faa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:be37dafa-e6ef-4275-9c00-a4e42a1df10b+14:17379:x1869752374031488:12345-192.168.201.41@tcp:35:bash.0 00000100:00100000:3.0:1783135206.559551:0:18256:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fe9faa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:be37dafa-e6ef-4275-9c00-a4e42a1df10b+15:17379:x1869752374031488:12345-192.168.201.41@tcp:35:bash.0 Request processed in 851us (1107us total) trans 12884901897 rc 0/0 00000100:00100000:3.0:1783135206.559562:0:18256:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 5 00000100:00100000:2.0:1783135206.646735:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:1.0:1783135206.647331:0:18253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752374031744 00000100:00100000:1.0:1783135206.647345:0:18253:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752374031744 00000100:00100000:0.0:1783135206.647603:0:18253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 30 00000100:00100000:0.0:1783135206.647637:0:18253:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fe9fa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:be37dafa-e6ef-4275-9c00-a4e42a1df10b+15:17389:x1869752374031744:12345-192.168.201.41@tcp:101:lfs.0 00010000:00010000:0.0:1783135206.647670:0:18253:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783135206.647702:0:18253:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ade00/0xd6c4b8f0586805fd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4428da03f5eb7918 expref: -99 pid: 18253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783135206.647873:0:18253:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 512 00010000:00010000:0.0:1783135206.648040:0:18253:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ade00/0xd6c4b8f0586805fd lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb7918 expref: 17 pid: 18253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135206.648058:0:18253:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fe9c9bb4100) 00010000:00010000:0.0:1783135206.648077:0:18253:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1783135206.648083:0:18253:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ade00/0xd6c4b8f0586805fd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb7918 expref: 17 pid: 18253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135206.648101:0:18253:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fe9f68ade00, rc 0) 00000100:00100000:0.0:1783135206.648193:0:18253:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fe9fa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:be37dafa-e6ef-4275-9c00-a4e42a1df10b+16:17389:x1869752374031744:12345-192.168.201.41@tcp:101:lfs.0 Request processed in 569us (1476us total) trans 12884901898 rc 301/301 00000100:00100000:0.0:1783135206.648201:0:18253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 30 00000100:00100000:2.0:1783135206.657328:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:1.0:1783135206.660886:0:18255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752374032000 00000100:00100000:1.0:1783135206.660926:0:18255:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752374032000 00000100:00100000:1.0:1783135206.660997:0:18255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 6 00000100:00100000:1.0:1783135206.661009:0:18255:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fe9f8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:be37dafa-e6ef-4275-9c00-a4e42a1df10b+16:17389:x1869752374032000:12345-192.168.201.41@tcp:35:lfs.0 00000100:00100000:1.0:1783135206.661389:0:18255:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fe9f8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:be37dafa-e6ef-4275-9c00-a4e42a1df10b+17:17389:x1869752374032000:12345-192.168.201.41@tcp:35:lfs.0 Request processed in 380us (4072us total) trans 12884901899 rc 0/0 00000100:00100000:1.0:1783135206.661398:0:18255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 6 00000040:00080000:3.0:1783135206.661415:0:18286:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1783135206.703519:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:1.0:1783135206.703648:0:18252:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752374032256 00000100:00100000:1.0:1783135206.703662:0:18252:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752374032256 00000100:00100000:1.0:1783135206.703775:0:18252:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 31 00000100:00100000:1.0:1783135206.703788:0:18252:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fec17480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:be37dafa-e6ef-4275-9c00-a4e42a1df10b+17:17392:x1869752374032256:12345-192.168.201.41@tcp:101:lfs.0 00010000:00010000:1.0:1783135206.703825:0:18252:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783135206.703855:0:18252:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43e600/0xd6c4b8f05868060b lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4428da03f5eb791f expref: -99 pid: 18252 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135206.704386:0:18252:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43e800/0xd6c4b8f058680612 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 18252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135206.704406:0:18252:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43e800/0xd6c4b8f058680612 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135206.704422:0:18252:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43e800/0xd6c4b8f058680612 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18252 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783135206.704437:0:18252:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1783135206.704649:0:18252:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43e600/0xd6c4b8f05868060b lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb791f expref: 20 pid: 18252 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135206.704674:0:18252:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43e800/0xd6c4b8f058680612 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb791f expref: 19 pid: 18252 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135206.704714:0:18252:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9fe9c33d0800) 00010000:00010000:1.0:1783135206.704717:0:18252:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1783135206.704722:0:18252:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fe9fe43e800, rc 0) 00000100:00100000:1.0:1783135206.704824:0:18252:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fec17480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:be37dafa-e6ef-4275-9c00-a4e42a1df10b+19:17392:x1869752374032256:12345-192.168.201.41@tcp:101:lfs.0 Request processed in 1037us (1323us total) trans 12884901900 rc 0/0 00000100:00100000:1.0:1783135206.704833:0:18252:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 31 00000100:00100000:0.0:1783135206.709898:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:0.0:1783135206.709952:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:3.0:1783135206.710063:0:18254:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752374032512 00000100:00100000:2.0:1783135206.710075:0:18237:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752374032384 00000100:00100000:3.0:1783135206.710076:0:18254:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752374032512 00000100:00100000:2.0:1783135206.710079:0:18237:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752374032384 00000100:00100000:2.0:1783135206.710148:0:18237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 0 00000100:00100000:3.0:1783135206.710155:0:18254:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 32 00000100:00100000:2.0:1783135206.710159:0:18237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fe7d0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:be37dafa-e6ef-4275-9c00-a4e42a1df10b+20:2367:x1869752374032384:12345-192.168.201.41@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1783135206.710161:0:18254:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fe7d2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:be37dafa-e6ef-4275-9c00-a4e42a1df10b+20:17392:x1869752374032512:12345-192.168.201.41@tcp:54:lfs.0 00010000:00010000:2.0:1783135206.710183:0:18237:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783135206.710215:0:18237:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43e800/0xd6c4b8f058680612 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb791f expref: 20 pid: 18252 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135206.710232:0:18254:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fea02166400/0xd6c4b8f058680620 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 18254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135206.710238:0:18237:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9fe9c33d0800) 00010000:00010000:2.0:1783135206.710244:0:18237:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1783135206.710267:0:18254:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fea02166400/0xd6c4b8f058680620 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135206.710302:0:18254:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fea02166400/0xd6c4b8f058680620 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135206.710337:0:18254:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fea02166400/0xd6c4b8f058680620 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18254 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783135206.710344:0:18237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fe7d0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:be37dafa-e6ef-4275-9c00-a4e42a1df10b+19:2367:x1869752374032384:12345-192.168.201.41@tcp:103:ldlm_bl.0 Request processed in 187us (461us total) trans 0 rc 0/0 00010000:00010000:3.0:1783135206.710345:0:18254:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fea02166400/0xd6c4b8f058680620 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 18254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135206.710353:0:18254:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fea02166400/0xd6c4b8f058680620 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 18254 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783135206.710353:0:18237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 0 00010000:00010000:3.0:1783135206.710359:0:18254:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fea02166400 already unused, calling callback (ffffffffc1f634f0) 00010000:00010000:3.0:1783135206.710364:0:18254:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fea02166400/0xd6c4b8f058680620 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 18254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135206.710371:0:18254:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fea02166400/0xd6c4b8f058680620 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 18254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135206.710379:0:18254:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9fe9c33d0800) 00010000:00010000:3.0:1783135206.710382:0:18254:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1783135206.710386:0:18254:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fea02166400/0xd6c4b8f058680620 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 18254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135206.710392:0:18254:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fea02166400/0xd6c4b8f058680620 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 18254 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783135206.710427:0:18254:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fe7d2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:be37dafa-e6ef-4275-9c00-a4e42a1df10b+18:17392:x1869752374032512:12345-192.168.201.41@tcp:54:lfs.0 Request processed in 266us (474us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135206.710440:0:18254:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 32 00000100:00100000:3.0:1783135206.716064:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:1.0:1783135206.716158:0:18255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752374032768 00000100:00100000:1.0:1783135206.716173:0:18255:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752374032768 00000100:00100000:1.0:1783135206.716248:0:18255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 7 00000100:00100000:1.0:1783135206.716257:0:18255:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fec16a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:be37dafa-e6ef-4275-9c00-a4e42a1df10b+18:17392:x1869752374032768:12345-192.168.201.41@tcp:35:lfs.0 00000100:00100000:1.0:1783135206.716562:0:18255:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fec16a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:be37dafa-e6ef-4275-9c00-a4e42a1df10b+19:17392:x1869752374032768:12345-192.168.201.41@tcp:35:lfs.0 Request processed in 306us (515us total) trans 12884901901 rc 0/0 00000100:00100000:1.0:1783135206.716568:0:18255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 7 00000100:00100000:2.0:1783135206.959535:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:1.0:1783135206.959700:0:18252:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752374033024 00000100:00100000:1.0:1783135206.959715:0:18252:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752374033024 00000100:00100000:1.0:1783135206.959800:0:18252:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 33 00000100:00100000:1.0:1783135206.959813:0:18252:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fe9f8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:be37dafa-e6ef-4275-9c00-a4e42a1df10b+19:17423:x1869752374033024:12345-192.168.201.41@tcp:101:cat.0 00010000:00010000:1.0:1783135206.959847:0:18252:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783135206.959872:0:18252:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43e600/0xd6c4b8f058680627 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4428da03f5eb7926 expref: -99 pid: 18252 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135206.960043:0:18252:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43e800/0xd6c4b8f05868062e lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 18252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135206.960065:0:18252:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43e800/0xd6c4b8f05868062e lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135206.960099:0:18252:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43e800/0xd6c4b8f05868062e lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18252 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783135206.960114:0:18252:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1783135206.960342:0:18252:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43e600/0xd6c4b8f058680627 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb7926 expref: 22 pid: 18252 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135206.960365:0:18252:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43e800/0xd6c4b8f05868062e lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb7926 expref: 21 pid: 18252 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135206.960376:0:18252:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9fe9c33d0800) 00010000:00010000:1.0:1783135206.960379:0:18252:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1783135206.960384:0:18252:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fe9fe43e800, rc 0) 00000100:00100000:1.0:1783135206.960474:0:18252:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fe9f8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:be37dafa-e6ef-4275-9c00-a4e42a1df10b+21:17423:x1869752374033024:12345-192.168.201.41@tcp:101:cat.0 Request processed in 663us (954us total) trans 12884901902 rc 0/0 00000100:00100000:1.0:1783135206.960482:0:18252:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 33 00000100:00100000:0.0:1783135206.963330:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:2.0:1783135206.963523:0:20272:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752374033152 00000100:00100000:2.0:1783135206.963537:0:20272:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752374033152 00000100:00100000:2.0:1783135206.963651:0:20272:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 1 00000100:00100000:2.0:1783135206.963664:0:20272:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fe7d1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:be37dafa-e6ef-4275-9c00-a4e42a1df10b+21:2370:x1869752374033152:12345-192.168.201.41@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783135206.963687:0:20272:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783135206.963720:0:20272:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43e800/0xd6c4b8f05868062e lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb7926 expref: 21 pid: 18252 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135206.963744:0:20272:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9fe9c33d0800) 00010000:00010000:2.0:1783135206.963751:0:20272:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783135206.963829:0:20272:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fe7d1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:be37dafa-e6ef-4275-9c00-a4e42a1df10b+20:2370:x1869752374033152:12345-192.168.201.41@tcp:103:ldlm_bl.0 Request processed in 167us (553us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135206.963858:0:20272:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 1 00000100:00100000:3.0:1783135206.966899:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:1.0:1783135206.966986:0:18255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752374033408 00000100:00100000:1.0:1783135206.966997:0:18255:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752374033408 00000100:00100000:1.0:1783135206.967065:0:18255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 8 00000100:00100000:1.0:1783135206.967077:0:18255:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fec14000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:be37dafa-e6ef-4275-9c00-a4e42a1df10b+20:17423:x1869752374033408:12345-192.168.201.41@tcp:35:cat.0 00000100:00100000:1.0:1783135206.968761:0:18255:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fec14000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:be37dafa-e6ef-4275-9c00-a4e42a1df10b+21:17423:x1869752374033408:12345-192.168.201.41@tcp:35:cat.0 Request processed in 1672us (1862us total) trans 12884901903 rc 0/0 00000100:00100000:1.0:1783135206.968774:0:18255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 8 00000100:00100000:0.0:1783135207.034126:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:3.0:1783135207.034330:0:18254:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752374033664 00000100:00100000:3.0:1783135207.034345:0:18254:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752374033664 00000100:00100000:3.0:1783135207.034425:0:18254:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 34 00000100:00100000:3.0:1783135207.034438:0:18254:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fe7d2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:be37dafa-e6ef-4275-9c00-a4e42a1df10b+21:17429:x1869752374033664:12345-192.168.201.41@tcp:101:dd.0 00010000:00010000:3.0:1783135207.034474:0:18254:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783135207.034502:0:18254:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fea02166400/0xd6c4b8f05868063c lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4428da03f5eb792d expref: -99 pid: 18254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135207.034764:0:18254:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fea02166600/0xd6c4b8f058680643 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 18254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135207.034783:0:18254:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fea02167400/0xd6c4b8f0586805e1 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb790a expref: 22 pid: 19572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135207.034793:0:18254:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43fc00/0xd6c4b8f0586805f6 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb7911 expref: 22 pid: 18252 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135207.034802:0:18254:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fea02166600/0xd6c4b8f058680643 lrc: 5/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135207.034847:0:18254:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43fc00/0xd6c4b8f0586805f6 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb7911 expref: 22 pid: 18252 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135207.034862:0:18254:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43fc00/0xd6c4b8f0586805f6 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb7911 expref: 22 pid: 18252 timeout: 589 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783135207.034965:0:18254:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9fec17b80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:18254:1869752384477440:192.168.201.41@tcp:104: 00010000:00010000:3.0:1783135207.035158:0:18254:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9fea02167400/0xd6c4b8f0586805e1 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb790a expref: 22 pid: 19572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135207.035168:0:18254:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9fea02167400/0xd6c4b8f0586805e1 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb790a expref: 22 pid: 19572 timeout: 589 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783135207.035178:0:18254:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9fec15180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:18254:1869752384477568:192.168.201.41@tcp:104: 00000100:00100000:3.0:1783135207.035203:0:18254:0:(client.c:2701:ptlrpc_set_wait()) set ffff9fe9c339d180 going to sleep for 11 seconds 00000100:00100000:0.0:1783135207.039793:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:0.0:1783135207.039889:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:2.0:1783135207.040438:0:18237:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752374033792 00000100:00100000:2.0:1783135207.040451:0:18237:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752374033792 00010000:00010000:2.0:1783135207.040506:0:18237:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43fc00/0xd6c4b8f0586805f6 lrc: 5/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb7911 expref: 23 pid: 18252 timeout: 589 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783135207.040558:0:18237:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752374033920 00000100:00100000:2.0:1783135207.040561:0:18237:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752374033920 00010000:00010000:2.0:1783135207.040574:0:18237:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fea02167400/0xd6c4b8f0586805e1 lrc: 5/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb790a expref: 24 pid: 19572 timeout: 589 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783135207.040613:0:18237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 11 00000100:00100000:2.0:1783135207.040631:0:18237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9f643e450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:be37dafa-e6ef-4275-9c00-a4e42a1df10b+24:2369:x1869752374033792:12345-192.168.201.41@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783135207.040650:0:18237:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783135207.040658:0:18237:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43fc00/0xd6c4b8f0586805f6 lrc: 5/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb7911 expref: 24 pid: 18252 timeout: 589 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135207.040673:0:18237:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43fc00/0xd6c4b8f0586805f6 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb7911 expref: 24 pid: 18252 timeout: 589 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135207.040701:0:18237:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9fe9c33d0800) 00010000:00010000:2.0:1783135207.040707:0:18237:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9fea02166600/0xd6c4b8f058680643 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135207.040718:0:18237:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff9fea02166600/0xd6c4b8f058680643 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135207.040724:0:18237:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783135207.040811:0:18237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9f643e450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:be37dafa-e6ef-4275-9c00-a4e42a1df10b+24:2369:x1869752374033792:12345-192.168.201.41@tcp:103:ldlm_bl.0 Request processed in 181us (1031us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135207.040820:0:18237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 11 00000100:00100000:2.0:1783135207.040884:0:18237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 12 00000100:00100000:2.0:1783135207.040890:0:18237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fe7d3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:be37dafa-e6ef-4275-9c00-a4e42a1df10b+23:2369:x1869752374033920:12345-192.168.201.41@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783135207.040898:0:18237:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783135207.040914:0:18237:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9fea02167400/0xd6c4b8f0586805e1 lrc: 5/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb790a expref: 23 pid: 19572 timeout: 589 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135207.040925:0:18237:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9fea02167400/0xd6c4b8f0586805e1 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb790a expref: 23 pid: 19572 timeout: 589 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135207.040937:0:18237:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9fe9c33d0800) 00010000:00010000:2.0:1783135207.040941:0:18237:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9fea02166600/0xd6c4b8f058680643 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135207.040951:0:18237:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fea02166600/0xd6c4b8f058680643 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 18254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135207.040959:0:18237:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fea02166600/0xd6c4b8f058680643 lrc: 4/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 18254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135207.040978:0:18237:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783135207.040995:0:18237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fe7d3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:be37dafa-e6ef-4275-9c00-a4e42a1df10b+23:2369:x1869752374033920:12345-192.168.201.41@tcp:103:ldlm_bl.0 Request processed in 105us (1107us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135207.041002:0:18237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 12 00010000:00010000:3.0:1783135207.042796:0:18254:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43fc00/0xd6c4b8f0586805f6 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb7911 expref: 22 pid: 18252 timeout: 589 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783135207.042826:0:18254:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9fec17b80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:18254:1869752384477440:192.168.201.41@tcp:104: 00010000:00010000:3.0:1783135207.043229:0:18254:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fea02167400/0xd6c4b8f0586805e1 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb790a expref: 21 pid: 19572 timeout: 589 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783135207.043244:0:18254:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9fec15180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:18254:1869752384477568:192.168.201.41@tcp:104: 00010000:00010000:3.0:1783135207.043275:0:18254:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9fea02166600/0xd6c4b8f058680643 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135207.043461:0:18254:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9fea02166600/0xd6c4b8f058680643 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135207.043468:0:18254:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fea02166600/0xd6c4b8f058680643 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18254 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783135207.043521:0:18254:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:3.0:1783135207.044608:0:18254:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fea02166400/0xd6c4b8f05868063c lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb792d expref: 22 pid: 18254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135207.044644:0:18254:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fea02166600/0xd6c4b8f058680643 lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb792d expref: 21 pid: 18254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135207.044654:0:18254:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9fe9c33d0800) 00010000:00010000:3.0:1783135207.044658:0:18254:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1783135207.044661:0:18254:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fea02166600, rc 0) 00000100:00100000:3.0:1783135207.044749:0:18254:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fe7d2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:be37dafa-e6ef-4275-9c00-a4e42a1df10b+21:17429:x1869752374033664:12345-192.168.201.41@tcp:101:dd.0 Request processed in 10313us (10636us total) trans 12884901904 rc 0/0 00000100:00100000:3.0:1783135207.044758:0:18254:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 34 00000100:00100000:0.0:1783135207.049412:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:1.0:1783135207.049564:0:18252:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752374034176 00000100:00100000:1.0:1783135207.049577:0:18252:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752374034176 00000100:00100000:1.0:1783135207.049672:0:18252:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 35 00000100:00100000:1.0:1783135207.049684:0:18252:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fe7d2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:be37dafa-e6ef-4275-9c00-a4e42a1df10b+21:17429:x1869752374034176:12345-192.168.201.41@tcp:36:dd.0 00010000:00010000:1.0:1783135207.050099:0:18252:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43e600/0xd6c4b8f058680651 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 18252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135207.050121:0:18252:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43e600/0xd6c4b8f058680651 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135207.050135:0:18252:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43e600/0xd6c4b8f058680651 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18252 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1783135207.050200:0:18252:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901905 00000004:00010000:1.0:1783135207.050228:0:18252:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000b20b40ec reply state 00000000e3f36f76 transno 12884901906 ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43e600/0xd6c4b8f058680651 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18252 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783135207.050237:0:18252:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1783135207.050449:0:18252:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fe7d2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:be37dafa-e6ef-4275-9c00-a4e42a1df10b+24:17429:x1869752374034176:12345-192.168.201.41@tcp:36:dd.0 Request processed in 765us (1052us total) trans 12884901906 rc 0/0 00000100:00100000:1.0:1783135207.050458:0:18252:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 35 00000020:00080000:1.0:1783135207.050464:0:18252:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1783135207.053454:0:3272:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43e600/0xd6c4b8f058680651 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135207.053477:0:3272:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43e600/0xd6c4b8f058680651 lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 18252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135207.053486:0:3272:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43e600/0xd6c4b8f058680651 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 18252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135207.053494:0:3272:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe9fe43e600 already unused, calling callback (ffffffffc1f634f0) 00010000:00010000:3.0:1783135207.053499:0:3272:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43e600/0xd6c4b8f058680651 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 18252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135207.053509:0:3272:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43e600/0xd6c4b8f058680651 lrc: 4/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 18252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135207.053555:0:3272:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9fe9c33d0800) 00010000:00010000:3.0:1783135207.053558:0:3272:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783135207.053564:0:3272:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43e600/0xd6c4b8f058680651 lrc: 2/0,0 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 18252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135207.053571:0:3272:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43e600/0xd6c4b8f058680651 lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 18252 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783135207.055117:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:2.0:1783135207.055233:0:18253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752374034304 00000100:00100000:2.0:1783135207.055246:0:18253:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752374034304 00000100:00100000:2.0:1783135207.055338:0:18253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 36 00000100:00100000:2.0:1783135207.055363:0:18253:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fe7d3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:be37dafa-e6ef-4275-9c00-a4e42a1df10b+23:17429:x1869752374034304:12345-192.168.201.41@tcp:101:dd.0 00010000:00010000:2.0:1783135207.055396:0:18253:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783135207.055421:0:18253:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828200/0xd6c4b8f058680658 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4428da03f5eb7934 expref: -99 pid: 18253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135207.055497:0:18253:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828200/0xd6c4b8f058680658 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb7934 expref: 24 pid: 18253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135207.055515:0:18253:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828200/0xd6c4b8f058680658 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb7934 expref: 24 pid: 18253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135207.055537:0:18253:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9fe9c33d0800) 00010000:00010000:2.0:1783135207.055540:0:18253:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1783135207.055544:0:18253:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fe9c7828200, rc 0) 00000100:00100000:2.0:1783135207.055686:0:18253:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fe7d3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:be37dafa-e6ef-4275-9c00-a4e42a1df10b+24:17429:x1869752374034304:12345-192.168.201.41@tcp:101:dd.0 Request processed in 325us (579us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135207.055693:0:18253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 36 00000100:00100000:2.0:1783135207.067708:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:1.0:1783135207.067880:0:18237:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752374034560 00000100:00100000:1.0:1783135207.067902:0:18237:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752374034560 00000100:00100000:1.0:1783135207.067988:0:18237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 2 00000100:00100000:1.0:1783135207.067999:0:18237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fe9f8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:be37dafa-e6ef-4275-9c00-a4e42a1df10b+24:17429:x1869752374034560:12345-192.168.201.41@tcp:103:dd.0 00010000:00010000:1.0:1783135207.068049:0:18237:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783135207.068080:0:18237:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828200/0xd6c4b8f058680658 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb7934 expref: 24 pid: 18253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135207.068108:0:18237:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9fe9c33d0800) 00010000:00010000:1.0:1783135207.068113:0:18237:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783135207.068195:0:18237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fe9f8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:be37dafa-e6ef-4275-9c00-a4e42a1df10b+23:17429:x1869752374034560:12345-192.168.201.41@tcp:103:dd.0 Request processed in 197us (502us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135207.068212:0:18237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 2 00000100:00100000:0.0:1783135207.070794:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:1.0:1783135207.070955:0:18252:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752374034688 00000100:00100000:1.0:1783135207.070967:0:18252:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752374034688 00000100:00100000:1.0:1783135207.071042:0:18252:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 37 00000100:00100000:1.0:1783135207.071054:0:18252:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fe7d1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:be37dafa-e6ef-4275-9c00-a4e42a1df10b+23:17429:x1869752374034688:12345-192.168.201.41@tcp:58:dd.0 00010000:00010000:1.0:1783135207.071190:0:18252:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43f400/0xd6c4b8f05868065f lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 18252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135207.071214:0:18252:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43f400/0xd6c4b8f05868065f lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135207.071228:0:18252:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43f400/0xd6c4b8f05868065f lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18252 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1783135207.073330:0:18252:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1783135207.073543:0:18252:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 64 off8384 00000040:00080000:1.0:1783135207.073770:0:18252:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x14:0x0].1, 136 off8328 00000100:00100000:1.0:1783135207.074075:0:18252:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fe7d1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:be37dafa-e6ef-4275-9c00-a4e42a1df10b+23:17429:x1869752374034688:12345-192.168.201.41@tcp:58:dd.0 Request processed in 3013us (3289us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135207.074090:0:18252:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 37 00000100:00100000:2.0:1783135207.078563:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:0.0:1783135207.078743:0:18253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752374034816 00000100:00100000:0.0:1783135207.078756:0:18253:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752374034816 00000100:00100000:0.0:1783135207.078862:0:18253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 38 00000100:00100000:0.0:1783135207.078874:0:18253:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fe9fb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:be37dafa-e6ef-4275-9c00-a4e42a1df10b+23:17429:x1869752374034816:12345-192.168.201.41@tcp:101:dd.0 00010000:00010000:0.0:1783135207.078965:0:18253:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783135207.078993:0:18253:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ad200/0xd6c4b8f058680666 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4428da03f5eb793b expref: -99 pid: 18253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135207.079166:0:18253:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43f400/0xd6c4b8f05868065f lrc: 2/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135207.079202:0:18253:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ad200/0xd6c4b8f058680666 lrc: 4/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb793b expref: 24 pid: 18253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135207.079228:0:18253:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43f400/0xd6c4b8f05868065f lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 18252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135207.079243:0:18253:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ad200/0xd6c4b8f058680666 lrc: 3/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb793b expref: 24 pid: 18253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135207.079261:0:18253:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9fe9c33d0800) 00010000:00010000:0.0:1783135207.079265:0:18253:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1783135207.079269:0:18253:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ad200/0xd6c4b8f058680666 lrc: 3/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb793b expref: 24 pid: 18253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135207.079306:0:18253:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fe9f68ad200, rc 0) 00000100:00100000:0.0:1783135207.079391:0:18253:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fe9fb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:be37dafa-e6ef-4275-9c00-a4e42a1df10b+24:17429:x1869752374034816:12345-192.168.201.41@tcp:101:dd.0 Request processed in 518us (843us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135207.079399:0:18253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 38 00010000:00010000:1.0:1783135207.363688:0:18241:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1783135207.685314:0:18286:0:(llog.c:800:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:3.0:1783135207.685327:0:18286:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x14:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1783135207.685381:0:18286:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x14:0x0] index 2 count 2 00000040:00080000:3.0:1783135207.685643:0:18286:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00000100:00100000:3.0:1783135207.685968:0:18286:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9fec15180 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:18286:1869752384477696:192.168.201.41@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1783135207.686205:0:18286:0:(client.c:2701:ptlrpc_set_wait()) set ffff9fe9c339dcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1783135207.695169:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:1.0:1783135207.695339:0:18263:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752374034944 00000100:00100000:1.0:1783135207.695351:0:18263:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752374034944 00000100:00100000:1.0:1783135207.695426:0:18263:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 0 00000100:00100000:1.0:1783135207.695438:0:18263:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fe9f9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:be37dafa-e6ef-4275-9c00-a4e42a1df10b+25:17430:x1869752374034944:12345-192.168.201.41@tcp:900:lhsmtool_posix.0 00000100:00100000:1.0:1783135207.695544:0:18263:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fe9f9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:be37dafa-e6ef-4275-9c00-a4e42a1df10b+25:17430:x1869752374034944:12345-192.168.201.41@tcp:900:lhsmtool_posix.0 Request processed in 107us (388us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135207.695553:0:18263:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 0 00000100:00100000:3.0:1783135207.696474:0:18286:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9fec15180 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:18286:1869752384477696:192.168.201.41@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1783135207.700074:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:0.0:1783135207.700186:0:19572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752374035072 00000100:00100000:0.0:1783135207.700198:0:19572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752374035072 00000100:00100000:0.0:1783135207.700265:0:19572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 39 00000100:00100000:0.0:1783135207.700276:0:19572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fe9f9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:be37dafa-e6ef-4275-9c00-a4e42a1df10b+24:17430:x1869752374035072:12345-192.168.201.41@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1783135207.700345:0:19572:0:(mdt_handler.c:7960:mdt_fid2path()) path get [0x2000013a1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1783135207.700516:0:19572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fe9f9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:be37dafa-e6ef-4275-9c00-a4e42a1df10b+24:17430:x1869752374035072:12345-192.168.201.41@tcp:53:lhsmtool_posix.0 Request processed in 240us (454us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135207.700524:0:19572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 39 00000100:00100000:2.0:1783135207.708859:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:3.0:1783135207.708957:0:18254:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752374035200 00000100:00100000:3.0:1783135207.708970:0:18254:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752374035200 00000100:00100000:3.0:1783135207.709057:0:18254:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 40 00000100:00100000:3.0:1783135207.709068:0:18254:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fe9fa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:be37dafa-e6ef-4275-9c00-a4e42a1df10b+24:17430:x1869752374035200:12345-192.168.201.41@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1783135207.709171:0:18254:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fea02166400/0xd6c4b8f05868066d lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 18254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135207.709191:0:18254:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fea02166400/0xd6c4b8f05868066d lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135207.709208:0:18254:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fea02166400/0xd6c4b8f05868066d lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135207.709245:0:18254:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fea02167400/0xd6c4b8f058680674 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 18254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135207.709252:0:18254:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fea02167400/0xd6c4b8f058680674 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135207.709259:0:18254:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fea02167400/0xd6c4b8f058680674 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135207.709333:0:18254:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fea02166e00/0xd6c4b8f05868067b lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 18254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135207.709343:0:18254:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fea02166e00/0xd6c4b8f05868067b lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135207.709350:0:18254:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fea02166e00/0xd6c4b8f05868067b lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 18254 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783135207.709398:0:18254:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00000004:00200000:3.0:1783135207.709402:0:18254:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1783135207.709417:0:18254:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fea02166e00/0xd6c4b8f05868067b lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 18254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135207.709439:0:18254:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fea02166400/0xd6c4b8f05868066d lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135207.709446:0:18254:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fea02166400/0xd6c4b8f05868066d lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 18254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135207.709453:0:18254:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fea02166400/0xd6c4b8f05868066d lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 18254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135207.709469:0:18254:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fea02166400 already unused, calling callback (ffffffffc1f634f0) 00010000:00010000:3.0:1783135207.709474:0:18254:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fea02166400/0xd6c4b8f05868066d lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 18254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135207.709482:0:18254:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fea02166400/0xd6c4b8f05868066d lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 18254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135207.709496:0:18254:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9fe9c33d0b00) 00010000:00010000:3.0:1783135207.709499:0:18254:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783135207.709504:0:18254:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fea02166400/0xd6c4b8f05868066d lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 18254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135207.709510:0:18254:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fea02166400/0xd6c4b8f05868066d lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 18254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135207.709526:0:18254:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fea02167400/0xd6c4b8f058680674 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135207.709532:0:18254:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fea02167400/0xd6c4b8f058680674 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 18254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135207.709538:0:18254:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fea02167400/0xd6c4b8f058680674 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135207.709543:0:18254:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fea02167400 already unused, calling callback (ffffffffc1f634f0) 00010000:00010000:3.0:1783135207.709545:0:18254:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fea02167400/0xd6c4b8f058680674 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135207.709551:0:18254:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fea02167400/0xd6c4b8f058680674 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 18254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135207.709568:0:18254:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x925dcd63 (ffff9fe9c33d0200) 00010000:00010000:3.0:1783135207.709571:0:18254:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783135207.709574:0:18254:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fea02167400/0xd6c4b8f058680674 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135207.709766:0:18254:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fea02167400/0xd6c4b8f058680674 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135207.709786:0:18254:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fea02166e00/0xd6c4b8f05868067b lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135207.709792:0:18254:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fea02166e00/0xd6c4b8f05868067b lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 18254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135207.709797:0:18254:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fea02166e00/0xd6c4b8f05868067b lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135207.709803:0:18254:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fea02166e00 already unused, calling callback (ffffffffc1f634f0) 00010000:00010000:3.0:1783135207.709806:0:18254:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fea02166e00/0xd6c4b8f05868067b lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135207.709811:0:18254:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fea02166e00/0xd6c4b8f05868067b lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 18254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135207.709819:0:18254:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9fe9c33d0800) 00010000:00010000:3.0:1783135207.709821:0:18254:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783135207.709824:0:18254:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fea02166e00/0xd6c4b8f05868067b lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135207.709830:0:18254:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fea02166e00/0xd6c4b8f05868067b lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18254 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783135207.709937:0:18254:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fe9fa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:be37dafa-e6ef-4275-9c00-a4e42a1df10b+24:17430:x1869752374035200:12345-192.168.201.41@tcp:34:lhsmtool_posix.0 Request processed in 869us (1092us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135207.709945:0:18254:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 40 00000100:00100000:2.0:1783135207.719536:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:0.0:1783135207.719711:0:19572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752374035456 00000100:00100000:0.0:1783135207.719725:0:19572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752374035456 00000100:00100000:0.0:1783135207.719801:0:19572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 41 00000100:00100000:0.0:1783135207.719814:0:19572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fe9fb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:be37dafa-e6ef-4275-9c00-a4e42a1df10b+24:17430:x1869752374035456:12345-192.168.201.41@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1783135207.719841:0:19572:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783135207.719869:0:19572:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ace00/0xd6c4b8f058680682 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4428da03f5eb7942 expref: -99 pid: 19572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135207.720002:0:19572:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ad400/0xd6c4b8f058680689 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 19572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135207.720022:0:19572:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ad400/0xd6c4b8f058680689 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 19572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135207.720037:0:19572:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ad400/0xd6c4b8f058680689 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 19572 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783135207.720407:0:19572:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1783135207.720545:0:19572:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ad400/0xd6c4b8f058680689 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 19572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135207.720554:0:19572:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ad400/0xd6c4b8f058680689 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 19572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135207.720562:0:19572:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ad400/0xd6c4b8f058680689 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 19572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135207.720569:0:19572:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe9f68ad400 already unused, calling callback (ffffffffc1f634f0) 00010000:00010000:0.0:1783135207.720574:0:19572:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ad400/0xd6c4b8f058680689 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 19572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135207.720583:0:19572:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ad400/0xd6c4b8f058680689 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 19572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135207.720698:0:19572:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9fe9c33d0800) 00010000:00010000:0.0:1783135207.720702:0:19572:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1783135207.720709:0:19572:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ad400/0xd6c4b8f058680689 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 19572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135207.720716:0:19572:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ad400/0xd6c4b8f058680689 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 19572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135207.720780:0:19572:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ace00/0xd6c4b8f058680682 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb7942 expref: 26 pid: 19572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135207.720792:0:19572:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9fe9c33d0b00) 00010000:00010000:0.0:1783135207.720794:0:19572:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1783135207.720799:0:19572:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ace00/0xd6c4b8f058680682 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb7942 expref: 26 pid: 19572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135207.720810:0:19572:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fe9f68ace00, rc 0) 00000100:00100000:0.0:1783135207.720956:0:19572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fe9fb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:be37dafa-e6ef-4275-9c00-a4e42a1df10b+25:17430:x1869752374035456:12345-192.168.201.41@tcp:101:lhsmtool_posix.0 Request processed in 1143us (1434us total) trans 12884901907 rc 301/301 00000100:00100000:0.0:1783135207.720965:0:19572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 41 00000100:00100000:2.0:1783135207.731516:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:3.0:1783135207.732147:0:18254:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752374035584 00000100:00100000:3.0:1783135207.732159:0:18254:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752374035584 00000100:00100000:3.0:1783135207.732241:0:18254:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 42 00000100:00100000:3.0:1783135207.732255:0:18254:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fe9fad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:be37dafa-e6ef-4275-9c00-a4e42a1df10b+25:17430:x1869752374035584:12345-192.168.201.41@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1783135207.732350:0:18254:0:(mdt_handler.c:7960:mdt_fid2path()) path get [0x2000013a1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1783135207.732497:0:18254:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fe9fad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:be37dafa-e6ef-4275-9c00-a4e42a1df10b+25:17430:x1869752374035584:12345-192.168.201.41@tcp:53:lhsmtool_posix.0 Request processed in 244us (995us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135207.732505:0:18254:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 42 00000100:00100000:2.0:1783135207.750256:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:1.0:1783135207.750641:0:18252:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752374035840 00000100:00100000:1.0:1783135207.750654:0:18252:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752374035840 00000100:00100000:1.0:1783135207.750730:0:18252:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 43 00000100:00100000:1.0:1783135207.750742:0:18252:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fe9fbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:be37dafa-e6ef-4275-9c00-a4e42a1df10b+25:17430:x1869752374035840:12345-192.168.201.41@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1783135207.750771:0:18252:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783135207.750800:0:18252:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43ea00/0xd6c4b8f058680697 lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4428da03f5eb7949 expref: -99 pid: 18252 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1783135207.751708:0:18252:0:(osp_internal.h:570:osp_update_last_fid()) Gap in objids: start=[0x280000400:0x23:0x0], count =31 00000004:00080000:1.0:1783135207.751718:0:18252:0:(osp_object.c:1645:osp_create()) Writing gap [0x280000400:0x23:0x0]+31 in llog 00000004:00080000:1.0:1783135207.751776:0:18252:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x42:0x0], index 1: 0 00010000:00010000:1.0:1783135207.752080:0:18252:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43ee00/0xd6c4b8f05868069e lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 18252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135207.752099:0:18252:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43ee00/0xd6c4b8f05868069e lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135207.752112:0:18252:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43ee00/0xd6c4b8f05868069e lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135207.752189:0:18252:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43ea00/0xd6c4b8f058680697 lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb7949 expref: 28 pid: 18252 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135207.752211:0:18252:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43ee00/0xd6c4b8f05868069e lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb7949 expref: 27 pid: 18252 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135207.752222:0:18252:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9fe9c9dd3900) 00010000:00010000:1.0:1783135207.752225:0:18252:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1783135207.752228:0:18252:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fe9fe43ee00, rc 0) 00000100:00100000:1.0:1783135207.755188:0:18252:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fe9fbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:be37dafa-e6ef-4275-9c00-a4e42a1df10b+27:17430:x1869752374035840:12345-192.168.201.41@tcp:101:lhsmtool_posix.0 Request processed in 4430us (4929us total) trans 12884901908 rc 0/0 00000100:00100000:1.0:1783135207.755205:0:18252:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 43 00000100:00100000:2.0:1783135207.770826:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:3.0:1783135207.771020:0:18254:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752374036096 00000100:00100000:3.0:1783135207.771042:0:18254:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752374036096 00000100:00100000:3.0:1783135207.771130:0:18254:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 44 00000100:00100000:3.0:1783135207.771143:0:18254:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fe9f9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:be37dafa-e6ef-4275-9c00-a4e42a1df10b+27:17430:x1869752374036096:12345-192.168.201.41@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1783135207.771226:0:18254:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783135207.771263:0:18254:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43ee00/0xd6c4b8f05868069e lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb7949 expref: 27 pid: 18252 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135207.771662:0:18254:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9fe9c9dd3900) 00010000:00010000:3.0:1783135207.771688:0:18254:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1783135207.775775:0:18254:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ace00/0xd6c4b8f0586806ac lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 18254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135207.775809:0:18254:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ace00/0xd6c4b8f0586806ac lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135207.775825:0:18254:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ace00/0xd6c4b8f0586806ac lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135207.775873:0:18254:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ad400/0xd6c4b8f0586806b3 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x1:0x0].0x1c9e8001 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 18254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135207.775945:0:18254:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ad400/0xd6c4b8f0586806b3 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x1c9e8001 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135207.775954:0:18254:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ad400/0xd6c4b8f0586806b3 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x1c9e8001 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135207.776478:0:18254:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ace00/0xd6c4b8f0586806ac lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135207.776489:0:18254:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ace00/0xd6c4b8f0586806ac lrc: 2/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 18254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135207.776497:0:18254:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ace00/0xd6c4b8f0586806ac lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 18254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135207.776504:0:18254:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe9f68ace00 already unused, calling callback (ffffffffc1f634f0) 00010000:00010000:0.0:1783135207.776508:0:18254:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ace00/0xd6c4b8f0586806ac lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 18254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135207.776516:0:18254:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ace00/0xd6c4b8f0586806ac lrc: 4/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 18254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135207.776531:0:18254:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9fe9c9bb4600) 00010000:00010000:0.0:1783135207.776535:0:18254:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783135207.776539:0:18254:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ace00/0xd6c4b8f0586806ac lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 18254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135207.776547:0:18254:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ace00/0xd6c4b8f0586806ac lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 18254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135207.776570:0:18254:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ad400/0xd6c4b8f0586806b3 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x1c9e8001 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135207.776577:0:18254:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ad400/0xd6c4b8f0586806b3 lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x1c9e8001 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 18254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135207.776583:0:18254:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ad400/0xd6c4b8f0586806b3 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x1c9e8001 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135207.776599:0:18254:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe9f68ad400 already unused, calling callback (ffffffffc1f634f0) 00010000:00010000:0.0:1783135207.776948:0:18254:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ad400/0xd6c4b8f0586806b3 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x1c9e8001 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135207.776959:0:18254:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ad400/0xd6c4b8f0586806b3 lrc: 4/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x1c9e8001 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 18254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135207.776968:0:18254:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x1c9e8001 (ffff9fe9c8301900) 00010000:00010000:0.0:1783135207.776971:0:18254:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783135207.776974:0:18254:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ad400/0xd6c4b8f0586806b3 lrc: 2/0,0 mode: --/PW res: [0x2000013a1:0x1:0x0].0x1c9e8001 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18254 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135207.776981:0:18254:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ad400/0xd6c4b8f0586806b3 lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x1:0x0].0x1c9e8001 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18254 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783135207.777254:0:18254:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fe9f9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:be37dafa-e6ef-4275-9c00-a4e42a1df10b+26:17430:x1869752374036096:12345-192.168.201.41@tcp:36:lhsmtool_posix.0 Request processed in 6106us (6437us total) trans 0 rc -2/-2 00000100:00100000:0.0:1783135207.777265:0:18254:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 44 00000100:00100000:2.0:1783135207.786144:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:1.0:1783135207.786267:0:19572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752374036224 00000100:00100000:1.0:1783135207.786307:0:19572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752374036224 00000100:00100000:1.0:1783135207.786370:0:19572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 45 00000100:00100000:1.0:1783135207.786381:0:19572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fe9f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:be37dafa-e6ef-4275-9c00-a4e42a1df10b+26:17430:x1869752374036224:12345-192.168.201.41@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1783135207.786408:0:19572:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783135207.786436:0:19572:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43ea00/0xd6c4b8f0586806ba lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4428da03f5eb7950 expref: -99 pid: 19572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135207.786479:0:19572:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43e400/0xd6c4b8f0586806c1 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 19572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135207.786495:0:19572:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43e400/0xd6c4b8f0586806c1 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135207.786508:0:19572:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43e400/0xd6c4b8f0586806c1 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135207.786646:0:19572:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43ea00/0xd6c4b8f0586806ba lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb7950 expref: 28 pid: 19572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135207.786667:0:19572:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43e400/0xd6c4b8f0586806c1 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb7950 expref: 27 pid: 19572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135207.786678:0:19572:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9fe9c9dd3a00) 00010000:00010000:1.0:1783135207.786681:0:19572:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1783135207.786691:0:19572:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fe9fe43e400, rc 0) 00000100:00100000:1.0:1783135207.786767:0:19572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fe9f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:be37dafa-e6ef-4275-9c00-a4e42a1df10b+27:17430:x1869752374036224:12345-192.168.201.41@tcp:101:lhsmtool_posix.0 Request processed in 387us (637us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135207.786775:0:19572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 45 00000100:00100000:2.0:1783135207.794129:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:0.0:1783135207.794238:0:18253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752374036480 00000100:00100000:0.0:1783135207.794251:0:18253:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752374036480 00000100:00100000:0.0:1783135207.794358:0:18253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 46 00000100:00100000:0.0:1783135207.794391:0:18253:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9f6fe4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:be37dafa-e6ef-4275-9c00-a4e42a1df10b+27:17430:x1869752374036480:12345-192.168.201.41@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1783135207.794501:0:18253:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ad400/0xd6c4b8f0586806c8 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 18253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135207.794520:0:18253:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ad400/0xd6c4b8f0586806c8 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135207.794534:0:18253:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ad400/0xd6c4b8f0586806c8 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18253 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1783135207.795173:0:18253:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x12:0x0].2, 88 off8344 00000004:00080000:0.0:1783135207.795187:0:18253:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 490190905932ns, next at 491190902965ns, rc = 0 00000004:00010000:0.0:1783135207.795594:0:18253:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000efb1c202 reply state 0000000054845a15 transno 12884901909 ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ad400/0xd6c4b8f0586806c8 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18253 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783135207.795607:0:18253:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1783135207.795732:0:18253:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9f6fe4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:be37dafa-e6ef-4275-9c00-a4e42a1df10b+29:17430:x1869752374036480:12345-192.168.201.41@tcp:36:lhsmtool_posix.0 Request processed in 1343us (1617us total) trans 12884901909 rc 0/0 00000100:00100000:0.0:1783135207.795742:0:18253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 46 00010000:00010000:0.0:1783135207.801012:0:3273:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ad400/0xd6c4b8f0586806c8 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135207.801037:0:3273:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ad400/0xd6c4b8f0586806c8 lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 18253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135207.801046:0:3273:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ad400/0xd6c4b8f0586806c8 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 18253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135207.801053:0:3273:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe9f68ad400 already unused, calling callback (ffffffffc1f634f0) 00010000:00010000:0.0:1783135207.801059:0:3273:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ad400/0xd6c4b8f0586806c8 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 18253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135207.801091:0:3273:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ad400/0xd6c4b8f0586806c8 lrc: 4/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 18253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135207.801115:0:3273:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9fe9c9dd3a00) 00010000:00010000:0.0:1783135207.801119:0:3273:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1783135207.801125:0:3273:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ad400/0xd6c4b8f0586806c8 lrc: 2/0,0 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 18253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135207.801132:0:3273:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ad400/0xd6c4b8f0586806c8 lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 18253 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783135207.802527:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:1.0:1783135207.802738:0:19572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752374036608 00000100:00100000:1.0:1783135207.802751:0:19572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752374036608 00000100:00100000:1.0:1783135207.802824:0:19572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 47 00000100:00100000:1.0:1783135207.802836:0:19572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9f6fe4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:be37dafa-e6ef-4275-9c00-a4e42a1df10b+28:17430:x1869752374036608:12345-192.168.201.41@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1783135207.802867:0:19572:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783135207.802898:0:19572:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43ea00/0xd6c4b8f0586806cf lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4428da03f5eb7957 expref: -99 pid: 19572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135207.802971:0:19572:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43ea00/0xd6c4b8f0586806cf lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb7957 expref: 29 pid: 19572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135207.802987:0:19572:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43ea00/0xd6c4b8f0586806cf lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb7957 expref: 29 pid: 19572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135207.803009:0:19572:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9fe9c9dd3a00) 00010000:00010000:1.0:1783135207.803013:0:19572:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1783135207.803016:0:19572:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fe9fe43ea00, rc 0) 00000100:00100000:1.0:1783135207.803086:0:19572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9f6fe4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:be37dafa-e6ef-4275-9c00-a4e42a1df10b+29:17430:x1869752374036608:12345-192.168.201.41@tcp:101:lhsmtool_posix.0 Request processed in 251us (569us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135207.803094:0:19572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 47 00000100:00100000:3.0:1783135207.805982:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:1.0:1783135207.806072:0:19201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752374036736 00000100:00100000:1.0:1783135207.806084:0:19201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752374036736 00000100:00100000:1.0:1783135207.806182:0:19201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 13 00000100:00100000:1.0:1783135207.806195:0:19201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fec15180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:be37dafa-e6ef-4275-9c00-a4e42a1df10b+5:2370:x1869752374036736:12345-192.168.201.41@tcp:2:lhsmtool_posix.0 00000100:00080000:0.0:1783135207.806894:0:18248:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1783135207.807103:0:19201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fec15180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:be37dafa-e6ef-4275-9c00-a4e42a1df10b+6:2370:x1869752374036736:12345-192.168.201.41@tcp:2:lhsmtool_posix.0 Request processed in 908us (1132us total) trans 12884901890 rc 0/0 00000100:00100000:1.0:1783135207.807114:0:19201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 13 00000100:00100000:3.0:1783135207.816425:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:2.0:1783135207.818046:0:18256:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752374036992 00000100:00100000:2.0:1783135207.818062:0:18256:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752374036992 00000100:00100000:2.0:1783135207.818149:0:18256:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 9 00000100:00100000:2.0:1783135207.818162:0:18256:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fec17b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:be37dafa-e6ef-4275-9c00-a4e42a1df10b+29:17430:x1869752374036992:12345-192.168.201.41@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1783135207.818546:0:18256:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fec17b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:be37dafa-e6ef-4275-9c00-a4e42a1df10b+30:17430:x1869752374036992:12345-192.168.201.41@tcp:35:lhsmtool_posix.0 Request processed in 384us (2136us total) trans 12884901910 rc 0/0 00000100:00100000:2.0:1783135207.818557:0:18256:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 9 00000100:00100000:2.0:1783135207.823637:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:0.0:1783135207.823794:0:18253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752374037248 00000100:00100000:0.0:1783135207.823806:0:18253:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752374037248 00000100:00100000:0.0:1783135207.823874:0:18253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 48 00000100:00100000:0.0:1783135207.823892:0:18253:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9f6fe7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:be37dafa-e6ef-4275-9c00-a4e42a1df10b+30:17430:x1869752374037248:12345-192.168.201.41@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1783135207.824028:0:18253:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9f6fe7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:be37dafa-e6ef-4275-9c00-a4e42a1df10b+30:17430:x1869752374037248:12345-192.168.201.41@tcp:57:lhsmtool_posix.0 Request processed in 138us (407us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135207.824044:0:18253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 48 00000100:00100000:3.0:1783135207.831117:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:1.0:1783135207.831338:0:19572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752374037376 00000100:00100000:1.0:1783135207.831351:0:19572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752374037376 00000100:00100000:1.0:1783135207.831431:0:19572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 49 00000100:00100000:1.0:1783135207.831444:0:19572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fec17100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:be37dafa-e6ef-4275-9c00-a4e42a1df10b+30:17430:x1869752374037376:12345-192.168.201.41@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1783135207.831469:0:19572:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783135207.831495:0:19572:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43e200/0xd6c4b8f0586806d6 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4428da03f5eb795e expref: -99 pid: 19572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135207.831596:0:19572:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43ec00/0xd6c4b8f0586806dd lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 19572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135207.831622:0:19572:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43ec00/0xd6c4b8f0586806dd lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 19572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135207.831637:0:19572:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43ec00/0xd6c4b8f0586806dd lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 19572 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783135207.831687:0:19572:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1783135207.831711:0:19572:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43ec00/0xd6c4b8f0586806dd lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 19572 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135207.831741:0:19572:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43e200/0xd6c4b8f0586806d6 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb795e expref: 32 pid: 19572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135207.831761:0:19572:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43ec00/0xd6c4b8f0586806dd lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb795e expref: 31 pid: 19572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135207.831793:0:19572:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9fe9c9dd3a00) 00010000:00010000:1.0:1783135207.831797:0:19572:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1783135207.831801:0:19572:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fe9fe43ec00, rc 0) 00000100:00100000:1.0:1783135207.831898:0:19572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fec17100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:be37dafa-e6ef-4275-9c00-a4e42a1df10b+31:17430:x1869752374037376:12345-192.168.201.41@tcp:101:lhsmtool_posix.0 Request processed in 456us (795us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135207.831906:0:19572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 49 00000100:00100000:3.0:1783135207.840785:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:1.0:1783135207.840903:0:18891:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752374037504 00000100:00100000:1.0:1783135207.840916:0:18891:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752374037504 00000100:00100000:1.0:1783135207.840988:0:18891:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 14 00000100:00100000:1.0:1783135207.840999:0:18891:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fec17800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:be37dafa-e6ef-4275-9c00-a4e42a1df10b+6:2370:x1869752374037504:12345-192.168.201.41@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1783135207.841024:0:18891:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783135207.841052:0:18891:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001afe611e/0xd6c4b8f0586806e4 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x42:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4428da03f5eb7965 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1783135207.841087:0:18891:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x42:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a487be7, blocks: 0x1 00010000:00010000:1.0:1783135207.841124:0:18891:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x42:0x0].0x0 since=490s v=(0 0) 00010000:00010000:1.0:1783135207.841129:0:18891:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783135207.841140:0:18891:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001afe611e/0xd6c4b8f0586806e4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb7965 expref: 7 pid: 18891 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135207.841164:0:18891:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000001afe611e/0xd6c4b8f0586806e4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb7965 expref: 7 pid: 18891 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135207.841181:0:18891:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fe9fe43e200, rc 0) 00000100:00100000:1.0:1783135207.841267:0:18891:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fec17800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:be37dafa-e6ef-4275-9c00-a4e42a1df10b+7:2370:x1869752374037504:12345-192.168.201.41@tcp:101:lhsmtool_posix.0 Request processed in 269us (497us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135207.841274:0:18891:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 14 00000100:00100000:3.0:1783135207.849094:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:0.0:1783135207.849222:0:18253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752374037760 00000100:00100000:0.0:1783135207.849235:0:18253:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752374037760 00000100:00100000:0.0:1783135207.849362:0:18253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 50 00000100:00100000:0.0:1783135207.849374:0:18253:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fec16300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:be37dafa-e6ef-4275-9c00-a4e42a1df10b+31:17430:x1869752374037760:12345-192.168.201.41@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1783135207.849521:0:18253:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fec16300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:be37dafa-e6ef-4275-9c00-a4e42a1df10b+31:17430:x1869752374037760:12345-192.168.201.41@tcp:57:lhsmtool_posix.0 Request processed in 149us (443us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135207.849530:0:18253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 50 00000100:00100000:3.0:1783135207.852425:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:1.0:1783135207.852552:0:19572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752374037888 00000100:00100000:1.0:1783135207.852564:0:19572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752374037888 00000100:00100000:1.0:1783135207.852657:0:19572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 51 00000100:00100000:1.0:1783135207.852670:0:19572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fec15880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:be37dafa-e6ef-4275-9c00-a4e42a1df10b+31:17430:x1869752374037888:12345-192.168.201.41@tcp:44:lhsmtool_posix.0 00000001:00080000:3.0:1783135207.940316:0:5791:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 12884901909 is committed 00000004:00080000:3.0:1783135207.940334:0:5791:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000001:00080000:3.0:1783135207.940356:0:5791:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 12884901895 is committed 00000001:00080000:3.0:1783135207.940392:0:5791:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 12884901910 is committed 00000100:00100000:2.0:1783135207.940634:0:3287:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1783135207.940660:0:3287:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9f6fe6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1869752384477824:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1783135207.940753:0:3287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135207.940833:0:18890:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384477824 00000100:00100000:2.0:1783135207.940842:0:18890:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384477824 00000100:00100000:2.0:1783135207.940907:0:18890:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1783135207.940918:0:18890:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fe90ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3287:x1869752384477824:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1783135207.941275:0:18890:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x42:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1783135207.941311:0:18890:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x42:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:2.0:1783135207.941314:0:18890:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x42:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1783135207.941316:0:18890:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x42:0x0] updating lvb ctime from disk: 1783135207 -> 1783135207 00002000:00010000:2.0:1783135207.941320:0:18890:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x42:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1783135207.941371:0:18890:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fe90ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3287:x1869752384477824:12345-0@lo:2:osp-syn-1-0.0 Request processed in 454us (617us total) trans 12884901891 rc 0/0 00000100:00100000:2.0:1783135207.941379:0:18890:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000004:00080000:2.0:1783135207.941438:0:3287:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9fe9f6fe6680/2, rc 0, transno 12884901891 00000100:00100000:2.0:1783135207.941445:0:3287:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9f6fe6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3287:1869752384477824:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1783135207.941829:0:19572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fec15880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:be37dafa-e6ef-4275-9c00-a4e42a1df10b+14:17430:x1869752374037888:12345-192.168.201.41@tcp:44:lhsmtool_posix.0 Request processed in 89158us (89416us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135207.941848:0:19572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 51 00000100:00100000:3.0:1783135207.944658:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:2.0:1783135207.945368:0:18891:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752374038016 00000100:00100000:2.0:1783135207.945381:0:18891:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752374038016 00000100:00100000:2.0:1783135207.945458:0:18891:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 16 00000100:00100000:2.0:1783135207.945469:0:18891:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fec14700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:be37dafa-e6ef-4275-9c00-a4e42a1df10b+7:2368:x1869752374038016:12345-192.168.201.41@tcp:16:lhsmtool_posix.0 00000100:00100000:2.0:1783135207.945691:0:18891:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fec14700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:be37dafa-e6ef-4275-9c00-a4e42a1df10b+7:2368:x1869752374038016:12345-192.168.201.41@tcp:16:lhsmtool_posix.0 Request processed in 223us (1046us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135207.945700:0:18891:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 16 00000100:00100000:3.0:1783135207.948931:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:0.0:1783135207.950576:0:18253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752374038272 00000100:00100000:0.0:1783135207.950614:0:18253:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752374038272 00000100:00100000:0.0:1783135207.950732:0:18253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 52 00000100:00100000:0.0:1783135207.950746:0:18253:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fec16680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:be37dafa-e6ef-4275-9c00-a4e42a1df10b+14:17430:x1869752374038272:12345-192.168.201.41@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1783135207.950833:0:18253:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783135207.950871:0:18253:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43ec00/0xd6c4b8f0586806dd lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb795e expref: 14 pid: 19572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135207.950913:0:18253:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9fe9c9dd3a00) 00010000:00010000:0.0:1783135207.950920:0:18253:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1783135207.950960:0:18253:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ad400/0xd6c4b8f0586806eb lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 18253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135207.950978:0:18253:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ad400/0xd6c4b8f0586806eb lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135207.950991:0:18253:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ad400/0xd6c4b8f0586806eb lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18253 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1783135207.951499:0:18253:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000af4aec1f reply state 000000003aa84b7f transno 12884901911 ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ad400/0xd6c4b8f0586806eb lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18253 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783135207.951511:0:18253:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1783135207.951655:0:18253:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fec16680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:be37dafa-e6ef-4275-9c00-a4e42a1df10b+15:17430:x1869752374038272:12345-192.168.201.41@tcp:36:lhsmtool_posix.0 Request processed in 911us (2737us total) trans 12884901911 rc 0/0 00000100:00100000:0.0:1783135207.951663:0:18253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 52 00010000:00010000:1.0:1783135207.954715:0:3272:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ad400/0xd6c4b8f0586806eb lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135207.954735:0:3272:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ad400/0xd6c4b8f0586806eb lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 18253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135207.954743:0:3272:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ad400/0xd6c4b8f0586806eb lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 18253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135207.954750:0:3272:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe9f68ad400 already unused, calling callback (ffffffffc1f634f0) 00010000:00010000:1.0:1783135207.954756:0:3272:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ad400/0xd6c4b8f0586806eb lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 18253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135207.954764:0:3272:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ad400/0xd6c4b8f0586806eb lrc: 4/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 18253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135207.954784:0:3272:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9fe9c9dd3a00) 00010000:00010000:1.0:1783135207.954787:0:3272:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783135207.954792:0:3272:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ad400/0xd6c4b8f0586806eb lrc: 2/0,0 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 18253 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135207.954799:0:3272:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ad400/0xd6c4b8f0586806eb lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 18253 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783135207.958656:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:0.0:1783135207.958870:0:18890:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752374038400 00000100:00100000:0.0:1783135207.958898:0:18890:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752374038400 00000100:00100000:0.0:1783135207.958967:0:18890:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 17 00000100:00100000:0.0:1783135207.958978:0:18890:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fe90c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:be37dafa-e6ef-4275-9c00-a4e42a1df10b+7:2368:x1869752374038400:12345-192.168.201.41@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1783135207.959236:0:18890:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x42:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1783135207.959240:0:18890:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x42:0x0] updating lvb mtime from disk: 0 -> 1783135206 00002000:00010000:0.0:1783135207.959243:0:18890:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x42:0x0] updating lvb atime from disk: 0 -> 1783135206 00002000:00010000:0.0:1783135207.959245:0:18890:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x42:0x0] updating lvb ctime from disk: 1783135207 -> 1783135206 00002000:00010000:0.0:1783135207.959248:0:18890:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x42:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1783135207.959363:0:18890:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fe90c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:be37dafa-e6ef-4275-9c00-a4e42a1df10b+8:2368:x1869752374038400:12345-192.168.201.41@tcp:2:lhsmtool_posix.0 Request processed in 386us (721us total) trans 12884901892 rc 0/0 00000100:00100000:0.0:1783135207.959371:0:18890:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 17 00000100:00100000:3.0:1783135207.972128:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:2.0:1783135207.972266:0:18891:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752374038528 00000100:00100000:2.0:1783135207.972327:0:18891:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752374038528 00000100:00100000:2.0:1783135207.972400:0:18891:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 18 00000100:00100000:2.0:1783135207.972413:0:18891:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fe95a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:be37dafa-e6ef-4275-9c00-a4e42a1df10b+8:2367:x1869752374038528:12345-192.168.201.41@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1783135207.972479:0:18891:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000b06bbad6/0xd6c4b8f0586806f2 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135207.972503:0:18891:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783135207.972509:0:18891:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783135207.972517:0:18891:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b06bbad6/0xd6c4b8f0586806f2 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135207.972537:0:18891:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b06bbad6/0xd6c4b8f0586806f2 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135207.972594:0:18891:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000b06bbad6/0xd6c4b8f0586806f2 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135207.972640:0:18891:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b06bbad6/0xd6c4b8f0586806f2 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135207.972650:0:18891:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b06bbad6/0xd6c4b8f0586806f2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135207.972658:0:18891:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe9c7828200 already unused, calling callback (ffffffffc1527ce0) 00010000:00010000:2.0:1783135207.972664:0:18891:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b06bbad6/0xd6c4b8f0586806f2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135207.972675:0:18891:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b06bbad6/0xd6c4b8f0586806f2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135207.972693:0:18891:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b06bbad6/0xd6c4b8f0586806f2 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135207.972702:0:18891:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b06bbad6/0xd6c4b8f0586806f2 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 18891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783135207.972818:0:18891:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fe95a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:be37dafa-e6ef-4275-9c00-a4e42a1df10b+8:2367:x1869752374038528:12345-192.168.201.41@tcp:1:lhsmtool_posix.0 Request processed in 407us (707us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135207.972825:0:18891:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 18 00000100:00100000:3.0:1783135207.982004:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:2.0:1783135207.982133:0:18252:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752374038784 00000100:00100000:2.0:1783135207.982145:0:18252:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752374038784 00000100:00100000:2.0:1783135207.982221:0:18252:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 53 00000100:00100000:2.0:1783135207.982251:0:18252:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fe95b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:be37dafa-e6ef-4275-9c00-a4e42a1df10b+14:17430:x1869752374038784:12345-192.168.201.41@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1783135207.982408:0:18252:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828200/0xd6c4b8f0586806f9 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 18252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135207.982430:0:18252:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828200/0xd6c4b8f0586806f9 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135207.982445:0:18252:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828200/0xd6c4b8f0586806f9 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 18252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135207.982785:0:18252:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828c00/0xd6c4b8f058680700 lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 18252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135207.982799:0:18252:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43ea00/0xd6c4b8f0586806cf lrc: 2/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb7957 expref: 15 pid: 19572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135207.982809:0:18252:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828c00/0xd6c4b8f058680700 lrc: 4/0,1 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135207.982856:0:18252:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43ea00/0xd6c4b8f0586806cf lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb7957 expref: 15 pid: 19572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135207.982873:0:18252:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43ea00/0xd6c4b8f0586806cf lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb7957 expref: 15 pid: 19572 timeout: 590 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783135207.982892:0:18252:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9fe90e680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:18252:1869752384477952:192.168.201.41@tcp:104: 00000100:00100000:2.0:1783135207.983020:0:18252:0:(client.c:2701:ptlrpc_set_wait()) set ffff9fe9c9d15e40 going to sleep for 11 seconds 00000100:00100000:2.0:1783135207.992931:0:18252:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9fe90e680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:18252:1869752384477952:192.168.201.41@tcp:104: 00010000:00010000:2.0:1783135207.992976:0:18252:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828c00/0xd6c4b8f058680700 lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18252 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783135207.996202:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:1.0:1783135207.996342:0:18238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752374038912 00000100:00100000:1.0:1783135207.996356:0:18238:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752374038912 00010000:00010000:1.0:1783135207.996416:0:18238:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43ea00/0xd6c4b8f0586806cf lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb7957 expref: 16 pid: 19572 timeout: 590 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783135207.996472:0:18238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 13 00000100:00100000:1.0:1783135207.996484:0:18238:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fe959180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:be37dafa-e6ef-4275-9c00-a4e42a1df10b+16:2369:x1869752374038912:12345-192.168.201.41@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1783135207.996505:0:18238:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783135207.996512:0:18238:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43ea00/0xd6c4b8f0586806cf lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb7957 expref: 16 pid: 19572 timeout: 590 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135207.996528:0:18238:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43ea00/0xd6c4b8f0586806cf lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb7957 expref: 16 pid: 19572 timeout: 590 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135207.996555:0:18238:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43ea00/0xd6c4b8f0586806cf lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb7957 expref: 16 pid: 19572 timeout: 590 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135207.996574:0:18238:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9fe9c9dd3a00) 00010000:00010000:1.0:1783135207.996579:0:18238:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828c00/0xd6c4b8f058680700 lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135207.996606:0:18238:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828c00/0xd6c4b8f058680700 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 18252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135207.996615:0:18238:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828c00/0xd6c4b8f058680700 lrc: 4/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 18252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135207.996647:0:18238:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783135207.996735:0:18238:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fe959180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:be37dafa-e6ef-4275-9c00-a4e42a1df10b+15:2369:x1869752374038912:12345-192.168.201.41@tcp:103:ldlm_bl.0 Request processed in 252us (550us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135207.996744:0:18238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 13 00010000:00010000:2.0:1783135207.997718:0:18252:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828c00/0xd6c4b8f058680700 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135207.997733:0:18252:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828c00/0xd6c4b8f058680700 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18252 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1783135207.997993:0:18252:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901912 00000001:00080000:2.0:1783135207.998161:0:18252:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901913 00000001:00080000:2.0:1783135207.998210:0:18252:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901914 00000100:00100000:2.0:1783135207.998552:0:18252:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9fe90e680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:18252:1869752384478080:0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1783135207.999381:0:18252:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135207.999433:0:18252:0:(client.c:2701:ptlrpc_set_wait()) set ffff9fe9c9d15240 going to sleep for 11 seconds 00000100:00100000:3.0:1783135208.000253:0:18257:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384478080 00000100:00100000:3.0:1783135208.000267:0:18257:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384478080 00000100:00100000:3.0:1783135208.000390:0:18257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1783135208.000402:0:18257:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fe90fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:18252:x1869752384478080:12345-0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1783135208.000537:0:18257:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fe90fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:18252:x1869752384478080:12345-0@lo:1000:mdt00_000.0 Request processed in 137us (1160us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135208.000545:0:18257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:0.0:1783135208.000641:0:18248:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1783135208.001754:0:18252:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9fe90e680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:18252:1869752384478080:0@lo:1000:mdt00_000.0 00000001:00080000:2.0:1783135208.002656:0:18252:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901915 00000100:00100000:2.0:1783135208.002763:0:18252:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9fe90e680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:18252:1869752384478208:0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1783135208.002846:0:18252:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135208.002890:0:18252:0:(client.c:2701:ptlrpc_set_wait()) set ffff9fe9c9d15e40 going to sleep for 11 seconds 00000100:00100000:3.0:1783135208.004001:0:18257:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384478208 00000100:00100000:3.0:1783135208.004015:0:18257:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384478208 00000100:00100000:3.0:1783135208.004109:0:18257:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1783135208.004121:0:18257:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fe90c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:18252:x1869752384478208:12345-0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1783135208.004735:0:18257:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fe90c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:18252:x1869752384478208:12345-0@lo:1000:mdt00_000.0 Request processed in 614us (1887us total) trans 12884901893 rc 0/0 00000100:00100000:3.0:1783135208.004745:0:18257:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1783135208.006179:0:18252:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9fe90e680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:18252:1869752384478208:0@lo:1000:mdt00_000.0 00010000:00010000:2.0:1783135208.006251:0:18252:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828c00/0xd6c4b8f058680700 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135208.006263:0:18252:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828c00/0xd6c4b8f058680700 lrc: 2/0,0 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 18252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135208.006271:0:18252:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828c00/0xd6c4b8f058680700 lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 18252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135208.006297:0:18252:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe9c7828c00 already unused, calling callback (ffffffffc1f634f0) 00010000:00010000:2.0:1783135208.006325:0:18252:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828c00/0xd6c4b8f058680700 lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 18252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135208.006334:0:18252:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828c00/0xd6c4b8f058680700 lrc: 4/0,0 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 18252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135208.006354:0:18252:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9fe9c9dd3a00) 00010000:00010000:2.0:1783135208.006358:0:18252:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1783135208.006363:0:18252:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828c00/0xd6c4b8f058680700 lrc: 2/0,0 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 18252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135208.006369:0:18252:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828c00/0xd6c4b8f058680700 lrc: 0/0,0 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 18252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135208.006416:0:18252:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43f400/0xd6c4b8f05868065f lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 18252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135208.006423:0:18252:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43f400/0xd6c4b8f05868065f lrc: 2/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 18252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135208.006428:0:18252:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43f400/0xd6c4b8f05868065f lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 18252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135208.006433:0:18252:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe9fe43f400 already unused, calling callback (ffffffffc1f634f0) 00010000:00010000:2.0:1783135208.006435:0:18252:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43f400/0xd6c4b8f05868065f lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 18252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135208.006441:0:18252:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43f400/0xd6c4b8f05868065f lrc: 4/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 18252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135208.006449:0:18252:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9fe9c33d0800) 00010000:00010000:2.0:1783135208.006451:0:18252:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1783135208.006467:0:18252:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ad200/0xd6c4b8f058680666 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb793b expref: 18 pid: 18253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135208.006479:0:18252:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ad200/0xd6c4b8f058680666 lrc: 2/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb793b expref: 18 pid: 18253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135208.006490:0:18252:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ad200/0xd6c4b8f058680666 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb793b expref: 18 pid: 18253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135208.006574:0:18252:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9f68ad200/0xd6c4b8f058680666 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb793b expref: 18 pid: 18253 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783135208.007821:0:18252:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9f6cbd500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:18252:1869752384478336:192.168.201.41@tcp:105: 00000100:00100000:2.0:1783135208.007968:0:18252:0:(client.c:2701:ptlrpc_set_wait()) set ffff9fe9c9d15180 going to sleep for 11 seconds 00000100:00100000:2.0:1783135208.012963:0:18252:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9f6cbd500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:18252:1869752384478336:192.168.201.41@tcp:105: 00010000:00010000:2.0:1783135208.013010:0:18252:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43f400/0xd6c4b8f05868065f lrc: 2/0,0 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 18252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135208.013022:0:18252:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9fe43f400/0xd6c4b8f05868065f lrc: 0/0,0 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 18252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135208.013072:0:18252:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829a00/0xd6c4b8f058680707 lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 18252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135208.013092:0:18252:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829a00/0xd6c4b8f058680707 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135208.013106:0:18252:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829a00/0xd6c4b8f058680707 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 18252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135208.013146:0:18252:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829a00/0xd6c4b8f058680707 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135208.013153:0:18252:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829a00/0xd6c4b8f058680707 lrc: 2/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 18252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135208.013160:0:18252:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829a00/0xd6c4b8f058680707 lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135208.013167:0:18252:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe9c7829a00 already unused, calling callback (ffffffffc1f634f0) 00010000:00010000:2.0:1783135208.013172:0:18252:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829a00/0xd6c4b8f058680707 lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135208.013180:0:18252:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829a00/0xd6c4b8f058680707 lrc: 4/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 18252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135208.013194:0:18252:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9fe9c33d0800) 00010000:00010000:2.0:1783135208.013198:0:18252:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783135208.013202:0:18252:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829a00/0xd6c4b8f058680707 lrc: 2/0,0 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135208.013208:0:18252:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7829a00/0xd6c4b8f058680707 lrc: 0/0,0 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135208.013220:0:18252:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828200/0xd6c4b8f0586806f9 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135208.013227:0:18252:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828200/0xd6c4b8f0586806f9 lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 18252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135208.013233:0:18252:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828200/0xd6c4b8f0586806f9 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 18252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135208.013245:0:18252:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe9c7828200 already unused, calling callback (ffffffffc1f634f0) 00010000:00010000:2.0:1783135208.013248:0:18252:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828200/0xd6c4b8f0586806f9 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 18252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135208.013254:0:18252:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828200/0xd6c4b8f0586806f9 lrc: 4/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 18252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135208.013262:0:18252:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9fe9c33d0800) 00010000:00010000:2.0:1783135208.013265:0:18252:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1783135208.013268:0:18252:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828200/0xd6c4b8f0586806f9 lrc: 2/0,0 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 18252 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135208.013274:0:18252:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828200/0xd6c4b8f0586806f9 lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 18252 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783135208.013817:0:18252:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fe95b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:be37dafa-e6ef-4275-9c00-a4e42a1df10b+18:17430:x1869752374038784:12345-192.168.201.41@tcp:57:lhsmtool_posix.0 Request processed in 31565us (31826us total) trans 12884901916 rc 0/0 00000100:00100000:2.0:1783135208.013830:0:18252:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 53 00000020:00080000:2.0:1783135208.013838:0:18252:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:3.0:1783135208.014214:0:18286:0:(llog.c:800:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:3.0:1783135208.014221:0:18286:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x14:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1783135208.014251:0:18286:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x14:0x0] index 2 count 2 00000040:00080000:3.0:1783135208.014270:0:18286:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00000100:00100000:2.0:1783135208.024562:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:3.0:1783135208.024705:0:18256:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752374039040 00000100:00100000:3.0:1783135208.024719:0:18256:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752374039040 00000100:00100000:3.0:1783135208.024799:0:18256:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 10 00000100:00100000:3.0:1783135208.024812:0:18256:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9ca847450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:be37dafa-e6ef-4275-9c00-a4e42a1df10b+18:17429:x1869752374039040:12345-192.168.201.41@tcp:49:dd.0 00000100:00100000:3.0:1783135208.025010:0:18256:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9ca847450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:be37dafa-e6ef-4275-9c00-a4e42a1df10b+18:17429:x1869752374039040:12345-192.168.201.41@tcp:49:dd.0 Request processed in 200us (464us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135208.025018:0:18256:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 10 00000100:00100000:3.0:1783135208.031781:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:2.0:1783135208.031903:0:18256:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752374039296 00000100:00100000:2.0:1783135208.031916:0:18256:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752374039296 00000100:00100000:2.0:1783135208.031989:0:18256:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 11 00000100:00100000:2.0:1783135208.032004:0:18256:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fe958380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:be37dafa-e6ef-4275-9c00-a4e42a1df10b+18:17430:x1869752374039296:12345-192.168.201.41@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1783135208.032898:0:18256:0:(mdd_object.c:4010:mdd_close()) Object [0x2000013a1:0x3:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1783135208.033023:0:18256:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901917 00010000:00010000:2.0:1783135208.033076:0:18256:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828200/0xd6c4b8f05868070e lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 18256 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135208.033109:0:18256:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828200/0xd6c4b8f05868070e lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 18256 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135208.033123:0:18256:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828200/0xd6c4b8f05868070e lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 18256 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135208.033134:0:18256:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828200/0xd6c4b8f05868070e lrc: 4/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 18256 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135208.033141:0:18256:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828200/0xd6c4b8f05868070e lrc: 4/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 18256 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135208.033148:0:18256:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828200/0xd6c4b8f05868070e lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 18256 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135208.033173:0:18256:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1783135208.033341:0:18256:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fe958380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:be37dafa-e6ef-4275-9c00-a4e42a1df10b+20:17430:x1869752374039296:12345-192.168.201.41@tcp:35:lhsmtool_posix.0 Request processed in 1336us (1573us total) trans 12884901918 rc 0/0 00000100:00100000:2.0:1783135208.033352:0:18256:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 11 00000020:00080000:2.0:1783135208.033359:0:18256:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1783135208.034134:0:18240:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783135208.034150:0:18240:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828200/0xd6c4b8f05868070e lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 18256 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135208.034161:0:18240:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe9c7828200 already unused, calling callback (ffffffffc1527ce0) 00010000:00010000:3.0:1783135208.034166:0:18240:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828200/0xd6c4b8f05868070e lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 18256 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135208.034176:0:18240:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828200/0xd6c4b8f05868070e lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 18256 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135208.034195:0:18240:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff9fe9c9dd3a00) 00010000:00010000:3.0:1783135208.034199:0:18240:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1783135208.034204:0:18240:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828200/0xd6c4b8f05868070e lrc: 1/0,0 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 18256 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135208.034211:0:18240:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fe9c7828200/0xd6c4b8f05868070e lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 18256 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135208.034233:0:18240:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783135208.034235:0:18240:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783135208.034251:0:18240:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1783135208.034332:0:18248:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1783135208.067647:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1783135208.067687:0:3286:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9f6cbd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1869752384478464:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1783135208.067796:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135208.068027:0:18894:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384478464 00000100:00100000:2.0:1783135208.068047:0:18894:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384478464 00000100:00100000:2.0:1783135208.068143:0:18894:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1783135208.068157:0:18894:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fe958000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1869752384478464:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1783135208.068208:0:18894:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1783135208.068265:0:18894:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fe958000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3286:x1869752384478464:12345-0@lo:13:osp-pre-0-0.0 Request processed in 111us (469us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135208.068274:0:18894:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1783135208.068455:0:3286:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9f6cbd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1869752384478464:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1783135208.068772:0:18248:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1783135208.233198:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:2.0:1783135208.233340:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:2.0:1783135208.233378:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:2.0:1783135208.233412:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:2.0:1783135208.233459:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:2.0:1783135208.233496:0:18253:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752374039680 00000100:00100000:2.0:1783135208.233508:0:18253:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752374039680 00000100:00100000:2.0:1783135208.233608:0:18253:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 26 00000100:00100000:2.0:1783135208.233622:0:18253:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9f6cbea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c20ee9e6-2328-4d1d-a817-651c3e3a5c78+6:2369:x1869752374039680:12345-192.168.201.41@tcp:400:kworker.0 00000100:00100000:2.0:1783135208.233727:0:18253:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9f6cbea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c20ee9e6-2328-4d1d-a817-651c3e3a5c78+6:2369:x1869752374039680:12345-192.168.201.41@tcp:400:kworker.0 Request processed in 108us (313us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135208.233736:0:18253:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 26 00000100:00080000:2.0:1783135208.233768:0:18248:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1783135208.233781:0:18891:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752374039552 00000100:00100000:2.0:1783135208.233785:0:18891:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752374039552 00000100:00100000:2.0:1783135208.233819:0:18891:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752374039808 00000100:00100000:2.0:1783135208.233823:0:18891:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752374039808 00000100:00100000:2.0:1783135208.233841:0:18891:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752374039936 00000100:00100000:2.0:1783135208.233843:0:18891:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752374039936 00000100:00100000:2.0:1783135208.233863:0:18891:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 13 00000100:00100000:2.0:1783135208.233869:0:18891:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9f6cbf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:be37dafa-e6ef-4275-9c00-a4e42a1df10b+5:2369:x1869752374039552:12345-192.168.201.41@tcp:400:kworker.0 00000100:00100000:2.0:1783135208.233900:0:18891:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9f6cbf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:be37dafa-e6ef-4275-9c00-a4e42a1df10b+5:2369:x1869752374039552:12345-192.168.201.41@tcp:400:kworker.0 Request processed in 31us (717us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135208.233907:0:18891:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 13 00000100:00100000:2.0:1783135208.233921:0:18891:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 14 00000100:00100000:2.0:1783135208.233927:0:18891:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9f6cbe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c20ee9e6-2328-4d1d-a817-651c3e3a5c78+5:2369:x1869752374039808:12345-192.168.201.41@tcp:400:kworker.0 00000100:00100000:2.0:1783135208.233953:0:18891:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9f6cbe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c20ee9e6-2328-4d1d-a817-651c3e3a5c78+5:2369:x1869752374039808:12345-192.168.201.41@tcp:400:kworker.0 Request processed in 26us (677us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135208.233970:0:18891:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 14 00000100:00100000:2.0:1783135208.233985:0:18891:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 15 00000100:00100000:2.0:1783135208.233992:0:18891:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9f6cbdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c20ee9e6-2328-4d1d-a817-651c3e3a5c78+5:2369:x1869752374039936:12345-192.168.201.41@tcp:400:kworker.0 00000100:00100000:2.0:1783135208.234021:0:18891:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9f6cbdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c20ee9e6-2328-4d1d-a817-651c3e3a5c78+5:2369:x1869752374039936:12345-192.168.201.41@tcp:400:kworker.0 Request processed in 29us (562us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135208.234028:0:18891:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 15 00000100:00080000:2.0:1783135208.234049:0:18248:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1783135208.234052:0:18248:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1783135208.234538:0:18247:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752374039424 00000100:00100000:3.0:1783135208.234544:0:18247:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752374039424 00000100:00100000:3.0:1783135208.234606:0:18247:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 121 00000100:00100000:3.0:1783135208.234617:0:18247:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9c8e4ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aff003e6-38dd-4a94-ba97-2d703b4bd555+13:2369:x1869752374039424:12345-192.168.201.41@tcp:400:kworker.0 00000100:00100000:3.0:1783135208.234650:0:18247:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9c8e4ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aff003e6-38dd-4a94-ba97-2d703b4bd555+13:2369:x1869752374039424:12345-192.168.201.41@tcp:400:kworker.0 Request processed in 37us (1272us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135208.234657:0:18247:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 121 00000100:00100000:2.0:1783135208.288073:0:3281:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:2.0:1783135208.288894:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:3.0:1783135208.289013:0:18896:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752374040064 00000100:00100000:3.0:1783135208.289025:0:18896:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752374040064 00000100:00100000:3.0:1783135208.289095:0:18896:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752374040192 00000100:00100000:3.0:1783135208.289098:0:18896:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752374040192 00000100:00100000:3.0:1783135208.289120:0:18896:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 0 00000100:00100000:3.0:1783135208.289132:0:18896:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9f6cbc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:be37dafa-e6ef-4275-9c00-a4e42a1df10b+9:2368:x1869752374040064:12345-192.168.201.41@tcp:4:dd.0 00010000:00010000:3.0:1783135208.289181:0:18896:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e4aa161b/0xd6c4b8f058680715 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135208.289209:0:18896:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000001afe611e/0xd6c4b8f0586806e4 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb7965 expref: 9 pid: 18891 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135208.289221:0:18896:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783135208.289226:0:18896:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783135208.289230:0:18896:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e4aa161b/0xd6c4b8f058680715 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 18896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135208.289450:0:18896:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000001afe611e/0xd6c4b8f0586806e4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb7965 expref: 9 pid: 18891 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783135208.289622:0:18895:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:0.0:1783135208.289632:0:18895:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_003' 00000100:00100000:0.0:1783135208.290432:0:20290:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 1 00000100:00100000:0.0:1783135208.290453:0:20290:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9f6cbca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:be37dafa-e6ef-4275-9c00-a4e42a1df10b+9:2368:x1869752374040192:12345-192.168.201.41@tcp:4:dd.0 00010000:00010000:0.0:1783135208.290486:0:20290:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d6a83bdc/0xd6c4b8f05868071c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x42:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135208.290878:0:18896:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000001afe611e/0xd6c4b8f0586806e4 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb7965 expref: 9 pid: 18891 timeout: 590 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783135208.290900:0:18896:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9fe958700 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_001:lustre-OST0001_UUID:18896:1869752384478592:192.168.201.41@tcp:104: 00010000:00010000:0.0:1783135208.291191:0:20290:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783135208.291198:0:20290:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783135208.291205:0:20290:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d6a83bdc/0xd6c4b8f05868071c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x42:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 20290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135208.291218:0:20290:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000d6a83bdc/0xd6c4b8f05868071c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x42:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 20290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783135208.291617:0:18896:0:(client.c:2701:ptlrpc_set_wait()) set ffff9fe9c339d240 going to sleep for 11 seconds 00000100:00100000:2.0:1783135208.299076:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:2.0:1783135208.299126:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:2.0:1783135208.299203:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:3.0:1783135208.300818:0:18897:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 4 min 3 max 116 00000100:00100000:1.0:1783135208.302022:0:18895:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 4 min 3 max 116 00000100:00100000:2.0:1783135208.303795:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:3.0:1783135208.304018:0:18897:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_004' 00000100:00100000:0.0:1783135208.305748:0:18897:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752374040320 00000100:00100000:0.0:1783135208.305769:0:18897:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752374040320 00000100:00100000:0.0:1783135208.305855:0:18897:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 4 min 3 max 116 00000100:00100000:0.0:1783135208.305866:0:18897:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752374040448 00000100:00100000:0.0:1783135208.305869:0:18897:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752374040448 00000100:00100000:0.0:1783135208.305885:0:18897:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 4 min 3 max 116 00000100:00100000:0.0:1783135208.305890:0:18897:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752374040576 00000100:00100000:0.0:1783135208.305893:0:18897:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752374040576 00000100:00100000:0.0:1783135208.307882:0:18897:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 4 min 3 max 116 00000100:00100000:0.0:1783135208.307904:0:18897:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752374040704 00000100:00100000:0.0:1783135208.307915:0:18897:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752374040704 00000100:00100000:2.0:1783135208.308573:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:2.0:1783135208.308686:0:3279:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:2.0:1783135208.308882:0:18896:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9fe958700 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_001:lustre-OST0001_UUID:18896:1869752384478592:192.168.201.41@tcp:104: 00010000:00010000:2.0:1783135208.308921:0:18896:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000e4aa161b/0xd6c4b8f058680715 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x42:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 18896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783135208.309100:0:18895:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 4 min 3 max 116 00000100:00100000:1.0:1783135208.309179:0:18895:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752374040832 00000100:00100000:1.0:1783135208.309185:0:18895:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752374040832 00000100:00100000:1.0:1783135208.309241:0:18895:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 4 min 3 max 116 00000100:00100000:1.0:1783135208.309249:0:18895:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752374040960 00000100:00100000:1.0:1783135208.309252:0:18895:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752374040960 00000100:00100000:2.0:1783135208.313756:0:3280:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.41@tcp (source: 12345-192.168.201.41@tcp) 00000100:00100000:3.0:1783135208.313969:0:20291:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 2 00000100:00100000:3.0:1783135208.313991:0:20291:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9f6cbc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:be37dafa-e6ef-4275-9c00-a4e42a1df10b+15:2368:x1869752374040320:12345-192.168.201.41@tcp:4:dd.0 00010000:00010000:3.0:1783135208.314234:0:20291:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003fb7a6e9/0xd6c4b8f058680723 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x42:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135208.314261:0:20291:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783135208.314268:0:20291:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783135208.314273:0:20291:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003fb7a6e9/0xd6c4b8f058680723 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x42:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 20291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135208.314311:0:20291:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000003fb7a6e9/0xd6c4b8f058680723 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x42:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 20291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783135208.318742:0:18237:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752374041088 00000100:00100000:0.0:1783135208.318763:0:18237:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752374041088 00010000:00010000:1.0:1783135208.319006:0:18237:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000001afe611e/0xd6c4b8f0586806e4 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x42:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb7965 expref: 16 pid: 18891 timeout: 590 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783135208.319073:0:18237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 14 00000100:00100000:1.0:1783135208.319087:0:18237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9f6cbc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:be37dafa-e6ef-4275-9c00-a4e42a1df10b+16:2369:x1869752374041088:12345-192.168.201.41@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1783135208.319114:0:18237:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783135208.319146:0:18237:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000001afe611e/0xd6c4b8f0586806e4 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x42:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb7965 expref: 16 pid: 18891 timeout: 590 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135208.319164:0:18237:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000001afe611e/0xd6c4b8f0586806e4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x42:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb7965 expref: 16 pid: 18891 timeout: 590 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135208.319196:0:18237:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001afe611e/0xd6c4b8f0586806e4 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x42:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.41@tcp remote: 0x4428da03f5eb7965 expref: 16 pid: 18891 timeout: 590 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135208.319218:0:18237:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783135208.319223:0:18237:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783135208.319701:0:18237:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000e4aa161b/0xd6c4b8f058680715 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x42:0x0].0x0 rrc: 5 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 18896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135208.319712:0:18237:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e4aa161b/0xd6c4b8f058680715 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x42:0x0].0x0 rrc: 5 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 18896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135208.319724:0:18237:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783135208.319727:0:18237:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783135208.319731:0:18237:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000d6a83bdc/0xd6c4b8f05868071c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x42:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 20290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135208.319739:0:18237:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d6a83bdc/0xd6c4b8f05868071c lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x42:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 20290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135208.319745:0:18237:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783135208.319747:0:18237:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783135208.319751:0:18237:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000003fb7a6e9/0xd6c4b8f058680723 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x42:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 20291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135208.319759:0:18237:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003fb7a6e9/0xd6c4b8f058680723 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x42:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 20291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135208.319832:0:20291:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000003fb7a6e9/0xd6c4b8f058680723 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x42:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 20291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135208.319860:0:20291:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003fb7a6e9/0xd6c4b8f058680723 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x42:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 20291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135208.319861:0:18237:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1783135208.319898:0:18896:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000e4aa161b/0xd6c4b8f058680715 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x42:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 18896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135208.319908:0:18896:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e4aa161b/0xd6c4b8f058680715 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x42:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 18896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783135208.321428:0:18237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9f6cbc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:be37dafa-e6ef-4275-9c00-a4e42a1df10b+15:2369:x1869752374041088:12345-192.168.201.41@tcp:103:ldlm_bl.0 Request processed in 2333us (7680us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135208.321442:0:18237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 14 00010000:00010000:2.0:1783135208.325015:0:20290:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000d6a83bdc/0xd6c4b8f05868071c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x42:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 20290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135208.325041:0:20290:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d6a83bdc/0xd6c4b8f05868071c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x42:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 20290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135208.389825:0:18241:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1783135208.422929:0:20291:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x42:0x0] updating lvb size from disk: 0 -> 3145728 00002000:00010000:2.0:1783135208.422939:0:20291:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x42:0x0] updating lvb mtime from disk: 1783135206 -> 1783135208 00002000:00010000:2.0:1783135208.422942:0:20291:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x42:0x0] updating lvb ctime from disk: 1783135206 -> 1783135208 00002000:00010000:2.0:1783135208.422943:0:20291:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x42:0x0] updating lvb blocks from disk: 1 -> 2055 00010000:00010000:2.0:1783135208.422958:0:20291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003fb7a6e9/0xd6c4b8f058680723 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x42:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 20291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135208.422970:0:20291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003fb7a6e9/0xd6c4b8f058680723 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x42:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 20291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135208.422979:0:20291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003fb7a6e9/0xd6c4b8f058680723 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x42:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 20291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135208.422985:0:20291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fea02166e00 already unused, calling callback (ffffffffc1527ce0) 00010000:00010000:2.0:1783135208.422990:0:20291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003fb7a6e9/0xd6c4b8f058680723 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x42:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 20291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135208.422999:0:20291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003fb7a6e9/0xd6c4b8f058680723 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x42:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 20291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135208.423019:0:20291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003fb7a6e9/0xd6c4b8f058680723 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x42:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 20291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135208.423027:0:20291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003fb7a6e9/0xd6c4b8f058680723 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x42:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 20291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783135208.423140:0:20291:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9f6cbc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:be37dafa-e6ef-4275-9c00-a4e42a1df10b+20:2368:x1869752374040320:12345-192.168.201.41@tcp:4:dd.0 Request processed in 109152us (124074us total) trans 12884901894 rc 0/0 00000100:00100000:2.0:1783135208.423154:0:20291:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 2 00000100:00100000:2.0:1783135208.423187:0:20291:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 3 00000100:00100000:2.0:1783135208.423198:0:20291:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9f6cbd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:be37dafa-e6ef-4275-9c00-a4e42a1df10b+19:2368:x1869752374040448:12345-192.168.201.41@tcp:4:dd.0 00010000:00010000:2.0:1783135208.423229:0:20291:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007c6793cf/0xd6c4b8f05868072a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x42:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135208.423478:0:20291:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783135208.423483:0:20291:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783135208.423489:0:20291:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007c6793cf/0xd6c4b8f05868072a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x42:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 20291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135208.423501:0:20291:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007c6793cf/0xd6c4b8f05868072a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x42:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 20291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1783135208.423878:0:7470:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 12884901892 is committed 00000001:00080000:3.0:1783135208.423892:0:7470:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 12884901894 is committed 00000001:00080000:3.0:1783135208.423901:0:7470:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 12884901891 is committed 00000001:00080000:3.0:1783135208.423906:0:7470:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 12884901893 is committed 00002000:00010000:1.0:1783135208.483439:0:18896:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x42:0x0] updating lvb size from disk: 3145728 -> 4194304 00002000:00010000:1.0:1783135208.483449:0:18896:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x42:0x0] updating lvb blocks from disk: 2055 -> 4103 00010000:00010000:1.0:1783135208.483462:0:18896:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e4aa161b/0xd6c4b8f058680715 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x42:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 18896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135208.483474:0:18896:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e4aa161b/0xd6c4b8f058680715 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x42:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 18896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135208.483481:0:18896:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e4aa161b/0xd6c4b8f058680715 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x42:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 18896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135208.483488:0:18896:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fea02167400 already unused, calling callback (ffffffffc1527ce0) 00010000:00010000:1.0:1783135208.483494:0:18896:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e4aa161b/0xd6c4b8f058680715 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x42:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 18896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135208.483501:0:18896:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e4aa161b/0xd6c4b8f058680715 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x42:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 18896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135208.483520:0:18896:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e4aa161b/0xd6c4b8f058680715 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x42:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 18896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135208.483527:0:18896:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e4aa161b/0xd6c4b8f058680715 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x42:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 18896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783135208.483627:0:18896:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9f6cbc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:be37dafa-e6ef-4275-9c00-a4e42a1df10b+19:2368:x1869752374040064:12345-192.168.201.41@tcp:4:dd.0 Request processed in 194493us (195565us total) trans 12884901895 rc 0/0 00000100:00100000:1.0:1783135208.483652:0:18896:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 0 00000100:00100000:1.0:1783135208.483682:0:18896:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 4 00000100:00100000:1.0:1783135208.483693:0:18896:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9f6cbd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:be37dafa-e6ef-4275-9c00-a4e42a1df10b+18:2368:x1869752374040576:12345-192.168.201.41@tcp:4:dd.0 00010000:00010000:1.0:1783135208.483723:0:18896:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001afe611e/0xd6c4b8f058680731 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x42:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135208.483736:0:18896:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783135208.483740:0:18896:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783135208.483746:0:18896:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001afe611e/0xd6c4b8f058680731 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x42:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 18896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135208.483758:0:18896:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001afe611e/0xd6c4b8f058680731 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x42:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 18896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1783135208.486908:0:7470:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 12884901895 is committed 00002000:00010000:1.0:1783135208.548705:0:20291:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x42:0x0] updating lvb size from disk: 4194304 -> 5242880 00002000:00010000:1.0:1783135208.548715:0:20291:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x42:0x0] updating lvb blocks from disk: 4103 -> 8199 00010000:00010000:1.0:1783135208.548730:0:20291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007c6793cf/0xd6c4b8f05868072a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x42:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 20291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135208.548744:0:20291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007c6793cf/0xd6c4b8f05868072a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x42:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 20291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135208.548753:0:20291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007c6793cf/0xd6c4b8f05868072a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x42:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 20291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135208.548761:0:20291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe9c7828e00 already unused, calling callback (ffffffffc1527ce0) 00010000:00010000:1.0:1783135208.548778:0:20291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007c6793cf/0xd6c4b8f05868072a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x42:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 20291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135208.548787:0:20291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007c6793cf/0xd6c4b8f05868072a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x42:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 20291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135208.548806:0:20291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007c6793cf/0xd6c4b8f05868072a lrc: 2/0,0 mode: --/PW res: [0x280000400:0x42:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 20291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135208.548813:0:20291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007c6793cf/0xd6c4b8f05868072a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x42:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 20291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783135208.548905:0:20291:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9f6cbd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:be37dafa-e6ef-4275-9c00-a4e42a1df10b+18:2368:x1869752374040448:12345-192.168.201.41@tcp:4:dd.0 Request processed in 125706us (249774us total) trans 12884901897 rc 0/0 00000100:00100000:1.0:1783135208.548915:0:20291:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 3 00000100:00100000:1.0:1783135208.548944:0:20291:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 5 00000100:00100000:1.0:1783135208.548955:0:20291:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9f6cbdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:be37dafa-e6ef-4275-9c00-a4e42a1df10b+17:2367:x1869752374040704:12345-192.168.201.41@tcp:4:dd.0 00010000:00010000:1.0:1783135208.548984:0:20291:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000757d0a52/0xd6c4b8f058680738 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x42:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135208.548995:0:20291:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783135208.548999:0:20291:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783135208.549005:0:20291:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000757d0a52/0xd6c4b8f058680738 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x42:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 20291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135208.549016:0:20291:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000757d0a52/0xd6c4b8f058680738 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x42:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 20291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135208.549188:0:20290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d6a83bdc/0xd6c4b8f05868071c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x42:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 20290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135208.549197:0:20290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d6a83bdc/0xd6c4b8f05868071c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x42:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 20290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135208.549204:0:20290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d6a83bdc/0xd6c4b8f05868071c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x42:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 20290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135208.549210:0:20290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe9f68ad800 already unused, calling callback (ffffffffc1527ce0) 00010000:00010000:0.0:1783135208.549213:0:20290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d6a83bdc/0xd6c4b8f05868071c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x42:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 20290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135208.549231:0:20290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d6a83bdc/0xd6c4b8f05868071c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x42:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 20290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135208.549243:0:20290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d6a83bdc/0xd6c4b8f05868071c lrc: 2/0,0 mode: --/PW res: [0x280000400:0x42:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 20290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135208.549250:0:20290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d6a83bdc/0xd6c4b8f05868071c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x42:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 20290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783135208.549330:0:20290:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9f6cbca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:be37dafa-e6ef-4275-9c00-a4e42a1df10b+17:2368:x1869752374040192:12345-192.168.201.41@tcp:4:dd.0 Request processed in 258886us (260437us total) trans 12884901896 rc 0/0 00000100:00100000:0.0:1783135208.549338:0:20290:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 1 00000100:00100000:0.0:1783135208.549354:0:20290:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 6 00000100:00100000:0.0:1783135208.549366:0:20290:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9f6cbf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:be37dafa-e6ef-4275-9c00-a4e42a1df10b+16:2367:x1869752374040832:12345-192.168.201.41@tcp:4:dd.0 00010000:00010000:0.0:1783135208.549383:0:20290:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d97e2b8d/0xd6c4b8f05868073f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x42:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135208.549392:0:20290:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783135208.549394:0:20290:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783135208.549399:0:20290:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d97e2b8d/0xd6c4b8f05868073f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x42:0x0].0x0 rrc: 4 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 20290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135208.549407:0:20290:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d97e2b8d/0xd6c4b8f05868073f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x42:0x0].0x0 rrc: 4 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 20290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1783135208.550021:0:7470:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 12884901896 is committed 00000001:00080000:3.0:1783135208.550036:0:7470:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 12884901897 is committed 00000001:00080000:0.0:1783135208.592954:0:7470:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 12884901898 is committed 00002000:00010000:2.0:1783135208.594684:0:18896:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x42:0x0] updating lvb size from disk: 5242880 -> 7340032 00002000:00010000:2.0:1783135208.594693:0:18896:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x42:0x0] updating lvb blocks from disk: 8199 -> 12295 00010000:00010000:2.0:1783135208.594710:0:18896:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001afe611e/0xd6c4b8f058680731 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x42:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 18896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135208.594725:0:18896:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001afe611e/0xd6c4b8f058680731 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x42:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 18896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135208.594734:0:18896:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001afe611e/0xd6c4b8f058680731 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x42:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 18896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135208.594754:0:18896:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe9fe43e200 already unused, calling callback (ffffffffc1527ce0) 00010000:00010000:2.0:1783135208.594759:0:18896:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001afe611e/0xd6c4b8f058680731 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x42:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 18896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135208.594770:0:18896:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001afe611e/0xd6c4b8f058680731 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x42:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 18896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135208.594794:0:18896:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001afe611e/0xd6c4b8f058680731 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x42:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 18896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135208.594801:0:18896:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001afe611e/0xd6c4b8f058680731 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x42:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 18896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783135208.594899:0:18896:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9f6cbd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:be37dafa-e6ef-4275-9c00-a4e42a1df10b+14:2368:x1869752374040576:12345-192.168.201.41@tcp:4:dd.0 Request processed in 111204us (295691us total) trans 12884901898 rc 0/0 00000100:00100000:2.0:1783135208.594909:0:18896:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 4 00000100:00100000:2.0:1783135208.594943:0:18896:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.41@tcp, seq: 7 00000100:00100000:2.0:1783135208.594956:0:18896:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9f6cbf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:be37dafa-e6ef-4275-9c00-a4e42a1df10b+13:2368:x1869752374040960:12345-192.168.201.41@tcp:4:dd.0 00010000:00010000:2.0:1783135208.594989:0:18896:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b06bbad6/0xd6c4b8f058680746 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x42:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135208.595001:0:18896:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783135208.595005:0:18896:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783135208.595012:0:18896:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b06bbad6/0xd6c4b8f058680746 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x42:0x0].0x0 rrc: 4 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 18896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135208.595036:0:18896:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b06bbad6/0xd6c4b8f058680746 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x42:0x0].0x0 rrc: 4 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 18896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1783135208.628056:0:7470:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 12884901900 is committed 00002000:00010000:2.0:1783135208.632723:0:20291:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x42:0x0] updating lvb size from disk: 7340032 -> 7654321 00002000:00010000:2.0:1783135208.632735:0:20291:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x42:0x0] updating lvb blocks from disk: 12295 -> 16391 00010000:00010000:2.0:1783135208.632752:0:20291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000757d0a52/0xd6c4b8f058680738 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x42:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 20291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135208.632765:0:20291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000757d0a52/0xd6c4b8f058680738 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x42:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 20291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135208.632774:0:20291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000757d0a52/0xd6c4b8f058680738 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x42:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 20291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135208.632781:0:20291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe9fe43ea00 already unused, calling callback (ffffffffc1527ce0) 00010000:00010000:2.0:1783135208.632786:0:20291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000757d0a52/0xd6c4b8f058680738 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x42:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 20291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135208.632795:0:20291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000757d0a52/0xd6c4b8f058680738 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x42:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 20291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135208.632820:0:20291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000757d0a52/0xd6c4b8f058680738 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x42:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 20291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135208.632829:0:20291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000757d0a52/0xd6c4b8f058680738 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x42:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 20291 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783135208.633003:0:20291:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9f6cbdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:be37dafa-e6ef-4275-9c00-a4e42a1df10b+11:2367:x1869752374040704:12345-192.168.201.41@tcp:4:dd.0 Request processed in 84046us (329216us total) trans 12884901899 rc 0/0 00000100:00100000:2.0:1783135208.633013:0:20291:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 5 00010000:00010000:1.0:1783135208.633703:0:20290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d97e2b8d/0xd6c4b8f05868073f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x42:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 20290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135208.633714:0:20290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d97e2b8d/0xd6c4b8f05868073f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x42:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 20290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135208.633721:0:20290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d97e2b8d/0xd6c4b8f05868073f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x42:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 20290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135208.633727:0:20290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe9f68aca00 already unused, calling callback (ffffffffc1527ce0) 00010000:00010000:1.0:1783135208.633731:0:20290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d97e2b8d/0xd6c4b8f05868073f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x42:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 20290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135208.633739:0:20290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d97e2b8d/0xd6c4b8f05868073f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x42:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 20290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135208.633750:0:20290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d97e2b8d/0xd6c4b8f05868073f lrc: 2/0,0 mode: --/PW res: [0x280000400:0x42:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 20290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135208.633757:0:20290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d97e2b8d/0xd6c4b8f05868073f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x42:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 20290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783135208.633795:0:20290:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9f6cbf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:be37dafa-e6ef-4275-9c00-a4e42a1df10b+9:2367:x1869752374040832:12345-192.168.201.41@tcp:4:dd.0 Request processed in 84434us (325230us total) trans 12884901900 rc 0/0 00000100:00100000:1.0:1783135208.633802:0:20290:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 6 00000001:00080000:3.0:1783135208.658901:0:7470:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 12884901901 is committed 00010000:00010000:2.0:1783135208.659194:0:18896:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b06bbad6/0xd6c4b8f058680746 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x42:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 18896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135208.659210:0:18896:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b06bbad6/0xd6c4b8f058680746 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x42:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 18896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135208.659219:0:18896:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b06bbad6/0xd6c4b8f058680746 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x42:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 18896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135208.659227:0:18896:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fe9c7828200 already unused, calling callback (ffffffffc1527ce0) 00010000:00010000:2.0:1783135208.659231:0:18896:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b06bbad6/0xd6c4b8f058680746 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x42:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 18896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135208.659240:0:18896:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b06bbad6/0xd6c4b8f058680746 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x42:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 18896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135208.659258:0:18896:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b06bbad6/0xd6c4b8f058680746 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x42:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 18896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135208.659265:0:18896:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b06bbad6/0xd6c4b8f058680746 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x42:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 18896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783135208.659400:0:18896:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9f6cbf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:be37dafa-e6ef-4275-9c00-a4e42a1df10b+5:2368:x1869752374040960:12345-192.168.201.41@tcp:4:dd.0 Request processed in 64445us (350710us total) trans 12884901901 rc 0/0 00000100:00100000:2.0:1783135208.659412:0:18896:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.41@tcp, seq: 7 00010000:00010000:3.0:1783135209.414024:0:18240:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1783135210.388234:0:20329:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-pcc test_1d: @@@@@@ FAIL: expected /mnt/pcc.d1d.sanity-pcc/d1d.sanity-pcc/13a3/0x2000013a1:0x2:0x0 size: 7654321 got: 0 00010000:00010000:3.0:1783135210.441980:0:18241:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783135211.459590:0:18240:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783135211.655894:0:3289:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1783135211.655916:0:3289:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9fe95b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1869752384478720:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1783135211.656159:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135211.656334:0:18894:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384478720 00000100:00100000:0.0:1783135211.656343:0:18894:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384478720 00000100:00100000:0.0:1783135211.656402:0:18894:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1783135211.656416:0:18894:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fe959880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3289:x1869752384478720:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1783135211.656465:0:18894:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 3407872 granted 71499776 pending 0 free 3851419648 avail 3849322496 00000100:00100000:0.0:1783135211.656530:0:18894:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fe959880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3289:x1869752384478720:12345-0@lo:13:osp-pre-1-0.0 Request processed in 109us (534us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135211.656544:0:18894:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00080000:3.0:1783135211.656720:0:18248:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1783135211.656751:0:3289:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 12884901893 gen 2 00000004:00080000:3.0:1783135211.656756:0:3289:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9fe9f6fe6680, transno 12884901891 00000004:00080000:3.0:1783135211.656774:0:3289:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 12884901893 committed transno 12884901893 00000100:00100000:3.0:1783135211.656804:0:3289:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9fe95b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3289:1869752384478720:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1783135211.660365:0:3289:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9f6cbfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:06a7653e-5f5a-4acc-ba93-0eff19f145f0:3289:1869752384478848:0@lo:400:kworker.0 00000100:00100000:2.0:1783135211.660433:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135211.660624:0:18245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384478848 00000100:00100000:3.0:1783135211.660633:0:18245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384478848 00000100:00100000:3.0:1783135211.660690:0:18245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:3.0:1783135211.660700:0:18245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9c8e48450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:06a7653e-5f5a-4acc-ba93-0eff19f145f0+19:3289:x1869752384478848:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783135211.660758:0:18245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9c8e48450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:06a7653e-5f5a-4acc-ba93-0eff19f145f0+19:3289:x1869752384478848:12345-0@lo:400:kworker.0 Request processed in 59us (324us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135211.660767:0:18245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:3.0:1783135211.661416:0:3286:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9fe95b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1869752384478976:0@lo:400:kworker.0 00000100:00100000:3.0:1783135211.661452:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135211.661499:0:3286:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1783135211.661506:0:3286:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9fe958a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3286:1869752384479104:0@lo:400:kworker.0 00000100:00100000:3.0:1783135211.661552:0:3286:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135211.661741:0:3289:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9fe959f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3289:1869752384479360:0@lo:400:kworker.0 00000100:00100000:2.0:1783135211.661770:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135211.661801:0:3289:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9f6cbfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:06a7653e-5f5a-4acc-ba93-0eff19f145f0:3289:1869752384478848:0@lo:400:kworker.0 00000100:00100000:2.0:1783135211.661881:0:3289:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1783135211.661887:0:3289:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9fe9fe959500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3289:1869752384479232:0@lo:400:kworker.0 00000100:00100000:2.0:1783135211.661910:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135211.661937:0:18891:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384478976 00000100:00100000:2.0:1783135211.661941:0:18891:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384478976 00000100:00100000:2.0:1783135211.662235:0:18891:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1783135211.662247:0:18891:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fe95a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3286:x1869752384478976:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783135211.662317:0:18891:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fe95a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3286:x1869752384478976:12345-0@lo:400:kworker.0 Request processed in 72us (864us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135211.662324:0:18891:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1783135211.662350:0:18252:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384479104 00000100:00100000:2.0:1783135211.662354:0:18252:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384479104 00000100:00100000:2.0:1783135211.662377:0:18252:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384479360 00000100:00100000:2.0:1783135211.662380:0:18252:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384479360 00000100:00100000:2.0:1783135211.662394:0:18252:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752384479232 00000100:00100000:2.0:1783135211.662396:0:18252:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752384479232 00000100:00100000:2.0:1783135211.662409:0:18252:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1783135211.662426:0:18252:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9fe958e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3286:x1869752384479104:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783135211.662458:0:18252:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9fe958e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3286:x1869752384479104:12345-0@lo:400:kworker.0 Request processed in 32us (905us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135211.662464:0:18252:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1783135211.662476:0:18252:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1783135211.662481:0:18252:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9f6cbe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3289:x1869752384479360:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783135211.662511:0:18252:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9f6cbe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3289:x1869752384479360:12345-0@lo:400:kworker.0 Request processed in 29us (740us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135211.662527:0:18252:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1783135211.663243:0:18252:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1783135211.663252:0:18252:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fe9f6cbfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3289:x1869752384479232:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1783135211.663336:0:18248:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1783135211.663341:0:18248:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1783135211.664302:0:18252:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fe9f6cbfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3289:x1869752384479232:12345-0@lo:400:kworker.0 Request processed in 1048us (2387us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135211.664312:0:18252:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1783135211.664365:0:3289:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9fe959500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3289:1869752384479232:0@lo:400:kworker.0 00000100:00100000:2.0:1783135211.664378:0:3289:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9fe959f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3289:1869752384479360:0@lo:400:kworker.0 00000100:00100000:2.0:1783135211.664414:0:3286:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9fe958a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3286:1869752384479104:0@lo:400:kworker.0 00000100:00100000:2.0:1783135211.664425:0:3286:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff9fe9fe95b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3286:1869752384478976:0@lo:400:kworker.0 Debug log: 39568 lines, 39568 kept, 0 dropped, 0 bad.